Data Engineer

Posted 1 month ago

Posting Date:

12/29/2025

 

POSITION:

Data Engineer

Full-time job, 40 hours per week

Pay/Salary: $135,533.00 year.

 

NUMBER OF  OPENINGS: 1

 

LOCATION:

MAXPEP LLC

1071 Cambridge Square, Suite B

Alpharetta, GA 30009

 

JOB DUTIES:

  • Load data into Spark RDD, perform advanced procedures like text analytics and processing using in memory data Computation capabilities of Spark.
  • Leverage Apache Spark on Google Cloud Dataproc, orchestrating Spark jobs written in scala for high-throughput batch processing of transactional and behavioral data.
  • Build performance-optimize python-based data connectors to ingest external vendors feed directly into GCP storage solutions such as Cloud Storage, triggering downstream Spark jobs.
  • Develop Python scripts using both Data frames/SQL and RDD in Spark for Data Aggregation. Develop spark program using Scala APIs for data processing.
  • Involve in creating Hive tables, loading data and writing Hive queries which will run internally in map reduce.
  • Implement Partitioning, Dynamic Partitions, Buckets in HIVE.
  • Develop the code for Importing and exporting data into HDFS and Hive using Sqoop. Implement POC to migrate map reduce jobs into Spark RDD transformations using Scala/Python.
  • Develop data pipelines to ingest, process, transform, and load data from various sources into GCP storage and analytics services such as BigQuery, Cloud Storage, and Dataflow.
  • Work under supervision.
  • Travel and/or Relocation to various unanticipated client sites throughout USA is required.

EDUCATION:

Master’s  degree in Computer Science/Information Technology/ IS/Engineering (any)/Business Analytics or closely related field with Six (6) months of experience in the job offered or as a Data Engineer or IT Consultant or Analyst or Programmer or Developer or Engineer or closely related field.

 

EXPERIENCE:

  • Experience of Six (6) months working with Python and Scala is required.
  • Travel and/or relocation is required to unanticipated client sites within USA.
  • International travel is not required.
  • The frequency of travel is currently not known as it depends on the client and project requirement that cannot be currently anticipated.
  • Employer provides Information technology services to various clients in USA and hence implementing projects will require such travel.

 

 

 

 

 

 

Apply For This Job

A valid phone number is required.