Lead Data Engineer: ADP

  • Georgia
  • Shiftcode Analytics

Title:

Lead Data Engineer Location: Hybrid Remote, 3-days onsite in Alpharetta, GA Duration: 3 months plus Visa: Any Visa(except h1b and CPT) Interview: Phone/Zoom

Must have 10+ years of experience Basic Skills/ Experience: • 8+ years of Data Engineering experience • Work experience with ETL, Data Modeling, and Data Architecture. • Experience with Big Data technologies such as Hadoop/Hive/Spark. • Skilled in writing and optimizing SQL. • Experience operating very large data warehouses or data lakes. • Knowledge in Python scripting, and Pyspark

Preferred Skills Experience: • Experience in designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data • Integrating end-to-end data pipeline to take data from source systems to target data repositories ensures the quality and consistency of data is always maintained.

Knowledge of Engineering and Operational Excellence using standard methodologies. • Comfortable using PySpark APIs to perform advanced data transformations. • Familiarity with implementing classes with Python. • Hands on experience or knowledge of Data Science modeling