Data Engineer

We are seeking a Data Engineer to join our team. This role involves building and maintaining data pipelines on AWS and on-premises platforms.

Key responsibilities

• Design and implement data pipelines using AWS services such as S3, Glue, Lambda, and EMR.
• Develop ETL workflows in DBT and Pyspark.
• Set up and manage Airflow DAGs for scheduling and monitoring.
• Integrate and expose APIs using API Gateway for data consumption.
• Perform data modeling and documentation.
• Collaborate with clients and stakeholders to gather requirements and ensure project lifecycle adherence.

Required qualifications

• Bachelor’s degree in Engineering (B.Tech) or equivalent.
• 3-5 years of experience in data engineering.
• Proficiency in SQL and Pyspark.
• Experience with AWS services (S3, Glue, Lambda, EMR).
• Strong communication skills and client-facing experience.
• Experience with Airflow and API development.

Nice to have

• Knowledge of data modeling concepts.
• Experience with Nifi and Cloudera on-premise cloud environments.
• Experience with API REST and SOAP services.