A

Technical Lead Data Engineer

Affine

IN Full–Time

As a Senior Technical Lead - Data Engineering & Cloud, your role will involve leading the design, development, and delivery of scalable data platforms across Azure and Google Cloud. You will be responsible for building modern data pipelines, hybrid cloud solutions, AI/ML frameworks, and mentoring technical teams to ensure the delivery of high-quality data products that support business decisions.

Key Responsibilities:

  • Lead end-to-end data engineering and cloud architecture initiatives
  • Design and manage data pipelines for batch and real-time processing
  • Build reusable data ingestion and data quality frameworks
  • Implement hybrid cloud solutions using Databricks and Snowflake
  • Work closely with business teams to deliver analytics and reporting solutions
  • Ensure data security, governance, and performance best practices
  • Drive automation and CI/CD for data pipelines
  • Guide and mentor engineers and oversee technical delivery
  • Support AI/ML initiatives and advanced analytics platforms

Technical Skills:

  • Cloud Platforms: Azure, Google Cloud Platform
  • Data Tools: Databricks, Azure Data Factory, Synapse, BigQuery
  • Programming: Scala, PySpark (Python), SQL
  • Data Engineering: ETL pipelines, streaming & batch processing
  • DevOps: Azure DevOps, GitHub, CI/CD
  • Databases: Azure SQL, Teradata, Oracle

Preferred Skills:

  • Experience with Snowflake and Delta Lake
  • Exposure to AI/ML platforms and LLM solutions
  • Data modelling and governance experience As a Senior Technical Lead - Data Engineering & Cloud, your role will involve leading the design, development, and delivery of scalable data platforms across Azure and Google Cloud. You will be responsible for building modern data pipelines, hybrid cloud solutions, AI/ML frameworks, and mentoring technical teams to ensure the delivery of high-quality data products that support business decisions.

Key Responsibilities:

  • Lead end-to-end data engineering and cloud architecture initiatives
  • Design and manage data pipelines for batch and real-time processing
  • Build reusable data ingestion and data quality frameworks
  • Implement hybrid cloud solutions using Databricks and Snowflake
  • Work closely with business teams to deliver analytics and reporting solutions
  • Ensure data security, governance, and performance best practices
  • Drive automation and CI/CD for data pipelines
  • Guide and mentor engineers and oversee technical delivery
  • Support AI/ML initiatives and advanced analytics platforms

Technical Skills:

  • Cloud Platforms: Azure, Google Cloud Platform
  • Data Tools: Databricks, Azure Data Factory, Synapse, BigQuery
  • Programming: Scala, PySpark (Python), SQL
  • Data Engineering: ETL pipelines, streaming & batch processing
  • DevOps: Azure DevOps, GitHub, CI/CD
  • Databases: Azure SQL, Teradata, Oracle

Preferred Skills:

  • Experience with Snowflake and Delta Lake
  • Exposure to AI/ML platforms and LLM solutions
  • Data modelling and governance experience

Posted 17 Mar 2026 · Listing from OnJob.io. Create a free profile to apply and see your AI match score.

Related Data & AI jobs

Hand-picked roles that match this listing on skills, category and location — each scored to your profile inside OnJob.

Explore more on OnJob

Create my free profile — free