Lead Data Engineer

Job Summary

We are looking for an experienced Lead Data Engineer with deep expertise in Databricks Lakehouse architecture and GenAI-enabled analytics. The ideal candidate will lead the design and implementation of scalable data platforms across Bronze, Silver, and Gold (Infomart) layers, enable NL2SQL for business users, and drive performance, cost optimization, and engineering best practices across large-scale data ecosystems. This role demands strong technical leadership, hands-on development skills, and close collaboration with stakeholders to deliver analytics-ready enterprise solutio

Key Responsibilities

Lakehouse Architecture & Engineering Design and implement enterprise-grade Databricks Lakehouse solutions across Bronze, Silver, and Gold/Infomart layers

Build scalable ingestion and transformation pipelines using Spark SQL, PySpark, and Delta Lake

Develop dimensional models (Star Schema) and curated datasets for BI and advanced analytics GenAI & Databricks Enablement

Enable NL2SQL capabilities using Databricks IQ / Genie for business self-service analytics Leverage Databricks Assistant to accelerate pipeline development, optimization, and refactoring

Design semantic layers and metrics frameworks to standardize enterprise analytics Performance & Cost Optimization

Optimize Databricks SQL Warehouses for performance and cost efficiency Apply advanced techniques such as partitioning, Z-Ordering, and query tuning Implement workload optimization and governance strategies Leadership & Collaboration

Own technical architecture and enforce scalable engineering standards Mentor data engineers, conduct code reviews, and guide best practices

Collaborate with product owners, analysts, and business stakeholders to translate requirements into robust data solutions

Build reusable data engineering frameworks to improve team productivity

Required Skills & Qualifications- Technical Skills

Strong expertise in Databricks, Spark SQL, PySpark, and Delta Lake

Hands-on experience with Databricks Workflows and Jobs

Advanced SQL and strong Python skills

Experience deploying Databricks on AWS, Azure, or GCP

Solid understanding of data modeling, semantic views, and metrics frameworks Soft Skills Strong problem-solving and analytical thinking

Excellent communication and stakeholder management skills

Proven experience in technical leadership

Preferred Qualifications Experience enabling GenAI-driven analytics or NL2SQL platforms Exposure to regulated domains such as Finance, Healthcare, or Compliance

Experience designing enterprise data governance and quality frameworks

Why Join Us?

Work on large-scale, high-impact data platforms

Lead GenAI-driven analytics initiatives

Opportunity to influence architecture decisions and engineering culture Collaborate with highly skilled data and a

Pay: ₹500,000.00 - ₹950,000.00 per year

Benefits:

• Health insurance
• Paid sick time
• Provident Fund

Work Location: In person