Lead Data Engineer

Job Summary We are looking for an experienced Lead Data Engineer with deep expertise in Databricks Lakehouse architecture and GenAI-enabled analytics. The ideal candidate will lead the design and implementation of scalable data platforms across Bronze, Silver, and Gold (Infomart) layers, enable NL2SQL for business users, and drive performance, cost optimization, and engineering best practices across large-scale data ecosystems. This role demands strong technical leadership, hands-on development skills, and close collaboration with stakeholders to deliver analytics-ready enterprise solutio Key Responsibilities Lakehouse Architecture & Engineering Design and implement enterprise-grade Databricks Lakehouse solutions across Bronze, Silver, and Gold/Infomart layers Build scalable ingestion and transformation pipelines using Spark SQL, PySpark, and Delta Lake Develop dimensional models (Star Schema) and curated datasets for BI and advanced analytics GenAI & Databricks Enablement Enable NL2SQL capabilities using Databricks IQ / Genie for business self-service analytics Leverage Databricks Assistant to accelerate pipeline development, optimization, and refactoring Design semantic layers and metrics frameworks to standardize enterprise analytics Performance & Cost Optimization Optimize Databricks SQL Warehouses for performance and cost efficiency Apply advanced techniques such as partitioning, Z-Ordering, and query tuning Implement workload optimization and governance strategies Leadership & Collaboration Own technical architecture and enforce scalable engineering standards Mentor data engineers, conduct code reviews, and guide best practices Collaborate with product owners, analysts, and business stakeholders to translate requirements into robust data solutions Build reusable data engineering frameworks to improve team productivity Required Skills & Qualifications- Technical Skills Strong expertise in Databricks, Spark SQL, PySpark, and Delta Lake Hands-on experience with Databricks Workflows and Jobs Advanced SQL and strong Python skills Experience deploying Databricks on AWS, Azure, or GCP Solid understanding of data modeling, semantic views, and metrics frameworks Soft Skills Strong problem-solving and analytical thinking Excellent communication and stakeholder management skills Proven experience in technical leadership Preferred Qualifications Experience enabling GenAI-driven analytics or NL2SQL platforms Exposure to regulated domains such as Finance, Healthcare, or Compliance Experience designing enterprise data governance and quality frameworks Why Join Us? Work on large-scale, high-impact data platforms Lead GenAI-driven analytics initiatives Opportunity to influence architecture decisions and engineering culture Collaborate with highly skilled data and a Pay: ₹500,000.00 - ₹950,000.00 per year Benefits: • Health insurance • Paid sick time • Provident Fund Work Location: In person