Senior Data Engineer - Medallion Architecture

We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using Databricks, PySpark, Azure, and Kafka.This role requires strong hands-on engineering expertise along with architecture thinking, production ownership, and customer-facing communication skills.Role : Senior Data EngineerLocation : Bangalore or Pune (Hybrid)Education : BE/BTech OR ME/MTechExperience : 4+ YearsKey Responsibilities :- Modernize legacy and non-scalable data architectures into cloud-native platforms- Design and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake and Databricks- Build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks notebooks- Develop and manage workflows using Databricks Workflows / Jobs- Optimize Spark jobs for performance, scalability, and cost efficiency- Implement data quality, governance, and lineage using DLT Expectations and Unity Catalog- Build real-time and event-driven data pipelines using Kafka or similar streaming technologies- Ensure platform reliability through monitoring, observability, and alerting- Collaborate with global customers and cross-functional engineering teams- Participate in architecture reviews, technical design, and best practice implementationRequired Skills :- 4+ years of experience in Data Engineering / Big Data Engineering- Strong hands-on experience with Databricks ecosystem- Deep expertise in PySpark and distributed data processing- Experience with Delta Lake, DLT, Unity Catalog, and Databricks Workflows- Strong understanding of ETL/ELT pipelines and data modeling- Experience with Azure Data Platform (ADLS, Azure services)- Experience with Kafka or event-streaming platforms- Good understanding of scalable distributed systems and event-driven architecture- Strong problem-solving and analytical skills- Excellent communication and stakeholder management skills- Experience working with global customers in client-facing environmentsGood to Have :- Healthcare / HealthTech domain experience- EHR/EMR migration projects- FHIR, HL7, CDA standards- HIPAA compliance exposure- Experience with Patient 360 or Master Patient Index platforms- AI-assisted development tool exposureWhy Join Us?- Opportunity to work on cutting-edge AI and SaaS platforms- Exposure to global customers across North America, EU, UAE, and Australia- High ownership and fast growth environment- Flexible work culture focused on outcomes- Work alongside accomplished global engineering teams- Opportunity to influence architecture, product, and business outcomes (ref:hirist.tech)