Data Engineer - Azure Databricks
Damco Solutions
Experience:- 5 to 10 years of experience in Data Engineering.Key Skills Required:- Strong hands-on experience with Databricks + Streaming.- PySpark.- SQL.- Delta Lake.- Unity Catalog.- Databricks Workflows / Jobs orchestration.- Experience with Azure Data Factory (ADF).- Experience building Lakehouse architectures using Bronze, Silver & Gold layers.- Good knowledge of Databricks Lakeflow:1. Declarative Pipelines.2. Lakeflow Connect.3. CDC (Change Data Capture).4. Data quality validations.- Experience with AI/BI and Genie:1. Semantic layers.2. Certified datasets.3. Self-service analytics solutions.- Experience building AI Agents/Copilots using:1. LLMs.2. RAG (Retrieval-Augmented Generation).3. Vector Search.4. Prompt Engineering.- Good understanding of Unity Catalog governance:1. Access controls.2. Data masking.3. Audit logging.4. Lineage.- Experience with CI/CD, Git, Databricks Repos & Asset Bundles.Expected Responsibilities:- Design, develop, and support end-to-end data pipelines in Databricks.- Build and maintain Delta tables under Unity Catalog.- Develop Lakeflow pipelines with incremental processing and CDC.- Enable AI/BI use cases through semantic models and Genie spaces.- Integrate SharePoint and external data sources into the Lakehouse.- Ensure data quality, governance, and operational reliability.- Drive delivery independently and proactively resolve issues. (ref:hirist.tech)
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Azure Databricks in Pune vacancy
- Job Title : Senior Data EngineerLocation : PuneJob Type : Full-TimeAbout TVARIT : TVARIT GmbH specializes in developing... ....Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and...SuggestedFull time
- ...maintain scalable batch and real-time data pipelines.- Build and optimize data solutions using Databricks, PySpark, Delta Lake, and... ...with Data Scientists, ML Engineers, Product teams, and business stakeholders... ...of cloud platforms such as Azure, AWS, or GCP.- Experience with...Suggested
- ...modernize their IT infrastructure and data ecosystems. With a focus on... ...scale.Role Overview:As a Data Engineer based in Pune, you will be... ...ETL/ELT pipelines using Azure Data Factory to facilitate seamless... ...data processing solutions using Databricks and Delta Lake to support...SuggestedHybrid work
- ...days/ weekStart date : ASAPPosition Overview :NTT DATA Americas is seeking a highly skilled Senior Data Engineer to support a Teradata Utilization Analysis engagement... ...deep Teradata DBA expertise with hands-on Databricks engineering capability and applied AI/ML skills. The...Suggested
- ...Role : We are seeking an analytical and highly skilled Data Engineer with a strong background in Databricks and deep domain experience in Manufacturing or Supply... ...Best Practices : Strong grip on CI/CD pipelines (Git, Azure DevOps, GitHub Actions, or Jenkins) and workflow orchestration...Suggested
- ...development, and optimization of scalable, high-performance data pipelines, ensuring reliable data ingestion and... ...Candidate Profile : - 6 to 10 years experience on Data Engineering role working with Databricks and Azure Cloud technologies.- Bachelors degree in computer science...Immediate start
- ...world. Type: Full-time, Remote About the role This is a full-time, dedicated position for a Data Engineer with specialized expertise in Microsoft Fabric and the Azure ecosystem to support a major data architecture modernization for a key client in the Biotech industry...Full timeContract workRemote jobWorldwideUS shiftShift work
- Data Pipeline Development & Operations : - Design, build, and operate scalable and reliable data pipelines on the Databricks platform.- Develop end-to-end data workflows from ingestion through... ...disruption during code transitions.Data Engineering Excellence : - Implement data...
- ...Role:We are seeking a highly capable, hands-on Lead Data Engineer (Manager) with deep expertise in Databricks to lead the design and delivery of scalable data solutions... ...PySpark/SQL)- Experience building data platforms on Azure (ADLS, ADF, Databricks) or similar cloud ecosystems-...
- Key Responsibilities :- Design, develop, and deploy data engineering solutions using Azure Databricks and Azure cloud services.- Build, optimize, and maintain scalable ETL/ELT pipelines using PySpark, SQL, and Azure Data Factory.- Develop and maintain high-performance data...
- Job Title : Databricks on AWS and PySpark EngineerJob SummaryWe're seeking an experienced Databricks on AWS and PySpark Engineer to join our team. The ideal candidate will have a strong background... ...building, and maintaining large-scale data pipelines and architectures using...
- Job Title: Data Engineer Azure DatabricksLocation: Pan India / HybridExperience: 4-10 YearsMandatory Skills: Azure, Azure Databricks & BI Tool (Power BI/Tableau)Job Summary:We are looking for a Data Engineer with strong hands-on experience in Azure data services and Databricks...
- ...technology services firm specializing in data engineering, cloud transformation, and advanced... ...and healthcare sectors.Role Overview:As a Databricks Developer, you will be responsible for designing... ..., and efficient processing within the Azure ecosystem to support critical business...Hybrid work
- Job Title : Azure Data EngineerLocation : Pune, Hyderabad, BangaloreExperience : 7 to 12 years.Skills : Databricks, Spark/ Pyspark/ Python, ETL, ADF/ AirflowNotice Period : Immediate to 45 DaysJob Description :- Expert level skills writing and optimizing complex SQL.- Experience...Immediate start
- Job Title : Azure Data Engineer - PySpark - RemoteJob Description : The engineer will be working within an established Microsoft Fabric data platform... ...Requirements : - PySpark essential- Microsoft Fabric and/or Databricks (hands-on, production use)- Notebook-based development (...Full timeWork at officeRemote jobWorking Monday to Friday
- Job Title : Azure Data EngineerLocation : PuneExperience : 6+ YearsJob Summary :We are seeking... ...a skilled and experienced Azure Data Engineer to design, develop, and optimize scalable... ...should have strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), Azure...
- ...Microsoft Fabric.- Integrate data from multiple enterprise systems... ...AI Agents, and chatbots using Azure AI Services and Azure OpenAI.-... ..., data architects, and engineering teams to deliver end-to-end data... ...Factory, Synapse Analytics, or Databricks.- Familiarity with CI/CD pipelines...
- ...address complex problems.- 8+ years exp on ML/Python (predictive modelling).- Design, implement, test, deploy and maintain innovative data and machine learning solutions to accelerate our business.- Create experiments and prototype implementations of new learning algorithms...
- ...Join us as a Data Engineer at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects... ...other highly valued skills may include: ~ Experience with Databricks. You may be assessed on the key critical skills relevant...Permanent employmentImmediate start
- ...Madison Logic, we turn buyer uncertainty into confident action. Using data-driven insights and strategic expertise, we help marketers align... ...data models and data schemas to align with both business and engineering requirements. Conduct data analysis to contribute to the...Full timeHybrid workLocal areaRemote jobWork from homeHome office
- ...solutions for structural connections, MEP supports and fire protection. We see tremendous opportunities in leveraging data to automate and optimize design and engineering tasks for our customers (value engineering).As a Machine Learning Engineer within the newly created Data &...Temporary work
- ...more at . Position Summary We are looking for experienced Data Engineer to manage in-progress and upcoming data infrastructure projects... ...Experience with most or all the following cloud services: AWS, Azure, Snowflake, Google Strong project management and organizational...Full time
- ...scalable, efficient, automated processes for data analysis, data model development,... ...Contribute to and promote good software engineering practices across the team- Communicate clearly... ...related field- Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity...
- ...across multiple states in India, impacting thousands of lives and driving sustainable growth in the rural economy.Role Overview :As a Data Engineer at Ayekart Fintech, you will play a crucial role in building and maintaining our data infrastructure. You will be responsible for...
- Job Summary :TVH is seeking a Senior Data Engineer to join our global team. The team specializes in building and maintaining data pipelines, consolidating and provisioning data from various sources across our different markets and industries, access management and creation...
- ...responsibilities Roles & Responsibilities: Data Pipeline Development: Design, build, and... ...experience in the area of Data Engineering and Modelling Preferred Skills / Special... ...with advanced analytics using Microsoft Azure, Databricks, and the Power BI Service is a strong...Full time
- ...autonomous spend-to-pay software. Its patented artificial intelligence accurately and efficiently processes information from thousands of data sources so that organizations can better understand enterprise spend at scale to make smarter business decisions. It seamlessly...Full time
Rs 12 lakh p.a.
? Hiring Alert | Data Engineer – Business Intelligence ? ? Location: Pune ? Role: Data Engineer – Business Intelligence ? Experience: 5+ Years ? Salary: 12 to 15 LPA We are looking for an experienced BI Data Engineer with strong expertise in SAP BO,...Full time- Job Summary :We are looking for an experienced Big Data Engineer to design, develop, and maintain scalable data pipelines capable of processing large volumes of structured and unstructured data. The ideal candidate should have strong expertise in distributed computing frameworks...
- About the job : Build the part of the system that actually moves the data.At DDN, we engineer high-performance infrastructure for environments where speed, scale, and reliability are non-negotiable.This role sits at the heart of that mission.We are looking for a Data Plane Engineer...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Azure Databricks. Be the first to apply!
