Consultant Data Engineer - Azure Databricks
Workplace
Consultant Data Engineer DatabricksLocation : Bangalore, Hyderabad, GurgaonExperience : 4 to 8 YearsEmployment Type : Full-timeJob Summary : We are looking for an experienced Consultant Data Engineer Databricks with 4 to 8 years of experience in designing, developing, and optimizing scalable data engineering solutions on Azure and Databricks. The ideal candidate should have strong hands-on experience with PySpark, Azure Data Factory (ADF), Databricks, ETL pipelines, SQL, and cloud-based data platforms.Key Responsibilities : - Design, develop, and maintain scalable ETL/ELT data pipelines using Azure and Databricks.- Develop and optimize data processing solutions using PySpark.- Build and manage data pipelines using Azure Data Factory (ADF).- Work with Databricks for data ingestion, transformation, processing, and optimization.- Write complex and optimized SQL queries for data extraction and transformation.- Implement data integration solutions across multiple data sources.- Perform data cleansing, transformation, validation, and quality checks.- Troubleshoot and optimize data pipelines for performance, reliability, and scalability.- Collaborate with data architects, developers, business teams, and clients to understand requirements.- Participate in technical discussions and contribute to solution design.- Ensure adherence to data engineering best practices, coding standards, and project requirements.- Support deployment, monitoring, and troubleshooting of data engineering solutions across environments.Required Skills : - 48 years of relevant experience in Data Engineering.- Strong hands-on experience with Databricks.- Strong proficiency in PySpark.- Hands-on experience with Azure Data Factory (ADF).- Strong knowledge of ETL/ELT concepts and data pipeline development.- Strong SQL skills.- Good understanding of Microsoft Azure data services.- Experience working with large datasets and distributed data processing.Preferred Qualifications : - Experience with Azure-based data engineering projects.- Knowledge of data lake/data warehouse concepts.- Experience in performance tuning of Spark/Databricks jobs.- Experience working in client-facing consulting environments.Key Skills : Databricks, PySpark, Azure Data Factory, ETL, Azure, SQL, Data Engineering (ref:hirist.tech)
- Role : Lead AI Engineer Core AILocation : Gurugram, Haryana | Work Mode : Hybrid | Experience... ...architectures.- Design AI pipelines covering data preparation, model training, evaluation,... ..., Docker, and cloud platforms (AWS/GCP/Azure).Leadership Expectations : - Proven ability...SuggestedHybrid work
- Job Title : GenAI Engineer / Software Engineering Professional Location : Bangalore/GurgaonRole... ...and deploy GenAI applications using Azure OpenAI, AWS Bedrock and Kiro.- Build enterprise... ...business processes, authorisations and data governance needs.3. Engineer for Scale, Quality...Suggested
- ...support services. We are a global customer experience and technology consulting services provider and a digital transformation partner of choice... ...Analytical Thinking: Exceptional problem-solving skills with a data-driven approach.- Adaptability: Ability to manage competing...Suggested
- ...yearsWe are seeking a Senior AI/ML Engineer to design, develop, and deploy... ..., collaborating with data scientists, platform engineers... ...Bedrock, SageMaker, Lambda, S3) or Azure; Docker, Kubernetes, Terraform... ...MongoDB, Redis, Apache Kafka, Databricks, Jupyter, MLflowQualifications...SuggestedHybrid work
- Description:We are hiring a Senior QA Engineer who can own test automation across data/ETL pipelines, APIs, and web frontends. You will design robust QA strategies, build CI/CD-native test suites, drive performance/load testing, and turn system requirements into executable,...SuggestedContract workShift workNight shift
- Job Description :We are seeking an experienced AWS Cloud DevOps Engineer to support the engineering, deployment, and ongoing operations of... ...are now operating in a multi-cloud environment, familiarity with Azure is a plus.Cloud Recovery & Business Continuity :- Design, implement...
- We are seeking an experienced Backend Developer / Data Engineer to join our team.You will be responsible for developing and maintaining a robust, scalable, and secure software platform for our customers.You will work closely with product managers, designers, and other developers...
- ...We are looking for a Senior Generative AI Engineer with deep hands-on expertise in building,... ...batching)- Collaborate with product managers, data scientists, and engineering teams to... ...deploying models/APIs on cloud platforms (AWS/Azure/GCP) using services like SageMaker,...Hybrid work
Rs 24 - 28 lakhs p.a.
...PM ISTThe mandate :AKS is building a permanent technical core of engineers who own outcomes, not isolated tickets. You will take end-to-end... ...objective is to deliver reliable systems that work with real client data, constraints and acceptance criteria. A typical portfolio may...Permanent employmentFull timeWork at officeLocal areaImmediate startRemote jobWorking Monday to FridayFlexible hoursNight shift- Job Summary : We are looking for experienced AI / GenAI Cloud Consultants and Senior Consultants with strong expertise in AI/ML, Generative... ...RAG and Enterprise Knowledge Architecture.- Strong software engineering skills with proficiency in Python and SQL.- Understanding of...
- Description : AuxoAI is hiring a Senior Applied AI Engineer to design and deploy production-grade AI agents capable of structured reasoning, planning, and decision-making.This role focuses on building intelligent agent systems that combine LLM-based reasoning with classical...Hybrid workWork at office3 days week
- ...production traces for failure patterns, generating targeted fine-tuning data or prompt updates, and validating that fixes hold under... ...speech are the strong default; exceptional MS students or research engineers with a publication track record are welcome to apply. Nice to...Full timeFlexible hours
- ...experience in Advanced Analytics, Data Science or AI. ~2–4 years of... ..., Time Series, NLP, Feature Engineering, Recommendation Systems and... .... Hands-on experience with Azure, AWS or GCP along with Python,... ...to Have Skills Exposure to Databricks, Spark, Hadoop, Hive, Feature...Full time
- ...NTT DATA strives to hire exceptional, innovative and passionate... ...currently seeking a Industry Consulting Snr. Consultant to join our team... ...Application / L2 Production Support Engineer Client: S&P Global –... ...exposure – AWS preferred ; Azure/GCP acceptable. ~ Monitoring...Hybrid workWork at officeRemote jobFlexible hoursShift work
- Role: Head of Fundraising & Partnerships Experience: 5-10 years Salary: Up to Upto 19 LPA Location: New Delhi ____________________________________________________________________ Role Purpose : We are looking for a hands-on, goal-oriented, and high-energy professional...
- ...incorrect, incomplete, ambiguous, or inconsistent answers Provide clear, constructive feedback or corrections to help maintain overall data quality Track recurring error patterns and report them to the project team Ensure Trainer output meets the project's quality...Remote jobHourly pay
- ...Requisition Id: 1736336 Consultant EY is looking for Consultant. T he opportunity As a Consultant you will help the... ...them to moderately complex situations. o Analyze and convert data into a tax product (advisory/compliance) and ensure accuracy...Contract workFlexible hours
- ...world for all. Job Title: Junior Data Engineering Specialist Experience Level: 3 – 5... ...stakeholders, you will build and operate Azure-based data pipelines and databases, contribute... ...operate. Working across assurance, consulting, law, strategy, tax and transactions, EY...
- ...path to becoming your best professional self. The opportunity : Consultant-TMT-TAX-TAX - ITTS - Corporate Tax Advisory - New Delhi TMT :... ...-wide operational excellence. We help them protect their data, brand and reputation. We also enable the pursuit of M&A strategies...Immediate start
- ...Lead Infrastructure Engineers help clients build and evolve systems that client organizations... .... You have extensive experience of Azure cloud and virtualization platforms, infrastructure... ...tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful...Remote jobFlexible hours
- ...Hybrid / Full-time We are looking for a Director of AI-Native Engineering — a senior engineering leader who will shape how AI-native... ...alignment with business goals • Partner with Product, Design, Data, and business stakeholders to shape high-impact solutions and prioritize...Full timeHybrid workWorldwide
- ...research, sales intelligence, and personalized multi-channel outreach to identify the right businesses and decision-makers. You’ll use data, experimentation, and automation to make outbound prospecting more effective and scalable. Your work will directly contribute to qualified...Full timeHybrid workWork at office
- ...Bridge33 is looking for an Analytics Engineer to help build and maintain the datasets that... ...business. You'll work at the center of our data platform modeling raw data from our... ...Experience with dbt and the modern data stack (Databricks, Snowflake, or similar cloud warehouse;...Contract workRemote job
- ...Web Scraping specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows...Hourly payPart timeFreelanceRemote job
- ...agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT: Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most of the code; you guide and evaluate What we look for:...Hourly payPermanent employmentTemporary workPart timeFreelance
- ...initiatives. Identify operational and customer challenges and develop practical, scalable solutions. Analyse business and customer data to identify trends, opportunities, and areas for improvement. Help establish and improve processes as the organisation scales....Full time
- ...This is a remote position. Role Overview We are looking for Data Engineers at Senior and Mid-Level to join our team in building a privacy-preserving data platform where data engineering meets production-grade software engineering. You will work on designing, developing...Full timeRemote job
- .... Role Overview We are looking for a Senior / Principal Data Architect to take technical ownership of a privacy-preserving data... ...for designing scalable data architecture, establishing engineering standards, and driving technical decisions across data ingestion...Full timeRemote job
- ...We are looking for an experienced Cloud & AWS Integration Engineer with strong SRE expertise to build, automate, and operate highly... ...UK business hours as required. Domain exposure: African data management GDPR African GPA/data-protection requirements...Full timeHybrid workRemote job
- ...Collaborate with Thrivent SMEs, data owners, and architecture... ...Proficiency in Python for data engineering or scripting use cases; experience... ...cloud data platforms (AWS, Databricks, Snowflake) for downstream... ...data access patterns.- Prior consulting or IT services delivery experience...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Consultant Data Engineer - Azure Databricks. Be the first to apply!
