Senior Data Engineer - Azure Databricks
ABS InfoTech Pvt. Ltd.
Roles & Responsibilities :- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.- Write efficient, high-performance SQL for data transformation and analysis.- Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing, data models, and pipelines.- Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the development lifecycle.- Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production environments with proper change control processes.- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.- Ensure data quality, reliability, and performance across all pipelines and platforms.What we're looking for :- 8+ years of overall experience in Data Engineering or related roles.- Strong hands-on experience with Azure Databricks, PySpark, and Python.- Proficiency in SQL for complex data transformations and performance-optimized queries.- Hands-on experience with Azure Data Factory (ADF) for pipeline orchestration.- Solid understanding of Azure Cloud, data warehousing, and data modeling.- Experience implementing CI/CD using Azure DevOps.- Proven technical leadership experience, including mentoring and code reviews.Notice Period :- Immediate joiners or candidates who can join within 15 days.Note :- The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location. (ref:hirist.tech)
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Azure Databricks in Gurgaon vacancy
- Role : Senior Software Engineer III (Backend)Location : Gurugram, Sector 34Work Mode : On-siteExperience : 6 - 8 YearsWe are looking for an experienced Backend Engineer who can take ownership of critical technical challenges and build high-performance, scalable software systems...Senior
- Title : AVP / Senior AVP AI Transformation & Strategic ConsultingExperience : 8 to 14 YearsWork Mode : Hybrid (weekly 2-3 days office)Location... ...financial institutions.Qualifications : - Bachelor's degree in Engineering, Technology, Business, Finance, or a related field.- 8 to 14+...SeniorHybrid workWork at office
- About the Role :We are looking for a DevOps Engineer to build, automate, and scale the... ...Manage and scale cloud infrastructure (AWS/Azure/GCP), including compute, networking, and storage... ...security, compliance, and adherence to fintech data-protection standards.- Automate...Senior
- About the Role : We're looking for a hands-on AI/ML Engineer to build and deploy intelligent AI solutions across our communication platform... ...cloud-native technologies.- Develop and maintain ML pipelines for data processing, training, evaluation, and continuous improvement.-...Suggested
- Data Pipeline Development & Operations :- Design, build, and operate... ...data pipelines on the Databricks platform.- Develop end-to-end... ...during code transitions.Data Engineering Excellence :- Implement data quality... ...Experience with cloud platforms (Azure, AWS, or GCP).- Understanding...Senior
- Job Title : Security Platform Engineering.Location : Delhi/NCR.Level : Manager to AD (We need 10 to 16 years experienced candidate).Experience Requirements :- 10+ Years of Experience: Candidate should have managed transformation projects related to Secrets Management.- 12+...
- Role Overview:As a Data Scientist in our Applied ML team, you will sit at the intersection of financial innovation and advanced predictive... .... You will collaborate closely with product managers, software engineers, and business stakeholders to translate ambiguous financial data...Hybrid work
- ...Description : We are seeking a skilled Senior Python Software Engineer to join our team in Delhi with 8+... ...driving innovation across Product & Data Engineering, focusing on Agentic AI,... ...Responsibilities : - Convert notebook-based and Databricks workflows into modular, reusable, and...SeniorFlexible hours
- Position : AI/ML Engineer (Voice Bot, Agentic AI)Overall/Total Experience : 4 - 7 years onlyLocation : GurugramWorking Days : 5 Days Working... ...-native technologies.- Develop and maintain ML pipelines for data processing, model training, evaluation, and continuous improvement...Work at officeImmediate start
- ...used by millions of investors across India.If you're a hands-on Engineering Manager with experience leading frontend teams while actively contributing... ...to development, we'd love to connect.Role : Engineering Manager/Senior Engineering Manager Frontend (Web & Mobile)Technical...Senior
- ...Opportunity : This is a strategic leadership role responsible for leading engineering teams, driving technical excellence, and delivering highly... ...Hire, coach, and develop Engineering Managers, Tech Leads, and Senior Engineers.Technology & Architecture : - Drive architecture and...Senior
- Position: Azure Databricks Developer (Pyspark, Databricks)Overall/Total Experience: 8-15 years onlyLocation... ..., and deliver scalable end-to-end data pipelines using Azure Data Factory,... ...diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.-...Immediate start
- ...Support various workflows and exception-handling mechanisms.- Design integration layers that are resilient to inconsistent partner data.Engineering leadership : - Make early technology-stack and architecture decisions.- Establish practical engineering standards without...
- ...Design, implement, and maintain end-to-end ML pipelines for model training, evaluation, and deployment.- Collaborate with data scientists and software engineers to operationalize ML models, serving frameworks (TensorFlow Serving, TorchServe) and experience with MLOps tools.-...Hybrid workFlexible hours
- Your Role :- Experience with Natural Language Processing (NLP).- Understanding of RAG, neural networks, and other AI/ML concepts.- Experience with AI/ML frameworks like TensorFlow, PyTorch, etc.- Experience with AI and Machine Learning algorithms.Your Profile :- 5 to 14 yrs ...Hybrid workFlexible hours
- Your Role :- 4+ years experience in development of reports in AxiomSL Controllers View 10- Good understanding on Data Sources, Data Models, Shorthand , Portfolios, Aggregations, Free Form ,- Tabular Reports and Workflow using AXIOM Controller view tool based on regulatory report...
- Role Overview : Seeking a highly skilled Senior SAP Commerce (Hybris) Developer who will be responsible for designing, developing, and maintaining high-performance, scalable, and secure SAP Commerce (Hybris) solutions for our digital commerce platform. You will work closely...SeniorHybrid workWork at office
- Position : Senior Product Manager (Growth, FinTech)Overall/Total Experience : 6-9 years onlyLocation : Gurugram/JaipurWorking Days : 5 Days... ...delivery milestones.- Own product readiness and launch gating : data capture, routing behaviour, UX flows, monitoring.- Write product...Senior
- ...: We are seeking a highly skilled and versatile Machine Learning Engineer (with GenAI expertise) who combines strong software engineering fundamentals... ...OOP principles.- Build and manage end-to-end ML pipelines : data ingestion, preprocessing, model training, evaluation, and...
- ...execution. You will own the technology strategy, architecture, engineering execution and technical evolution of Client's SaaS platform. You... ...production- Establish technology standards around architecture, APIs, data, security, observability, engineering practices and drive AI-...SeniorFull time
- ...services, ensuring seamless connectivity and superior user experiences in a rapidly evolving global market.Role Overview :As a Data Science Engineer, you will be at the forefront of developing intelligent solutions that optimize network performance and enhance customer...Hybrid work
- ...digital growth for its international clientele.Role Overview:As a Senior Salesforce B2B Developer, you will serve as a technical lead... ...third-party ERP, CRM, or payment gateway systems to ensure seamless data flow.- Optimize existing Salesforce environments by refactoring code...SeniorHybrid work
- Senior Backend DeveloperCompanys profile :Founded in late 2014, by the Ex-President of Oberoi... ..., MongoDB, Redis, and Elasticsearch for data management and performance tuning.- Containerize... ...such as AWS Certified DevOps Engineer or Certified Kubernetes Administrator (CKA...SeniorLong term contract
- ...the team functions as a hub for high-end engineering, leveraging cutting-edge technology to drive... ...customer experience.Role Overview :As a Senior AI Engineer, you will lead the design and... ...work within a cross-functional team of data scientists, product managers, and software...SeniorHybrid workWork at office
- Model Validation AI Senior Model ValidatorExperience : 7+ YearsLocation : Delhi / Chennai / BangaloreRole Overview :We are looking for a... ...actionable remediation areas to stakeholders.- Collaborate with AI/ML, Data Science, Model Risk, Technology and Governance teams.- Liaise...Senior
- Senior Python + Generative AI EngineerLocation : Gurgaon / Bangalore... ...work on :Were looking for engineers who have moved beyond AI demos... ...Integrate vector databases and data pipelines- Work with cloud platforms... ...etc.)- Cloud exposure (AWS / Azure / GCP) and containerized...SeniorHybrid work
- About the Role : We are looking for a highly motivated and analytical individual with an engineering background and strong mathematical foundations to join our team as a Data Analyst. The ideal candidate will have experience working with large datasets, deriving insights through...Senior
- ...What you will do: Sr. Principal Engineer responsible for end-to-end embedded platforms (Embedded Software (Mako 5 platform), Embedded OS Lifecycle Management and product security). Operates at the intersection of architecture, development, and security, driving platform...SeniorFull timeShift work
- ...We are seeking a talented Lead/Senior Domino Data Lab Engineer with strong React expertise to join our team. In this role, you will design and build... ...methodologies Knowledge of cloud platforms such as AWS, Azure, or GCP Exposure to Kubernetes and Terraform Familiarity with...Senior
- ...We are seeking an experienced Lead/Senior Domino Data Lab Engineer with strong Python expertise to design, develop, and deploy scalable data science... ...CD workflows Familiarity with cloud platforms such as AWS, Azure, or GCP Background in model deployment, monitoring, and...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Azure Databricks. Be the first to apply!
