Senior Data Engineer - Azure Databricks
ABS InfoTech Pvt. Ltd.
Roles & Responsibilities :- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.- Write efficient, high-performance SQL for data transformation and analysis.- Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing, data models, and pipelines.- Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the development lifecycle.- Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production environments with proper change control processes.- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.- Ensure data quality, reliability, and performance across all pipelines and platforms.What we're looking for :- 8+ years of overall experience in Data Engineering or related roles.- Strong hands-on experience with Azure Databricks, PySpark, and Python.- Proficiency in SQL for complex data transformations and performance-optimized queries.- Hands-on experience with Azure Data Factory (ADF) for pipeline orchestration.- Solid understanding of Azure Cloud, data warehousing, and data modeling.- Experience implementing CI/CD using Azure DevOps.- Proven technical leadership experience, including mentoring and code reviews.Notice Period :- Immediate joiners or candidates who can join within 15 days.Note :- The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location. (ref:hirist.tech)
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Azure Databricks in Hyderabad vacancy
- ...spirit, and continually building mutual trust. Job Title: Senior Specialist - Accounting Business Group/Department:... ...flexibility is needed during the month end close/deadline. Sensitive data access: Yes Education & Qualifications (Required and...SeniorWork at officeLocal areaShift work
- ...client meetings • Maintains accurate and up-to-date recruitment records in the applicant tracking system (ATS), including inputting data from offline recruitment process when necessary • Manages and processes all incoming applications, ensuring accurate entry into the applicant...SeniorFull timeLocal area
- ...Senior Specialist Technical Support – Product Data Platform The Opportunity Join a global biopharma company with a 130-year legacy and mission to achieve new milestones in healthcare. Be part of technology driven, data-led organization supporting a diversified...SeniorFull timeStart todayHybrid workWork at officeRemote jobDay shift
- ...to make the world cleaner, healthier, and safer. Team As Senior Project Manager / Senior Product Owner, you will be a key individual... ...software, systems, electronics, mechanical, and hardware engineering teams. Translating business, customer, and product needs into...SeniorRemote jobFull timeHybrid workWork at officeLocal areaDay shift
- JOB DESCRIPTION Work Schedule Standard (Mon-Fri) Environmental Conditions Office Job Description As part of the Thermo Fisher Scientific team, you’ll discover meaningful work that makes a positive impact on a global scale. Join our colleagues in bringing...SeniorRemote jobFull timeWork at officeWorking Monday to Friday
- ...your ideas matter. From leveraging insights and analysis to make data-driven decisions - to spearheading sustainable business practices... ...right thing. About the role As a Regional Tax Compliance Senior Analyst – Direct Tax, you will report to the Area Tax Compliance...SeniorLocal area
- Role : Application Developer - Azure Cloud Full StackLocation : Bangalore / Hyderabad / Kolkata (India)Client : IBM India Private LimitedBusiness... ...seeking an experienced Azure Cloud Full Stack Developer / Cloud Engineer with strong expertise in Azure cloud technologies, application...Full timeWork at officeImmediate startShift workDay shiftAfternoon shift
- AWS Data EngineerLocation: Bangalore / Pune / Hyderabad / Bhubaneswar / Chennai / CoimbatoreExperience: 6+ YearsWork Mode: HybridNotice... ...preferredAbout the Role:We are looking for experienced AWS Data Engineers to design, develop and maintain scalable data engineering solutions...Immediate start
- ...capabilities, a good understanding of software engineering best practices, and practical exposure to... ...requirements, API specifications, data schemas, and acceptance criteria.- Practical... ...- Experience with cloud platforms such as Azure, AWS, or GCP.- Experience with Docker, containerized...Contract work
- Job Summary :Senior back-end-leaning full-stack engineers focus on core platform services, APIs, and security-critical logic for Project Vulcan. These engineers work primarily with Python and Go, contributing to scalable, secure services and integrations deployed in containerized...
- Experience : 7+ YearsDegree : Not MandatoryJob Description :We are looking for an experienced Site Reliability Engineer (SRE) - Migration with strong hands-on experience in cloud migration and infrastructure transformation. The role involves executing end-to-end migration activities...
- GCP Data Engineer 5+ YearsLocation: Bangalore / Pune / Hyderabad / Bhubaneswar / Chennai / CoimbatoreExperience: 5+ YearsWork Mode: HybridNotice Period: Immediate Joiners to 30 Days preferredAbout the Role:We are looking for experienced GCP Data Engineers to build and maintain...Hybrid workImmediate start
- Oracle BRM Data Migration EngineerExp Level : 5+ yearsInterview Mode - 2 rounds VirtualWork Location : Hyderabad, Bangalore, Noida, Pune Salary No bar for right resourcesQualifications and Skills :- Proven expertise in Oracle BRM (Mandatory skill) with a strong understanding...
- About the Role :We are looking for a GenAI Engineer with 2+ years of relevant experience to join the technology team of a leading organisation... ...and platforms.- Work with cloud platforms such as AWS, GCP or Azure for deploying and scaling AI solutions.Required Skills:- 2+ years...
- ...innovative and highly skilled AI Engineer to design, develop, and deploy... ...applications that elevate our Data Science and Business... ...LLM API integration (OpenAI, Azure OpenAI, Anthropic).- Experience... ...with Azure Machine Learning, Databricks, MLflow, and vector databases...Work at office
- Role Summary : The Applied Engineer will work on building and scaling GenAI-driven conversational applications, with a strong focus on backend... .... This role requires hands-on expertise in Python, .NET, and Azure, and the ability to translate GenAI concepts into reliable, production...
- Job Title : AI Engineer ArchitectExperience : 10+ YearsLocation : Hyderabad... ...platforms, MLOps, and modern data engineering practices. This... ...AI solutions leveraging Azure OpenAI, OpenAI APIs, and other... ...Search- Azure Data Factory- Azure Databricks- Azure Synapse Analytics- Azure...Full time
- Role Overview:As a Data Scientist in our Applied ML team, you will sit at the intersection of financial innovation and advanced predictive... .... You will collaborate closely with product managers, software engineers, and business stakeholders to translate ambiguous financial data...Hybrid work
- Senior Data EngineerSnowflake - dbt - Matillion Data Productivity CloudLocations : Hyderabad /... ...highly skilled and experienced Senior Data Engineer to join our growing data team. In this... ...data from APIs, flat files, cloud storage (Azure Data Lake, AWS S3), and databases into...SeniorHybrid workWork at officeImmediate start
- Role : Senior QA Engineer (Automation)Location : Rai Durg, HyderabadWork mode : 5 Days WFO (Work from... ...test scenarios to validate endpoints, data accuracy, and performance.- Performance... ...working with cloud platforms such as AWS or Azure.- Familiarity with CI/CD pipelines and...SeniorWork at officeImmediate startWorldwide
- ...correction, security hardening, and compliance enforcement across AWS, Azure, VMware, and REST-integrated environments. Combine Ansible with... ...in enterprise environments.- Must have expert-level Ansible engineering, including advanced Jinja2 templating, dynamic inventory, custom...Full time
- Data ScientistExperience : 8+ YearsLocation : HyderabadWork Mode : Hybrid 4 Days Work From OfficeNotice Period : Immediate to 15 DaysAbout... ...translating complex data insights into actionable business and engineering decisions.Key Responsibilities : - Define and build the metrics...Hybrid workImmediate start
- Position: Azure Databricks Developer (Pyspark, Databricks)Overall/Total Experience: 8-15 years onlyLocation... ..., and deliver scalable end-to-end data pipelines using Azure Data Factory,... ...diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.-...Immediate start
- ...Automation TestingJob Summary:The Senior SailPoint IdentityIQ (IIQ)... ...tester will work closely with IAM engineers, developers, DevOps, and... ...including:- Active Directory / Azure AD- HR systems- Databases (JDBC... ...enterprise applications- Ensure data integrity and compliance with...SeniorFull time
- Application Developer Azure Cloud Full StackAzure Cloud Full Stack Developer Banking / Financial ServicesJob Location : Bangalore / Hyderabad... ...for an experienced Azure Cloud Full Stack Developer / Cloud Engineer with strong expertise in Microsoft Azure, TypeScript, Python, Terraform...Work at officeImmediate startShift workAfternoon shift
- ...requirements into scalable solutions across reporting, ETL-like pipelines, data transformation, and automation.This role is not a people-... ...solution patterns, tooling, and documentation.Reporting & Data Engineering :- Build and maintain complex PostgreSQL-based reporting...US shiftAfternoon shift
- Your Role :- Experience with Natural Language Processing (NLP).- Understanding of RAG, neural networks, and other AI/ML concepts.- Experience with AI/ML frameworks like TensorFlow, PyTorch, etc.- Experience with AI and Machine Learning algorithms.Your Profile :- 5 to 14 yrs ...Hybrid workFlexible hours
- Your Role :- 4+ years experience in development of reports in AxiomSL Controllers View 10- Good understanding on Data Sources, Data Models, Shorthand , Portfolios, Aggregations, Free Form ,- Tabular Reports and Workflow using AXIOM Controller view tool based on regulatory report...
- Job Description :- Expert knowledge in AWS Data Lake implementation and support (S3, Glue, DMS, Athena, Lambda, API Gateway, Redshift).- Handling of data related activities such as data parsing, cleansing, quality definition, data pipelines, storage, and ETL scripts.- Experiences...
- ...digital growth for its international clientele.Role Overview:As a Senior Salesforce B2B Developer, you will serve as a technical lead... ...third-party ERP, CRM, or payment gateway systems to ensure seamless data flow.- Optimize existing Salesforce environments by refactoring code...SeniorHybrid work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Azure Databricks. Be the first to apply!
