Senior Data Engineer - Azure Databricks
ABS InfoTech Pvt. Ltd.
Roles & Responsibilities :- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.- Write efficient, high-performance SQL for data transformation and analysis.- Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing, data models, and pipelines.- Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the development lifecycle.- Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production environments with proper change control processes.- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.- Ensure data quality, reliability, and performance across all pipelines and platforms.What we're looking for :- 8+ years of overall experience in Data Engineering or related roles.- Strong hands-on experience with Azure Databricks, PySpark, and Python.- Proficiency in SQL for complex data transformations and performance-optimized queries.- Hands-on experience with Azure Data Factory (ADF) for pipeline orchestration.- Solid understanding of Azure Cloud, data warehousing, and data modeling.- Experience implementing CI/CD using Azure DevOps.- Proven technical leadership experience, including mentoring and code reviews.Notice Period :- Immediate joiners or candidates who can join within 15 days.Note :- The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location. (ref:hirist.tech)
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Azure Databricks in Hyderabad vacancy
- ...part of what’s next in electronics and the world. Job Description This is a full-time, on-site role for a Senior Hardware Verification Engineer using UVM, located at Hyderabad, India The role involves developing and maintaining UVM-based verification...SeniorFull timeWorldwide
- ...It all started when engineer Fred Luddy wrote code that automated a tedious task for his... ...ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the... ...concurrency. We are looking for a seasoned IC5 Senior Staff Engineer with deep expertise in...SeniorFull timeWork at officeRemote jobFlexible hours
- ...private equity firms. Our services are underpinned by a Group-wide commitment to ESG and best-in-class technology including a global data platform and innovative proprietary tools supported by in-house experts. Above all, what makes us different is our people. Operating...SeniorLong term contractFull timeHybrid workLocal areaWorldwideShift work
- ...private equity firms. Our services are underpinned by a Group-wide commitment to ESG and best-in-class technology including a global data platform and innovative proprietary tools supported by in-house experts. Above all, what makes us different is our people. Operating...SeniorLong term contractFull timeHybrid workLocal areaWorldwide
- ...commitment to ESG and best-in-class technology including a global data platform and innovative proprietary tools supported by in-house... ...possibilities. Job Description JOB DESCRIPTION : Senior Accountant Department: Client Services Job Summary To provide...SeniorLong term contractFull timeHybrid workWork at officeLocal areaWorldwide
- ...commitment to ESG and best-in-class technology including a global data platform and innovative proprietary tools supported by in-house... ...and possibilities. Job Description Join our team as a Senior Accountant, Fund Accounting, you will deliver accurate and timely...SeniorFull timeHybrid workWork at officeLocal areaWorldwideFlexible hours
- ...seeking an experienced professional to join our team in the role of Senior Consultant Specialist In this role, you will: Manage IBM MQ... ...based on merit and suitability to the role.” Personal data held by the Bank relating to employment applications will be used...SeniorPermanent employmentFlexible hours
- ...operations that support our global workforce. We are seeking a Senior Payroll Service Delivery Analyst (US) to join our Global Capability... ...requirements. Review payroll transactions, validate employee data, perform reconciliations, and resolve payroll discrepancies to maintain...SeniorHybrid workLocal areaUS shift
- ...cost, and performance. Develop prompt engineering strategies, prompt pipelines, guardrails,... ...backend services, AI-driven applications, data pipelines, and microservices. Collaborate... ...microservices. Experience with AWS, GCP, or Azure and CI/CD and DevOps practices....SeniorFull timeFlexible hours
- ...Senior Marketing Quality Tester As a Senior Marketing Quality Tester, you ensure the quality, accuracy, and consistency of marketing and webshop activities across all vidaXL webshops. You perform complex testing, identify risks, improve testing processes, and support junior...Senior
- ...Job Title: Senior Credentialing Specialist – Healthcare Location: Hyderabad, Telangana Company: Harmony United Medsolutions Pvt. Ltd About us: Harmony United Medsolutions Pvt. Ltd. [HUMS] is a dynamic and innovative company dedicated to revolutionizing the Healthcare...SeniorFull timeMonday to Thursday
- ...of the world’s most innovative financial organizations. As a Senior Product Associate in Cash and Check Product, you contribute to... ...discovery and requirements definition ~ Developing knowledge of data analytics and data literacy About Us JPMorganChase...Senior
- ...of what's possible. As a Lead Software Engineer at JPMorganChase within the Payments Trust... ...infrastructure scalability Influence leaders and senior stakeholders across business, product, and... ...use in engineering workflows, including data sensitivity considerations, secure...
- ...Behind our iconic power brands that touch millions of lives daily – from Dettol and Lysol to Durex and Nurofen – lies a dynamic and vital engine: Reckitt's Global Business Services (GBS). Fuelled by a culture of positive energy and co-creativity - while learning together -...SeniorLocal area
- ...change inspired, Individual self-driven hands-on Team Member. The Senior CRM Salesforce Developer will play a key role in designing,... ...platform, following best practices and industry regulations. Define data models, integrations, workflows, and automation strategies to...Senior
- ...Arcesium is a global financial technology firm that solves complex data-driven challenges faced by some of the world’s most sophisticated... ...communication and presentation skills, will present and persuade senior management ~“Roll up your sleeves” attitude : Self-starter who...SeniorWork at office
- ...service of a trusted partner. Role: As a Senior Quality Analyst - you will play a pivotal... .... You will be an expert within our engineering organization, deeply understanding product... ...criteria, personas, customer journeys, test data, edge cases, non-functional expectations,...SeniorFull timeShift work
- ...With innovative enterprise solutions and data insights, Zinnia simplifies the experience... ...policyholders. WHO YOU ARE: You are a Data Engineer who wants to go deep on platform and... ...tuning components under the guidance of senior engineers. Implement and integrate with...
- ...Senior Specialist, HAI Platforms The Opportunity: Based in Hyderabad, join... ...organization driven by digital technology and data-backed approaches that support a diversified... ...are seeking a Senior Specialist Platform Engineer – BPM Platforms (Appian)to join our HAI Platform...SeniorStart todayHybrid workDay shift
Rs 15 - 20 lakhs p.a.
...(Fixed Ops). This role partners closely with Product Managers, Engineering, Design, and Operations to translate complex business and customer... ...CPQ) and related platforms. Analyze current-state workflows, data models, and configurations to recommend improvements that...SeniorFull timeWeekday workRs 50 lakh p.a.
...product lines, partner closely with Product Management and Engineering leadership, and mentor senior architects and engineers across the organization.... ...standards, patterns, and guardrails across areas such as data ingestion, detection pipelines, APIs, identity management...Full timeWeekday work- ...to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017. Following that, subsequent projects... ...Other Languages English: C2 Proficient Seniority Lead...
- ...Understand and apply good software engineering principles and be able to work collaboratively... ...Cloud Platforms (Azure) Messaging... ...Advanced Seniority Senior...Senior
Rs 17 lakh p.a.
...MongoDB/Redis. • Hands-on experience with REST APIs, Microservices & Serverless Architecture. • Experience with AWS, Azure, or GCP. • Familiarity with Docker, CI/CD, Git & Azure DevOps. • Bachelor's/Master's degree in CS, Engineering, IT, or related field....Full timeHybrid workShift work- ...seekers and Employees. If you are a Oracle ERP/RMC Security – Senior Consultant looking for excitement, challenge and stability in... ...administration (add/modify users, add/remove roles, assign data security context, manage profiles, etc.). ~ Experience operating...SeniorLong term contractContract workHybrid workImmediate start
- ...Responsibilities Design, implement, and manage Azure cloud infrastructure and DevOps practices. Develop and maintain CI/CD pipelines... ...environment. Participate in solution design, code reviews, engineering forums, technical talks, and knowledge-sharing activities....SeniorFull time
- ...communication skills.- Must worked on BIP/OIBI/FBDI reports where BIP is mandatory.Education and Qualifications : - Preferred Bachelor of Engineering degree in Computer Engineering, Master's in Computer Applications, or equivalent from a reputed institute. (ref:hirist.tech)Full time
- ...will be working closely with product and engineering teams based out of the USA, Europe,... ...reviews.- Work closely with architect or senior engineers on the low-level designs.-... ...API based platform development.- AWS, Azure, GCE.- SQL, Data structures.Nice to Have :- Experience...SeniorPermanent employment
- Role Overview :We are seeking a seasoned Senior Developer specializing in Red Hat Directory Server (RHDS) to join our high-performing engineering team. In this role, you will be responsible for architecting, deploying, and maintaining robust identity management solutions that...SeniorHybrid workRemote job
- ...technical, hands-on, and strategic Data Science Leader to spearhead... ...from sourcing, cleaning, and engineering complex, unstructured data to... ...across major cloud platforms (Azure, AWS, GCP, or Snowflake).- Team... ...and strategic roadmaps for senior enterprise stakeholders.Who do...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Azure Databricks. Be the first to apply!
