Lead Data Engineer SQL AWS
talent worx
Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.
You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.
As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.
Develop, deploy, and operate data extraction and automation pipelines in production.
Integrate and deploy machine learning models into pipelines (e.g., Lead the delivery of complex extraction, transformation, and ML deployment projects.
Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
Strengthen data quality and reliability through logging, metrics, and automated alerts.
Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.
2-6 years of relevant experience in data engineering, automation, or ML deployment.
- Expert proficiency in Python, including building extraction libraries and RESTful APIs.
- Hands-on experience with task queues and orchestration: Strong AWS expertise: Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
- Proven experience deploying ML models to production.
- Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
- Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)
- Description :JD and required Skills & Responsibilities :The Lead Engineer in the FOE POD is a senior technical leader responsible for architecting... ...blends deep MarTech orchestration expertise with modern big data engineering, cloud-native design, and emerging AI driven development...Suggested
- ...Practice Overview Practice: Data and Analytics (DNA) - Analytics Consulting Location: Gurugram, India At Oliver Wyman DNA... ...And Responsibilities We have open positions ranging from Data Engineer to Lead Data Engineer, providing talented and motivated professionals...SuggestedFull timeHybrid workWork at officeLocal areaRemote jobFlexible hours3 days week
Oliver Wyman
Gurgaon1 day ago - ...Lead Data Engineer This role is responsible for designing, building, and maintaining the infrastructure that collects, stores, and processes raw data, transforming it into usable information for analysis by business analysts for the Joint Replacement franchise. This role...SuggestedFull time
- ...Responsibilities Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data... ...Qualifications Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. 8+ years of...Suggested
EXL
Gurgaon6 days ago Rs 2.5 - 9 lakhs p.a.
~ with engineers, product managers, and technical program managers across teams. ~ Understand the trade-offs between consistency, durability... ...enterprise-class experience with large-scale cloud solutions in data science/analytics projects and engineering projects. ~ Expert...SuggestedAvalara Technologies
Delhia month ago- Key Responsibilities : - Lead the design, development, and maintenance of data pipelines and ETL processes for efficient data integration and transformation.-... ...could be used for New proposals as well as for Data Engineering pipelines, refreshes, automations and integrations.-...
- Job Description : 1. Profile : Designation : Lead Data and Analytics EngineerLocation : Head Office, New DelhiReports to Head : DCoEQualification... ...the enterprise data and analytics ecosystem covering : - Data Engineering & Data Platforms (lake/lakehouse/warehouse)- Business...Work at office
Rs 12 - 20.5 lakhs p.a.
• Lead the design and development of scalable data infrastructure with a focus on data warehousing solutions. • Architect and optimize data warehouse systems... ...processing and analytics. • Manage and mentor data engineering teams while ensuring best practices in data...Global Business Ser 4u
Delhia month ago- ...Tech Lead – Decommissioning Services The Tech Lead will own the technical and functional governance of the Solix-based data archival platform, while also bringing deep expertise in the Azure... ...Azure Data Platform & Engineering Design and oversee data archival...Full timeLocal area
Rs 5 - 9.5 lakhs p.a.
...Key Responsibilities Design and develop scalable data architecture and infrastructure Lead the implementation of data warehousing solutions Manage... ...reliable, and high-performing Lead and mentor data engineering teams Oversee data integration, transformation, and...Global Business Ser 4u
Delhi28 days ago- Responsibilities : - Own end-to-end data architecture across ingestion, transformation, storage... ...and guide a small team of 2 to 3 data engineers, setting standards and driving execution-... ...roles- At least 2 years of experience leading or mentoring engineers- Strong hands-on expertise...
- ...Position: Team Lead – Data Engineering We are looking for an experienced Team Lead / Architect – Data Engineer to design, architect, and lead scalable cloud-based data platforms. Key Responsibilities: Design and architect scalable, high-performance data solutions...Full time
- Role Overview :We are looking for a Lead Data Engineer with strong experience in building scalable data platforms and driving data engineering initiatives. In this role, you will work closely with stakeholders to design, develop, and optimize data pipelines and analytics platforms...
- ...Role: Lead Azure Data Engineer Location: Gurugram Experience: 8+ Years Work Model: ODC ( 5 days work from office) Technical Skills Azure Analytics (Databricks, Data Factory) AI/ML (Azure ML, Cognitive Services) Programming (Python/Java/Scala, SQL) DevOps...Work at officeWeekend work
Incedo Inc.
Gurgaon3 days ago - Position : Lead Python Data Engineer Experience : 8+ YearsJob type : Remote, India Job base location : Noida (Delhi, NCR)Role Overview :We are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate...Remote job
- ...Overview We are seeking a senior QA Lead with extensive experience in quality assurance for data platforms and analytics solutions. This role requires expertise... ...data solutions Strong understanding of data engineering and analytics workflows Experience with Agile testing...
Rackspace Technology
Gurgaon3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer SQL AWS. Be the first to apply!
