Lead Data Engineer - Pyspark/Python
Mount Talent Consulting
Role : Lead AI+Data EngineerJob Description :- Owning the design, build, and operation of production-grade data platforms and pipelines across cloud, hybrid, and on-premise environments.- Leading end-to-end data engineering delivery across ingestion, transformation, data modeling, orchestration, serving and productionization for analytics and AI use cases.- Architecting scalable batch, streaming, real-time, and API-driven data solutions that are reliable, maintainable, and fit for business-critical decisioning.- Designing data foundations that are trusted and reusable with strong practices across data quality, governance, cataloging, lineage, and access control.- Leading GenAI-enabled implementations with strong architectural judgment and hands-on credibility across RAG, retrieval design, LLM application patterns, workflow design, evaluation and production deployment.- Writing, reviewing and raising the bar on engineering work in Python, Java, or Scala, with strong depth in distributed data systems and modern data platforms.- Building reusable data engineering assets and implementation patterns that accelerate delivery across client engagements.- Translating ambiguous business problems into scalable data and AI engineering solutions in partnership with senior clients. (ref:hirist.tech)
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Pyspark/Python in Gurgaon vacancy
- ...features, we thrive on making data driven decisions to serve our... ...The Team The Data Platform Engineering team builds the platform that... ...them. About The Role As Lead Engineer, Data Platform, you will... ...production engineering in Python and SQL, including building and...PythonWork at officeImmediate startRemote jobHome office
- ...Google is hiring for the role of Data and AI Engineer! Responsibilities of the Candidate: Interact... ...services. Engage with technical leads, and partners to lead high velocity migration... ...algorithms and software (e.g., Python, Java, Scala, Spark, Hadoop). Experience...Python
- ...integrating SIEM with Palo Alto NGFW, AWS, Azure, GCP, Active Directory, Azure AD, Okta, and other enterprise security platforms.- Knowledge of Python or PowerShell for automation is an added advantage.- Excellent customer-facing communication and consulting skills. (ref:hirist.tech)Python
- Job Description : Lead Engineer, EDT Data & Analytics Cloud EngineeringThe Lead Cloud Platform Engineer supports the operational excellence, security, and reliability of the enterprise data & analytics platform on Azure and Databricks. The role combines platform operations,...Suggested
- ...are building an intelligent, data-intensive B2B SaaS platform that... ..., context-aware insights. Our engineering culture values sleek design... ...data streams coming from backend Python/Node services.- Cross-... ...Competitive Compensation: Industry-leading salary packaged with performance...PythonFull timeRemote job
- ...Overview :As a Senior Backend Engineer, you will be at the heart of our... ...managers, frontend engineers, and data scientists, to translate... ...implement scalable microservices using Python to ensure high availability and... ...between distributed services.- Lead system design discussions and...PythonHybrid workWork at office
- ...Opportunity : We are looking for experienced Big Data Engineers and Databricks professionals who can... ...hands-on experience with Apache Spark, Python, and Databricks, along with practical... ....- Strong expertise in Apache Spark and PySpark.- Practical experience with Azure or AWS...PythonCity centre
- ...Overview:We are seeking a high-caliber AI Engineer to join our Gurgaon-based team to spearhead... ..., you will bridge the gap between complex data engineering and cutting-edge Generative AI... ...-grade NLP and Deep Learning models using Python, with a strong focus on transformer...PythonHybrid work
- Purpose Of The Position : The Senior DevOps Engineer is responsible for designing, building,... ...secure, and resilient AWS infrastructure.- Lead Infrastructure-as-Code implementation using... ...and automation skills with proficiency in Python.- Experience implementing ISO 27001, SOC2,...Python
- ...excellent opportunity to join the InsurTech Data Science Team where we are passionate... ...and business skills to inspire product, engineering, finance, business and strategy, and our... ...AnalysisMandatory : SQL + AB testing+ Tableau+ Python+ Adobe Analytics, stakeholder management+...Python
- ...design, and evolution of a largescale SaaS platform on AWS. Lead distributed systems engineering, set technical standards, conduct critical code reviews,... ...software engineering experience.- Strong expertise in Python with Django framework.- Proficiency in Node.js and React...Python
- About the Role:We are looking for a technically strong Engineering Manager to lead a backend engineering pod of 6 - 9 engineers within a high-growth... ...equivalent.- Strong hands-on expertise in Java (primary) and/or Python.- Experience with distributed systems and microservices...Python
- ...infrastructure costs.What you'll do :1. Design and build scalable Python backend services and APIs for high-volume video-generation... ...quality and cost, and write them up for the team.4. Design caching and data flows (Redis, MySQL, object storage) that remove redundant compute...Python
- Job Description : As a Software Development Engineer II (SDE II), you will design, build, and maintain scalable, high-throughput backend... ...preferred).- Strong backend development experience across C++, Java, or Python.- Hands-on experience working with distributed streaming/...Python
- Job Description :As a Staff Engineer, you will be instrumental in designing... ...your strong foundation in Data Structures, Algorithms, and programming... ...languages such as C++/ Java/ Python to real-world challenges.... ...scalability, and performance.- Lead technical design discussions and...Python
- ...looking for a Technical Manager to lead the Software Development... ...management, design, and other engineering teams to develop scalable solutions... ...languages such as Java, Python, Golang OR Erlang.- Expertise... ...technologies (SQL, NoSQL), real-time data processing, and messaging...Python
- DevOps Engineer Cloud (HFT)Location: Mumbai | Experience: 4+ YearsAbout the Role:Join a leading HFT and algorithmic trading team to build and manage high-performance cloud infrastructure... ..., and Graviton.- Build automation using Python, Bash, and Infrastructure as Code.- Manage...Python
- About the Role:We are looking for a Lead Data Specialist to own and manage the entire data lifecycle... ...trading environment. You will lead data engineering, ETL pipelines, data quality processes,... ...behaviors- Hands-on experience with:1. Python (mandatory)2. SQL and distributed...Python
- ...handling vast amounts of market data, and collaborating with... ...Backtesting and live trading Platform(python) : Work on improving our in-house... ...and Team leadership : Lead and mentor a small team of upto... ...environment. Preferably already being a senior engineer. (ref:hirist.tech)Python
- ...journey? What we are looking for Looking for a motivated Cloud Data Engineer with 5–7 years of experience to design, develop, and maintain... ...with AWS or Azure, along with strong programming skills in Python and SQL, and a solid understanding of ETL/ELT processes, data warehousing...PythonFull time
- ...The Data Engineer designs, builds, and maintains scalable data pipelines and integration solutions that power analytics, reporting, and business... ...using orchestration tools while building efficient SQL and Python/Scala-based transformation processes. Ensure data quality, governance...PythonFull time
- ...invest in every relationship, lead with curiosity, champion diverse... ...~1-2 years of software engineering experience designing, coding,... ...~ Solid coding proficiency in Python or C#, with experience building... ...powered features for intelligent data products. ~ Designs, codes,...Python
- ...Enterprise Architect Senior Manager Data - Gurgaon, India Locations... ...delivers solutions through leading-edge management consulting... ...collaborate, and influence data engineering best practices across BCG, while... .... ~ Data engineering (Python preferred), API/microservice design...PythonWork at officeLocal area
- We are seeking a DevOps Engineer to design and operate a resilient, scalable... ...Operate and optimize data platforms (RDS/Aurora) Lead capacity planning, cost optimization... ...Proficiency in Python, Bash, or Go...Python
- We are looking for an experienced Data Engineer with strong hands-on expertise in Python, Snowflake, SQL, and data engineering technologies. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions supporting enterprise data and...Python
- About this role Introduction to Multi-Asset Strategies & Solutions (MASS)The Multi-Asset Strategies & Solutions (MASS) team is at the core of BlackRock’s portfolio construction, asset allocation, and active management ecosystem. MASS leverages BlackRock’s full spectrum of ...PythonFull time
- Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation...
- ...complexity to help organizations navigate their most defining transformative moments. As a business of Marsh, we work alongside the world’s leading experts across risk, reinsurance and capital, people and investments, and management consulting. Together with Marsh Risk, Guy...Full time
- ...Practice Overview Practice: Data and Analytics (DNA) - Analytics Consulting Location: Gurugram, India At Oliver Wyman DNA, we partner with clients to solve tough strategic business challenges with the power of analytics, technology, and industry expertise. We drive digital...Full time
- ...APIs and integrations Knowledge of ITIL processes (Incident, Change, Problem Management) Exposure to automation tools / scripting (Python, JavaScript, Shell) Experience in telecom / OSS / managed services environment Familiarity with cloud platforms and DevOps...PythonFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Pyspark/Python. Be the first to apply!
