(Senior) Data Engineer (ML, Big Data)
Luxoft
Provide End to End Development solution to one of the largest investment banking products by scaling up the latest technology stack by adopting the cloud based services under Client Life Cycle Management area
Responsibilities
Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from various sources and storage systems.
Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
Leading the implementation of algorithms and prototypes to transform raw data into useful information.
Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations.
Creating innovative data validation methods and data analysis tools.
Ensuring compliance with data governance and security policies.
Interpreting data trends and patterns to establish operational alerts.
Developing analytical tools, programs, and reporting mechanisms.
Conducting complex data analysis and presenting results effectively.
Preparing data for prescriptive and predictive modeling.
Continuously exploring opportunities to enhance data quality and reliability.
Applying strong programming and problem-solving skills to develop scalable solutions.
Skills
Must have
10+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Scala/Java and Spark for applied large-scale data processing.
Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Experience with RDBMS and OLAP databases like MySQL, Redshift.
Familiarity with Agile methodologies.
Obsession for service observability, instrumentation, monitoring, and alerting.
Knowledge or experience in architectural best practices for building data lakes.
Nice to have
Passion for testing strategy, problem-solving, and continuous learning.
Willingness to acquire new skills and knowledge.
Possess a product/engineering mindset to drive impactful data solutions.
Experience working in distributed environments with global teams.
Other
Languages
English: C2 Proficient
Seniority
Senior
- Senior Data EngineerSenior
- ...Role Overview We are looking for a Data Engineer to support and enhance the CS-AT platform, which processes large-scale machine log data (15–20 years) to enable predictive and proactive maintenance solutions. The role involves building and optimizing data pipelines, log...Senior
- ...We are looking for a Senior Data Engineer - AI & Analytics with strong Data Engineering expertise, analytical thinking, and AI enablement capabilities to build scalable data solutions that power analytics, dashboards, recommendations, and AI-driven use cases. The role...Senior
- Job Details : - Job Title : Senior Data Engineer - Microsoft Fabric- Experience : 8+ Years- Location : Bengaluru- Employment Type : Full-TimeJob Summary : - We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Azure Data Factory (ADF)...SeniorFull time
- ...Job Title: Senior Data Engineer (5+ Years Experience) Location: Bangalore/Hyderabad/Gurgaon/Indore/Raipur Experience: 5+ Years Employment Type: Full-time Job Summary: We are looking for a highly skilled Data Engineer with 5+ years of experience in building...SeniorFull time
- ...Java/Scala. 2. Proficiency in Spark/Flink/Hive/Hadoop/Azure/Databricks for batch and real-time processing. 3. Solid understanding of data pipeline, data warehousing and data modelling. 4. Experience with data visualization tools like QlikSense or PowerBI. 5. Experience...Senior
- ...across the BFSI, healthcare, and retail sectors modernize their data infrastructure. With a focus on delivering scalable, cloud-... ...efficiency and strategic decision-making.Role Overview : As a Senior Data Engineer, you will be at the forefront of designing and maintaining robust...SeniorHybrid work
- Senior Data Engineer - Microsoft FabricExperience : 8+ YearsLocation : BangaloreNP : Immediate - 20 days(Serving)Work Mode : HybridRequired Skills :- Strong hands-on experience in ADF, Azure Synapse, Microsoft Fabric- Expertise in Python and PySpark- Experience in building scalable...SeniorImmediate start
- About the Role:We are looking for a Senior Data Engineer with strong expertise in Databricks, PySpark, SQL, and Delta Lake to build scalable data platforms and modern Lakehouse solutions. The ideal candidate should have experience in Hadoop modernization, ETL/ELT development...Senior
- We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using...SeniorHybrid workFlexible hours
Rs 40 - Rs 45 per hour
...Roles & Responsibility Key Responsibilities: Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data. Enhancing infrastructure for scalability, automation, and data delivery improvements. Developing real-time and batch...Senior- .... The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers... ...the automotive industry. This role goes beyond traditional data engineering and offers the opportunity to shape the enterprise data...Senior
- ...perspectives, turn inputs into actions, and uphold trust through integrity. Skills and Competencies ~6–9 years of experience in data engineering with a strong focus on scalable data platforms ~ Strong proficiency in Python including pandas, SQLAlchemy, and PySpark ~...Senior
- Job Title : Sr. Data Engineer.Work Experience : 4-6 Years (Senior).Work Location : India or Malaysia.Contract Tenure : Permanent after probationary period.Key Responsibilities : - Design, develop, and maintain end-to-end data pipelines using Microsoft Fabric.- Participate in...SeniorPermanent employmentContract work
- ...systems, making critical decisions on less than 10% of available data. We built Orbital to change that. It’s a foundation model built specifically... ...the UK. We’re just getting started The Role As our Data Engineer, you’ll architect and maintain pipelines that make high-frequency...SeniorHybrid work
- Job Purpose and Impact : The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible...Senior
- ...traders of all levels from beginners to institutional-level clients. Let's talk about the cool stuff you do at Axi! As the Senior Data Engineer for the Customer Data Platform, you will play a pivotal role improving Axi’s data capabilities which deliver positive...SeniorLocal area
- ...safe, secure, and seamless for anyone logging in. The Auth0 Data Engineering Team Within Auth0, the Data Engineering team builds... ...sure everyone has access to consistent and reliable data The Senior Data Engineer Opportunity Reporting to the manager of the Data...SeniorFull timeHybrid workLocal areaWorldwide
- ...Req ID: 376331 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you... ...thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....SeniorHybrid workWork at officeRemote jobFlexible hours
- ...excited about transforming messy, fragmented data into a clean, scalable foundation that... ...entire teams can build on? Are you the kind of engineer who sees a dozen bespoke schemas and... ...searching for a hands-on, technically excellent Senior Data Engineer who wants to build the data...SeniorLong term contractFull timeHybrid workRemote jobWorldwide
- ...Job Description: Senior Data Engineer Experience: 6–10 Years Location: Bengaluru Notice Period: Immediate to 30 Days Preferred About the Role We are seeking an experienced Senior Data Engineer to join our growing data engineering team. The ideal candidate will...SeniorContract workImmediate start
- ...Job Introduction Join us in building the next generation of data intelligence capabilities for the automotive industry. This role goes beyond traditional data engineering and offers the opportunity to shape the enterprise data foundation that powers analytical products,...SeniorFull time
- Wed, 05/27/2026 - 00:41 Job Description Summary Responsible for developing, testing and implementing data engineering solutions to generate analytical and reporting solutions. Responsible for analyzing and preparing the data needed for data science based outcomes. Also responsible...SeniorRelocation package
- ...Description:Key Responsibilities:- Design and implement scalable data pipelines using Azure Data Factory and Azure Databricks- Develop... ...:- Bachelor's degree in Computer Science, Engineering, Mathematics, or related field (or equivalent professional experience...SeniorFlexible hours
- ...Communication, Employee Groups and Celebration. Position Overview Purpose & Scope: As part of Ralph Lauren's Data Strategy initiative, we are seeking a Senior Data Engineer to lead the design and delivery of scalable data products that power analytics across commercial,...Senior
- ...of the world’s largest companies. Our Data Services practice sits at the centre of everything... ...Data Factory — where your broader data engineering experience will add immediate value.... ...skills; able to work directly with senior client-facing stakeholders ~ Experience...SeniorImmediate start
- Responsibilities :- Develop, maintain, and optimize data pipelines and workflows and Feature Store to ensure seamless data ingestion... ...data solution.- Design, develop, implement, and architect Data Engineering pipelines, considering performance & scalability including data...Senior
- ...Join us and build an exceptional experience for yourself, and a better working world for all. EY- GDS - Data and Analytics – Senior – Forward Deployed Engineer As part of our EY-GDS AI & Data team, we help our clients solve complex business challenges with the help...SeniorLong term contract
- About Us : Actualize is a trusted global partner in engineering and digital transformation, with 20+ years of domain expertise in the manufacturing... ...intelligent automation to modernize legacy systems and enable data-led innovation. Headquartered in Bangalore, we also operate from...SeniorHybrid workLocal area
- Job Description : Senior Data Scientist & Machine Learning EngineerRole Overview : We are seeking a highly experienced, versatile Senior Data Scientist & Machine Learning Engineer to bridge the gap between advanced data science, full-stack software engineering, and production...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to (Senior) Data Engineer (ML, Big Data). Be the first to apply!
