(Senior) Data Engineer (ML, Big Data)
Luxoft
Provide End to End Development solution to one of the largest investment banking products by scaling up the latest technology stack by adopting the cloud based services under Client Life Cycle Management area
Responsibilities
Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from various sources and storage systems.
Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
Leading the implementation of algorithms and prototypes to transform raw data into useful information.
Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations.
Creating innovative data validation methods and data analysis tools.
Ensuring compliance with data governance and security policies.
Interpreting data trends and patterns to establish operational alerts.
Developing analytical tools, programs, and reporting mechanisms.
Conducting complex data analysis and presenting results effectively.
Preparing data for prescriptive and predictive modeling.
Continuously exploring opportunities to enhance data quality and reliability.
Applying strong programming and problem-solving skills to develop scalable solutions.
Skills
Must have
10+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Scala/Java and Spark for applied large-scale data processing.
Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Experience with RDBMS and OLAP databases like MySQL, Redshift.
Familiarity with Agile methodologies.
Obsession for service observability, instrumentation, monitoring, and alerting.
Knowledge or experience in architectural best practices for building data lakes.
Nice to have
Passion for testing strategy, problem-solving, and continuous learning.
Willingness to acquire new skills and knowledge.
Possess a product/engineering mindset to drive impactful data solutions.
Experience working in distributed environments with global teams.
Other
Languages
English: C2 Proficient
Seniority
Senior
- The Opportunity:As a Senior Data Engineer, you will design, build and operate scalable data platforms and pipelines for global customers. You will work closely with customers, product teams and engineers to deliver reliable, production-grade data systems. You will play a key...Senior
- About the Role :We are looking for a highly skilled Senior Real-time Data Engineer to design, develop, and scale a high-performance analytics platform capable of processing millions of real-time events daily. The ideal candidate should have strong expertise in Apache Pinot along...Senior
- ...Job Title: Senior Data Engineer (5+ Years Experience) Location: Bangalore/Hyderabad/Gurgaon/Indore/Raipur Experience: 5+ Years Employment Type: Full-time Job Summary: We are looking for a highly skilled Data Engineer with 5+ years of experience in building...SeniorFull time
- ...Key Responsibilities • Build and maintain scalable ETL/ELT pipelines • Develop Python-based automation and data engineering solutions • Work with Azure cloud services and modern data architecture • Integrate APIs from multiple platforms and external systems...SeniorFull time
- ...We are looking for a Senior Data Engineer - AI & Analytics with strong Data Engineering expertise, analytical thinking, and AI enablement capabilities to build scalable data solutions that power analytics, dashboards, recommendations, and AI-driven use cases. The role...Senior
Rs 40 - Rs 45 per hour
...Roles & Responsibility Key Responsibilities: Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data. Enhancing infrastructure for scalability, automation, and data delivery improvements. Developing real-time and batch...Senior- ...We are looking for a highly skilled Senior Data Engineer to join our Data Engineering chapter within the Technology Platform domain. The ideal candidate will have strong expertise in real-time data streaming, modern data platforms, and AI/ML operationalization (AIOps/MLOps...Senior
- We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using...SeniorHybrid workFlexible hours
- Job Title : Sr. Data Engineer.Work Experience : 4-6 Years (Senior).Work Location : India or Malaysia.Contract Tenure : Permanent after probationary period.Key Responsibilities : - Design, develop, and maintain end-to-end data pipelines using Microsoft Fabric.- Participate in...SeniorPermanent employmentContract work
- ...A bout the Role We are looking for a Senior Real-time Data Engineer to lead the architecture and development of our customer-facing analytics engine. Our Sales Engagement Platform processes millions of events daily—from email interactions to live call metadata. Your mission...SeniorFull time
- ...We're Hiring: Sr. Data Engineer | Freelancing & Remote Opportunity Are you a seasoned Data Engineer looking for flexible freelance work with the freedom of remote delivery ? We're hiring a Senior Data Engineer to build and scale modern data platforms. Role:...SeniorRemote jobFreelanceFlexible hours
- ...safe, secure, and seamless for anyone logging in. The Auth0 Data Engineering Team Within Auth0, the Data Engineering team builds... ...sure everyone has access to consistent and reliable data The Senior Data Engineer Opportunity Reporting to the manager of the Data...SeniorFull timeHybrid workLocal areaWorldwide
- ...of the world’s largest companies. Our Data Services practice sits at the centre of everything... ...Data Factory — where your broader data engineering experience will add immediate value.... ...skills; able to work directly with senior client-facing stakeholders ~ Experience...SeniorFull timeImmediate start
- ...we reward performance and impact players with generous equity and incredible career growth opportunities.About the Role : As a Senior Data Engineer on the Data Science team, you'll be embedded with data scientists and ML engineers to build the data infrastructure that powers...SeniorShift workNight shift
- Description :PRIMARY REQUIREMENTS : MUST HAVE :- Data Engineering : Build and maintain data ingestion and transformation. Use Python, SQL, and DBT to deliver scalable, fault-tolerant data flows. Exposure to data warehouse design, Splunk/Dynatrace monitoring, and cloud-native...Senior
- Description :We are looking for a highly skilled Senior Data Engineer / BI Engineer with strong expertise in Snowflake data warehousing, Tableau analytics, and relational databases. The ideal candidate will be responsible for building robust data pipelines, designing analytical...Senior
- ...As a Senior Data Engineer, you'll be at the forefront of our data infrastructure, designing and building scalable data pipelines that transform raw information into valuable business intelligence. You'll lead technical initiatives, make architectural decisions, and collaborate...SeniorFlexible hours
- Responsibilities :- Develop, maintain, and optimize data pipelines and workflows and Feature Store to ensure seamless data ingestion... ...data solution.- Design, develop, implement, and architect Data Engineering pipelines, considering performance & scalability including data...Senior
- ...Job Description Design and deliver robust, production-grade data-intensive applications and services that power business-critical use cases at scale. This role combines strong software engineering fundamentals with deep data engineering expertise and technical leadership...SeniorLong term contractFull timeLocal area
- ...take your career wherever you want it to go. Join EY and help to build a better working world. EY- GDS - Data and Analytics – Senior – Forward Deployed Engineer As part of our EY-GDS AI & Data team, we help our clients solve complex business challenges with the help...SeniorLong term contractFull time
- ...excited about transforming messy, fragmented data into a clean, scalable foundation that... ...entire teams can build on? Are you the kind of engineer who sees a dozen bespoke schemas and... ...searching for a hands-on, technically excellent Senior Data Engineer who wants to build the data...SeniorLong term contractFull timeHybrid workRemote jobWorldwide
- ...Communication, Employee Groups and Celebration. Position Overview Purpose & Scope: As part of Ralph Lauren's Data Strategy initiative, we are seeking a Senior Data Engineer to lead the design and delivery of scalable data products that power analytics across commercial,...Senior
- ...sound like you? Then it seems like you’d make a great addition to our vibrant international team. We are looking for: Senior Software Engineer (Data Engineer - AI Solutions) You’ll make an impact by: · Design, build, and maintain data pipelines that serve the needs of...Senior1 day week
- ...Senior Data Engineer – Mindera At Mindera, we leverage technology to build high-impact products that transform businesses. Our Data Engineering team plays a crucial role in enabling data-driven decisions by building scalable, reliable, and efficient data platforms. As...SeniorFull timeFlexible hours
- About Us : Actualize is a trusted global partner in engineering and digital transformation, with 20+ years of domain expertise in the manufacturing... ...intelligent automation to modernize legacy systems and enable data-led innovation. Headquartered in Bangalore, we also operate from...SeniorHybrid workLocal area
- ...fundamentally redefine how employees work. About the Role: Glean is building a world-class Data Organization composed of data science, applied science, data engineering and business intelligence groups. Our data engineering group is based in our Bangalore, India office...SeniorFull timeHybrid workWork at office3 days week
- ...is not an “offshore center.” It’s a core engineering and research hub - working on the exact same... ...problems in trading, systems, and data science. What You’ll Love: Zero bureaucracy... ...client interfaces. Partner with Senior Quants and Product Managers to translate...SeniorFull timeWork at office
- ...Role: Senior Data Engineer Location: Hyderabad, India Full/ Part-time: Full time Build a career with confidence Carrier Global Corporation, global leader in intelligent climate and energy solutions is committed to creating solutions that matter for people and...SeniorFull timePart timeFlexible hours
- About the Role :We are looking for a highly skilled Senior Data Engineer to design, develop, and optimize scalable data pipelines and data infrastructure.The ideal candidate will have strong expertise in big data technologies, cloud platforms, ETL frameworks, and data warehousing...Senior
- Job Summary: We are seeking a highly skilled Senior Lead Engineer with extensive experience in data analysis, architecture, and strategy. The ideal candidate will have a strong background in designing databases, data warehouses, and data products, with a proven ability to lead...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to (Senior) Data Engineer (ML, Big Data). Be the first to apply!
