Senior Data Engineer - ETL/ELT Pipelines
Spectral Consultants – Search & Recruitment firm
Description :We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data platforms that support analytics, business intelligence, and AI/ML initiatives.The ideal candidate will have strong expertise in big data technologies, cloud data ecosystems, ETL/ELT processes, and distributed data processing frameworks.This role requires close collaboration with data scientists, analysts, product teams, and business stakeholders to enable reliable, high-quality, and efficient data solutions across the organization.Key Responsibilities :- Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data processing.- Develop and optimize data architectures, data lakes, and data warehouse solutions.- Build robust batch and real-time data processing systems.- Integrate data from multiple internal and external sources while ensuring data quality and consistency.- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.- Work with cloud-based data platforms such as AWS, Azure, or GCP.- Implement data governance, security, monitoring, and compliance best practices.- Collaborate with data scientists and analysts to support reporting, analytics, and machine learning use cases.- Troubleshoot production data issues and perform root cause analysis.- Automate workflows, scheduling, and orchestration using modern data engineering tools.- Maintain technical documentation and data lineage standards.- Mentor junior engineers and contribute to engineering best practices.Required Skills & Qualifications :Technical Skills :- Strong experience with SQL and database technologies- Hands-on expertise in Python, Scala, or Java- Experience with ETL/ELT tools and frameworks- Strong knowledge of big data technologies such as Spark, Hadoop, or Kafka- Experience with cloud data services on AWS, Azure, or GCP- Familiarity with data warehouses such as Snowflake, Redshift, BigQuery, or Synapse- Experience with workflow orchestration tools like Airflow or Prefect- Knowledge of data modeling, schema design, and data governance- Experience with REST APIs and data integration techniques- Familiarity with containerization and CI/CD practices is preferred (ref:hirist.tech)
- Description : About the jobExperience : - 5+ years of experience in data engineering or related roles- Proven experience with ETL/ELT pipeline development- Experience with cloud data platform (GCP)- Experience with big data technologiesTechnical Skills : - Programming Languages...Data
- ...Services & ConsultingDepartment : Engineering Software & QAAbout the Role :... ...and optimizing large-scale data processing solutions. The ideal... ...in developing scalable data pipelines and transforming complex datasets... ...PySpark.- Build and optimize ETL/ELT pipelines for processing...DataPermanent employmentFull time
- ...Design, develop, and maintain scalable data pipelines for processing large volumes of structured... ...Design and implement cloud-native data engineering solutions.- Ensure data quality, governance... ...best practices.- Experience building ETL/ELT pipelines and data integration solutions...DataSenior
- About the Role : We are looking for a highly skilled and experienced Senior Data Engineer to design, develop, and optimize scalable data platforms and pipelines that support business intelligence, analytics, reporting, and data-driven decision-making across the organization...DataSenior
- Job Description : - Design and implement scalable data pipelines using Azure Data Factory and Azure Databricks- Develop and optimize ETL/ELT processes for large-scale distributed data processing- Build and maintain data lake and lakehouse architectures on Azure cloud platform...DataSeniorImmediate start
- ...Client Location - Sholinganallur (Hybrid work mode)Role : Data Engineering Engineer 3 /Senior Engineer/Lead EngineerPosition Description : - The... ...Experience in design, development and implementation of data pipelines using Data Warehousing applications- Experience in integrating...DataSeniorPermanent employmentHybrid workImmediate start
- We are seeking an experienced DataStage ETL Engineer to design, develop, and execute high volume data migration pipelines that move legacy data into our modern data warehouse and cloud platforms. The role will be part of the Data Migration Delivery Team, working closely with...DataSeniorFull time
- ...Developer with 5 to 10 years of experience in data engineering and cloud data warehousing.The ideal... ..., and optimizing scalable data pipelines, data models, and analytics solutions to... ...warehouse solutions.- Strong understanding of ETL/ELT concepts and modern data engineering...Data
- Description :We are looking for a highly skilled Snowflake Engineer to design, develop, and optimize scalable cloud-based data solutions using the Snowflake platform.The ideal... ...will have expertise in data warehousing, ETL/ELT pipelines, SQL optimization, cloud technologies,...Data
- About This Role :We are seeking a talented and experienced Senior Data Engineer to join our data engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure on cloud platforms. This role requires expertise in...DataSenior
- Job Description : Senior Data Engineer (Azure)Role : Senior Data EngineerExperience : 6-8 YearsJob Family : Data & AnalyticsJob Summary :We are... ...cloud ecosystem to design, build, and maintain scalable data pipelines and solutions. The candidate should have hands-on experience...DataSenior
- ...- Design, develop, and maintain complex data pipelines using Azure Data Factory (ADF) and other... ...extraction, transformation, and loading (ETL) processes- Create and maintain data... ...and provide technical guidance on data engineering best practices- Stay current with emerging...DataSenior
- Job Description :CDM Smith is seeking a Data Engineer to join our Digital Engineering Solutions... ...engineering practices, and reliable data pipelines to enable analytics and AI capabilities across... ...to extract, transform, and load (ETL/ELT) data from various sources into target...Data
- ...using MicroStrategy.- Build and manage schema objects, metadata, and data models to support reporting needs.- Collaborate with business... ...techniques.- Solid understanding of data warehousing concepts and ETL processes.- Proven experience working with stakeholders to define...DataSenior
- ...We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines for enterprise-grade data platforms within the Risk & Compliance domain. The ideal candidate will have strong expertise in PySpark, Python , and data engineering...DataSenior
- ...We are looking for a Senior Data Engineer with deep expertise in real-time data streaming and distributed data processing to design, build,... ...business stakeholders to deliver low-latency, high-throughput data pipelines that power advanced analytics and decision-making. Key...DataSenior
- ...Direct Contract with HaparzAbout the Role :We are looking for a Senior Data Engineer to architect and build the foundational Data Engine for an AI... ...candidate should have strong expertise in building scalable ETL/ELT pipelines, designing AI-native data architectures, and enabling...DataSeniorContract workHybrid workWork at office
- ...Wood India Consulting division is currently recruiting for a Senior Engineer - Subsea Pipeline to join the team focusing on subsea projects within our... ...considering factors such as seabed conditions, geotechnical data, flow assurance, and pipeline routing ~ Perform detailed...DataSeniorFull timeFor contractors
- ...We are seeking a skilled Senior Palantir Data Software Engineer to join our team and contribute to a complex Data Transformation project within the... ...have the opportunity to design and implement advanced data pipelines and analytics solutions, leveraging cutting-edge Big...DataSenior
- ...digital strategy, experience design, and engineering, with a unique combination of agility,... ...Overview: We are seeking an experienced Senior Data Engineer to build and optimize scalable... ...role focuses on designing reliable data pipelines, lakehouse and warehouse models, and...DataSenior
- Job Description : Role : Lead / Senior Informatica CDI ConsultantRole... ...technical Senior Informatica Cloud Data Integration (CDI) Consultant with 8 to 10 years of overall ETL experience, including deep... ...implementation of cloud-native data pipelines. You will be instrumental in...DataSeniorLong term contractHybrid work
- ...Architect-level depth in Informatica Data Quality (IDQ) including rules engine design, exception framework... ...escalation workflows in collaboration with senior business stakeholders and data governance... ...Architect automated data cleansing pipelines covering standardisation, de-...DataFull timeRemote jobWork from home
- ...Job Description We are seeking a highly experienced Azure Data Engineer with 10+ years of hands-on experience, specializing in Azure... ...Microsoft Azure. The ideal candidate will be deeply skilled in ETL/ELT engineering, distributed data processing, and cloud-native data...DataSeniorFull timeLocal areaFlexible hours
- ...With exceptional talent, trusted data and intelligence, and world-... ...scalable and reliable data pipelines and infrastructure, primarily... ...with analytics, product, and engineering teams to understand data requirements... ...-level data pipelines and ETL/ELT processes.- Strong proficiency...DataSeniorHybrid workWork at office
- Role : Senior Data EngineerJob Overview : We are seeking an experienced Senior Data Engineer to join our dynamic team and drive our data engineering initiatives. The ideal candidate... ...play a crucial role in building robust data pipelines, optimizing data workflows, and enabling...DataSeniorFull timeFlexible hours
- Required Skills :Mandatory Skills :- Strong experience in :1. Azure Data Factory (ADF)2. Azure Databricks3. Apache Spark4. Lakeflow... ...Azure cloud platform and data services.- Strong understanding of ETL/ELT concepts and data warehousing principles.- Experience working with...DataSenior
- ...We are seeking a talented and driven Senior AI Engineer to join our team and lead the development of cutting-edge AI/ML models and GenAI... ...and GenAI solutions in production Design and maintain robust ETL pipelines and data workflows Develop LLM-based applications using modern...DataSenior
- We are seeking an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP)... ...developing, and maintaining scalable data pipelines and analytics platforms.The candidate... ...processing concepts.Good-to-Have Skills : - ETL development and data integration experience...Data
- Description : As a Lead Data Engineer, you will be at the forefront of designing, developing, and... ...the delivery of high-quality data pipelines that drive critical business decisions and... ...scalable and reliable data pipelines using ETL tools and cloud-based technologies to ingest...Data
- About the Role : We are looking for a Senior Data Engineer to design, build, and manage scalable data solutions that power business intelligence... ....Key Responsibilities : - Design and develop scalable data pipelines and ETL processes.- Build and optimize data models and data architecture...DataSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - ETL/ELT Pipelines. Be the first to apply!
