Data Engineer — PySpark + AWS Glue
Temporary
Yadimen Consulting Limited
Data Engineer — PySpark + AWS Glue
ETL & Data Pipelines | 2 Openings
Location: Remote (UK)
Employment Type: Contract / Permanent
Experience Level: 4–8 Years
Openings: 2
About the Role
We are looking for a skilled Data Engineer with solid hands-on experience in PySpark, AWS Glue, and ETL development to build and maintain scalable, production-grade data pipelines on AWS. You will be part of a delivery-focused team working on complex data engineering challenges, contributing to data lake architecture and end-to-end pipeline development.
Requirements
Key Responsibilities
• Design, develop, and maintain scalable ETL pipelines using PySpark and AWS Glue
• Build and optimise data ingestion, transformation, and loading workflows
• Orchestrate data workflows using AWS Step Functions
• Develop serverless functions using AWS Lambda (Python)
• Work with data lake architectures on AWS to support analytical use cases
• Ensure pipeline reliability, monitoring, and performance optimisation
Required Skills & Experience
• Strong hands-on experience with PySpark and AWS Glue
• Proven track record in ETL pipeline development and optimisation
• Experience orchestrating workflows with AWS Step Functions
• Proficiency in serverless development using AWS Lambda (Python)
• Good SQL skills and a solid understanding of data processing principles
Nice to Have
• Exposure to Java-based microservices
• Understanding of REST APIs and backend service integrations
• Experience working with AWS-based data lakes
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Engineer — PySpark + AWS Glue in Bangalore vacancy
- Job Summary :NetConnect Global is hiring a Lead Data Engineer for a reputed client. We are looking for a highly skilled professional with expertise in AWS Data Services, PySpark, Data Warehousing, NoSQL Databases, and Enterprise Data Platforms to drive large-scale data transformation...Data
- We are looking for an experienced AWS Data Engineer with strong expertise in PySpark, PostgreSQL, and AWS Data Engineering services.Key Responsibilities:- Design and implement scalable data reporting infrastructure.- Build and maintain data pipelines and ETL processes.- Develop...Data
- Hiring Data Engineer for Bangalore Location.Experience : 9 -13 YearsJob Location : BangaloreF2F... ...performance data processing applications using PySpark to handle distributed computing tasks... ...cloud-based data infrastructure on AWS, ensuring cost-effective resource utilization...DataHybrid work
- ...Role Overview :We are seeking a highly skilled and experienced AWS Lead Data Engineer to join our dynamic team in Bangalore or Chennai. In this... ...robust and scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Redshift for efficient data ingestion,...Data
- ...Senior Data Engineer Teradata VaaS + AWS | SME Fraud Data Warehouse Location: Remote (UK) Employment Type: Contract / Permanent... ...expertise in AWS-based data lake architectures — including S3, Glue, Redshift, and Athena • Experience designing and...DataPermanent employmentContract workRemote job
- Hiring : AWS Data EngineerLocation : Bangalore (Bagmane Solarium)Work Mode : Hybrid (3 Days/Week... ...are looking for an experienced AWS Data Engineer to join our growing data engineering team.... ...Apache Spark.- Develop and maintain AWS Glue jobs for data transformation and orchestration...DataFull timeHybrid workWork at office3 days week
- Job Title : AWS Spark Scala Data EngineerJob Summary : We are seeking a highly skilled AWS Spark Scala Data Engineer to design, develop, and optimize scalable data processing solutions on... ...Work with AWS services such as S3, EMR, Glue, Redshift, and Athena.- Optimize Spark jobs...DataFull timeImmediate start
- Position : Data Engineer - AWS Cloud PlatformExperience : 6- 16 YearsLocation : Open / HybridJob Summary :We are seeking an experienced Data Engineer... ...or distributed data processing frameworks.- Knowledge of AWS Glue, S3, Lambda, Athena, Redshift, or related AWS analytics...Data
- ...As a Senior Lead Software Engineer at JPMorganChase within the CORPORATE... ...Hands-on experience with **AWS services** including Step Functions... ...workflows, including data sensitivity considerations, secure... ...services such as **OpenSearch, Glue, Athena, or Kinesis**. About...DataFor contractors
- Big Data AWS Engineer : Location : Bengaluru / Gurugram (Work from the Office).Experience : 69 Years.Employment Type : Full-Time.About the Role... ...solving and analytical skills.Technical Skills : - AWS : Lambda, Glue, S3, EMR, RDS, IAM, CloudWatch.- Big Data : Apache Spark, Spark...DataFull timeWork at office
- Job Title : Data Engineer (GenAI)Location : Gurugram / Bangalore (Hybrid)Experience : 5+ YearsEmployment Type : Full-TimeMandatory Skills : - Python- PySpark- SQL- Data Engineering- GenAI, LLMs or RAG- Azure/AWS (Any Cloud)Job Responsibilities : - Build and optimize scalable...DataFull timeHybrid work
- Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The... ....- Experience with Kafka is preferred.Preferred Skills : - AWS/GCP/Azure- Docker- Kubernetes- Delta Lake- Git & CI/CD- Agile/...Data
- Job Description :We are looking for a Data Engineer with strong hands-on experience in building... ...distributed data processing systems using PySpark and Scala. The role involves working on large... ...Have :- Experience with cloud platforms (AWS or Azure)- Knowledge of data lakes and...Data
- ...Job Title : Data Engineer – PySpark & Snowflake Experience : 3–5 years Location : DTC Infotech Bangalore Mode : 5 days WFO Notice... ...data modelling concepts • Familiarity with cloud platforms ( AWS / Azure / GCP ) Good-to-Have Skills: • Experience with...DataFull timeImmediate start
- Job Title : AWS Data engineer who has Provisioned RedShift cluster managementRequired Skills : AWS Data engineer, Expertise on Provisioning redshift... ...in SQL and hands-on experience with ETL/ELT tools such as AWS Glue, dbt, Apache Airflow, or Step Functions.- Strong knowledge of...DataImmediate start
- We are seeking a skilled and motivated Data Engineer to design, build, and optimize our next-generation data pipelines. In this role, you will... ...our data architecture, leveraging Databricks, Python, and PySpark to transform raw data into actionable insights. You will collaborate...Data
- ...to 30 days..!!Key Responsibilities & Skillsets : Common Skillsets : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy...DataImmediate start
- ...Design, build, and maintain scalable data pipelines and ETL/ELT workflows on AWS.- Develop and optimize cloud-based... ...Skills:- Strong experience in Data Engineering with 6-15 years of industry... ...expertise with AWS services such as S3, Glue, Lambda, EMR, Redshift, Athena, RDS...Data
- Role : AWS Data EngineerLocation : Bangalore, Delhi (Hybrid)Mandatory Skills : AWS (S3, Redshift, Glue, Lambda, EMR), Python, Spark & Data EngineeringJob Description :We are looking for an AWS Data Engineer with strong experience in building scalable data pipelines and working...DataHybrid work
- ...Description : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and... ...architect and deploy cloud-native data solutions within the AWS ecosystem, ensuring high availability and fault...DataHybrid work
- Role Overview :Our client is looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms and... ...based data platforms- Large-scale data processing- Databricks & PySpark ecosystems- Real-time streaming systems- AI-driven data engineering...Data
- Job Summary : We are seeking a skilled Data Engineer to join our team and support the migration of enterprise data to an AWS Lakehouse environment. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring high data quality...Data
- Role : Data Engineer - Azure (Associate Architect / Senior)Experience Level : 4 to 7 YearsWork location... ...:- A strong hands-on knowledge of Spark/Pyspark.- Expertise in writing SQL queries and... ...cloud platforms like Azure (preferred), AWS or GCP.- Prior experience of ADF is a...DataHybrid work
- Job Overview : We are seeking an experienced Senior Data Engineer to join our dynamic team and drive our data engineering initiatives. The ideal... ...processing workflows using Azure Databricks with Spark and PySpark.- Implement and manage Lake flow Declarative Pipelines for efficient...Data
- Role Overview : As a Senior Data Engineer, you will be at the forefront of designing and implementing robust data pipelines that serve as the... ....- Develop high-performance data processing applications using PySpark and Azure Databricks to handle large-scale analytical workloads...DataHybrid work
- ...of what's possible. As a Lead Software Engineer at JPMorganChase within the Asset and Wealth... ...microservices , REST APIs , NoSQL data stores , and event-driven patterns.... ...applications and services. Working knowledge of AWS (or a comparable cloud platform)....Data
- Job Description :We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and data platforms that... .... The ideal candidate will have strong expertise in Python, PySpark, Scala, Apache Spark, Hadoop, SQL, Azure Cloud, and Databricks,...Data
- ...centers in Chennai and Bengaluru, focusing on Data Strategy, Data Engineering, and Artificial IntelligenceLooking for an AWS Data Engineer with experience and skills listed... ...large tables partitions- Must have experience in PySpark- Must have experience in Databricks- Must have...Data
- ...you help shape the future of software security. As a Security Engineer III at JPMorganChase within the Cybersecurity and Technology Controls... ...documentation, validating outputs and ensuring sensitive data is handled appropriately. Applies reuse-first, AI-assisted practices...Data
- ...you could do with us.About the Staff Devops Engineer role : Responsibilities (Not exhaustive) :... ...functional teams (Backend, Frontend, Data, Security, QA etc.) on planning and execution... ...infrastructure for large scale production systems on AWS- Deep knowledge of Linux as a production...DataLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer — PySpark + AWS Glue. Be the first to apply!
