PySpark AWS Data engineer
Aspyra
Job Description : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy pandas.- Excellent communication & presentation skills.- Experience in managing Python codes and collaborating with customer on model evolution.- Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise).- Superior analytical and problem solving skills.- Should be able to work on a problem independently and prepare client ready deliverable with minimal or no supervision.- Good communication skill for client interaction.Data Management Skillsets : - Ability to understand data models and identify ETL optimization opportunities. Exposure to ETL tools is preferred.- Should have strong grasp of advanced SQL functionalities (joins, nested query, and procedures).- Strong ability to translate functional specifications / requirements to technical requirements.Required Skillset : - Demonstrated expertise in building distributed data processing systems using PySpark and Python, with a deep understanding of data modeling and schema design.- Proven ability to architect and deploy cloud-native data solutions within the AWS ecosystem, ensuring high availability and fault tolerance.- Strong analytical mindset with the ability to translate complex business requirements into technical specifications that drive tangible project outcomes.- Excellent communication skills, with the ability to articulate technical concepts to non-technical stakeholders and work effectively in a collaborative, hybrid-work environment.- A degree in Computer Science, Engineering, or a related quantitative field, combined with 3 to 7 years of professional experience in data engineering roles.- High degree of adaptability to work across time zones in a fast-paced, global MNC environment, with a commitment to continuous learning and technical excellence.Key Skills : - Pyspark, AWS, Data Ingestion, Data Transformation, Data Engineering, Bigquery, Hadoop, Big Data, Aws Glue, SQL, Data Integration, Hive, Data Migration, Data Pipeline, Big Data Technologies, Data Warehousing, Spark, Data Modeling, ETL, Python. (ref:hirist.tech)
- We are looking for an experienced AWS Data Engineer with strong expertise in PySpark, PostgreSQL, and AWS Data Engineering services.Key Responsibilities:- Design and implement scalable data reporting infrastructure.- Build and maintain data pipelines and ETL processes.- Develop...Suggested
- ...Data Engineer — PySpark + AWS Glue ETL & Data Pipelines | 2 Openings Location: Remote (UK) Employment Type: Contract / Permanent Experience Level: 4–8 Years Openings: 2 About the Role We are looking for a skilled Data Engineer...SuggestedPermanent employmentContract workRemote job
- Hiring Data Engineer for Bangalore Location.Experience : 9 -13 YearsJob Location : BangaloreF2F... ...performance data processing applications using PySpark to handle distributed computing tasks... ...cloud-based data infrastructure on AWS, ensuring cost-effective resource utilization...SuggestedHybrid work
- Role Overview :As an AWS Data Engineer, you will play a pivotal role in architecting and maintaining robust data pipelines that power our clients... ...data ingestion and processing pipelines using AWS Glue and PySpark to handle large-scale datasets efficiently.- Develop and optimize...SuggestedHybrid workRemote job
- Description :AI Engineer (LLM & Advanced AI)Experience Range : 3 9 YearsLocation... ...- Apply advanced analytics and data science techniques to validate... ...data pipelines using Python, PySpark, and SQL.- Work with large... ...:- Deploy AI solutions on AWS, Azure, or GCP.- Integrate AI models...SuggestedFull time
- Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The... ....- Experience with Kafka is preferred.Preferred Skills : - AWS/GCP/Azure- Docker- Kubernetes- Delta Lake- Git & CI/CD- Agile/...
- ...Overview :We are looking for a skilled PySpark Developer to design, develop, and optimize large-scale data processing solutions. The ideal... ....- Collaborate with data engineers, data architects, analysts, and... ...Experience with cloud platforms such as AWS, Azure, or GCP.- Exposure to...
- Mandatory Skills :- AWS- Data Engineering- Python Or PySpark.Roles and Responsibilities :- Design, develop, and maintain large-scale data pipelines using AWS services such as AWS Glue, Lambda, EMR, and Redshift.- Develop scalable and efficient data models using PySpark and Spark...
- Role Overview : As a PySpark Developer, you will be at the forefront of building scalable data pipelines that transform raw information... ...product managers, and infrastructure engineers, to design robust architectures... ...cloud-native environments on AWS, enhancing system scalability...Hybrid work
- Job Description :We are looking for a Data Engineer with strong hands-on experience in building... ...distributed data processing systems using PySpark and Scala. The role involves working on large... ...Have :- Experience with cloud platforms (AWS or Azure)- Knowledge of data lakes and...
- ...development opportunities.Job Description : Data Engineer :The Data Engineer will be a part of BNIs... ..., MongoDB, Redis- Experience in Python/PySpark is a must- Experience with tools like... ...stability back to normalcy- Knowledgeable with AWS services from Data Engineering point of...Work at office
- Role : Data Engineer - Azure (Associate Architect / Senior)Experience Level : 4 to 7 YearsWork location... ...:- A strong hands-on knowledge of Spark/Pyspark.- Expertise in writing SQL queries and... ...cloud platforms like Azure (preferred), AWS or GCP.- Prior experience of ADF is a...Hybrid work
- Role Overview:We are seeking a seasoned Lead AWS Data Engineer to spearhead the design, development, and optimization of our large-scale data... ...Architect and deploy end-to-end data pipelines using AWS Glue and PySpark to ensure seamless data ingestion and transformation for high-...Full timeHybrid work
- ...centers in Chennai and Bengaluru, focusing on Data Strategy, Data Engineering, and Artificial IntelligenceLooking for an AWS Data Engineer with experience and skills listed... ...large tables partitions- Must have experience in PySpark- Must have experience in Databricks- Must have...
- ...Job Title : Data Engineer – PySpark & Snowflake Experience : 3–5 years Location : DTC Infotech Bangalore Mode : 5 days WFO Notice... ...data modelling concepts • Familiarity with cloud platforms ( AWS / Azure / GCP ) Good-to-Have Skills: • Experience with...Full timeImmediate start
- Job Title : PySpark DeveloperExperience : 5+ YearsLocation : Bangalore... ...& ConsultingDepartment : Engineering Software & QAAbout the Role :... ...building and optimizing large-scale data processing solutions. The... ...with cloud platforms such as AWS, Azure, or GCP.- Knowledge of...Permanent employmentFull time
- We are looking for an experienced PySpark Data Engineer with 58 years of hands-on experience in building scalable data pipelines and modern data platforms... ...candidate should have strong expertise in PySpark, Snowflake, AWS, and core Data Engineering concepts. Experience in Java is a...
- Role Overview : As a Senior Data Engineer, you will be at the forefront of designing and implementing robust data pipelines that serve as the... ....- Develop high-performance data processing applications using PySpark and Azure Databricks to handle large-scale analytical workloads...Hybrid work
- We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team. Responsibilities... ...Must have 6+ years of experience in data intensive Pyspark development...
- Role Overview :Our client is looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms and... ...based data platforms- Large-scale data processing- Databricks & PySpark ecosystems- Real-time streaming systems- AI-driven data engineering...
- Job Title - Data Engineer Position type - Full Time Work Location - Bangalore, WhitefieldWorking style - Hybrid Cab Facility - Yes Shift Time... ...- Proficiency in data processing languages such as Python, Pyspark, SQL - ETL experience including data cleansing and preparation...Full timeHybrid workShift work
- We are seeking a skilled and motivated Data Engineer to design, build, and optimize our next-generation data pipelines. In this role, you will... ...our data architecture, leveraging Databricks, Python, and PySpark to transform raw data into actionable insights. You will collaborate...
- ...application. This position reports to the Engineering Manager. Responsibilities: Align... ...Experience in defining technical requirements, data extraction, data transformation,... ...Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch. ~ Development...Full time
- Job Description :We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and data platforms that... .... The ideal candidate will have strong expertise in Python, PySpark, Scala, Apache Spark, Hadoop, SQL, Azure Cloud, and Databricks,...
- Job Overview : We are seeking an experienced Senior Data Engineer to join our dynamic team and drive our data engineering initiatives. The ideal... ...processing workflows using Azure Databricks with Spark and PySpark.- Implement and manage Lake flow Declarative Pipelines for efficient...
- ...Role: Data Engineer (PySpark, SQL, GCP) Experience: 6+ Years Locations: Indore | Raipur | Gurgaon | Bangalore We are looking for experienced Data Engineers to build and optimise scalable data pipelines and data models using modern data engineering practices. The role...Full timeHybrid work
- Job Title : AWS Data EngineerLocation : Bangalore - Whitefield (Hybrid)Experience : 6-10 YearsEmployment... ...are looking for an experienced AWS Data Engineer to design, build, and maintain scalable... ....- Strong expertise in Apache Spark/PySpark.- Experience working with AWS services...Full timeHybrid work
- ...to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017. Following that, subsequent projects... ...10+ years of experience in data intensive Pyspark development Must have experience in...
- Job Title : Python Engineer - PySparkLocation : Hyderabad / BengaluruExperience : 5-7 YearsNotice... ...experienced Python Engineer with strong PySpark expertise to join our engineering team.... ...hands-on experience in building scalable data processing solutions using Python and Apache...Permanent employmentFull timeImmediate start
- ...to 30 days..!!Key Responsibilities & Skillsets : Common Skillsets : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy...Immediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to PySpark AWS Data engineer. Be the first to apply!
