PySpark AWS Data engineer
Aspyra
Job Description : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy pandas.- Excellent communication & presentation skills.- Experience in managing Python codes and collaborating with customer on model evolution.- Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise).- Superior analytical and problem solving skills.- Should be able to work on a problem independently and prepare client ready deliverable with minimal or no supervision.- Good communication skill for client interaction.Data Management Skillsets : - Ability to understand data models and identify ETL optimization opportunities. Exposure to ETL tools is preferred.- Should have strong grasp of advanced SQL functionalities (joins, nested query, and procedures).- Strong ability to translate functional specifications / requirements to technical requirements.Required Skillset : - Demonstrated expertise in building distributed data processing systems using PySpark and Python, with a deep understanding of data modeling and schema design.- Proven ability to architect and deploy cloud-native data solutions within the AWS ecosystem, ensuring high availability and fault tolerance.- Strong analytical mindset with the ability to translate complex business requirements into technical specifications that drive tangible project outcomes.- Excellent communication skills, with the ability to articulate technical concepts to non-technical stakeholders and work effectively in a collaborative, hybrid-work environment.- A degree in Computer Science, Engineering, or a related quantitative field, combined with 3 to 7 years of professional experience in data engineering roles.- High degree of adaptability to work across time zones in a fast-paced, global MNC environment, with a commitment to continuous learning and technical excellence.Key Skills : - Pyspark, AWS, Data Ingestion, Data Transformation, Data Engineering, Bigquery, Hadoop, Big Data, Aws Glue, SQL, Data Integration, Hive, Data Migration, Data Pipeline, Big Data Technologies, Data Warehousing, Spark, Data Modeling, ETL, Python. (ref:hirist.tech)
- We are looking for an experienced AWS Data Engineer with strong expertise in PySpark, PostgreSQL, and AWS Data Engineering services.Key Responsibilities:- Design and implement scalable data reporting infrastructure.- Build and maintain data pipelines and ETL processes.- Develop...Suggested
- ...developing, and maintaining large-scale data pipelines using AWS services, as well as developing scalable and efficient data models using PySpark and Spark SQL to process massive... ...objectives.Required Skills :- AWS- Data Engineering- Python or PySparkPreferred Skills :- Experience...SuggestedLong term contract
- Mandatory Skills : AWS, Data Engineering, Python Or PySpark.Roles and Responsibilities:- Design, develop, and maintain large-scale data pipelines using AWS services such as AWS Glue, Lambda, EMR, and Redshift.- Develop scalable and efficient data models using PySpark and Spark...Suggested
- Role: Data EngineerRequired Technical Skill Set: Python, Pyspark, Databricks, DeltaLake, MongoDB, Sympy, UnityCatalog, SQL, Pandas... ...transformation pipelines using AWS services (Lambda Functions, Step... ...to collaborate with Software Engineers and Frontend Engineers.- Participate...SuggestedImmediate start
- Job Title : Data Engineer (GenAI)Location : Gurugram / Bangalore (Hybrid)Experience : 5+ YearsEmployment Type : Full-TimeMandatory Skills : - Python- PySpark- SQL- Data Engineering- GenAI, LLMs or RAG- Azure/AWS (Any Cloud)Job Responsibilities : - Build and optimize scalable...SuggestedFull timeHybrid work
- Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The... ....- Experience with Kafka is preferred.Preferred Skills : - AWS/GCP/Azure- Docker- Kubernetes- Delta Lake- Git & CI/CD- Agile/...
- Job Description:We are looking for a Data Engineer with strong hands-on experience in building scalable... ...data processing systems using PySpark and Scala. The role involves working on large... ...Have:- Experience with cloud platforms (AWS or Azure)- Knowledge of data lakes and file...
- Role Overview : As a PySpark Developer, you will be at the forefront of building scalable data pipelines that transform raw information... ...product managers, and infrastructure engineers, to design robust architectures... ...cloud-native environments on AWS, enhancing system scalability...Hybrid work
- ...centers in Chennai and Bengaluru, focusing on Data Strategy, Data Engineering, and Artificial IntelligenceLooking for an AWS Data Engineer with experience and skills listed... ...large tables partitions- Must have experience in PySpark- Must have experience in Databricks- Must have...
- ...Job Title : Data Engineer – PySpark & Snowflake Experience : 3–5 years Location : DTC Infotech Bangalore Mode : 5 days WFO Notice... ...data modelling concepts • Familiarity with cloud platforms ( AWS / Azure / GCP ) Good-to-Have Skills: • Experience with...Full timeImmediate start
- Job Title : Data Engineer (Databricks & PySpark)Experience : 5-8 YearsLocation : Bangalore (Hybrid)Employment Type : Full-timeJob Description : We are looking... ...Skills : - Experience with cloud platforms such as Azure, AWS, or GCP.- Knowledge of Delta Lake, Spark optimization, and...Full timeHybrid work
- Role : Data Engineer - Azure (Associate Architect / Senior)Experience Level : 4 to 7 YearsWork location... ...:- A strong hands-on knowledge of Spark/Pyspark.- Expertise in writing SQL queries and... ...cloud platforms like Azure (preferred), AWS or GCP.- Prior experience of ADF is a...Hybrid work
- We are looking for an experienced PySpark Data Engineer with 58 years of hands-on experience in building scalable data pipelines and modern data platforms... ...candidate should have strong expertise in PySpark, Snowflake, AWS, and core Data Engineering concepts. Experience in Java is a...
- ...application. This position reports to the Engineering Manager. Responsibilities: Align... ...Experience in defining technical requirements, data extraction, data transformation,... ...Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch. ~ Development...Full time
- Pyspark Data EngineerRequirements :- Hands-on expertise in designing, building, and maintaining Apache Spark pipelines in production environments... ...:- Bachelors or Masters degree plus 6+ years of data engineering experience with strong PySpark expertise.Role Overview :We are...Hybrid work
- Role Overview : As a Senior Data Engineer, you will be at the forefront of designing and implementing robust data pipelines that serve as the... ....- Develop high-performance data processing applications using PySpark and Azure Databricks to handle large-scale analytical workloads...Hybrid work
- Role Overview :As a Senior Data Engineer, you will serve as a technical cornerstone in building and scaling robust data pipelines that power... ...Design and implement scalable data processing pipelines using PySpark to handle large-scale datasets, ensuring optimal performance and...Long term contractHybrid work
Rs 15 - 20 lakhs p.a.
We're Hiring | PySpark Developer / Senior Data Engineer Location: Hyderabad, Pune, Chennai, Bengaluru Experience: 6–9 Years Work Mode: Hybrid Budget: Up to ₹20 LPA We are looking for an experienced PySpark Developer / Senior Data Engineer with strong expertise...Full timeHybrid work- We are seeking a skilled and motivated Data Engineer to design, build, and optimize our next-generation data pipelines. In this role, you will... ...our data architecture, leveraging Databricks, Python, and PySpark to transform raw data into actionable insights. You will collaborate...
- We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team. Responsibilities... ...Must have 8+ years of experience in data intensive Pyspark development....
- ...Script and have 6+ years of experience with big data frameworks like Spark, Hadoop or Kafka.- You excel in Apache Spark/PySpark fundamentals.- You excel in using stream and... ...data governance practices.- Data Engineering Expertise: You have advanced skills in designing...Full timeWork from homeFlexible hours
- ...Company :A leading technology organization delivering cloud-native data engineering and analytics solutions for global enterprises. The company... ...a Senior Data Engineer with strong expertise in Python, PySpark, Azure Data Services, and ETL development to build and optimize...
- ...Role: Data Engineer (PySpark, SQL, GCP) Experience: 6+ Years Locations: Indore | Raipur | Gurgaon | Bangalore We are looking for experienced Data Engineers to build and optimise scalable data pipelines and data models using modern data engineering practices. The role...Full timeHybrid work
- Job Title : AWS Data EngineerLocation : Bangalore - Whitefield (Hybrid)Experience : 6-10 YearsEmployment... ...are looking for an experienced AWS Data Engineer to design, build, and maintain scalable... ....- Strong expertise in Apache Spark/PySpark.- Experience working with AWS services...Full timeHybrid work
- ...to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017. Following that, subsequent projects... ...10+ years of experience in data intensive Pyspark development Must have experience in...
- Role Overview :As a PySpark Developer, you will serve as a critical architect within our data engineering team, responsible for designing, developing, and maintaining high-performance data pipelines that process massive datasets. You will collaborate closely with data scientists...Hybrid work
- Job Summary : We are seeking an experienced AWS Data Engineer with 5+ years of expertise in designing, developing, and maintaining scalable data solutions.The ideal candidate should have strong SQL programming skills, hands-on experience with AWS data services, data warehousing...
- Job Summary :We are seeking an experienced AWS Data Engineer with 8+ years of expertise in designing, building, and managing large-scale data platforms. The ideal candidate will be responsible for developing scalable ETL pipelines, enabling efficient data ingestion, and delivering...
- Job Title : AWS Data engineer who has Provisioned RedShift cluster managementRequired Skills : AWS Data engineer, Expertise on Provisioning redshift cluster management, SQL, with understanding on WLM (Workload Management)Location : RemoteJoining period : Immediate joinersDuration...Immediate start
- ...Responsibilities:- Design, build, and maintain scalable data pipelines and ETL/ELT workflows on AWS.- Develop and optimize cloud-based data architectures... ...processes.Required Skills:- Strong experience in Data Engineering with 6-15 years of industry experience.- Hands-on...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to PySpark AWS Data engineer. Be the first to apply!
