Lead software engineer pyspark,python,emr,unix,etl jobs

 ...Job Description As a Lead Software Engineer, Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and...  ...operational stability Extensive hands-on experience with PySpark, and ETL/Streaming Pipelines. Experience  in AWS services... 

 ...Job Description Lead Software Engineer Build a data platform to support Asset Management's data analytics and discovery needs. If you have...  ...programming skills (Oracle SQL and PL/SQL) and also have skills (Python, scripting etc.). You know Amazon Web Services-AWS. At... 

 ...Skills Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably). Experience in Automating ETL process/Pipelines and AWS Data & Infrastructure...  ...with AWS components like S3, Athena, EMR, Glue, Redshift, Kinesis and SageMaker.... 

 ...Summary: We are looking for a skilled Lead AWS Data Engineer to join our team in Mumbai. The ideal candidate will have experience in...  ...AWS cloud technologies. You should be proficient in SQL, PySpark, and Python and have hands-on experience with AWS services like Redshift... 

 ...Position: AIML_Python Enginner Kothapet_Hyderabad _Hybrid.( 4 days a week onsite) Contract to hire fulltime...  ...Jenkins, Nexus, AUTOSYS for scheduling Experience with ETL process for ML pipelines with PySpark, Kafka, AWS EMR Serverless Good to have experience in H2O.ai... 

 ...Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly...  ...~ Comfortable and hands on with the Python programming. ~ Strong experience in...  ...AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc. ~ Strong experience in developing... 

 ...HIH - Software Engineering Associate Advisor Position Summary Evernorth, a leading Health Services company, is looking for exceptional data engineers/developers in our...  ...Engineering, Computer Science Primary Skills PYTHON, Databricks, TERADATA, SQL, UNIX, ETL, Data... 

 ...Technical Design and Development Expertise Any of the ETL tools (Informatica, IICS, Matillion, Data Stage), and hosting...  ...and distributed RDBMS systems is a must. Experience across Python, PySpark, and Unix/Linux Shell Scripting . Project Management Is a must... 

 ...are currently seeking a Sr Data Engineer (Life and Annuity) to join our...  ...development experience in Scala/Python.. Strong Database SQL...  ...advantage. . Experience with ETL/ELT process and frameworks is a...  ...services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift... 

 ...financial markets, is looking for a Lead Java Application Developer to...  .... Participate in multiple software development processes...  ...Science, Information Systems or Engineering is required, or in lieu, a demonstrated...  ...Basic networking knowledge / Unix scripting ~ Minimum- 1-2... 

 ...We are looking for a  Lead Data Engineer  to join our Content Tech Big Data Engineering Team in India...  ...to speak with you if you have skills in Python, Spark and have experience on building...  ...Degree or equivalent in computer science, software engineering, or a related field At... 

 ...The job includes all parts of software development lifecycle: refining...  ...other full stack and frontend engineers on the team to de/-refine APIs...  .... You are proficient in Java/ Python/ Scala or similar Functional...  ...~ Proficiency in building ETL (Extract-Transform-Load) systems... 

 ...practices, standards, and the full software development lifecycle—from design...  ...and NPM ~ Experience with Unix/Linux shell scripting ~ Knowledge...  ...Experience with messaging systems, ETL, or reporting tools is a plus ~ Knowledge of Python is a plus ~ Understanding of... 

 ...Group, Inc. (MUFG) is one of the worlds leading financial groups. Headquartered in Tokyo...  ...About the Role: Position Title: Sr. Software Engineer. Corporate Title: Analyst, Software Engineering...  ...: Develop and maintain complex ETL mappings, workflows, and UNIX shell... 

 ...Profile : AWS Data Engineer Mandate Skills : AWS + Databricks + Pyspark + SQL role Location : Bangalore /Pune /Hyderabad...  ...-efficiency Develop and manage ETL/ELT processes with schema transformations...  ...3+ years AWS experience (S3, EMR, Glue, Lambda, Redshift) Proficiency... 

 ...This role is for a Data Engineer with extensive experience in data engineering, data warehousing...  ...candidate will have strong expertise in Python, PySpark, and AWS data services to design,...  ...AWS data services like Glue, Lambda, and EMR . Develop and maintain scalable ETL... 

 ...Job Description Required Skills: Python Programming: Strong ability to write clean...  ...: Familiarity with S3, Redshift, Lambda, EMR is an advantage. ETL Development: Understanding of ETL processes and data engineering principles. Version Control: Experience... 

 ...and SQL/PL-SQL optimization. ETL tools (preferably Informatica),...  ...(AWS, Kubernetes), and Python. The candidate should have experience...  ... Good knowledge of UNIX, Shell Scripting, u-deploy (or...  ...continuous integration  Large scale software product engineering experience... 

 ...About The Role We are actively hiring a Data Engineer (SDE2 level) with strong expertise in Core Python, PySpark, and Big Data technologies to join a high-performance...  ..., develop, and maintain scalable and efficient ETL pipelines using Core Python and PySpark. Work with... 

 ...based in Powai, involves the development of an ETL module and requires the candidate to be...  ...stored procedures, packages, and functions Unix shell scripting and strong communication skills...  ...a proactive mindset with a willingness to learn, and familiarity with Autosys and Python.... 

Mandatoty skill : Python experience and solid understanding of ML lifecycle.This is a contract position with our...  ..., Nexus, AUTOSYS for scheduling.- Experience with ETL process for ML pipelines with PySpark, Kafka, AWS EMR Serverless.- Good to have experience in H2O.ai.- Good... 

 ...talent and ambitions Join Iris Software — one of the fastest-growing...  ...complex Application & Product Engineering, Data & Analytics, Cloud,...  .... ~5+ years of expertise in ETL Testing ~ Good knowledge of...  ...Datawarehouse, ETL concepts, Unix commands, shell/bash script or... 

 ...Position : Senior Cloud Data Engineer (1 Position) Experience : 8+ Years Location : Hyderabad Education : Preference...  .../IIM/NIT . Primary Skills : Data Engineering (ETL/ELT) Spark (Glue/EMR) Python/Scala AWS (S3, Glue, EMR, Athena, Aurora, DMS)... 

 ...mentoring and training to team of engineers. Handles complex operational tasks...  .... Qualification/Skillsets (Python, AWS - EKS, S3, Lambda, Glue, EMR, RDS Data Stores, CloudFront, API Gateway...  ...) 6+ years of experience in software development and technical... 

 ...Should have knowledge on any one of these ETL Tools: Talend, Datastage, Informatica...  ...Should possess mandatory Linux/Unix Skills Expertise in Python, Data Flow, Pubsub, Big Query, CICD...  ...any of the RDBMS Holding GCP Data Engineer certifications would be an added advantage... 

 ...Senior AWS Data Engineer (PySpark & Python) — On-site, India Industry & Sector: Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real... 

 ...seeking experienced AWS Data Engineers to design, implement, and maintain...  ...data technologies, SQL, and PySpark. ~ Experience - 7 to 10...  ...technologies including Glue, Redshift, EMR, Kinesis and Athena...  ...scripting languages: Pyspark, Python etc. Experience in using... 

 ...Website- Job Title: ETL Developer – DataStage, AWS, Snowflake...  ...Senior Developer to join our data engineering team. You will work on...  ...on experience with AWS Glue (PySpark or Spark) and AWS Lambda for...  .... ~ Proficiency in SQL , Unix scripting , and basic Python... 

 ...seeking an experienced Senior DevOps Engineer to join our dynamic team. The...  ...scripting skills in Bash and Python for automation and tooling. ~...  ...~ Solid understanding of Linux/Unix systems administration and...  ...expertise with AWS services (e.g., EMR, OpenSearch, MSK) Experience... 

 ...Join us as a Senior ETL Test Engineer at Barclays, responsible for supporting the successful delivery of location strategy projects...  ...and implementing ETL test automation scripts using Python, SQL scripting, QuerySurge, Unix and Shall Scripts. Automate comparison, schema...