Get new jobs by email
- Description :We are looking for a Senior/Lead Data Engineer to architect and scale our next-... ...maintain automated ELT/ETL pipelines using Apache Airflow to ensure high availability and efficient... .../Event-driven architecture (Kafka, Flink, or Kinesis).- Experience with Infrastructure...Suggested
- ...Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and... ...with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow...Suggested
- Overview :We are looking for a skilled Data Engineer II to join our Data Platform team. You will play a key role in building and optimizing... ..., and maintain robust ETL/ELT pipelines using Scala and Apache Spark/Flink (Core, SQL, Streaming) to process massive datasets with low...Suggested
- ...Pipeline Orchestration : Design, build, and maintain robust data pipelines using Apache Airflow. You will write and optimise DAGs to automate ETL... ...with the construction tech team, data analysts, and software engineers to understand data requirements for our Digital Twin and...Suggested
Rs 6 - 12 lakhs p.a.
...and interaction with other members of the Engineering/QA team. ~ Participate in Agile... ...experience design, build, and deploy scalable data solutions. ~ Experience in building Enterprise... ...query optimization. ~ Experience in Apache Nifi is required (3+ years) ~ Experience...Suggested- ...exceptional career development and success. Principal Scala (Apache Spark) Engineer at BairesDev We are seeking a Principal Scala (Apache... ...vision and architecture for large-scale distributed data systems. You'll shape Spark ecosystem contributions, design high...SuggestedLocal areaWorldwide
- ...exceptional career development and success. Staff Scala (Apache Spark) Engineer at BairesDev We are seeking a Staff Scala (Apache Spark)... ...to lead the architecture and optimization of distributed data systems. You'll drive large-scale Spark applications, improve...SuggestedLocal areaWorldwide
- ...empowered to grow, innovate, and thrive in an inclusive workplace. Job Summary We are seeking a skilled Data Engineer with strong expertise in PySpark and Apache Airflow to design, build, and optimize scalable data pipelines. The ideal candidate should have...Suggested
- ...is associated with breakthrough startups like Amelia.ai. This is a full-time Remote role for a Senior ETL Data Architect / Lead Data Engineer (Databricks, Apache Airflow & BERT/LLM Expert) The person can work from home (anywhere in INDIA, job location is in India)....SuggestedFull timeRemote jobWork from home
- ...exceptional career development and success. Apache Hadoop Developer at BairesDev We are... ...Hadoop Developer with expertise in big data ecosystem, HDFS architecture, MapReduce... ...source projects, and collaborate with engineering teams to deliver innovative big data...SuggestedLocal areaWorldwide
- ...platforms, AIaS automates the updates to data, models, and applications. Combined with strong... ...you This position is for a Staff Data Engineer with solid development experience who will... ...in real-time streaming systems (Spark/Flink/Kafka/Ray Streaming) -Skilled with Docker...SuggestedHybrid workWork at officeLocal areaFlexible hours
Rs 3 - 7 lakhs p.a.
Job Description JOB DESCRIPTION A talented and experienced Data Engineer with a strong focus on ETL projects to join our team. The ideal... ...extensive experience in data warehouse projects, and proficiency in Apache Nifi, PostgreSQL, Java or Node JS, and AWS. The primary...Suggested- Description :- Role : Data engineer- Loc : Gurugram- Work Mode : Hybrid- Shift Timing : 11AM- 8 PMKey Responsibilities :- Development of data... ...& Development Practices :- Strong experience with Scala and Apache Spark.- Experience with large-scale data engineering solutions....SuggestedHybrid workShift work
- ...Wells Fargo is seeking a Senior Software Engineer In this role, you will: Lead moderately... ..., Cloud Storage, Kubernetes Engine, Apache spark flow, Airflow Strong programming... ...and SQL. Strong experience building big data pipelines using Apache Spark, Hive, Hadoop...SuggestedContract work
- ...About this role: Wells Fargo is seeking a Software Engineering Manager to join the FDLZ (Finance Data Landing Zone) Data Engineering team within the... ...streaming frameworks like Spark Structured Streaming or Apache Flink . ~ Hands‑on with optimization techniques:...SuggestedContract work
- ...and services. Role Overview As a Data Applications Lead, you'll own end-to-... ...analytics. You will lead a small team of engineers and work closely with data science,... ...Work with streaming platforms like Apache Kafka and Flink for real-time data processing. Ensure...Work at office
- ...Wells Fargo is seeking a Lead Software Engineer - Data Engineering to join the GFCM - Global Funding... ...data pipelines using Python, SQL, Apache Spark, and modern data lake/lakehouse technologies... ...Spark Structured Streaming or Apache Flink . ~ Data Lakehouse & Storage ~ Hands...Contract work
- Role: Lead Data Engineer Location: Bangalore Years of Experience: 6 -8 Years About The Function At MakeMyTrip (MMT), technology... ...stream processing engines like Spark Structured Streaming or Apache Flink ~ Analytical processing on Big Data using Spark ~ At least...
- ...Job Description: We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing... ...understanding of distributed computing frameworks (e.g., Apache Spark, Apache Flink, Apache Storm) and cloud-based data platforms (e.g., AWS...
Rs 2.5 - 10 lakhs p.a.
...Queries) is MUST ~ Hands on experience in Apache Flink Streaming Or Spark Streaming MUST ~... ...in Apache Kafka experience is MUST ~ Data Lake Development experience. ~ Orchestration... ...Bachelor's degree in Computer Science, Engineering, or a related field ~5 + years...- ...specializes in the transformation of data in the US healthcare industry... ...continually strive to advance engineering excellence and technology... ...with ETL tools like Apache Airflow, Talend, or Informatica... ...frameworks such as Hadoop, Spark, or Flink. ~ Experience in data warehousing...
- ...LEAD DATA ENGINEER - Mumbai Overview of the Company: Jio Platforms Ltd. is a revolutionary... ...frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including... ...streaming technologies (Kafka, Spark Streaming, Flink, etc.). Database Expertise :...Hybrid workRemote job
- ...5k/rps 30ms response time 300 GB data transfer/hour 1000 VMs deployed at... ...using AWS and columnar formats like Apache Hudi, Iceberg, Parquet, etc ~ Experience in distributed data processing engines like Apache Spark, Apache Flink, Datalfow/Apache Beam, etc ~ Knowedge...Hybrid work
Rs 3.15 - 4.2 lakhs p.a.
...Actively hiring Data Engineer Mumbai (Hybrid) Start Date... ...performance. 3. Build robust data processing workflows using Apache Spark (preferred) and/or Apache Flink. 4. Integrate, clean, and transform data from...Hybrid workImmediate start- ...of its proprietary tests, vast data sets and advanced analytics. The... ...and proficient Cloud Data Engineer to join our Guardant Data Platform... ...utilizing technologies such as Apache Spark, AWS Glue, Athena, Redshift... ...Batch, ECS - Fargate, Kinesis, Flink, DynamoDB, and SageMaker....Hybrid workWork at office
Rs 2.5 - 5 lakhs p.a.
...optimize scalable ETL pipelines using Apache Airflow or similar frameworks to... ...Utilize Spark (PySpark), Kafka, Flink, or similar tools to enable distributed data processing and real-time streaming... ...scientists, analysts, and software engineers to support data-driven decision-...- ...Soothsayer Analytics is a global AI & Data Science consultancy headquartered in Detroit... ...gain a competitive edge. As a Data Engineer, you will build the foundation that... ...Work with distributed systems like Apache Spark, Kafka, or Flink for real-time/large-scale data processing...Full time
- ...We're looking for a Data Engineer with hands on experience in graph databases to design, build,... ...such as Airflow, dbt, Kafka/Kinesis, Spark/Flink. o Optimize data quality,... ...o RDF Triple Stores: Ontotext GraphDB, Apache Jena/Fuseki, Blazegraph, Stardog, Neptune...Hybrid work
- ...you. Job Description Visa’s Data and AI Platform team is at the... ...analytics and low‑latency responses. Engineers on our team work with modern open‑source... ...leading open‑source frameworks such as Apache Kafka, Apache Flink, Apache Spark, Apache Druid, Apache Pinot...Hybrid workWork at officeLocal areaWorldwideFlexible hours
- ...About the Team: We are a team of engineers and problem-solvers building scalable, modern data infrastructure. Our mission is to... ...and streaming solutions using Apache Kafka and AWS Kinesis. •Leverage... .... •Familiarity with AWS Flink or other stream processing frameworks...
