Get new jobs by email
- Responsibilities :- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (... ....- Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver...Suggested
- ...are looking for a highly skilled Sr. Big Data Engineer professional to join our team. This role... ...performance and low-latency components to run Spark clusters. Interpret functional... ...Technologies: Experience with HDFS, Hive, HBase, Apache Spark, and Kafka. Familiarity with...Suggested
- Description :Responsibilities :Data Engineering & Architecture :- Design and implement scalable and... ...Expectations, or custom validations.- Optimize Spark jobs for performance, cost, and... ...or Jenkins.Leadership & Collaboration :- Lead a team of data engineers, ensuring best practices...Suggested
- ...Responsibilities :- Design, develop, and manage data pipelines using Databricks (Spark, Delta Lake).- Optimize large-scale data... ...of professional experience in data engineering or similar roles.- Strong experience with Databricks, Apache Spark, and Delta Lake.- Proficient in...Suggested
- Description :OverviewRole : Data EngineerLocation : BangaloreJob Overview... ...Data Architect to define and lead our enterprise data... ...position also includes mentoring data engineers and ensuring best practices in... ...and streaming pipelines using Apache Spark, Airflow, and AWS Glue, ensuring...Suggested
- ...Fusemachines Fusemachines is a leading AI strategy, talent, and... ...infrastructure and code required for data integration, storage,... ...looking for a skilled Sr. Data Engineer/Technical Lead with a strong background... ...plus), databases, flat files, Apache Parquet, event streaming,...SuggestedFull timeContract workRemote job
- Responsibilities :- 9 years of experience in the development of Data Lakes with Data Ingestion from disparate data sources, including relational... ...DB.- Experience in using column-oriented data file format like Apache Parquet, and Apache Iceberg as the table format for analytical...SuggestedImmediate start
- ...Job Title: Sr Data Engineering Lead Location: Indore, MP (Hybrid 3 Days a Week) Employment Type: Full-Time About the Role Ccube is seeking... ...architectures integrating batch and streaming pipelines (Spark, Kafka, Delta Lake, Iceberg, Hudi, etc.). ○ Build reusable...SuggestedFull timeHybrid work3 days week
- ...high-performance, scalable, and optimized data solutions for large enterprise-wide data mining... ...require expert knowledge in Databricks, Spark, SQL, and MDM practices. JOB... ...experience developing data pipelines within an Apache Spark environment (preferably Databricks)....SuggestedFull time
- ...Environmental Conditions Office Position Overview As a Lead Data Engineer, your pivotal responsibility involves spearheading data... ...Snowflake, or BigQuery. Strong hands-on experience with SQL, Apache Spark, and Python (experience with Pandas preferred). Proficient...SuggestedRemote jobFull timeWork at officeWorking Monday to Friday
- ...Responsibilities :- Design, build, and optimize robust data streaming and batch processing pipelines using Apache Flink.- Develop scalable and efficient ETL... ...closely with cross-functional teams to integrate data engineering solutions with other platforms and applications.- Implement...Suggested
- ...and roadmap for scalable, secure, and high-quality data pipelines and platforms.- Lead and mentor a team of data engineers while establishing engineering best practices,... ...Engineer role.- 5+ years recent experience with Apache Spark and solid understanding of the fundamentals...SuggestedPermanent employmentFull timeRemote job
- Description : Were Hiring : Data Engineering Lead (Immediate Joiners Only Within 7 Days) Are you passionate about cloud data engineering and ready... ...?Were looking for a Data Engineering Lead skilled in Azure, Apache Spark, and AWS Glue to join our growing team!Location :...SuggestedImmediate start
- ...create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorgan Chase within the Consumer and Community Banking -... ...algorithms Experience with Python/Java, Terraform, Spark Preferred qualifications, capabilities, and skills ~...Suggested
- ...the Role :We are looking for a skilled and motivated Big Data Engineer with strong experience in Apache NiFi, Snowflake, Databricks, and Python (PySpark). The... ...processing.- Apply performance tuning techniques in Spark jobs to optimize resource utilization and execution time...Suggested
- Description :Relevant Experience : 7-10 years.Job description :- Lead the data engineering team by driving the design, build, test, and launch of new... ...completion.Skill Required :Must Haves :- SQL, Python, Py Spark, Spark SQL, Spark, Distributed Systems.- Databricks, ADLS Gen...
- Job Title : Lead Data EngineerLocation : Kochi / TrivandrumExperience : 10+ yearsNotice Period... ...:Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data... ...Functions, S3, and data platforms (EMR, Apache Spark, Iceberg).- Database Exposure : DynamoDB...Immediate start
- ...Role :We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and... ...Server, and AWS RDS.- Orchestrate and monitor data workflows with Apache Airflow to ensure reliable and timely delivery.- Implement streaming...
- Description :Job Summary :We are seeking a highly skilled Lead Data Engineer with strong expertise in SQL, Python, Big Data technologies, and Google... ..., and availability.- Work with Big Data tools (e.g., Hadoop, Spark, Kafka) for data transformation and aggregation.- Ensure...
- ...global financial markets infrastructure and data business. We are dedicated, open-access... ...Russell! We're establishing a team of engineers passionate about data, software craftsmanship... ...testable data pipelines using Python and Apache Spark • Orchestrating data workflows...Full timeWorldwide
London Stock Exchange Group
Bangalore3 days ago - ...powered by robust and intelligent data systems.Were on the lookout for a Data Engineer Senior II to architect and maintain... ..., optimising data systems, and leading with technical excellence, youll thrive... ...data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT.-...Remote jobWork from homeFlexible hoursWeekend work
- Description:We are looking for a skilled Data Engineer with 9+ years of experience in big data technologies... ...modern data storage formats, including Apache Iceberg. You will work closely with cross... ...scalable data pipelines using Apache Spark.- Implement and manage large-scale data...
- Description :Primary Job Title : Data Engineering Lead.About The Opportunity :We are seeking a highly skilled Lead Data Engineer with strong expertise... ...Functions, Query Optimization).- Big Data Tools : PySpark, Spark SQL.- ETL Development : Data ingestion, transformation, and...
- Description : We are looking for a highly skilled Lead Data Engineer with strong expertise in data architecture, modeling, and scalable data systems... ...fault-tolerant, high-performance data solutions using DataOS, Spark, and Python.- Translate complex business needs into robust...
- Role Overview : We are seeking an experienced Lead Data Engineer to design, build, and optimize scalable data platforms within the Azure Databricks... ...and build data solutions using Databricks, SQL, Python, Spark, and Delta Lake within the Azure ecosystem (Blob Storage, Data...
- Job Summary : We are looking for a highly experienced Data Engineer with deep expertise in Python, PySpark, and BigQuery to join our data engineering... ...and maintain job orchestration and scheduling using tools like Apache Airflow - Write efficient SQL queries and scripts for data...
- Description : Lead Data Quality Engineer (with Cloud-Agnostic Data Engineering Expertise).Experience : 12 Years.Location : Mumbai, Bangalore, Hyderabad... ...with big data and distributed processing tools such as Apache Spark, Kafka, Hadoop, etc.- Proven experience in performance...
- ...: We are looking for a highly skilled Data Engineer to design, build, and manage scalable data... ...pipelines across MySQL, Kafka, and Spark ensuring reliable, secure, and performant... ...experience working with Kafka (Confluent or Apache) for building event-driven or CDC-based pipelines...Full time
- Description:Senior Data Engineer (Spark & Lakehouse)Location: Remote, India (Preferred: Bangalore/Pune)Experience: 6+ YearsDomain: Data Engineering... ...highly optimized, production-grade ETL/ELT pipelines using Apache Spark (PySpark/Scala) to process petabytes of data.-...Remote job
- We are seeking a talented Lead Big Data Engineer to deliver roadmap features which would helpcustomers to Measure, Communicate and Eliminate Cyber... ...in design and architecture Big Data solutions using Spark- 3+ years experience in working with engineering resources for...
