Get new jobs by email
- Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good... ...domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration...Big Data
- Key Responsibilities- Design, develop, and optimize robust big data pipelines for data ingestion, processing, and transformation using tools like Hadoop, Spark, Scala, Hive etc.- Manage and maintain large-scale distributed data storage and processing systems.- Collaborate with...Big Data
- ...:- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform... ...Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver...Big Data
- Job Title: Senior Data Engineer/Developer.Number of Positions: 2.Job Description:- The Senior Data Engineer will be responsible... ...a Senior Data Engineer or similar role.- Experience with big data tools: Hadoop, Spark, Kafka, Ansible, chef, Terraform, Airflow, and Protobuf RPC...Big DataSide job
- ...Job Description As a Software Engineer III - Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will be instrumental in designing and implementing the next generation of a cloud-native liquidity risk management platform for JPMC. The Liquidity...Big Data
- Description : Data Engineer Analytics & Platform DevelopmentRole Overview :We are seeking a skilled... ...-time data processing solutions using Spark, Kafka, or Hadoop.- Translate business requirements... ...cloud storage systems (S3, ADLS, GCS).- Big Data Technologies : Working knowledge of...Big Data
- ...DESCRIPTION :Responsibilities : - Collaborate with Data Engineers and Data Scientists to integrate and... ...large-scale data processing using Spark Pools, fine-tuning configurations for performance... ...+ years experiencing developing scalable Big Data applications or solutions on...Big Data
- Job Title : Data Engineer Scala with Play OR SparkLocation : HyderabadExperience : 4 to 7 YearsEmployment Type : Full-TimeAbout the Role :We are... ...Design and develop highly scalable backend systems using Scala (Spark / Play) and Python.- Build and maintain data processing...SuggestedFull time
- Summary : Seeking a passionate Data Engineer (2-3 years' experience) to build scalable data solutions. Must have expertise in Spark (Scala), Java, AWS EMR, and AWS Glue, with end-to-end data pipeline exposure. Oracle ERP migration experience is a plus.Key Responsibilities :...Suggested
- ...- Design, develop, and maintain scalable big data systems and pipelines.- Implement data processing... ...datasets using tools such as Hadoop, Spark, and Hive.- Develop and maintain ETL... ...with scripting/programming languages (Java, Scala, Python, or Shell).- Strong problem-solvingPreferred...Big Data
- About the Role :We are looking for a highly skilled Data Engineer to join our clients Big Data team. The ideal candidate will have deep expertise in Hadoop, Spark, and modern data ecosystems, and will be responsible for designing, building, and optimizing data pipelines that...Big DataContract workRemote job
- ...products that provide accurate data to drive better-informed decisions... ...recognized as one of the best big companies to work for as well... ...THE OPPORTUNITY :This Staff Data Engineer position can work out remotely... ...implement, and optimize Apache Spark jobs to define, schedule,...Big DataFull timeRemote job
- Job Description :The Data Engineer is responsible for processing structured and unstructured data, validating data quality, and developing... ...at an Enterprise level in the following tools and languages :- Spark Scala- python- Mysql- Apache ParquetDesired Pluses :- Java-...Suggested
- ...for a highly skilled and motivated Senior Data Engineer to join our clients team. You will play a... ...optimize large datasets.- Utilize Apache Spark for distributed data processing and real-... ...best practices in data engineering and big data technologies.Required Skills : - 6-9...Big Data
- Exciting Job Opportunity in Pune!Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic... ...Requirements :- Minimum of 5+ years of experience- Proficient in Spark development for batch and streaming applications- Skilled in Pyspark...Big Data
- ...an exciting opportunity to advance your data engineering career and drive innovation in cloud automation... ...scalable data pipelines using Python and Big Data frameworks to support governance... ...Hands-on experience with Hadoop, Spark, or similar Big Data technologies Proficiency...Big Data
- ...requirements to technical specifications - data streams, data integrations, data transformations... ...tabular format.- Working experience on Spark.- Working experience of Azure SQL, SQLMI,... ...scalable Data pipeline on cloud (Azure) for big data platforms.- Working experience on AWS...Big DataFlexible hours
- ...have a strong building Real-Time Enterprise Data Vault on Delta Lake, used as a Raw Data... ...as Business DV.- Will be using Databricks Spark Structured Streaming and Synapse Spark Pools... ...- Data Vault, real-time coding requires on scala, spark,- Moving from on-premise to cloud, need...
- Job Description : - 5-10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark.- Very good expertise in algorithms and data structures- Excellent in at least one programming language: Python, Go, R- Hands-on expertise...Big Data
- ...About the Role :We are looking for a skilled Data Engineer to design, build, and maintain efficient... ....- Work with cloud platforms and big data technologies to support distributed... ...scripting languages such as Python, Java, or Scala.- Familiarity with ETL tools and frameworks...Big Data
- ...environment. This role offers immense growth potential and a chance to work with cutting-edge technologies. As a Lead Software Engineer- Python / Spark Big Data at JPMorgan Chase within the Capital Reporting product, you will be executing software solutions, designing, developing,...Big Data
- Job Responsibilities :- Collaborate with data scientists, software engineers, and business stakeholders to understand... ...like MongoDB, Redis, Apache Spark would be add on..- Knowledge of distributed computing frameworks and big data technologies (e.g., Hadoop, Spark)...Big Data
- Role : Big Data EngineerAbout Organization :Our Client is an IT consulting organization focused... ...closely with other members of the data engineering team, as well as with stakeholders in... ...technologies such as Data Lake, SQL, PostgreSQL, Spark, and Azure Data Explorer- Proficiency in...Big Data
- ...Summary : We are looking for a passionate and skilled Data Engineer to design, develop, and maintain scalable data... ...data-focused role.- Strong proficiency in Python or Scala for data processing.- Hands-on experience with Big Data frameworks such as Spark, Hadoop, or Flink.- Expertise...Big Data
- Description :- Reply is looking for a Data Engineer with experience building and contributing to... ...Databricks technology experience implementing Big Data with Advanced Analytics solutions.-... ...- Proficiency in Python and Apache Spark- Develop and manage Databricks notebooks...Big Data
- ...GPTW winner.Position Overview : We are looking for an experienced and driven Data Engineer to join our team. The ideal candidate will have a strong foundation in big data technologies, particularly Spark, and a basic understanding of Scala to design and implement efficient data...Big DataLong term contract
- About the advertising data flow team :The advertising data flow team is responsible... ...Kinesis streams a variety of big data technologies including Athena, EMR, Spark, and Lambdas.The senior-level... ...bit about you :You will :- Lead the engineering efforts across multiple software...Big Data
- ...large volumes of batch and real-time data.- Maintain and enhance existing... ...with other services.- Utilize Big Data tools such as Kafka, AWS S3 Data Lake, EMR, and Spark to ingest, store, transform, and... ...writing high-quality, well-structured Scala code with an emphasis on...Big Data
- ...About the Role :We are looking for a skilled Data Engineer to design, build, and maintain scalable... ...and unstructured data using tools like Spark, Databricks, or Azure Data Factory.- Implement... ...:- Strong programming skills in Python, Scala, or Java.- Proficiency in SQL for data...Big Data
- ...PM ISTExperience : 6+ years of hands-on Data Engineering experienceAbout the Role :We are looking... ...problem-solving, and working with cutting-edge big data technologies.Key Responsibilities :-... ...data pipelines for ETL processes using Spark (PySpark/Scala).- Optimize data flow and...Big DataShift work