Spark data onboarding engineer jobs

 ...We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions...  ...to ensure data integrity and system resilience within Spark jobs. Optimize PySpark jobs for performance, including partitioning... 

 ...Job Title : Lead Data Engineer Experience Required : 9 to 15 Years Mode of Work : Remote Job Description We are seeking a seasoned...  ...manage large-scale data pipelines, particularly using Apache Spark. Collaborate with client ML engineers to define and... 

 ...exceptional career development and success. Principal Scala (Apache Spark) Engineer at BairesDev We are seeking a Principal Scala (Apache...  ...technical vision and architecture for large-scale distributed data systems. You'll shape Spark ecosystem contributions, design... 

 ...building an adaptive experience that provides data and ML driven opportunities to our...  ...geographically distributed team of Machine Learning engineers and ML Scientists to design and code large...  ...in big data technologies, particularly Spark, Hive, and Databricks. ~ Proficiency in... 

 ...experience Life at Visa. Job Description As a Senior Data Scientist, you'll join our Value Added Services – Digital...  ...relational and non-relational databases. Apply your data engineering skills with Hadoop, Spark, and Scala. Represent the team in various technical... 

 ...career — and we have the perfect software engineering opportunity for you. As a Software Engineer...  ...and reporting from large, diverse data sets in service of continuous improvement...  ...& develop data pipelines end to end using Spark SQL, Java and AWS Services. Utilize programming... 

 ...Inviting applications for the role of Manager, Data Engineer, AWS, Python, Spark, Databricks for ETL - Agentic AI Key Responsibilities. ~ Architect and implement AI agent powered products using Semantic Kernel and Python, enabling automated workflows ~ Orchestrate... 

 ...career — and we have the perfect software engineering opportunity for you. As a Software Engineer...  ...troubleshooting Building pipelines in spark, tuning spark queries Writes secure and...  ...and draws conclusions from large, diverse data sets to identify problems and contribute... 

 ...Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud...  ...Role Overview :Seeking an experienced Senior Data Engineer to lead data ingestion,...  ...and manage high-volume data pipelines using Spark/Databricks.- Implement ELT frameworks using... 

 ...periodical and ad-hoc reports using operational data · Develop semantic core to align data...  ...testing of the releases · Big Data: Spark, Hive, Data Bricks · Language: SQL, JAVA...  ...· Experience with Data Migration, Data Engineering, Data Analysis · Big Data: SCALA, HADOOP... 

 ...Job Description: Spark Expertise Expert proficiency in Spark Ability to design and implement efficient data processing workflows Experience with Spark SQL and DataFrames...  ...a team of technical professionals Data Engineer and Application Developers ensuring... 

 ...development and success. Senior Apache Spark Developer at BairesDev We are seeking...  ...Spark Developer to work on distributed data processing systems and real-time analytics...  ...and optimize distributed data processing engines for batch and real-time analytical workloads... 

 ...Management: Lead and manage a team of technical professionals â€' Data Engineer and Application Developers, ensuring effective collaboration...  ...knowledge Client Interfacing skills Project and Team management Technical and Professional Requirements: Spark, Scala, Bigdata

 ...digital transformation journey this is the place for you Technical Requirements: ~ Primary skills Technology Big Data Data Processing Spark Additional Responsibilities: Knowledge of more than one technology Basics of Architecture and Design... 

 ...Senior Python & Spark Developer_full-time_Ahmedabad & Mumbai Job Title: Senior Python...  ...Django, Flask) and PySpark for large-scale data processing. The ideal candidate will be a...  ...s or Master's degree in Computer Science, Engineering, or related field. 5+ years of professional... 

 ...Job Title: Senior Python & Spark Developer Job Type: Full-Time Experience Required: 5...  ...Django, Flask) and PySpark for large-scale data processing. The ideal candidate will be a...  ...s or Master's degree in Computer Science, Engineering, or related field. * 5+ years of professional... 

 ...Opening: Senior Software developer | Python & Spark Developer | Work Location: Ahmedabad...  ...Design, develop, and maintain scalable data-driven & event-driven applications. Build...  ...Bachelor's/Master's in Computer Science, Engineering, or related field 5+ years in software development... 

 ...Job Title : Engineering (Data Engineering) Location : Gurgaon Experience Required : 1+ Years Employment Type : Full-Time Department...  .... The role involves working with big data technologies like Spark, Kafka, and Python/Scala to support data management, analytics... 

 ...career — and we have the perfect software engineering opportunity for you. As a Software Engineer...  ...and draws conclusions from large, diverse data sets to identify problems and contribute...  ...and 2+ years applied experience in Java Spark, AWS, SQL Proficiency in one or more large... 

 ...opportunity for you to take your software engineering career to the next level. As a Software...  ...applied experience Strong understanding of Data Warehousing, Data Lake, ETL processes and...  ...e.g Hadoop, Snowflake, Databricks, Apache Spark, PySpark, Airflow, Apache Kafka, Java,... 

 ...opportunity for you to advance your software engineering career and grow your skills at JPMorgan...  ...and draws conclusions from large, diverse data sets to support secure, stable application...  ...Databricks and Python Experience with Spark, Kafka, and cloud platforms (preferably AWS... 

 ...Kick-start your software engineering career as an entry-level Software Engineer I. Be part of a team that...  ...responsibilities Design, develop, and maintain scalable data pipelines and ETL processes. Work with large datasets using Spark on Data bricks or AWS EMR. Write efficient... 

 ...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.... 

 ...seeking highly energetic, passionate, technology enthusiast for Data Engineering team. The successful candidate will work as a Senior Data...  ...maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark) Responsible for the implementation and test of scalable distributed... 

 ...aiming to establish itself as the world's leading data-driven payments company. We are seeking a hands-on Director of Data Engineering, Data Science, and GenAI/ML. This role is...  ...technologies such as Java, Microservices, Hadoop, Spark, and AI/ML frameworks. -Deep technical... 

Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support...  ...ecosystem (HDFS, MapReduce, YARN).- Strong expertise in Apache Spark for large-scale data processing and analytics.- Proficiency in... 

 ...platforms, AIaS automates the updates to data, models, and applications. Combined with strong...  ...you This position is for a Staff Data Engineer with solid development experience who will...  ...in real-time streaming systems (Spark/Flink/Kafka/Ray Streaming) -Skilled with... 

 ...The Role We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong...  .... Strong expertise in big data technologies such as Hadoop, Spark, Hive, HBase, Kafka, Flume. Proficiency in SQL and at least... 

 ...Position Overview Job Title: Data Engineer (ETL, Big Data, Hadoop, Spark, GCP) , Assistant Vice President Location: Pune, India Role Description Senior engineer is responsible for developing and delivering elements of engineering solutions to accomplish business... 

 ...Job Description Senior Manager, Lead Data Engineer The Opportunity Based in Hyderabad...  ...configurations, and code to ensure easy onboarding for new team members and future scalability...  ...Processing & Transformation Apache Spark (Concepts & Usage) Databricks (...