Senior data engineer spark/hadoop jobs in Gurgaon

Position : Big Data EngineerExperience : 59 Years Job Type : Full-timeJob...  ...a highly skilled Big Data Engineer with 59 years of experience to...  ...and implementing solutions using Hadoop-based technologies and AWS. The...  ...using frameworks like Spark, Kafka, and other cloud technologies... 

 ...adaptive experience that provides data and ML driven opportunities to...  ...team of Machine Learning engineers and ML Scientists to design and...  ...viable products and work with seniors and peers in crafting and implementing...  ...technologies, particularly Spark, Hive, and Databricks. ~... 

 ...Key Deliverables : # Build scalable data pipelines integrating Oracle and SQL Server data. # Automate data ingestion and processing for AI/ML workflows. # Optimize data storage, compute performance, and security compliance. # Collaborate with AI/ML teams for model-... 

 ...Data Lakehouse & Data Product Engineer Purpose & Overall Relevance for the Organization: Be part of a team building a state-of-the-art data lakehouse...  ...integration with data warehouse solutions. Exposure to Spark Architecture: Familiarity with Spark, PySpark, and... 

 ...Role Responsibilities: Develop and maintain automated data extraction and parsing systems Monitor website changes to ensure data accuracy and uptime Design scalable, high-performing data pipelines and ETL workflows Support operations to maintain data integrity and... 

 ...Job Title: Senior AWS Data Engineer Location: Gurgaon / Hyderabad Experience: 1.6 – 6 years About the Role :We are seeking a skilled AWS Data Engineer with strong expertise in data engineering tools and cloud technologies. The ideal candidate should have hands... 

 ...Responsibilities: Collaborate with business stakeholders to identify and document requirements for data engineering projects. Analyze existing data processes and workflows to identify opportunities for improvement and optimization. Work closely with data engineers... 

 ...Role Description Role Description: As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing andoptimizing the Microsoft...  ...reliable data pipelines using Azure services, Apache Spark, and related big data technologies Familiarity with... 

 ...Overview This role will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support the global business’s data needs. The Data Engineer will ensure the availability, reliability, and performance of data systems by integrating... 

 ...Key Responsibilities  : **Data Modelling:Design and implement efficient data models, ensuring data accuracy and optimal performance....  ...Utilize Git and GitHub for version control and collaboration on data engineering projects. *Performance Optimization: Identify and implement... 

 ...is Findem: Findem is the only talent data platform that combines 3D data with AI. It...  ...are looking for an experienced Big Data Engineer, who will be responsible for building, deploying...  ...experience in Big data technologies like Spark, Hadoop, Athena / Presto, Redshift, Kafka etc... 

 ...processes using open source tools and data frameworks like AWS Glue,...  ..., Apache Kafka, Apache Spark, Apache Airflow and Pentaho...  ...Collaborate with product and engineering teams to design and develop a...  ...data technologies like Apache Hadoop, Apache Hive, and others. Familiarity... 

 ...'ll help you in advancing your skills and career. Here, you'll be supported in progressing - whatever your ambitions. Senior Data Engineer We are looking for an experienced Data Engineer with strong backend and full-stack expertise to design, build, and scale... 

 ...exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-...  ...About The Role We are looking for a Senior Data Engineer with a collaborative, 'can...  ...Databricks, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions... 

 .... Strong hands-on expertise in SQL programming and Snowflake development. Experience working with structured and semi-structured data (JSON, Parquet, Avro) in Snowflake. Knowledge of Snowflake features like Streams, Tasks, Snowpipe, Time Travel, and Cloning. Background... 

 ...from wind turbines to semiconductors. At Kuehne+Nagel, our contribution counts in more ways than we imagine. ‎ The role of Data Quality Engineer is vital for digital transformation journey of Kuehne + Nagel Integrated Logistics. The Data Specialist enables data centric... 

 ...extract information from different data sources for business analytics...  ...Collaborate with senior developers to implement Python...  ...~ Bachelor's in Electrical Engineering or Computer Science required...  ...understanding of big data domains like Hadoop/MapReduce and ETL architectures... 

 ...Our platform manages over 470 terabytes of data distributed across five databases,...  ...seeking a talented and motivated tech data engineer to join our team who will be responsible for...  ...Frameworks: Experience with Airflow, dbt, Apache Spark, Kafka, Flink or similar technologies. ~... 

 ...this opportunity Must have skills required: 3+ years of experience in data science, or data engineering, preferably in a security or biometrics-focused company., Machine Learning, Python, Spark, SQL, TensorFlow, PyTorch Wink Inc. is Looking for: Role Overview... 

 ...Role: Senior Data Scientist Location: Gurugram, Pune Experience: 3 to 5 Years Job details: We are looking for a Data Scientist with expertise in AI/ML, Generative AI, Retrieval-Augmented Generation (RAG), and Large Language Models (LLMs) . The role requires strong... 

 ...expertise and a range of perspectives to spark change. BCG delivers solutions through leading...  ...Do Design, document & implement the data pipelines to feed data models for subsequent...  ...of the data being transformed via engineering pipelines for end consumption in Analytical... 

 ...and incentives most likely to close the sale. Its micro-marketing engine then delivers the right message at the right time to those...  ...and a stronger ROI. What You'll Do You will be part of our Data Platform & Product Insights data engineering team. As part of this... 

 ...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Middle/Senior Python & Data Engineer , you’ll enhance data quality and accelerate integration test cycles across the climate data platform, ensuring faster, more... 

 ...Mission OpenBlue: This is How a Space Comes Alive How will you do it We're seeking a detail-oriented and technically skilled Data Engineer to streamline our data operations. The ideal candidate will take ownership of the stability, integrity, and performance of our... 

 ...We are looking for a Data Engineer to join the Data Platform team who can help develop and deploy...  ...institute ➔ 2+ years of experience in Spark and Scala ➔ Should be very strong with...  ...structures and algorithm. ➔ Fluent with Hadoop/Pig/Hive/Storm/SQL ➔ Good to have knowledge... 

 ...IMMEDIATE JOINER Senior Data Engineer Location: Gurgaon Employment Type: full-time Team: Data & Insights About Blu Parrot:...  ...engineering for ML models. Big Data Technologies: Experience with Hadoop, Spark, or other big data frameworks. Why Join Us:... 

 ...Description Senior Data Engineer Syneos Health® is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into outcomes to address modern market... 

 ...alongside the LiveOps Lead and the LiveOps Engineer (Data Science) to maintain and improve data...  ...data initiative within the company. As a Senior Data Engineer you will: Perform a...  ...leverage Python, Cloud Airflow, SQL, AWS, Spark, Kedro, JIRA, Service Now amongst others... 

Job Description :AuxoAI is seeking a Senior Data Scientist with deep expertise in advanced algorithms and scientific rigor to lead strategic...  ...problem spaces - Conduct exploratory data analysis, feature engineering, and statistical modeling with an emphasis on interpretability... 

 ...learning problems and design solution workflows. ~ Work with our data platform and applications team to help them successfully...  ...roadmap What You Need ~ Masters in Computer Science, Computer Engineering or other relevant fields (PhD Preferred) ~7+ years of experience...