Get new jobs by email
- Overview :We are looking for a skilled Data Engineer II to join our Data Platform team. You will... ...distributed systems, bridging traditional big data engineering with modern cloud-native... ...ETL/ELT pipelines using Scala and Apache Spark/Flink (Core, SQL, Streaming) to process...SQLBig Data
- ...to design and architect complex data lake on the cloud- Build... ...orchestration leveraging state of the art big data technologies- Work with... ...this role :- Strong Big data engineering (Batch & Streaming) experience... ...cloud leveraging tech like EMR, Spark, Spark streaming- 5 or more years...SQLBig Data
- ...Role: Data Engineer – Big Data (Batch & Streaming) Location: Bengaluru, India (Hybrid – 3 days onsite per week) Employer: Flexton Inc. Client... ...role focuses on processing user and transactional data using Spark SQL, Flink SQL, Hadoop/HDFS and light Java work for...SQLBig DataHybrid workImmediate start3 days week
Flexton Inc.
Bangalorea month ago - ...~ Develop, test, and deploy data processing applications using Apache Spark and Scala. ~ Optimize and... ...experience in Apache Spark, Scala, and Spark SQL for distributed data processing.... ...~ Familiarity with other Big Data technologies, including Apache...SQLBig DataFull timeFor contractors
Photon Interactive Private limited
India17 days ago - ...Responsibilities :- Collaborate with data scientists, software engineers, and business stakeholders to understand... ...programming languages such as Python, SQL and Web Scrapping.- Understanding of... ...technologies like MongoDB, Redis, Apache Spark would be add on..- Knowledge of...SQLBig Data
- Data Engineer Spark | Databricks | AWSKey Skills :- Programming & Querying : SQL, Python, PySpark- Big Data & Processing : Apache Spark (Batch & Streaming)- Cloud Platform : AWS (S3, EMR, Glue, Redshift preferred)- Data Platforms : Databricks, Delta Lake, Delta Live Tables (...SQLBig Data
Rs 5 - 6 lakhs p.a.
...Job description As a Data Engineer , you are required to ~ Design, build, and maintain data pipelines that efficiently process... ...Data Engineering Desired Knowledge & Experience ~Spark: Spark 3.x, RDD/DataFrames/SQL, Batch/Structured Streaming ~ Knowing Spark...SQLBig DataSiemens
Bangalore6 days ago- ...the design and development of new Data & Analytics solutions in various... ...Overall working experience in Data Engineering 5+ years :Strong knowledge of Python, Apache Spark, and Airflow with a minimum of 3+... ...:- Solid understanding of SQL- Strong experience with relational...SQLBig Data
- About the advertising data flow team :The advertising data flow team is responsible... ...Kinesis streams a variety of big data technologies including Athena, EMR, Spark, and Lambdas.The senior-level... ...bit about you :You will :- Lead the engineering efforts across multiple software...SQLBig Data
- ...development, and maintenance of data pipelines and ETL processes for... ...proposals as well as for Data Engineering pipelines, refreshes, automations... ...).- Advanced knowledge of SQL, PL/SQL, and database performance... ...data warehousing concepts and big data technologies.- Strong skills...SQLBig Data
- ...learning outcomes. To support our growing Data & Analytics capability, we are hiring a Data Engineer who will play a critical role in... ...AWS technologies Build and optimize big data processing workflows using Databricks and Spark Develop robust ETL/ELT solutions with...SQLBig DataRemote job
McGraw Hill
Noida28 days ago - ...with the care, pharmacy benefits, data and resources they need to feel... ...Here at Optum, our Product Engineering team is looking for an exceptional... ...cloud technologies, Python, Spark/Pyspark. ~3+ years of solid experience... ...~ Skilled at optimizing SQL statements ~ Subject matter...SQLBig DataContract workShift work
Optum
Bangalore16 days ago - Description :We are seeking an experienced Spark Developer to design, develop, and optimize big data solutions using Apache Spark. The ideal candidate will have... ...transformation, and ETL pipelines.- Collaborate with data engineers and analysts to deliver high-quality solutions.-...SQLBig Data
- Hi Jobseeker, We are hiring Python Spark Developer for our MNC client. Location-Pune, Hyderabad Interview... ...- only immediate to 15days We are looking for a Data Engineer with experience in Python , Spark SQL , Hive , and Airflow . In this role, you will be...SQLBig DataImmediate start
Natobotics
Pimpri1 day ago - ...We’re Hiring: Spark-Scala Developer (Big Data Engineer) Location: Bangalore (Day 1 Onsite) ⏳ Notice Period: Immediate to 2–3 Weeks Experience: 5+ Years ❗ Note: Candidates with only PySpark experience will not be considered Share your profiles: ****@*****.***...SQLBig DataImmediate start
Rs 7 - 12 lakhs p.a.
...for a highly skilled and experienced Azure Data Engineer with strong expertise in Azure... ...PySpark strong programming skills for big data processing Azure Synapse Analytics... ...warehousing concepts and analytics Pyspark, Sql, Adb, Adf, Azure, Databricks, Azure Syanpse...SQLBig DataPermanent employmentFull timeRARR Technologies
Bangalore8 days ago- ...and we have the perfect software engineering opportunity for you. As a... ...troubleshooting Building pipelines in spark, tuning spark queries Writes... ...from large, diverse data sets to identify problems and contribute... ...Learning Frameworks and Big Data technologies such as Hadoop...Big Data
Jpmorgan & Co
Secunderabad1 day ago - The objectives of a Data Engineer typically revolve around designing, implementing, and managing robust... ...Iceberg Strong hands-on expertise In SQL Experience using GitHub for version... ...and database management. Experience with big data technologies and distributed...SQLBig Data
symplr
Bangalore23 days ago - ...Requirement :What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support-... ...platforms and data products.- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java programming...Big Data
Rs 3 - 12 lakhs p.a.
...RESPONSIBILITIES: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from various sources and storage systems. Leading the implementation...Big DataRosemallow Technologies
Coimbatore15 days ago- Description : The Data Transformation Engineer is responsible for designing, developing, and optimizing ETL... ...managing data infrastructure, optimizing big data processes, and working with cloud-... ...and optimize performance.- Work with SQL, Java, or Scala for data transformation...SQLBig Data
- ...configuration, case storage, security, and data insights and analytic. The successful... ...to contribute to all parts of the data engineering and deployment lifecycle, including... ...from a wide variety of data sources using SQL, Amazon and AWS big data technologies Must possess...SQLBig Data
Amazon
Bangalore8 days ago - ...Job Title: Senior Data Engineer Location: Chennai WFO Experience: 8–10+ Years Type: Full... ...ideal candidate has deep expertise in Big Data ecosystems , data pipeline development... .... Key Skills: Big Data: Spark, Hive, HDFS, NiFi, Kafka, HBase, Phoenix...SQLBig DataFull time
DMAIC Academy & Consultancy
Chennai1 day ago - ...Job Description Junior Data Engineer / DWH & Python Developer (Fresher) Job Overview We are... ...a strong foundation in Python and SQL, problem-solving skills, and an eagerness... ...like Pandas or NumPy. Familiarity with big data technologies (e.g., Apache Spark, Kafka...SQLBig Data
Zensar Technologies
Pune1 day ago Rs 4 - 7 lakhs p.a.
...developing, and maintaining scalable data pipelines, preferably using PySpark... ...exposed to the fast-paced world of Big Data technology and has experience... ...Java, Scala, or Python or PySpark, SQL. ~4-8 years of experience in data engineering, with a focus on PySpark. ~...SQLBig DataFull timeMedtronic
Punea month agoRs 3 - 9 lakhs p.a.
...Description We are seeking a skilled Data Engineer to join our team in India. The ideal candidate... ...engineering or related field. ~ Proficiency in SQL and experience with relational databases (... ...PostgreSQL, Oracle). ~ Experience with big data technologies such as Hadoop, Spark,...SQLBig DataTeamware Solutions
Bangalore8 days agoRs 3 - 10 lakhs p.a.
# No of years experience 5+ Detailed job description - Skill Set: # Bigdata Testing - Hadoop, HDFS, Hive, Kafka, Spark, SQL UNIX Mandatory Skills # Bigdata Testing - Hadoop, HDFS, Hive, Kafka, Spark, SQL UNIX Good to Have Skills # Bigdata Testing - Hadoop, HDFS,...SQLBig DataFusion Plus Solutions
Secunderabad8 days ago- ...years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting... ...at least 2 DBMS/appliances among Redshift, SQL Server, PostgreSQL, Oracle. Should have... ...Should have knowledge and experience of Big Data Technologies (Hadoop ecosystem) and NO...SQLBig DataFull time
Rs 4 - 7 lakhs p.a.
...Computer Science, Information Technology, Engineering, or a related field. A Master s... ...Minimum of 4+ years of experience in a data engineering role or similar.... ...platforms (AWS, Azure, Google Cloud) and big data tools (e.g., Hadoop, Spark). Technical Skills: Proficiency...SQLBig DataImpronics Technologies
Gurgaon22 days ago- ...Description IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest... ..., and load data from a wide variety of data sources using SQL, Amazon and AWS big data technologies Must possess strong verbal and...SQLBig Data
Amazon Robotics
Bangalore1 day ago
