Average salary: Rs800,000 /yearly
More statsSearch Results: 38,450 vacancies
...Description :- Excellent skills on SQL and Advance Level SQL.- Knowledge of Big Data Processing Cluster (Azure HDInsight / AWS EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-SQL/ PY-Spark/ Azure Data Factory/ AWS Glue etc. - Working Experience...
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble... ..., dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly...
...Digital and Cloud transformation operated by the group. A Data Division was created to help and reach this aim.
As a production engineer on the Hadoop HDP/CDP stack in the IT domain “DATAPLATFORMS” in the DATA division, you’ll be at the heart of the production teams. You’ll...
...leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing...
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
...EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for...
Responsibilities : - Design and implement scalable data pipelines and engineering infrastructure to support machine learning systems at scale.-... ...Azure, AWS, GCP).- 2 years of experience in Python, Databricks/Hadoop.- 2 years of experience in MLOps.Good to have :- Curiosity,...
...RESPONSIBILITIES:
1. Cluster Management
You will manage and administer Hadoop clusters running on Hortonworks and Cloudera Data Platform.... ...and Documentation:
You will work closely with data engineering, analytics, and DevOps teams to support data-driven initiatives....
...should have worked closely with data scientists and machine learning engineers to understand their infrastructure needs and provide efficient... ...with distributed computing and big data technologies like Hadoop and Spark.- Familiarity with machine learning operations (MLOps)...
...Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define... ...8+.- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python...
Job Description :The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate... ...such as MS SQL Server, PostgreSQL, MongoDB, Cassandra, Redis, Hadoop, Spark, Hive, Teradata, or MicroStrategy- A high-level understanding...
...Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support- Collaborate with data... ...products.- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java...
...: Skills :- 8+ years of proven experience as a Lead in Big Data Engineering. - Mandatory Technical Proficiency - Hands-on experience with Python... ...computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark. - Proficient in Data Modelling that can...
Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain... ...updated with emerging technologies and best practices in data engineering, and proactively identify opportunities for process optimization...
...infrastructure, security, and other partners.- 3-5 years in an engineering role.- 1-3 years participating in agile development.- Scrum certification... ...in elastic search is mandatory.- 3-5 Years of experience in Hadoop & Elastic Search mandatory.- 3-5 Years of experience in Spark is...
...Position - Hadoop Developer Location - Pune/Hyderabad/Gurgaon/Bangalore (Hybrid)
Experience - 5+
We are looking for a talented Hadoop Developer - Data Engineer to design, develop, and maintain our big data infrastructure. The ideal candidate will have a strong background...
...working towards design, architecture, development, and operationalization of Data Engg & AI/ML models across Big Data Ecosystem (PySpark, Hadoop, Snowflake, Python) - Experience in architecture, design, and implementation of data intensive applications for practical use-cases-...
...highly skilled Data Science team. Lead on projects from a data engineering perspective, working with our clients to model their data landscape... ...of experience, with at least 3+ years in Big Data technologies (Hadoop / Spark / Relational DBs) and similar experience in working on...
...extraordinary and make a real difference for companies and the planet .
About the role....
Managing, Installing & config. of Hadoop (hive, hdfs, Ambari & Nifi) . Designing the architecture and to integrate with o9 Product. Involved in Hadoop maintenance & monitoring...
Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed... ...in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java...
