Average salary: Rs370,000 /yearly
More statsSearch Results: 10,222 vacancies
...for?- Bachelor in Computer Science, Engineering, Statistics, Maths or related quantitative... ...4-5 years of relevant experience in data modeling.- Proficiency in data... ...and technologies.- Familiarity with big data technologies like Hadoop and Spark.- Excellent communication and...
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal... ...of data sources using SQL and AWS - big data technologies- Build analytics tools... ...also have hands-on experience of using many software/tools such as :- Advanced SQL and...
Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data... ...proficiency.- Spark Streaming: Mandatory experience.- Big Data Technologies: Familiarity with Hadoop, Kafka...
...Good understanding of the Apache Hadoop open-source eco-systems, tools... ...of multithreading concepts, data structures and algorithms, maven... ...).
Docker/K8s/GCP will be a big plus point.
Cassandra/Kafka/... ...Working knowledge of Storm, Kafka, Spark
Excellent verbal, written...
Basic :- Excellent skills on SQL and Advance Level SQL.- Knowledge of Big Data Processing Cluster (Azure HDInsight / AWS EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-SQL/ PY-Spark/ Azure Data Factory/ AWS Glue etc.- Working Experience on Jupyter...
...Description : Skills :- 8+ years of proven experience as a Lead in Big Data Engineering. - Mandatory Technical Proficiency - Hands-on experience with... ...computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark. - Proficient in Data Modelling that can...
...Technologies should be Hive, PIG, Sqoop, Zookeeper,Cloudera - these are Hadoop Ecosystem tools2. Candidate should have worked in at least one... ...understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at least good POC experience. At least basic...
Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance... ...stakeholders as SME for data engineering- Engages in technical problem solving... ...with managing and transforming big data sets using pyspark, spark-scala- Experience with AWS services -...
...for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL... ...using industry best practices- Manage team of data engineers (both full-time associates and/or third party resources)- Own...
Position : Data EngineerLocation : GurgaonExperience : Min 4+ yearsRole & Responsibilities... ...using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory... ...Databricks notebooks and scripts.- Lead Data Engineering Projects to manage and implement data-...
...Experience :- Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required...
...Collaborate with enterprise architects, data architects, developers & engineers, data scientists, and information... ...performance and scalability.
Experience in Spark, Elastic Search, Caching, SQL... ...level.
Hands-on experience in Big Data technologies – Hadoop, Sqoop, Hive...
...:- 10+ years of experience in software development and delivery.- 5 to... ...work experience on large-scale Data applications- Good aptitude, strong... ...good working experience on :- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Spark - Batch Processing- Setting ETL...
...Description :Work with a team of high-performing Data Scientists and cross-functional teams to... ...tools (R, Python, KNIME, etc.) and use big data technologies- Knowledge of business... ...and ability to use Big data technologies (Hadoop, Spark, Kafka, Presto etc) and Cloud computing services...
...in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and... ...Proficiency in SQL and database management.- Experience with big data technologies such as Hadoop, Spark, or Kafka.- Strong problem-solving and...
Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements... ..., and implementing Azure Cloud based big data solutions for clients. Your role... ...distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink...
Role : Lead Data EngineerExperience : 7+ YearsNotice Period : Immediate to 15 Days.Location... ...and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL... ...understanding and hands-on experience of Data engineering pipeline management tools such as Airflow-...
Data Modeler Responsibilities : As a data modeler, you will be responsible to understand... ...in new environments.- Perform reverse engineering of physical data models from databases... ...in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have... ...Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And...
