Average salary: Rs1,815,208 /yearly
More statsSearch Results: 4,178 vacancies
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble... ..., dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly...
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
Responsibilities : - Design and implement scalable data pipelines and engineering infrastructure to support machine learning systems at scale.-... ...Azure, AWS, GCP).- 2 years of experience in Python, Databricks/Hadoop.- 2 years of experience in MLOps.Good to have :- Curiosity,...
...: Skills :- 8+ years of proven experience as a Lead in Big Data Engineering. - Mandatory Technical Proficiency - Hands-on experience with Python... ...computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark. - Proficient in Data Modelling that can...
What are we looking for?- Bachelor in Computer Science, Engineering, Statistics, Maths or related quantitative degree.- 4-5 years of relevant... ...and technologies.- Familiarity with big data technologies like Hadoop and Spark.- Excellent communication and collaboration skills.- Strong...
Rs 5 - 30 lakhs p.a.
...Mumbai, Mumbai Suburban, Salary Range: Competitive, Employee Count: 51-200
Qualifications and Skills
~4-6 years of experience in Hadoop administration
~ Proficiency in NoSQL databases like MongoDB, HBase, Cassandra, Couchbase
~ Strong knowledge in Hadoop ecosystem...
...for reuse of data models in new environments.- Perform reverse engineering of physical data models from databases and SQL scripts.- Evaluate... ...Collibra, Alteryx and Solidatus- Experience in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
Job Description :1. Technologies should be Hive, PIG, Sqoop, Zookeeper,Cloudera - these are Hadoop Ecosystem tools2. Candidate should have worked in at least one Production project, not only understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at...
...Build the future of data. Join the Snowflake team.
The Sales Engineer will work hand-in-hand with Sales, Product, Engineering, and Marketing... ...technology (e.g. Netezza, Exadata, Teradata, Greenplum, Hadoop etc.)
Experience and track record of success selling data and/...
...Data Engineer Company Name: Blackstraw.ai
Office Location: Delhi (Work from Office)
Job Type: Full-time
Experience: 4+ Years... ...and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
● Experience in writing Python programs...
...Exciting Opportunity for the role of Data Engineer with one of the Largest Travel Domain Expert(Immediate joiners preferred) Exp:7+ Years... ...mart creation.
Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
Strong problem-solving skills and attention...
...record of academic excellence in Mathematics, Computer Science, Engineering, Physics, or similar. ·
8+ years of relevant experience in Data... ...Airflow and Nifi.
o Large Scale/ Big Data technology, such as Hadoop, Spark, Hive, Impala, PrestoDb, Kafka.
o Fast and distributed...
...Data Engineer
Office Location: Delhi (Work from Office)
Job Type: Full-time
Experience: 3+ Years
Job Description:
We are... ...and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
Experience in writing Python programs...
...Cloud Function.
~ Strong experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark including DevOPs.
~ Good hands on expertise... ...of GCP core services like Google cloud storage, Google compute engine, Cloud SQL, Cloud IAM.
~ Good to have knowledge on GCP services...
...Strong understanding of data structures, algorithms, and software engineering principles.
Proven experience in training, configuring, and... ...interpret data
Familiarity with big data technologies such as Hadoop and Spark.
Experience with cloud platforms such as AWS,...
...Knowledge, Skills and Abilities :- Proven experience working as a data engineer- Highly proficient in using the spark framework (python and/or... .../azure cloud factory)- Experience with big data technologies (Hadoop)- Experience with ingestion tools (nifi/azure cloud factory-...
Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities... ...Mandatory experience.- Big Data Technologies: Familiarity with Hadoop, Kafka, and Hive.- SQL: Strong knowledge.- Problem-Solving:...
...LPAExcellent Communication Skills :Skillsets : - Snowflake Data Engineer. Candidates should have hands on exp on snowflake features and all... ...- Good knowledge of data base management and SQL, Good to have- Hadoop/Spark, HIVE- Superior analytical and problem solving skills -...
.... He/ She will work with different stakeholders as SME for data engineering- Engages in technical problem solving across multiple technologies... ...on model evolution- Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise).- Superior analytical and...
...experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.
~ Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.
~ Exposure to enterprise application development is a must.
Roles...
