Average salary: Rs1,534,062 /yearly
More statsSearch Results: 1,215 vacancies
Job Title: Data Engineer (Spark, Scala, Java)Location: Gurgaon (Hybrid Mode).Experience: 4-10 Yrs.Job Description:We are seeking a highly skilled Data Engineer with expertise in Apache Spark, Scala, and Java to join our dynamic team. The ideal candidate will have a strong background...
...or Google Cloud.- Experience with data warehousing concepts and technologies.- Familiarity with big data technologies like Hadoop and Spark.- Excellent communication and collaboration skills.- Strong analytical and problem-solving skills.- Attention to detail and a commitment...
...Production project, not only understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at least good POC experience. At least basic knowledge of Spark with Java or Scala4. HIVE, SQL, HDFS, SQOOP - hands on experience5. Spark, Spark SQL, Spark Spring, Kafka...
Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data pipelines using Databricks and PySpark.- Implement and manage real-time data processing with Spark Streaming...
...Enterprise reporting systems, relational (MySQL, Microsoft SQL Server etc.).- Knowledge and ability to use Big data technologies (Hadoop, Spark, Kafka, Presto etc) and Cloud computing services in Azure/AWS/GCP for data engineering, ML Ops- Ability to delivery, strong...
...stewards / data custodians / end users etc- Demonstrated experience of building efficient data pipelines using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.- Understand the need for both batch and stream ingestion...
Rs 12 - 16 lakhs p.a.
...business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key... ...theories, structures, categories and best practices C: Experience with Java essential Python, and R highly desired D: Experience with Apache Spark...
...Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor's degree in computer science or related field. - 7+ years...
...contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in... ...Engineer :Desired skills for lead data engineer include :- Python- Spark- Java- Hive- SQL- Hadoop architecture- Large scale search applications...
...have good working experience on :- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Spark - Batch Processing- Setting ETL pipelines- Python or Java programming language is mandatory.- Worked in data Lake , Data warehousing Domain in Cloud Environment- Exposure...
Key Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for...
...SQL.- Knowledge of Big Data Processing Cluster (Azure HDInsight / AWS EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-SQL/ PY-Spark/ Azure Data Factory/ AWS Glue etc.- Working Experience on Jupyter Notebook / Zeppelin.- Experience on Implementing...
Rs 12 - 16 lakhs p.a.
...Description : Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Microsoft SQL Server,Unix to Linux Migration,Data Warehouse ETL Testing,Amazon Web Service Job Requirements :...
Rs 7 - 15 lakhs p.a.
...Description : Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good To Have Skills : Python Programming Language Job Requirements : Key Responsibilities: a Lead the team and contribute to the...
Rs 7 - 11 lakhs p.a.
...Description : Design, build and configure applications to meet business process and application requirements. Must Have Skills : Apache Spark Good To Have Skills : Job Requirements : Key Responsibilities: AStrong experience in creating ScalaSpark jobs for data transformation...
...Mumbai, Pune, Nagpur, Indore, Delhi/NCR, Ahmedabad.Job Description :- 6+ years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs-...
...Skills : Python , Pyspark, Azure data bricks, data factor, data lake, SQL.- Deep knowledge and experience working with Python/Scala and Spark- Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow.- Experience working with...
Rs 12 - 20 lakhs p.a.
...Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have Skills : Apache Spark Good to Have Skills : No Technology Specialization Job Requirements : Key Responsibilities : 1 Set-up and configure data bricks for an...
Rs 20 - 21 lakhs p.a.
...Responsibilities
Roles And Responsibilities Of Cloudera & Spark Developer
Secure data management and portable cloud-native data analytics delivered in an open, hybrid data platform. Whether you're powering business-critical AI applications or real-time analytics at scale...
...data modeling, ETL processes, and building both batch and streaming pipelines. The candidate should also possess advanced proficiency in Spark, Databricks, Kafka, Python, SQL, and Change Data Capture (CDC) methodologies.Key responsibilities :- Design, develop, and maintain...
