Average salary: Rs398,750 /yearly
More statsSearch Results: 1,331 vacancies
...building efficient data pipelines using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory, Informatica,... ...in data engineering tools- Programming Languages - SQL, Python- Technologies - Spark/ Azure Data factory /Azure Data Lake Storage...
...Systems, Mathematics, Computer Engineering, ManagementSkills for Lead Data Engineer :Desired skills for lead data engineer include :- Python- Spark- Java- Hive- SQL- Hadoop architecture- Large scale search applications and building high volume data pipelines- Message queuing-...
...Should have good working experience on :- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Spark - Batch Processing- Setting ETL pipelines- Python or Java programming language is mandatory.- Worked in data Lake , Data warehousing Domain in Cloud...
Rs 12 - 16 lakhs p.a.
...process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Microsoft SQL Server,Unix to Linux Migration... ...Experience : A:Should have Excellent development experience with Python producing data applications B:Should have 8 years of experience using...
Rs 7 - 15 lakhs p.a.
...Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good To Have Skills : Python Programming Language Job Requirements : Key Responsibilities: a Lead the team and contribute to the design and build of...
Rs 12 - 16 lakhs p.a.
...process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key Responsibilities... ...categories and best practices C: Experience with Java essential Python, and R highly desired D: Experience with Apache Spark streaming...
Rs 12 - 20 lakhs p.a.
...acting as the primary point of contact. Must have Skills : Apache Spark Good to Have Skills : No Technology Specialization Job... ...Creation of simple data model as data product 4 Strong Knowledge in Python 5 Strong Knowledge of Spark Applications lifecycle 6 Exposure to...
Job Description :Skills : Python , Pyspark, Azure data bricks, data factor, data lake, SQL.- Deep knowledge and experience working with Python/Scala and Spark- Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow.- Experience...
...years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from... ...variety of sources such as flat files relational databases and APIs- Python scripting with focus on data transformation and manipulation...
Rs 7 - 11 lakhs p.a.
...Description : Design, build and configure applications to meet business process and application requirements. Must Have Skills : Apache Spark Good To Have Skills : Job Requirements : Key Responsibilities: AStrong experience in creating ScalaSpark jobs for data transformation...
Rs 20 - 21 lakhs p.a.
...Responsibilities
Roles And Responsibilities Of Cloudera & Spark Developer
Secure data management and portable cloud-native data analytics... ...cluster from external sources such as Oracle, SQL etc.
Strong Python with Pyspark experience is MUST
Should be able to demonstrate...
Key Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for...
Rs 8 - 20 lakhs p.a.
...Skills Required: Python + AWS/Airflow (Candidate should be very good in Python) Spark, SQL.
Experience: 3-8 years
Salary: 8 to 20 LPA
Location: Bangalore
No. of positions: 4 (2 SSE, 2 TC)
Job Description
Role requires experience in AWS...
...Must have Skills: Apache Spark
Good to Have Skills: Data Warehouse ETL Testing
Key Responsibilities:
A: The resource will write and review complex SQL statements
B: The resource will work on ETL preferably on OWB
C: The resource will work on...
Job Description :Technical Expertise :- Should have experience of working on Microsoft Azure tools like Spark, Databrick, Synapse (knowledge of these will be an added advantage).- Should be very strong on BI and EDWH concepts.- Must have good experience on working on Microsoft...
...NCRNotice Period - Max 30 daysJob Description : We are looking for an experienced MLOPs Engineer with expertise in Spark/PySpark, MLOps/LLMops/DLOps, CI/CD, Kafka, Python, distributed computing, GitHub, data pipelines, cloud hosting, Azure services, Microsoft services, various...
...Candidate should have worked in at least one Production project, not only understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at least good POC experience. At least basic knowledge of Spark with Java or Scala4. HIVE, SQL, HDFS, SQOOP - hands on...
...dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly scalable... ..., etc.- Object-oriented/object function scripting languages: Python, Scala, etc.- Visualization tools- Tableau, Power BI, Qlik etc.What...
...Common Skillsets : - 5+ years of experience in analytics, Oracle, ETL, Python and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala- Experience with AWS services - Glue, Lambda, EMR, Redshift, RDS-...
...build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big Data using Spark.At least...
