Average salary: Rs1,021,986 /yearly
More statsGet new jobs by email
- ...big data technologies.- Strong skills in Python for data processing and automation.- Experience with streaming data pipelines (Kafka, Spark Streaming).- Past experience of developing or enhancing Cloud and data flow Architecture, including Data Engineering pipelines, refreshes...Suggested
- ...Work with cloud platforms such as GCP, AWS, or Azure.Required Skills & Development Practices :- Strong experience with Scala and Apache Spark.- Experience with large-scale data engineering solutions.- Knowledge of Agile development practices including :1. Iterative...SuggestedHybrid workShift work
- ...Development & Optimization :- Build Scalable Pipelines: Design, develop, and maintain robust ETL/ELT pipelines using Scala and Apache Spark/Flink (Core, SQL, Streaming) to process massive datasets with low latency.- Performance Tuning: optimize Spark jobs and SQL queries for...Suggested
- ...architecture across ingestion, transformation, storage, and analytics- Design and scale batch and streaming pipelines using Python, Airflow, Spark / PySpark, Kafka, dbt, and Debezium- Architect and optimize data models across MongoDB, ClickHouse, and OpenSearch for high-volume...Suggested
- Description :We are seeking an experienced Spark Developer to design, develop, and optimize big data solutions using Apache Spark. The ideal candidate will have strong expertise in distributed data processing and a solid understanding of the Hadoop ecosystem.Education :- B....Suggested
Rs 5 - 10 lakhs p.a.
...frameworks. Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs. Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations. Data Analysis...SuggestedPHOTON
Kolkatta7 days ago- ...demonstrated through one or a combination of the following: work experience, training, military experience, education ~3+ years of Spark experience ~3+ experience on Abinitio ~3+ years of Python or other scripting language ~3+ years of data warehouse experience ~...Suggested
The Wells Fargo Foundation
Bangalore6 days ago Rs 4 - 7 lakhs p.a.
...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using Pyspark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations. Create...SuggestedFusion Plus Solutions
Secunderabad9 days ago- Hi Jobseeker, We are hiring Python Spark Developer for our MNC client. Location-Pune, Hyderabad Interview Mode- Virtual Experience- 4yrs to 9yrs Notice Period- only immediate to 15days We are looking for a Data Engineer with experience in Python , Spark...SuggestedImmediate start
Natobotics
Pimpri2 days ago - ...institutional sales/equity research or a related role within the financial services or investment management industry. About Avendus Spark : Avendus Spark Institutional Equities is India's leading Domestic institutional brokerage house. Trusted by 400+ institutional...Suggested
Avendus
Chennai1 day ago - ...Azure data engineering Strong expertise in building ETL/ELT pipelines using Azure Data Factory Proficient in Azure Databricks and Spark programming (Python/Scala) Experience with Delta Lake architecture and optimization Strong knowledge of Apache Kafka for...SuggestedFull timeHybrid workImmediate start
Deqode
Pune1 day ago - BigData Developer(Spark) Position Description At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading...SuggestedPermanent employmentFull timeNo agency
- ...Key Responsibilities Design, develop, and maintain backend services leveraging Java along with Apache NiFi and Apache Spark for data integration and processing. Build and optimize data pipelines to facilitate the flow of data between systems efficiently. Implement...SuggestedFull time
- ...Talent Worx is thrilled to announce an exciting opportunity for the roles of Snowflake and Spark Developers! Join us in revolutionizing the data analytics landscape as we partner with one of the Big 4 firms in India. What impact will you make? Your contributions will...Suggested
- ...engineering, with a strong focus on large-scale data platforms and data products.- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java programming language.- Experience leading and managing teams of data engineers-...Suggested
- ...Architecture & Technical Leadership : - Define the target-state data architecture for Nike's unified analytics platform using Databricks, Spark, and AWS-native services.- Own and execute the Snowflake divestiture strategy, ensuring zero residual footprint and seamless...Immediate start
- ...Cline, LLMs, Claude, and related AI-assisted engineering platforms. The ideal candidate will bring deep technical expertise in Hadoop, Spark, Kafka, Big Data technologies, Java 8+, distributed systems, and API-driven application development, along with demonstrated strength...Full timeHybrid workWork at officeLocal areaShift work
Rs 7 - 12 lakhs p.a.
...Java-based applications using the Spring framework. Batch Data Processing: Design and implement batch processing solutions using Spark Batch for large-scale data processing. Real-Time Data Processing: Build and maintain real-time data pipelines using Spark Streaming...RARR Technologies
Bangalore9 days agoRs 3 - 15 lakhs p.a.
...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations....Phygital Insights
Bangalore16 days agoRs 8 - 10 lakhs p.a.
...production rollout and infrastructure configuration Demonstrable experience of successfully delivering big data projects using Kafka, Spark Exposure working on NoSQL Databases such as Cassandra, HBase, DynamoDB, and Elastic Search Experience working with PCI Data...Long term contractIfintalent Global Private Limited
Pune7 days ago- ...Responsibilities Executes standard software solutions, design, development, and technical troubleshooting Building pipelines in spark, tuning spark queries Writes secure and high-quality code using the syntax of at least one programming language with limited guidance...
Jpmorgan & Co
Secunderabad2 days ago Rs 20 - 35 lakhs p.a.
...understanding of software engineering principles Excellent analytical and troubleshooting skills Mandatory Skills (Specific Role): Spark & Scala HQL / SQL Scheduling tools (Oozie / Control-M) Shell scripting / Python Tools & Technologies: HUE Hive...Matrix Hr Technologies Private Limited
Bangalore8 days ago- ...be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave. Join us Spark Java Developer Barclays which will be helping us build, maintain and support the all First line of controls applications. The...
- ...Scrapping.- Understanding of databases like No Sql , relational database, In Memory database and technologies like MongoDB, Redis, Apache Spark would be add on..- Knowledge of distributed computing frameworks and big data technologies (e.g., Hadoop, Spark) is a plus.- Excellent...
- ...Join us as a BigData Quality Analyst - Spark, Scala, AWS at Barclays where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable...Permanent employmentImmediate start
- ...architecture across ingestion, transformation, storage, and analytics.- Design and scale batch and streaming pipelines using Python, Airflow, Spark / PySpark, Kafka, dbt, and Debezium.- Architect and optimize data models across MongoDB, ClickHouse, and OpenSearch for high-volume...
- ...Engineering, or equivalent ~ Proficiency in Python ; working proficiency in Scala. ~ Strong experience with Big Data processing (Spark, Databricks) and event streaming (Kafka). ~ Experience with orchestration and platform tooling such as Airflow ; ability to...Full timeLocal areaFlexible hours
NielsenIQ
Chennai2 days ago - ...JOB DESCRIPTION ~ Develop, test, and deploy data processing applications using Apache Spark and Scala. ~ Optimize and tune Spark applications for better performance on large-scale data sets. ~ Work with the Cloudera Hadoop ecosystem (e.g., HDFS,...Full timeFor contractors
Photon Interactive Private limited
India18 days ago - ...About the Role We are seeking a highly skilled and experienced Senior Software Engineer with expertise in Python, Databricks, Scala, Spark, and Azure to join our dynamic team. The ideal candidate will have a solid background in designing and developing large-scale data...Contract workShift work
Optum
Chennai18 days ago Rs 8 - 10 lakhs p.a.
...Job description * Design and implement efficient data handling system based on Java and Spark. * Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL queries. * Implement data stores that support the scalable processing...PHOTON
Chennai7 days ago
