Average salary: Rs2,183,333 /yearly
More statsGet new jobs by email
- ...ROLE SUMMARY We are seeking a highly skilled PySpark Developer with hands-on experience in Databricks to join Sompo's IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions...Suggested
- ...data extract, transformation and load steps conform to specified exit criteria and standards. Design and execute test scenarios, develop, and document data test plans based on requirements and technical specifications. Identify, analyze, and document all defects. Perform...Suggested
- ...delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to the organizational guidelines and...Suggested
- ...relevant minimum 5+ years) Detailed job description - Skill Set: Technical Lead Candidate should have good hands on experience in Pyspark preferrable more than 7 years. Should have very good understanding of Agile development methodologies and excellent team handling...Suggested
- ...consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline...Suggested
- ...Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration...Suggested
- ...Develop and optimize scalable data pipelines using Databricks and Apache Spark. Design and implement solutions for data integration,... ...manage ETL processes in Databricks. Write optimized Spark SQL and PySpark code for data transformations. Work with large datasets and...Suggested
- ...by designing and implementing robust ETL pipelines. Creating PySpark scripts both generic templates and scripts tailored to specific... ...data processes. Collaborating with cross-functional teams to develop scalable and maintainable data integration architectures. Strong...Suggested
- ...We're Hiring: PySpark Developer (Databricks) Experience: 4+ Years in Data Engineering / Distributed Systems Location: Offshore (Sompo IT Systems Development Unit) Joiners: Immediate Budget: Competitive Role Summary: Design, build, and optimize large-scale...SuggestedImmediate start
- ...: Experience using Git for collaborative development. Big Data Tools: Exposure to Hive, PySpark , or similar technologies. Roles & Responsibilities Develop and optimize Python scripts for data processing and automation. Write efficient Spark SQL...Suggested
- ...Technical Experience : Experience 5 yrs of Hands on Exp of Pyspark AWS Glue Python SQL Experience in Leading a team managing Delivery Understanding of Development LifeCycle CICD Pipelines Experience around Working with Agile Practices JIRA Experience in...Suggested
- ...Job title : Python, Pyspark Developer with Databricks Skills : Python, Pyspark, Databricks, SQL, Azure Experience Required : 8-10 Location : Indore, Pune Notice Period : Immediate to 15 days, Serving notice Overview: We are seeking a highly skilled Python...SuggestedImmediate start
- ...Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop high-quality code...Suggested
- ...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations. Experience...Suggested
- Role: Spark Scala Developer Experience: 3-8 years Location: Bengaluru Employment Type: Full-time ⸻ What We're Looking For We're hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You...SuggestedFull time
- ...Data Engineering (PySpark): Design, develop, and optimize robust ETL pipelines using PySpark . Handle large volumes of structured and unstructured data. Implement data quality checks, deduplication, and validation logic. Integrate data from multiple sources...Permanent employmentFull time
- ...We are looking for a Lead ETL Developer to join our C3 Data team based in Bangalore. This role offers a unique opportunity to work on Clarivate... ...-edge big data technologies. Our team has expertise in Python, PySpark, Spark, Databricks, ECS, AWS, and Airflow -- and we would love...
- We are looking for a skilled Python PySpark Developer with 34 years of experience in designing, developing, and maintaining big data solutions. The ideal candidate will have hands-on expertise in Python, PySpark, and data pipeline development, along with strong problem-solving...
- Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It's a chance to hone your existing technical...Permanent employmentFull time
- PySpark Developer Position Description At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and...Permanent employmentFull timeNo agency
- ...Job Title: Data Engineer – Python / PySpark Number of Position: 4 Experience: 3 to 10 years Location: Pune (Client - USA) Work Model: Full-time, hybrid work, 3 days/week in office(Client location.) Job Type: Contract-to-Hire Client Domain: Utilities...Full timeContract workHybrid workWork at office3 days week
- ...of the project / customer. Facilitate in Technical Aspects Develop and evolve highly scalable and fault-tolerant distributed... ...Python is a must. ~ Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch. ~ Development and support experience...
- ...Must-Have Skills Good experience in Pyspark - Including Dataframe core functions and Spark SQL Good experience in SQL DBs - Be able to write queries including fair complexity. Should have excellent experience in Big Data programming for data transformation and aggregations...
- ...maintain and improve our data infrastructure, which enables us to develop market research products and delivery data to our customers. In... ...procedures, Snowflake and dbt. ~5+ years of experience with PySpark to design, optimize and scale distributed data processing pipelines...Full timeFlexible hours
- ...Azure). Strong knowledge of Azure SQL, Data Lake, Data Factory, PySpark, and related services. Experience in Spark Optimization.... ...synchronization (Azure SQL, Data Lake, Data Factory, PySpark, etc.). Develop solutions for secure handling of PII and non-PII data, ensuring...
- Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation... ...ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and...Immediate start
- ...skilled Senior Data Engineer with a strong background in Python, PySpark, Hive , and distributed data processing frameworks. The ideal... ..., Concentrix, UST Global . Key Responsibilities Design, develop, and maintain efficient and scalable big data pipelines using Python...
- ...apply now. We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN).... ...Collaborate seamlessly across diverse technical stacks, including AWS. Develop and deliver detailed presentations to effectively communicate...Long term contract
- ~ Build up data pipelines for consumption by the data science team. ~ Clear understanding and experience with Python and PySpark. ~ Experience in writing Python programs and SQL queries. ~ Experience in SQL Query tuning. ~ Build and maintain data pipelines in...Remote job
- ...successful as a Data Engineer you should have experience with: Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on Experience in developing, testing and maintaining applications on AWS Cloud. Strong hold on AWS Data Analytics...Immediate start