Get new jobs by email
- ...Spark/Python/Pentaho Developer, AS Position Overview Job Title: Spark/Python/Pentaho Developer Location: Pune, India Role Description Spark/Python/Pentaho Developer. Need to workon Data Integration project. Mostly batch oriented using Python/Pyspark/...SuggestedFlexible hours
- ...Design Mentor more junior members of the engineering team to develop and perform as highly as possible Comply with the terms and... ...6+ years of production experience with AWS cloud technologies, Python, Spark/Pyspark. ~3+ years of solid experience designing and building...SuggestedContract workShift work
Rs 4 - 7 lakhs p.a.
...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using Pyspark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations. Create...SuggestedRs 3 - 15 lakhs p.a.
...The developer must have sound knowledge in Apache Spark and Python programming. Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations. Experience...SuggestedRs 5 - 6 lakhs p.a.
...experience in Data Engineering Desired Knowledge & Experience ~Spark: Spark 3.x, RDD/DataFrames/SQL, Batch/Structured Streaming ~... ...Partitioning, Distribution, Data Skew, Compaction ~Languages: Python/Functional Programming (FP) ~SQL TSQL/Spark SQL/HiveQL ~Storage...Suggested- Python&spark developers with snowflake exp, preferred with airflow Location: Hyderabad client: TechM End client: Creditone Exp:4-5 yrs exp Python&spark developers with snowflake exp, preferred with airflow Location: Hyderabad client: TechM End...Suggested
- Hi Jobseeker, We are hiring Python Spark Developer for our MNC client. Location-Pune, Hyderabad Interview Mode- Virtual Experience- 4yrs to 9yrs Notice Period- only immediate to 15days We are looking for a Data Engineer with experience in Python , Spark...SuggestedImmediate start
- ...data architecture across ingestion, transformation, storage, and analytics- Design and scale batch and streaming pipelines using Python, Airflow, Spark / PySpark, Kafka, dbt, and Debezium- Architect and optimize data models across MongoDB, ClickHouse, and OpenSearch for high-...Suggested
- ...and scalable manner. Depending on the team you join, your role may involve developing mobile features to enhance customer and client banking experiences, strategizing on leveraging Python, AWS and Spark to accelerate our trading systems, innovating payment solutions for...SuggestedFor contractors
- ...Job Description : The mandatory skills include Apache Spark with Scala, Java, or Python strong RDBMS development experience using MS SQL Server or equivalent databases such as Oracle, MySQL, or PostgreSQL Linux with shell scripting Python strong analytical and problem...Suggested
- ...and automation. Job responsibilities Designs, develops, and maintains scalable data pipelines using Python and Big Data frameworks to support governance initiatives... ...and automation Hands-on experience with Hadoop, Spark, or similar Big Data technologies Proficiency in...Suggested
- ...Key Responsibilities Design, develop, and maintain backend services leveraging Java along with Apache NiFi and Apache Spark for data integration and processing. Build and optimize data pipelines to facilitate the flow of data between systems efficiently. Implement...SuggestedFull time
- ...About the Role: 11 About the Role : Lead Software Developer - Data Platform The Team : We are seeking a highly skilled... ...including leadership experience. ~ Strong proficiency in Python, SQL, Spark for data processing and automation and good expose to Java is...SuggestedSide jobWorldwideFlexible hours
- ...decisions. What will you be doing Design, develop, and maintain scalable data pipelines and... ...processing workflows using Databricks and Spark Develop robust ETL/ELT solutions with... ...~ Advanced proficiency in SQL and strong Python scripting skills ~ Solid understanding...SuggestedRemote job
- ...support business objectives and foster a culture of growth and inclusion. Job responsibilities Design, develop, and maintain scalable data pipelines using Python and Spark Build and optimize ETL workflows in Databricks, leveraging Delta Lake features Integrate and...Suggested
- ...Regularly provides technical guidance and direction to support the business and its technical teams, contractors, and vendors Develops secure and high-quality production code, and reviews and debugs code written by others Drives decisions that influence the product...For contractors
- ...data technologies including Athena, EMR, Spark, and Lambdas.The senior-level represents :... ...Coach and mentor engineers within the team to develop their skills and abilities- Continuously... ...- The following skills/certifications: Python, SQL, GCP- Additional nice to have skills/...
- ...approaches to build solutions or break down technical problems Develops secure high-quality production code, and reviews and debugs code... ...including error handling, retries, and idempotency. Optimize Spark jobs using best practices (predicate pushdown, broadcast joins, AQE...
- ....- Contribute to IM DnA platform development and enterprise data strategy.Required Skills : - Strong knowledge of ETL tools, SQL, Python, Spark.- Experience with cloud platforms (Azure/AWS/GCP).- Familiarity with data modeling, metadata management, and governance practices....
- ...architecture for Nike's unified analytics platform using Databricks, Spark, and AWS-native services.- Own and execute the Snowflake... ...Platform Strategy : - Design and implement ETL/ELT pipelines using Python, Spark, and SQL, enabling large-scale data transformation and advanced...Immediate start
- ...on experience in building scalable data pipelines using Python, SQL, Scala, and Apache Spark . The ideal candidate should have deep expertise in batch... ...(GCP preferred) . Key Responsibilities ~ Design, develop, and optimize ETL/ELT pipelines for large-scale data...Freelance
- ...advanced technologies like Databricks and Spark, we help our clients unlock the full... ..., you will be instrumental in designing, developing, and maintaining robust data pipelines and... ...data pipelines using Databricks, Spark, and Python to ingest, process, and transform large datasets...Full time
- ...issues to managers and team. Leads and develops internal standards for data administration... ...of experience in writing complex SQL and Python Solid hands-on experience with data warehousing... ...to real-time/streaming platforms (Kafka, Spark Streaming, Flink) Familiarity with CI/CD...
- ...them according to the new architecture paradigm.- Integrate developed solutions with other components of the system- Working closely... ...experience in Data Engineering 5+ years :Strong knowledge of Python, Apache Spark, and Airflow with a minimum of 3+ years of practical experience...
- ...Sc. / M.Sc. in Computer Science, Computer Engineering, or equivalent ~ Proficiency in Python ; working proficiency in Scala. ~ Strong experience with Big Data processing (Spark, Databricks) and event streaming (Kafka). ~ Experience with orchestration and...Full timeLocal areaFlexible hours
- ...Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics... ..., military experience, education ~3+ years of Spark experience ~3+ experience on Abinitio ~3+ years of Python or other scripting language ~3+ years of data...
- ...scalability. Our tech stack includes Hive, Spark, Flink, Presto, Iceberg , Looker, Power... ...platforms such as Hive to Iceberg ~ Develop reliable ETL/ELT workflows to ingest,... ...in SQL and a programming language such as Python ~ Experience building data pipelines using...For contractors
- ...Job Title: Python REST API Developer Your Mission Join Global BI Development Team as we shape the future of our BI landscape in the Azure Cloud... ...Experience or interest in distributed data processing with Spark or real-time data pipelines using Kafka is a plus, but not required...
- ...opportunity for you. As a Software Engineer II - Data Engineer - Spark, Python, Databricks or AWS EMR at JPMorgan Chase within the Commercial... ...grow within your role. Job responsibilities Design, develop, and maintain scalable data pipelines and ETL processes....
- ...requirements and design efficient data models.- Develop, implement, and maintain robust and... ...Proficiency in programming languages such as Python, SQL and Web Scrapping.- Understanding of... ...technologies like MongoDB, Redis, Apache Spark would be add on..- Knowledge of distributed...
