Get new jobs by email
- Senior Data Engineer – Azure, Airflow & PySpark We're hiring a Senior Data Engineer (6–9 years of experience) to lead the modernization of our data ecosystem from legacy platforms (Azure Synapse, SQL Server) to a next-gen Microsoft Fabric lakehouse. If you bring deep Azure...Suggested
- ...- Minimum 5 years of experience in data analytics field- Experience with Azure/AWS Databricks- Experience in building... ...experience in Scala or Python, PySpark and SQL- Ability to troubleshoot and... ...apply to a big data environment- Data Engineering expertise in Big Data Management...Suggested
- Description :We are seeking a strong Data Engineer with advanced expertise in Databricks and PySpark. The successful candidate will be a key contributor to critical projects... ...data pipelines, and orchestrating workflows in Azure Databricks.Key Responsibilities :- Migrate Palantir...Suggested
- ...develop, and implement robust and scalable data pipelines using Azure Data Factory (ADF) . Efficiently... ...and scripts primarily using Python and PySpark . Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and...Suggested
- ...and community. We are hiring a talented Pyspark to join our team. If you're excited to... ...seeking a skilled and experienced PySpark Data Engineer (ETL Lead) to join our growing data... ...data pipeline orchestration tools (e.g., Airflow, Azkaban) is a plus. Experience with...Suggested
- Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to... ...years of experience in PySpark, AWS Data Engineering eco Systems like Athena, Glue... ...You'll also need experience working with AirFlow. You'll Also Need Experience of working...SuggestedPermanent employmentFull time
- ...Position Summary We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, data lakes, and... ...analytics. The ideal candidate has strong experience with PySpark, Microsoft Azure Fabric, and modern data engineering tools. Key Responsibilities...SuggestedLong term contractHybrid work
- ...Software Development, Big Query, TERRAFORM, Data Fusion, Cloud SQL, GCP, KAFKA Bachelor... ..., Tekton, Cloud SQL, Redis Memory, Airflow, Cloud Storage 2+ Years in Data Transfer Utilities... ...4+ years of strong experience in python, Pyspark development. 4+ years of shell scripting...Suggested
- Join us as a Data Engineer We're looking for someone to build effortless, digital first customer experiences to help simplify... ...fundamentals Experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow Good knowledge of modern code development practices...Suggested
- ...Join us as a Data Engineer - Pyspark at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence... .... Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage. Knowledge on Ab-...SuggestedImmediate start
- ...Responsibilities Strong expertise in PySpark and Apache Spark for batch and real-time data processing. Experience in... ...with scheduling tools like Airflow or Control-M to orchestrate workflows... ...Spark,Python,ETL,Unix,Linux,data engineering,Agile methodologies,CI/CD,data modeling...Suggested
- ...seeking a highly skilled and experienced Big Data Engineer with 5+ years of relevant experience... ...strong expertise in Python, SQL, Spark/PySpark, and AWS Cloud . You will play a... ...routines using workflow scheduling tools like Airflow. DevOps Practices: Understand and...SuggestedFlexible hours
- ...Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS... ...and OyC. Exposure to orchestration tools (Airflow, Databricks Workflows). Scala experience is...Suggested
- ...Technical Skills Cloud Platforms: Azure (Databricks, Data Factory, Data Lake Storage, Synapse Analytics... ...). Data Processing: Databricks (PySpark, Spark SQL), Apache Spark. Programming Languages: Python, SQL Data Engineering Tools: Delta Lake, Azure Data Factory,...SuggestedPermanent employmentFull time
- ...working experience in Python, Pyspark, AWS and SQL. Programming &... ...joins, window functions) Big Data & Processing: PySpark for... ...EMR, Redshift, Athena) Data Engineering: Data pipeline design, data ingestion... ...Other Nice-to-Have: Airflow (or other orchestration tools)...Suggested
- Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy... ...with: Hands on experience in pyspark and strong knowledge on Dataframes, RDD... ...Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage....Immediate start
- ...We are seeking a skilled Data Engineer with hands-on experience in Databricks and PySpark to design and implement scalable data pipelines and analytics solutions.... ...data warehouses on cloud platforms (preferably Azure , AWS , or ). Implement scalable and optimized...
- ...building, and maintaining the infrastructure required for data integration, storage, processing, and analytics (BI... ...). We are looking for a skilled Senior Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps and...Full timeContract workLocal areaRemote jobWorldwide
- ...Design, develop, and optimize big data pipelines and ETL workflows using PySpark , Hadoop (HDFS, MapReduce, Hive,... ...and orchestration using tools like Airflow , Cloud Composer , or similar.... ...'s degree in Computer Science, Engineering, or related field. ~3+ years of...
- ...About The Role We are actively hiring a Data Engineer (SDE2 level) with strong expertise in Core Python, PySpark, and Big Data technologies to join a high-performance... ...Integration (Bonus) Exposure to cloud platforms such as Azure or AWS is a plus. Understanding of cloud...Hybrid work
- ...for you to take your software engineering career to the next level. Job... ...reporting from large, diverse data sets to improve applications and... ...Strong programming skills in PySpark and SparkSQL. Proficient in orchestration using Airflow. In-depth knowledge of Big Data...
- ...Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL JOB LOCATION : Kolkata/Pune/Mumbai/Bangalore/BBSR EXPERIENCE REQUIREMENT : 4+ Technical Skill Set : Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL Must have...Flexible hours
- ...business.With expertise is in the fields of Data, IoT, AI, Cloud Infrastructure and SAP, it... ...and problem solving.Job Profile : Data Engineer.Location : Pune.Employment Type : Full-time... ...extensively on Databricks and its modules using PySpark for data processing.- Designs, Develops,...Full timeShift work
- Join us as a Software Engineer, PySpark And AWS This is an opportunity for a driven Software Engineer to take on an exciting new... ...years of experience in Pyspark, AWS, Sql, Python, AWS, Data Orchestration like Airflow. You'll also need experience in Banking domain and Basel...Permanent employmentFull time
- ...Years of experience 8 to 10 Years Experience in Perform Design, Development & Deployment using Azure Services ( Databricks, PySpark , SQL, Data Factory,) Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume...
- Description :Were Hiring : Azure Data Engineer.Preferred Locations : Gurgaon & Bangalore.Open To : PAN India.Experience : 8 12 Years.Notice Period... ...Lake, Data Factory, Data Bricks.- Big Data Tools: Spark, PySpark.- Programming: Python, SQL, Java (good to have).- Data Modeling...Immediate start
- ...Join us as an Application Engineer - PySpark Developer at Barclays, where you'll take part in the... ...Hands-on programming experience in a Big Data Hadoop ecosystem. Proficiency in PySpark... ...with scheduling tools like AutoSys, airflow. Strong understanding of Agile methodologies...Immediate start
- ...We are looking for a Lead ETL Developer to join our C3 Data team based in Bangalore. This role offers a unique opportunity... ...data technologies. Our team has expertise in Python, PySpark, Spark, Databricks, ECS, AWS, and Airflow -- and we would love to speak with you if you have...
- ...technical expert and a lead member of our Engineering team.- Designing and building data pipelines from data ingestion to... ..., Hive, & Data Lake, using Hive, PySpark and Python Programming.- Develop... ...workflow orchestration tools like Apache Airflow design and deploy DAGs.- Location :...Hybrid work
- ...DATAECONOMY: We are a fast-growing data & analytics company... ...skilled and experienced Senior Data Engineer to lead the end-to-end development... ...optimize ETL pipelines using PySpark for large-scale data... ...years of experience with Apache Airflow for workflow orchestration....Hybrid work
