Search Results: 603 vacancies
...Ltd is a leading consulting firm in the banking industry. We are currently seeking a talented individual to join our team as a DBT + Airflow. In this role, you will be responsible for managing and optimizing the data transformation and workflow processes for our banking clients...
...Dear Candidates,
We are hiring for the position of Airflow, Python, DBT at LTI Mindtree.
Having 6+ yrs of Data Engineering, Orchestration experience using Apache Airflow and Python.
Must be well-versed with the agile way of project execution and all scrum ceremonies...
...Principal Consultant-Airflow/Python Engineer - HMS047106
Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility...
We are seeking a highly skilled and experienced Senior Python Developer with expertise in Apache Airflow to join our team. The ideal candidate will have a strong background in Python development, with at least 5 years of experience, along with demonstrated proficiency in designing...
...: 4-8 years Location : BangaloreSkills Required : - AWS, python, ETL must have- Development experience in workflow platforms such as Airflow, Prefect, Temporal, etc- Experience in Java or Python, SQL, Postgres, Kafka- Experience working with Git, specifically working in a team...
Job Title: Senior Python Developer with Airflow ExperienceLocation: Bangalore (Work from office)Job Description:We are seeking a highly skilled and experienced Senior Python Developer with expertise in Airflow to join our team. As a Senior Python Developer, you will be responsible...
...systems and data processing with spark.Knowledge of any tool for scheduling and orchestration of data pipelines or workflows (preferred Airflow)(must to have)1+ years experience developing modern, industry standard big data frameworks with AWS or other cloud services(Must-have...
...management system performance.Qualification and Experience :- Hands-on experience in working with services/technologies like - Apache Airflow, Cloud Composer, Oozie, - Azure Data Factory, and Cloud Data Fusion (Expertise in any 2 is required)- Well-versed with Data services,...
...Masters / PhD Degree in Computer ScienceRequirements :- Atleast 5 to 8 yrs of experience in building software products. - Excellent in Airflow, Apache Spark, and other data engineering tools to automate data workflows- Expert in Python (Preferable), Scala & RDBMS & NoSQL...
...-Performance Data Products or Data Systems as a Data Architect/Engineer.Technical Skills : - Proficiency in orchestration tools like Airflow.- Proficiency in SQL and relational databases (e.g., PostgreSQL, Aurora) and NoSQL databases (e.g., MongoDB, Cassandra). - Good knowledge...
...INDIA (preferably near to Tech M office)
Experience : 6-12 Years
Key words to search for the candidate.
Mandatory – Python, Airflow, SQL, Data Modelling
Good to have but not mandatory – Healthcare Domain experience, Snowflake.
Certifications (Good to have) –...
...strategies, etc)
Deep knowledge of AWS Cloud Computing (scalability and optimization)
Knowledge of orchestration frameworks (e.g. Airflow) and containerization (e.g. Docker, Kubernetes)
Experience with automation technologies such as Terraform, Gitlab, etc....
...automation/DevOps best practices for CI/CD, IaC, Containerization, etc.
Requirements:
~ Job Title: Sr Big Data Engineer (GCP) - Airflow and Oozie
~ About the Role:
~ We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team....
...Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.
Responsibilities
Work closely with...
...Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and/or Oracle), Linux, Shell scripting, GitLab, Airflow, Cassandra & Elasticsearch.Experience in big data processing tools/languages using Apache Spark Scala.Experience with orchestration...
...experience writing SQL, structuring data, and data storage practices.
Project/Internship experience of working with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data .
Project/Internship experience working on Amazon...
...team.
Skillful in ETL process and tools.
Clear understanding and experience with Python and PySpark or Spark and SCALA with HIVE Airflow Impala and Hadoop and RDBMS architecture.
Experience in writing Python programs and SQL queries.
Experience in SQL Query tuning...
...applications using big data technologies such as Hadoop, Spark, Flink, Dataflow etc.
Experience with workflow orchestration tools such as Airflow/Luigi/Azkaban etc.
Experience with coding languages like Python/Java/Scala
Experience with at least one cloud platform AWS/GCP/...
...global customers including Fortune 500 companies
Must have: Python, ML concepts and frameworks, Fast API, Graph QL, AWS, ML Flow, AirFlow, ML pipeline creation, drift monitoring
JD:
Responsibilities:
1. Requirements Analysis: Collaborate with business stakeholders...
...SQL.
Experience using AWS (EC2, S3)
Experience using GIT
Working knowledge of some of the following technologies: Aerospike, Airflow, Druid, Flink, Apache Spark, Apache Kafka ,Kubernetes, MySQL, Redis
Understanding of different big data file formats and storage &...
