Data Engineer - Python/SQL
Questhiring
Job Description Data Engineer : Location : Noida / GurgaonExperience : 4 to 5 YearsWe are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms on AWS. The role requires strong expertise in Python, SQL, ETL/ELT pipelines, Airflow, and AWS data services to enable reliable, secure, and high-performance data solutions for analytics and business reporting. Candidates with exposure to the BFSI / lending / banking domain will be preferred.Key Responsibilities : - Design, build, and maintain scalable ETL/ELT pipelines and data workflows on AWS.- Develop and optimize data models (OLTP/OLAP), schemas, and warehousing solutions (e.g., Redshift, Snowflake, or similar).- Build data ingestion frameworks for batch and streaming data from diverse sources (APIs, RDBMS, files, event streams).- Implement data quality checks, validation rules, and monitoring for data reliability and SLAs.- Write efficient, production-grade Python and SQL for data transformations and orchestration.- Manage and optimize data storage, partitioning, and performance (query tuning, indexing, cost optimization).- Implement orchestration and workflow management (e.g., Airflow/Step Functions).- Collaborate with stakeholders to translate business requirements into technical specs and data contracts.- Ensure data security, governance, lineage, and compliance (IAM, encryption, PII handling).- Set up observability for pipelines (logging, metrics, alerting) and support on-call rotations.- Contribute to CI/CD for data workloads, infrastructure-as-code, and best practices documentation.Required Skills : - 4 to 5 years of hands-on experience in Data Engineering.- Strong experience with AWS services such as S3, Glue, Athena, Lambda, Redshift, Step Functions, EMR/Glue Spark, IAM, and CloudWatch.- Proficiency in Python and advanced SQL.- Experience with ETL/ELT pipelines, data modeling, and data warehousing.- Hands-on experience with Airflow or equivalent orchestration tools.- Good understanding of data quality, monitoring, and performance tuning.- Familiarity with Git, CI/CD, and Infrastructure as Code (Terraform / CloudFormation).Preferred : - Exposure to BFSI / Banking / NBFC / Lending domain.- Experience with Kinesis / Kafka / MSK.- Knowledge of Docker, ECS / EKS.- Familiarity with Parquet, Delta, Iceberg, and Lake Formation. (ref:hirist.tech)
- We're seeking a skilled Mid-Level Data Engineer to join our team at SMC Global SecuritiesExperience : 4- 8 yearsNotice Period : Immediate... ...Data Lake (S3), Data Warehouse- Write and optimize complex SQL queries and Python scripts- Implement and orchestrate data workflows.Good to...SQLImmediate start
- We are seeking a highly experienced Senior Data Engineer (10 to 15 years) to design and scale AI-ready, compliant data platforms with a... ...data quality, performance, and reliability.Must Have Skills:- Python and SQL- Data modelling and ETL/ELT pipelines- Distributed data systems...SQL
- Job Title : Data Engineer (GenAI)Location : Gurugram / Bangalore (Hybrid)Experience : 5+ YearsEmployment Type : Full-TimeMandatory Skills : - Python- PySpark- SQL- Data Engineering- GenAI, LLMs or RAG- Azure/AWS (Any Cloud)Job Responsibilities : - Build and optimize scalable...SQLFull timeHybrid work
- Role Overview :We are seeking a seasoned Data Engineer to join our high-impact data platform team... ...scalable ETL/ELT pipelines using Python to process large-scale datasets, ensuring... ...analytics.- Develop and optimize complex SQL queries and stored procedures to support...SQLHybrid workWork at office
- Role Overview:Seeking a Senior Data Engineer to build and manage scalable data pipelines and cloud-based data solutions, supporting advanced... ...pipelines and infrastructure- Work with Snowflake/Azure/AWS, Python, and SQL- Develop data models aligned with business needs- Monitor and...SQL
- Role Overview :As a Data Engineer at Rayosys, you will be responsible for designing, building, and maintaining the data infrastructure... ...expertise in designing complex data architectures using Python, Scala, and advanced SQL for high-performance data processing.- Proven ability to...SQL
- Job Description : We are looking for an experienced data engineer to join our team. You will use various methods to... ...Data EngineerOpen Positions : 1Skills Required : Python, Pyspark, SCALA, spark, Azure Databricks, kafka, sql, data warehousing, Data EngineeringRole : Responsibilities...SQL
- Role : AWS Data EngineerLocation : Bangalore, Delhi (Hybrid)Mandatory... ...Redshift, Glue, Lambda, EMR), Python, Spark & Data EngineeringJob... ...We are looking for an AWS Data Engineer with strong experience in building... ...on experience in AWS services, SQL, and Python.Key...SQLHybrid work
- ...Description :This is a senior-level engineering role where the candidate would be a part of the Data Engineering team distributed in... ...- 6+ years of Java/Scala and/or Python programming with good CS fundamentals... ...ETLs- 6+ years' experience of SQL, RDBMS and/or NoSQL database...SQL
- ..., develop, and maintain large-scale data pipelines using Snowflake SQL, ETL processes, and Snowpipe.- Develop... ....- Advanced proficiency in SQL and Python, with a proven ability to write... ...reflecting a strong foundation in data engineering principles.- A track record of delivering...SQLHybrid work
- Job description :- Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production... ...to successful completionSkill Required :Must Haves :- SQL, Python, Py Spark, Spark SQL, Spark, Distributed Systems- Databricks,...SQL
- ...0 days..!!Key Responsibilities & Skillsets : Common Skillsets : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy pandas...SQLImmediate start
- ...Role: Data Engineer (PySpark, SQL, GCP) Experience: 6+ Years Locations: Indore | Raipur | Gurgaon | Bangalore We are looking for experienced Data Engineers to build and optimise scalable data pipelines and data models using modern data engineering practices. The role...SQLFull timeHybrid work
- Description : We are seeking a skilled Data Engineer with strong experience in cloud technologies, big data processing, and ETL development. The... ...pipeline creation- Knowledge of Tableau or Power BI- Strong SQL and data processing skills- Good understanding of data warehousing...SQLImmediate start
- ...serve as a critical architect within our data engineering team, responsible for designing, developing... ....- Optimize existing Spark jobs and SQL queries to improve processing speed and reduce... ...processing solutions using PySpark and Python, with a deep understanding of distributed...SQLHybrid work
- Position : Data Engineer with AWS & PysparkExperience : 4+ YearsLocation : Noida / GurugramEmployment... ...services)3. Snowflake4. Tableau- Strong SQL programming and query optimization skills... ...and DevOps practices.- Experience with Python-based data processing frameworks.-...SQLFull time
- ...Job Title: Senior Data Engineer (5+ Years Experience) Location: Bangalore/Hyderabad/Gurgaon... ...candidate should have strong expertise in Python, Apache Airflow, and data ingestion frameworks... ...platforms Write efficient and complex SQL queries for data transformation and...SQLFull time
- Responsibilities :1. Design, Develop, Maintain and own data engineering projects built from requirements by... ...and push to targets.4. Design and Create SQL, tables, procedures, functions etc.5.... ...Write Spark Tasks/Applications mainly in Python.7. Evaluate, test and update data...SQL
- ...Services preferred)Role Overview :We are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and data... ...in Data Engineering or related roles- Strong expertise in : 1. SQL (advanced querying, performance optimization)2. PySpark and...SQLImmediate start
- Job Description : We are seeking a Big Data Testing Engineer with 5 to 10 years of experience in ETL Testing... ....This role requires strong expertise in SQL, data validation, ETL testing,... ...data validation and ETL testing using SQL, Python, or scripting tools.- Conduct performance...SQL
- ...Responsibilities:- Design, develop, and maintain ETL/ELT pipelines to ingest data from core lending systems, LOS, LMS, CRM, and finance systems into... ..., foreclosures, NPA, and write-offs.- Write and optimize complex SQL queries in MySQL and Redshift for performance and scalability.-...SQL
- ...communication medium to drive sales and optimize promotions.Key Skills :- T-SQL, Azure SQL DB, Replication, SSRS, SSIS, Backup, View, Stored Procedures, Functions, Performance Tuning, Data Quality, ETL/Data Pipeline, Backup, Automation jobs. NoSQL Dbs.- Experience : 3-8...SQL
- ...Data Engineer – BigQuery Required Skills: Python, PySpark, BigQuery SQL, Airflow, GCP, Big Data Years of experience: 5+ Years Locations: Indore, Gurugram We are seeking skilled Data Engineers with experience in modern data engineering practices and data modelling...SQLFull timeHybrid work
- Senior Data EngineerExperience : 3-5 YearsLocation : GurgaonDepartment : Data EngineeringEmployment... ...skilled and motivated Senior Data Engineer to join our growing Data Engineering... ...Languages : - Strong proficiency in Python- Advanced SQL skillsGood to Have : - JavaData Engineering...SQLFull time
- ...detection and forecasting in observability data.- Design a root cause analysis system using... ...evaluate AI agents.- Handle large datasets using Python and its ML ecosystem (e.g., NumPy, Pandas,... ...databases and data processing frameworks (SQL, Spark, Dask, etc.).- Experience in...SQLLong term contract
- ...We are looking for a Data Engineer- Mid to design, build, and maintain scalable data pipelines... ...or related roles ~ Strong experience in Python (Pandas, SQLAlchemy, Airflow operators, etc... ...Intermediate to advanced proficiency in SQL ~ Hands-on experience with ETL/ELT...SQLFull timeRemote jobWork from homeFlexible hoursWeekend work
- ...performing, and highly skilled Big Data + GCP professionals to design,... ...experience with UNIX / Shell / Perl / Python scripting.- Proficiency in... ...GCP using services such as Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, DataProc, DataFlow etc.- Database...SQL
- ...a major IT country with many talented engineers, as evidenced by the fact that cutting-... ...Description PayPay India is looking for a Data Engineer to work on our payment system... ...at least one primary language (Scala, Python, etc.) and SQL. Experience with data catalog and...SQL
- ...A Data Engineer designs and maintains scalable data pipelines and storage systems, with a focus on integrating and processing knowledge graph... ..., with knowledge graph expertise. Proficiency in Python, SQL, and graph query languages (SPARQL, Cypher). Experience with...SQL
- ...Responsibilities: ~ Participate in the entire data pipeline lifecycle, focusing on... ..., and privacy. ~ Mentor other data engineers, providing technical guidance, and... .... ~ Strong experience with SQL (SQL Server, Postgres) and Python, Scala ~ Identify opportunities for...SQL
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Python/SQL. Be the first to apply!
