Data Engineer - SQL/Python
Interface Consultancy Services
Job Description:We are seeking a highly experienced Senior Data Engineer (1015 years) to design and scale AI-ready, compliant data platforms with a strong focus on Retrieval-Augmented Generation (RAG) architectures.This role is critical in enabling secure, governed, and explainable AI solutions in a regulated financial services environment, ensuring compliance with data privacy, model governance, and audit requirements.The ideal candidate combines deep data engineering expertise, GenAI experience, and strong understanding of regulatory and risk frameworks.Required Skills & Experience:- 1015 years in Data Engineering / Platform Engineering- 3+ years in GenAI / RAG / LLM-based systems- Proven experience working in regulated environments (Banking, Insurance, or similar)Core Technical Skills:- Strong expertise in:1. Python, SQL2. Data modelling, ETL/ELT pipelines3. Distributed data systems- Deep AWS experience:1. S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM- Data orchestration tools:1. Airflow / Step FunctionsRAG & GenAI:- Hands-on experience building:1. Enterprise RAG pipelines with governed data access2. Vector databases (OpenSearch, Pinecone, FAISS, Chroma)- Strong understanding of:1. Embeddings, semantic search2. Chunking strategies & retrieval optimisation- Experience with:1. LangChain, LlamaIndex (or equivalent)Regulatory & Governance Expertise (Must-Have):- Strong knowledge of:1. GDPR / UK Data Protection Act2. Data governance frameworks (data classification, lineage, retention)3. Access control models (RBAC, ABAC)- Experience implementing:1. Data masking, anonymisation2. Encryption & key management3. Audit trails and compliance reporting- Familiarity with:1. Model Risk Management frameworks2. Responsible AI principles (fairness, transparency, accountability)Preferred / Advanced Skills:- Experience with:1. Graph databases (Neo4j, Neptune) for Graph RAG2. Agent orchestration frameworks- Knowledge of:1. LLM evaluation frameworks2. Guardrails, safety filters, red-teaming- Exposure to:1. API-first, microservices architecture2. Customer-facing AI journeys (chatbots, knowledge assistants) (ref:hirist.tech)
- Job Title : Data EngineerExperience : 6-7 YearsLocation : Chennai (Hybrid)Key Skills : Python, PySpark, AWS (S3, Lambda, Glue, EMR, Redshift), SQL, Snowflake, DBT, MongoDB, Kafka, AirflowJob Description... ...Virtusa is hiring a Senior Data Engineer with expertise in building...SQLHybrid work
- We are seeking a highly experienced Senior Data Engineer (10 to 15 years) to design and scale AI-ready, compliant data platforms with a... ...data quality, performance, and reliability.Must Have Skills:- Python and SQL- Data modelling and ETL/ELT pipelines- Distributed data systems...SQL
- ...DaysLocation : RemotePrimary Skill : Python, Airflow, RedshiftDomain... ...performance tuning in large-scale data warehouse environments.-... ...expertise in writing high-performance SQL queries, including complex... ...functional teams including Data Engineers, Business Analysts, QA teams, and...SQLImmediate start
- Job Description : Job Role : Data Engineer (AML Data)Experience : 7+ YearsLocation : ChennaiKey... ...Ingestion pipelines.- Develop and optimize Python and Oracle PL/SQL solutions.- Perform... ...development.- Hands-on experience with Oracle SQL and PL/SQL.- ETL/Data Engineering...SQL
- Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The... ...expertise in Python.- Hands-on experience with PySpark.- Excellent SQL skills.- Experience with Spark optimization and tuning.-...SQL
- ...deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL).- Build ETL/ELT pipelines,... ...- Must have 10+ years of software engineering experience with at least 5+ years... ...Must have strong experience with Python and SQL for data processing and Apache...SQL
- Job Title : Senior Data EngineerLocation : Bangalore, Pune, Chennai, Chandigarh, Mumbai, Panchkula... ...cloud services (AWS, Azure, GCP).- Strong SQL skills and experience with databases.-... ...- Kafka- AWS- Azure, GCP- SQL, NoSQL- Python, Java, Scala- Informatica- Talend- Redshift...SQLImmediate start
- Role Overview :As a Senior Data Engineer, you will serve as a technical cornerstone in building... ...analytical applications.- Develop complex SQL queries and stored procedures to facilitate... ...reviews and promoting best practices in Python development to maintain high engineering...SQLLong term contractHybrid work
- Role Overview :We are seeking a highly skilled AWS Data Engineer to join our production support team in Chennai, Hyderabad, or Bangalore. In this... ...long-term fixes that prevent future system failures.- Optimize SQL queries and database performance to ensure rapid data retrieval...SQLLong term contractHybrid work
- Lead Data EngineerLocation : Chennai - onsiteExperience : 6+ yearsMandatory skills : Python, Pyspark, SQL, DSA, Cloud (AWS/GCP - 1st priority, Azure)Job Description :Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications...SQL
- Job Description : Data Engineering & Pipeline Development : - Design, develop, and maintain scalable... ..., and prototype development using Python and GCP services.MLOps & Model Lifecycle... ...Skills : - Strong proficiency in Python, SQL, and Google Cloud Platform (GCP).- Experience...SQLContract work
- Job Title : Azure Data EngineerLocation : Pune, Hyderabad, BangaloreExperience : 7 to 12 years.Skills : Databricks, Spark/ Pyspark/ Python, ETL, ADF/ AirflowNotice Period : Immediate to 45 DaysJob... ...writing and optimizing complex SQL.- Experience with complex data modelling...SQLImmediate start
- ...deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL).- Build ETL/ELT pipelines,... ...: Must have 10+ years of software engineering experience with at least 5+ years... ...Must have strong experience with Python and SQL for data processing and Apache...SQL
- ...Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure.... ...insights to innovate and grow. As a QA Engineer, you’ll be part of a team of smart,... ...technologies such as Cloud/Bigdata Automation, Python, Pyspark, SQL, Hive, Databricks, Airflow, Performance...SQLFull timeLocal areaFlexible hours
Rs 15 - 20 lakhs p.a.
We're Hiring | PySpark Developer / Senior Data Engineer Location: Hyderabad, Pune, Chennai, Bengaluru Experience: 6–9 Years Work... .../ Senior Data Engineer with strong expertise in PySpark, Python, SQL, and large-scale data engineering. Requirements Key Skills...SQLFull timeHybrid work- ...forefront of building scalable data pipelines that transform raw information... ...managers, and infrastructure engineers, to design robust architectures... ...and maintain sophisticated SQL queries and Hive scripts to... ...data pipelines using PySpark and Python, with a deep understanding of...SQLHybrid work
- Pyspark Data EngineerRequirements :- Hands-on expertise in designing... ...understanding of Oracle SQL and HDFS, including handling file... ...output datasets.- Ability to write Python, Pyspark, and shell scripts to... ...degree plus 6+ years of data engineering experience with strong PySpark...SQLHybrid work
- Job Description :Highly skilled Lead Data Engineer with extensive experience in ETL development, SQL, database management, Qlik (Qlik Replicate and Qlik Compose), Data Lakes, PySpark, and AWS Glue. The ideal candidate will lead the design and implementation of scalable data...SQL
- Position : PySpark Developer / Senior Data EngineerLocation : Hyderabad,... ...Overview : As a Senior Data Engineer, you will be at the core of our... ...pipelines using PySpark and Python to ensure seamless data ingestion... ...using PySpark, Python, and SQL, with a deep understanding of distributed...SQLHybrid workWork at office
- We are looking for an experienced Python Lead Data Engineer to design, develop, and optimize scalable data platforms and enterprise-grade data pipelines... ...expertise in Python, FastAPI, Apache Airflow, Snowflake, SQL, ETL/ELT, and CI/CD practices while leading a team of engineers...SQL
- Role : Data Engineer (Azure + Microsoft Fabric)Experience : 3 to 5 YearsLocation : ChennaiJob Description : We are looking for a... ...Microsoft Fabric, Azure Data Factory (ADF), Azure Dedicated SQL Pool (Synapse), SQL, Python, and PySpark. The ideal candidate will design, develop,...SQL
- ...TASKS: Build and maintain data pipelines to transform, process... ...University degree in computer science, Engineering, or a related technical field... ...knowledge/skills: in SQL and relational databases preferably... ...in languages such as R, Python, Scala, Databricks (including...SQLFull timeRemote job
- ...Role Overview : Were looking for a hands-on Data Engineer to own the data layer of customer go-... ...end data migrations, building high-quality SQL models, and implementing automated data... ...Tableau, or Metabase.- Working knowledge of Python for lightweight data transformations and...SQL
- ...Min. 2 years hands-on with GCP Data Platforms)Job Summary :We are seeking a high-caliber GCP Data Engineer to design, build, and deploy scalable... ....The ideal candidate is a Python expert who understands the... ...Primary Languages : Advanced Python, SQL, and Java.- GCP Core : Deep...SQL
- Job Summary :We are looking for an experienced Big Data Engineer to design, develop, and maintain scalable data pipelines capable... ...with Kafka or other streaming technologies.- Strong SQL skills.- Experience with Python or Scala.- Knowledge of Airflow/Oozie or similar orchestration...SQL
- Job Title : GCP Data Engineer with Big QueryExperience : 3+ YearsNotice : ImmediateJob Location... ...Data Engineer specializing in Snowflake, SQL (T-SQL), and SSIS to join our data engineering... ...Knowledge of scripting languages (e.g., Python) for automation is a plus.- Excellent...SQL
- Job Description :We are seeking a highly skilled Snowflake DBT Engineer to design, develop, and optimize scalable data transformation pipelines. The ideal candidate will have strong expertise in DBT, SQL, and Snowflake, along with a solid understanding of Data Vault 2.0 and...SQL
- Role : Pyspark Data Engineer 1. Hands-on expertise in designing, building, and maintaining Apache... ...00 GB+.4. Strong understanding of Oracle SQL and HDFS, including handling file formats... ...output datasets.5. Ability to write Python, Pyspark, and shell scripts to process, transform...SQL
- ...Senior Engineer in Production Management (Big Data - Snowflake Focused) The Senior Engineer in Production Management... ...other Big Data solution) 5 Python (Data Engineering) 4 Data... ...Cloud Platforms (AWS) 4 SQL 5 High Availability Systems...SQLFull time
- As a Senior Data Engineer on the Data Science team, you will be embedded with data scientists and ML engineers to build the data infrastructure... ...consistency, latency, throughput, and fault tolerance.- Strong SQL and proficiency with at least one of (py)Spark, DBT, or Airflow...SQL
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - SQL/Python. Be the first to apply!
