Sign up to access all features of our service
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer - SQL/Python

Interface Consultancy Services

Job Description:We are seeking a highly experienced Senior Data Engineer (1015 years) to design and scale AI-ready, compliant data platforms with a strong focus on Retrieval-Augmented Generation (RAG) architectures.This role is critical in enabling secure, governed, and explainable AI solutions in a regulated financial services environment, ensuring compliance with data privacy, model governance, and audit requirements.The ideal candidate combines deep data engineering expertise, GenAI experience, and strong understanding of regulatory and risk frameworks.Required Skills & Experience:- 1015 years in Data Engineering / Platform Engineering- 3+ years in GenAI / RAG / LLM-based systems- Proven experience working in regulated environments (Banking, Insurance, or similar)Core Technical Skills:- Strong expertise in:1. Python, SQL2. Data modelling, ETL/ELT pipelines3. Distributed data systems- Deep AWS experience:1. S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM- Data orchestration tools:1. Airflow / Step FunctionsRAG & GenAI:- Hands-on experience building:1. Enterprise RAG pipelines with governed data access2. Vector databases (OpenSearch, Pinecone, FAISS, Chroma)- Strong understanding of:1. Embeddings, semantic search2. Chunking strategies & retrieval optimisation- Experience with:1. LangChain, LlamaIndex (or equivalent)Regulatory & Governance Expertise (Must-Have):- Strong knowledge of:1. GDPR / UK Data Protection Act2. Data governance frameworks (data classification, lineage, retention)3. Access control models (RBAC, ABAC)- Experience implementing:1. Data masking, anonymisation2. Encryption & key management3. Audit trails and compliance reporting- Familiarity with:1. Model Risk Management frameworks2. Responsible AI principles (fairness, transparency, accountability)Preferred / Advanced Skills:- Experience with:1. Graph databases (Neo4j, Neptune) for Graph RAG2. Agent orchestration frameworks- Knowledge of:1. LLM evaluation frameworks2. Guardrails, safety filters, red-teaming- Exposure to:1. API-first, microservices architecture2. Customer-facing AI journeys (chatbots, knowledge assistants) (ref:hirist.tech)

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - SQL/Python in Chennai vacancy
  • Job Title : Data EngineerExperience : 6-7 YearsLocation : Chennai (Hybrid)Key Skills : Python, PySpark, AWS (S3, Lambda, Glue, EMR, Redshift), SQL, Snowflake, DBT, MongoDB, Kafka, AirflowJob Description...  ...Virtusa is hiring a Senior Data Engineer with expertise in building... 
    SQL
    Hybrid work

    PROLEGION PRIVATE LIMITED

    Chennai
    13 days ago
  • We are seeking a highly experienced Senior Data Engineer (10 to 15 years) to design and scale AI-ready, compliant data platforms with a...  ...data quality, performance, and reliability.Must Have Skills:- Python and SQL- Data modelling and ETL/ELT pipelines- Distributed data systems... 
    SQL

    Nasugroup

    Chennai
    19 days ago
  •  ...DaysLocation : RemotePrimary Skill : Python, Airflow, RedshiftDomain...  ...performance tuning in large-scale data warehouse environments.-...  ...expertise in writing high-performance SQL queries, including complex...  ...functional teams including Data Engineers, Business Analysts, QA teams, and... 
    SQL
    Immediate start

    SPI TECHNOLOGIES INDIA PRIVATE LIMITED

    Chennai
    13 days ago
  • Job Description : Job Role : Data Engineer (AML Data)Experience : 7+ YearsLocation : ChennaiKey...  ...Ingestion pipelines.- Develop and optimize Python and Oracle PL/SQL solutions.- Perform...  ...development.- Hands-on experience with Oracle SQL and PL/SQL.- ETL/Data Engineering... 
    SQL

    TekPillar

    Chennai
    28 days ago
  • Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The...  ...expertise in Python.- Hands-on experience with PySpark.- Excellent SQL skills.- Experience with Spark optimization and tuning.-... 
    SQL

    Wize Careers Consultants

    Chennai
    28 days ago
  •  ...deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL).- Build ETL/ELT pipelines,...  ...- Must have 10+ years of software engineering experience with at least 5+ years...  ...Must have strong experience with Python and SQL for data processing and Apache... 
    SQL

    Worksconsultancy

    Chennai
    4 days ago
  • Job Title : Senior Data EngineerLocation : Bangalore, Pune, Chennai, Chandigarh, Mumbai, Panchkula...  ...cloud services (AWS, Azure, GCP).- Strong SQL skills and experience with databases.-...  ...- Kafka- AWS- Azure, GCP- SQL, NoSQL- Python, Java, Scala- Informatica- Talend- Redshift... 
    SQL
    Immediate start

    Mobile Programming LLC

    Chennai
    6 days ago
  • Role Overview :As a Senior Data Engineer, you will serve as a technical cornerstone in building...  ...analytical applications.- Develop complex SQL queries and stored procedures to facilitate...  ...reviews and promoting best practices in Python development to maintain high engineering... 
    SQL
    Long term contract
    Hybrid work

    Growel Softech Pvt. Ltd.

    Chennai
    18 days ago
  • Role Overview :We are seeking a highly skilled AWS Data Engineer to join our production support team in Chennai, Hyderabad, or Bangalore. In this...  ...long-term fixes that prevent future system failures.- Optimize SQL queries and database performance to ensure rapid data retrieval... 
    SQL
    Long term contract
    Hybrid work

    Kiash Soluitons LLP

    Chennai
    27 days ago
  • Lead Data EngineerLocation : Chennai - onsiteExperience : 6+ yearsMandatory skills : Python, Pyspark, SQL, DSA, Cloud (AWS/GCP - 1st priority, Azure)Job Description :Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications... 
    SQL

    Eucloid Data Solutions Pvt Ltd

    Chennai
    8 days ago
  • Job Description : Data Engineering & Pipeline Development : - Design, develop, and maintain scalable...  ..., and prototype development using Python and GCP services.MLOps & Model Lifecycle...  ...Skills : - Strong proficiency in Python, SQL, and Google Cloud Platform (GCP).- Experience... 
    SQL
    Contract work

    Altimetrik India Pvt. Ltd

    Chennai
    13 days ago
  • Job Title : Azure Data EngineerLocation : Pune, Hyderabad, BangaloreExperience : 7 to 12 years.Skills : Databricks, Spark/ Pyspark/ Python, ETL, ADF/ AirflowNotice Period : Immediate to 45 DaysJob...  ...writing and optimizing complex SQL.- Experience with complex data modelling... 
    SQL
    Immediate start

    Wipro Technologies

    Chennai
    1 day ago
  •  ...deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL).- Build ETL/ELT pipelines,...  ...: Must have 10+ years of software engineering experience with at least 5+ years...  ...Must have strong experience with Python and SQL for data processing and Apache... 
    SQL

    ABS InfoTech Pvt. Ltd.

    Chennai
    8 days ago
  •  ...Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure....  ...insights to innovate and grow.  As a QA Engineer, you’ll be part of a team of smart,...  ...technologies such as Cloud/Bigdata Automation, Python, Pyspark, SQL, Hive, Databricks, Airflow, Performance... 
    SQL
    Full time
    Local area
    Flexible hours

    NielsenIQ

    Chennai
    16 hours ago
  • Rs 15 - 20 lakhs p.a.

    We're Hiring | PySpark Developer / Senior Data Engineer Location: Hyderabad, Pune, Chennai, Bengaluru Experience: 6–9 Years Work...  .../ Senior Data Engineer with strong expertise in PySpark, Python, SQL, and large-scale data engineering. Requirements Key Skills... 
    SQL
    Full time
    Hybrid work

    Vrinda International

    Chennai
    8 days ago
  •  ...forefront of building scalable data pipelines that transform raw information...  ...managers, and infrastructure engineers, to design robust architectures...  ...and maintain sophisticated SQL queries and Hive scripts to...  ...data pipelines using PySpark and Python, with a deep understanding of... 
    SQL
    Hybrid work

    Risk Resources LLP

    Chennai
    11 days ago
  • Pyspark Data EngineerRequirements :- Hands-on expertise in designing...  ...understanding of Oracle SQL and HDFS, including handling file...  ...output datasets.- Ability to write Python, Pyspark, and shell scripts to...  ...degree plus 6+ years of data engineering experience with strong PySpark... 
    SQL
    Hybrid work

    SK HR Consultants

    Chennai
    6 days ago
  • Job Description :Highly skilled Lead Data Engineer with extensive experience in ETL development, SQL, database management, Qlik (Qlik Replicate and Qlik Compose), Data Lakes, PySpark, and AWS Glue. The ideal candidate will lead the design and implementation of scalable data... 
    SQL

    Nasugroup

    Chennai
    11 days ago
  • Position : PySpark Developer / Senior Data EngineerLocation : Hyderabad,...  ...Overview : As a Senior Data Engineer, you will be at the core of our...  ...pipelines using PySpark and Python to ensure seamless data ingestion...  ...using PySpark, Python, and SQL, with a deep understanding of distributed... 
    SQL
    Hybrid work
    Work at office

    MLOPS Solutions Private Limited

    Chennai
    8 hours ago
  • We are looking for an experienced Python Lead Data Engineer to design, develop, and optimize scalable data platforms and enterprise-grade data pipelines...  ...expertise in Python, FastAPI, Apache Airflow, Snowflake, SQL, ETL/ELT, and CI/CD practices while leading a team of engineers... 
    SQL

    REVEILLE TECHNOLOGIES PRIVATE LIMITED

    Chennai
    6 days ago
  • Role : Data Engineer (Azure + Microsoft Fabric)Experience : 3 to 5 YearsLocation : ChennaiJob Description : We are looking for a...  ...Microsoft Fabric, Azure Data Factory (ADF), Azure Dedicated SQL Pool (Synapse), SQL, Python, and PySpark. The ideal candidate will design, develop,... 
    SQL

    HEPL - A Cavinkare Group Company(Consultant)

    Chennai
    6 days ago
  •  ...TASKS: Build and maintain data pipelines to transform, process...  ...University degree in computer science, Engineering, or a related technical field...  ...knowledge/skills: in SQL and relational databases preferably...  ...in languages such as R, Python, Scala, Databricks (including... 
    SQL
    Full time
    Remote job

    Nordex Group

    Chennai
    4 days ago
  •  ...Role Overview : Were looking for a hands-on Data Engineer to own the data layer of customer go-...  ...end data migrations, building high-quality SQL models, and implementing automated data...  ...Tableau, or Metabase.- Working knowledge of Python for lightweight data transformations and... 
    SQL

    BBG INDIA DEVELOPERS LLP (BBG INDIA DEVELOPERS)(11133)

    Chennai
    28 days ago
  •  ...Min. 2 years hands-on with GCP Data Platforms)Job Summary :We are seeking a high-caliber GCP Data Engineer to design, build, and deploy scalable...  ....The ideal candidate is a Python expert who understands the...  ...Primary Languages : Advanced Python, SQL, and Java.- GCP Core : Deep... 
    SQL

    The Judge Group

    Chennai
    6 days ago
  • Job Summary :We are looking for an experienced Big Data Engineer to design, develop, and maintain scalable data pipelines capable...  ...with Kafka or other streaming technologies.- Strong SQL skills.- Experience with Python or Scala.- Knowledge of Airflow/Oozie or similar orchestration... 
    SQL

    Wize Careers Consultants

    Chennai
    28 days ago
  • Job Title : GCP Data Engineer with Big QueryExperience : 3+ YearsNotice : ImmediateJob Location...  ...Data Engineer specializing in Snowflake, SQL (T-SQL), and SSIS to join our data engineering...  ...Knowledge of scripting languages (e.g., Python) for automation is a plus.- Excellent... 
    SQL

    Mouri Tech (P) Ltd

    Chennai
    25 days ago
  • Job Description :We are seeking a highly skilled Snowflake DBT Engineer to design, develop, and optimize scalable data transformation pipelines. The ideal candidate will have strong expertise in DBT, SQL, and Snowflake, along with a solid understanding of Data Vault 2.0 and... 
    SQL

    Anlage Infotech (India) Pvt Ltd

    Chennai
    5 days ago
  • Role : Pyspark Data Engineer 1. Hands-on expertise in designing, building, and maintaining Apache...  ...00 GB+.4. Strong understanding of Oracle SQL and HDFS, including handling file formats...  ...output datasets.5. Ability to write Python, Pyspark, and shell scripts to process, transform... 
    SQL

    Spacevinfotech

    Chennai
    8 hours ago
  •  ...Senior Engineer in Production Management (Big Data - Snowflake Focused) The Senior Engineer in Production Management...  ...other Big Data solution) 5 Python (Data Engineering) 4 Data...  ...Cloud Platforms (AWS) 4 SQL 5 High Availability Systems... 
    SQL
    Full time

    NTT DATA Services

    Chennai
    16 hours ago
  • As a Senior Data Engineer on the Data Science team, you will be embedded with data scientists and ML engineers to build the data infrastructure...  ...consistency, latency, throughput, and fault tolerance.- Strong SQL and proficiency with at least one of (py)Spark, DBT, or Airflow... 
    SQL

    TGS The Global Skills

    Chennai
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - SQL/Python. Be the first to apply!