Senior Data Engineer - Python/SQL
SHIMENTO INDIA LLP
Hiring : Senior Data Engineer | 6+ Years.Location : Bangalore.Role : Senior Data Engineer.We are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, and own end-to-end production data pipelines powering analytics and business decision-making.The ideal candidate should have strong experience in transaction-level data modeling, data quality, auditability, data lineage, and production pipeline ownership, preferably within finance, risk, or compliance data domains.Key Responsibilities : - Own data architecture and system design decisions for data pipelines and data models.- Design and build scalable, production-grade data pipelines end-to-end.- Design transaction-level fact tables and standard fact/dimension models.- Implement Bronze/Silver/Gold (Medallion) architecture.- Build pipelines for finance, risk, or compliance use cases where accuracy and auditability are critical.- Implement data quality controls, reconciliation, anomaly detection, and audit trails.- Write complex SQL using CTEs, window functions, CASE logic, COALESCE, NULLIF, and date/timestamp handling.- Build idempotent data reload patterns and handle late-arriving or corrected records without double-counting.- Develop and maintain Airflow-style DAGs and cross-pipeline dependencies.- Build Python-based ETL tooling using Pandas, SQLAlchemy, and database drivers.- Work with YAML-driven configurations and integrate with APIs where required.- Own CI/CD processes using Git workflows.- Document data models, pipeline logic, data lineage, and operational processes.Must-Have Skills : - 6+ years of experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, reconciliation, auditability, and lineage practices.- Experience with Airflow or similar orchestration tools.- Strong data modeling knowledge - Fact/Dimension, Normalization, Medallion Architecture.Good to Have : - Finance, Risk, or Compliance data experience.- Spark / Hive / Hadoop experience.- YAML-based pipeline configuration.- CI/CD and Git workflows.- API integrations.- Experience with large-scale production data platforms. (ref:hirist.tech)
- ...ticketing system with clarity and precision. Collaborate with engineering and security teams to escalate unresolved issues. Contribute... ...red teaming (bonus, not required). Proficiency with scripting (Python, Bash) or automation is a plus. Certifications like CEH,...SuggestedShift work
- ...PwC Consulting Solutions is hiirng for the role of Business AI Engineer Intern! Responsibilities of the Intern: Supporting teams by coordinating... ...on strategic initiatives and projects Conducting research and data analysis to discern patterns and provide insights...SuggestedInternship
- ...Dexcom is hiring for the role of Software Test Development Engineer 1 Responsibilities of the Candidate : We are broadening our vision... ...'s degree in a technical or engineering discipline. strong foundation in python or other object oriented programming languages....Suggested
- ...Responsibilities Define, architect, analyze, and develop functional safety software for GPU, DLA, and other Tegra compute engines. Define and establish company-wide processes for formal verification of software architecture and user-mode driver designs. Develop initiatives...SeniorFull time
- ...OpenAI APIs, Vertex AI, and AWS Bedrock, applying prompt engineering and embeddings. Integrate data from ERP systems and procurement platforms, including... ...experience in Generative AI or LLM development. ~ Strong Python programming skills. ~ Experience with LangChain,...SuggestedFull timeContract work
- ...foundational framework components that enable extensibility for other engineering teams. Collaborate with Product Management, Design, and... ...and approaches that advance Okta’s identity platform. Mentor senior engineers and influence technical direction across multiple teams...Long term contractFull timeHybrid workWorldwide
- ...localization tooling and write thin Python, Shell, Bash, or PowerShell... ...CI, client tooling, APIs, data layers, encoding, formatting,... ...project managers, and platform engineers to integrate localized assets... ...localization standards. For senior candidates, guide L10n engineering...Full timeContract work
- ...Collaborate with product managers, business teams, architects, senior engineers, and operations teams to deliver solutions and improve... ...experience with one or more of Java/Spring Boot, Node.js, or Python. Experience with at least one modern frontend framework, such...Full time
- ...you the keys to fast-track your career. Engineer audio systems and integrated technology... ...Experience in TEST AUTOMATION, especially on Python. Responsible for Sanity Test, System... ...Python and Robot Framework Experience with data analysis, logs, tracing Good English...Full timeHybrid workWork at officeImmediate start3 days week
- ...Automotive, we give you the keys to fast-track your career. Engineer audio systems and integrated technology platforms that augment the... ...developing and implementing automated testing solutions using Python and Robo Framework. What You Will Do 1. Test Automation: Develop...Work at officeImmediate start
- ...We are looking for a Senior Fusion Architect (Configurator) with strong experience in Adobe... ...managing integrations, and ensuring smooth data flow across systems while maintaining... ...comprised of nearly 2,000 people with 50% engineers and 50% creative talent. We’re always on the...SeniorFull time
- ...customize contract templates on Agiloft and configure workflows, rules, and dashboards. Work with APIs and connectors to support smooth data flow across connected systems. Hands-on expertise with Agiloft KB configuration, business rules, workflow automation, custom...SeniorContract workFlexible hours
- ...As a Senior Service Reliability Engineer (SRE) you will take a multifaceted approach to ensure technical excellence... ...and scripting languages such as Python. You have a good understanding of... ...equivalent and you are proficient in using data from these tools to dissect and...SeniorRemote job
- ...️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any... ...AI era? Join us at Zscaler. Role We are looking for a Senior Manager, Finance Transformation to join our team. This is a hybrid...SeniorLong term contractFull timeContract workHybrid workWork at officeLocal area
- ...technical reviews with customer stakeholders ranging from network engineers to C-level executives, identifying optimization opportunities... ...Proficiency with infrastructure automation and scripting using Python, Terraform, or Ansible for network provisioning and configuration...Long term contractFull timeTemporary workHybrid workLocal areaDay shift
- ..., take action, and rapidly recover from cyberattacks – keeping data safe and businesses resilient. The company’s unique AI-powered... ...reduce risks, improve governance, and do more with data. Senior Engineer- C++ (with Cloud) The Opportunity We have an outstanding career...Senior
- ...: We’re hiring a Sr. Machine Learning Engineer to join the ML Engineering team. Our team... ...inference, and the shared platforms that let Data Science and product teams ship safely.... ...substantial end-to-end ownership. ~ Strong Python engineering skills and practical...SeniorFull time
- ...s mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow teams... ..., Ethics and Compliance, and ESG platform, OneTrust is seeking a Senior UX Designer to join the User Experience Design team within our...SeniorFull timeInternshipWork at officeLocal areaWorldwideFlexible hours3 days week1 day week
- ...ordinate with a global team of Cloud Operations Engineers who are tasked with ensuring our uptime... ...in monitoring, system performance data collection and analysis, and reporting... ...following programming languages: Java, Go, Python, Javascript A keen interest in learning...Full timeTemporary workHybrid workWorldwideShift work
- ...thinking, use technology and data to uncover new opportunities,... ...determined by role, tenure, or seniority. Every team member - no matter... ...place for you. THE ROLE Engineering Manager (Data Engineering) We... ...Strong hands-on background with SQL, Python, and Spark, with...SQLLong term contractLocal area
- ...Overview : As a Staff Backend Engineer, you will work closely with... ...infrastructure components in Go, Java, or Python with a strong focus on... ...ML Platform, Model Serving, Data, and Product Engineering teams... ...standards, and mentor senior engineers across multiple teams...Long term contractHybrid workWork at officeRemote jobWork from home2 days week
- ...tech, and hyper-connected world. Role Overview : As a Senior Staff Backend Engineer you will partner with leaders of multiple platform teams.... ...the last 3 years. ~ Fluent in one or more of Java, Go or Python. ~ Experience with Amazon EKS ~ Proven track record of...SeniorHybrid workWork at officeRemote jobWork from home2 days week
- ...product vision • Analytical thinker who works well in a fast-paced, data-driven and highly ambiguous entrepreneurial culture... ...verbal and written communications skills • Bachelor's degree in Engineering, Statistics or equivalent experience Preferred • Prior product...Senior
- ...Principal Engineer/Chief Architect, Coupang Eats Coupang is one of the largest and fastest... ...experience to our customers and partners. As a senior technical leader in Eats Engineering, you... ...experience in Java development, system & data architecture, distributed computing &...
- ...Job Description: Director of Backend Engineering (AI Infrastructure) Company Introduction... ...-bottleneck training environments. 2. Data & Storage Systems HPC Data Pipelines:... ...a "Hardware-as-Code" mindset, utilizing Python, Ansible, and Terraform to eliminate manual...
- ...QA Automation Engineer (Playwrigh & Appium ) About Us “Capco, a Wipro company, is a global technology and management consulting... ...automation. ~ Experience with JavaScript/TypeScript, Java, or Python , with preference for JavaScript/TypeScript when using Playwright...Local area
- ...Bangalore Location: Bengaluru Hybrid Mode - 3 days WFO (Tues, Wed, Thurs) per week Overview: Automation QA Engineer (Playwright + Python) – 5+ Years Experience ~5+ years of experience in Automation Testing . ~ Strong hands-on experience with Playwright...Hybrid workLocal areaFlexible hours
- ...all in on this mission. If you are too, let's talk. Title: Senior Software Engineer, Lifecycle Management Company Description: Okta is the... ...with object-oriented languages, e.g. Java ~ Experience with data stores, e.g. relational databases ~ Experience with one or...SeniorFull timeHybrid workWork at officeLocal areaWorldwide
- ...you are too, let's talk. Job Overview: We are looking for a Senior Engineer to join the FGA DevEx team and help evolve our end to end... ...and SaaS. This team owns the SDKs in Go, JavaScript, .NET, Python, Java and other languages, along with CLI workflows, IDE integrations...SeniorFull timeHybrid workLocal areaWorldwide
- ...future of IT: whether you're in engineering, product, sales, marketing,... ...Administrator to own and evolve our SQL Server database infrastructure... ...production environments. This senior individual contributor role... ...changes while maintaining data integrity across multi-tenant...SQLLong term contractWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Python/SQL. Be the first to apply!
