Sr Data Engineer
Full-time
Shell
, India Job Family Group: Information Technology (IT) Worker Type: Regular Posting Start Date: August 18, 2026 Business Unit: Projects and Technology Experience Level: Experienced Professionals Job Description: Where you fit? An exciting opportunity to work at the Trading & Supply- Shell Energy Software Engineering & Analytics organization. We are looking for a talented Senior Data Engineer with great interpersonal skills to join our team. Shell Trading and Supply is the world's largest Energy Trader. It combines a global network of trading companies, industry leading shipping and maritime capabilities, and an integrated network of supply and distribution activities to act as the central integrator for Royal Dutch Shell. Our trading capability, deep market knowledge, global portfolio and end-to-end integration within Shell creates opportunities to deliver value for our customers and for Shell across Upstream, Downstream, Integrated Gas and New Energies. Through our main trading offices in London, Houston, Singapore, Dubai and Rotterdam we trade crude oil, natural gas, LNG, electricity, refined products, chemical feedstocks and environmental products. With more than 125 distribution terminals and hundreds of outside supply points in around 25 countries, our supply and distribution infrastructure is well positioned to make deliveries around the world. Trading is at the centre of the Shell's Energy Transition and Decarbonisation plans, working closely with New Energies and the wider business to develop lower carbon solutions, driven through technology and data. If you would like to be at the centre of Shell's future, join our Trading & Supply Competency Centre and play a part in the delivery of our energy future. What's the role? Senior Data Engineer is an individual with proven experience in adhering to Data Engineering best practices, delivering Data related optimal & performance driven solutions which helps business making quick decision while generating value. They are expected to have continuous improvement mindset, driving value-based process, product/application optimization. What you'll be doing?
- Design, develop, and maintain scalable, high-performance data engineering solutions that support business decision-making and generate measurable value.
- Build and optimize end-to-end data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Databricks, PySpark, Python, and SQL.
- Develop data engineering solutions for the Energy rading & Supply business, leveraging domain knowledge of ETRM ( Endur, and Nucleus).
- Implement data modeling strategies to support enterprise reporting, analytics, and operational requirements.
- Drive continuous improvement initiatives by optimizing data products, processes, applications, and platform performance.
- Apply performance tuning and optimization techniques using PySpark and SQL to improve data processing efficiency and scalability.
- Design and support enterprise data platforms, Master Data Management (MDM), Data Catalog, and analytics solutions.
- Collaborate with cross-functional teams in an Agile environment, ensuring adherence to data engineering best practices, quality standards, and governance requirements.
- Manage source control, CI/CD, and release management processes using GitHub, Azure DevOps, and related tools.
- Work with relational and non-relational databases to support data integration, transformation, and analytics initiatives.
- Partner with business and technical stakeholders to translate Energy Trading business requirements into scalable data solutions.
- Contribute to innovation initiatives, including the evaluation and adoption of emerging technologies and AI-driven solutions.
- Bachelor's degree in Engineering, Computer Science, Information Technology, or a related field; MCA qualification is also acceptable.
- With at least 8 - 10 years of experience in Data Engineering, with a proven track record of delivering enterprise-scale data solutions.
- Strong experience in the Trading & Supply domain, including Endur and Nucleus.
- Deep understanding of the Energy Trading business domain and experience building data solutions that support trading operations and decision-making.
- Expertise in Microsoft Azure technologies, including:
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Azure Databricks
- Data Pipeline Development
- Azure Fabric
- Strong hands-on experience with PySpark, Python, Advanced SQL and Data Modeling
- Experience working with both relational and non-relational database technologies.
- Proven expertise in SQL query optimization and PySpark performance tuning.
- Experience with source control and DevOps practices, including GitHub, Azure DevOps, build pipelines, and release management.
- Hands-on experience implementing enterprise data platforms, Master Data Management (MDM), Data Catalog, and analytics solutions.
- Experience working in Agile delivery environments and applying engineering best practices.
- Databricks Certified Associate certification required.
- Excellent verbal and written communication skills.
- Experience working with data products and platforms within the Energy sector.
- Knowledge of ETRM (Energy Trading and Risk Management) systems, particularly Endur, and its integration with enterprise energy applications.
- Experience implementing AI-powered solutions and platforms, such as AI Foundry and Databricks Genie.
- Hands-on experience with Microsoft Fabric and/or Power BI.
- Exposure to advanced analytics, data governance, and modern cloud-based data architectures.
- Progress as a person as we work on the energy transition together.
- Continuously grow the transferable skills you need to get ahead.
- Work at the forefront of technology, trends, and practices.
- Collaborate with experienced colleagues with unique expertise.
- Achieve your balance in a values-led culture that encourages you to be the best version of yourself.
- Benefit from flexible working hours, and the possibility of remote/mobile working.
- Perform at your best with a competitive starting salary and annual performance related salary increase - our pay and benefits packages are considered to be among the best in the world.
- Take advantage of paid parental leave, including for non-birthing parents.
- Join an organisation working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply.
- Grow as you progress through diverse career opportunities in national and
- international teams.
- Gain access to a wide range of training and development programmes.
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Sr Data Engineer in Bangalore vacancy
- ...provides comprehensive title insurance, closing/settlement, property data and technology solutions. First American (India) creates quality... ...We are seeking a highly motivated and skilled Software Engineer with 5–8 years of professional experience in designing, developing...SeniorFull time
- ...operational toil, and enable modern, cloud‑first identity capabilities at enterprise scale. What You’ll Do: Directory Platform Engineering & Operations Engineer, harden, and operate enterprise and multidomain Active Directory environments supporting critical...SeniorHybrid work
- ...research and contextual analytics. We empower enterprises with data-driven insights, leveraging advanced AI, machine learning, and cloud... ...preferred.Education :- Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical field.Technical Expertise...Suggested
- ...the Role : We are seeking a highly skilled and experienced AI/ML Engineer to design, develop, and deploy scalable machine learning and generative... ..., AI Agents, and prompt engineering techniques.- Create scalable data pipelines for model training, evaluation, and inference.-...SuggestedFull time
- ...using Django, Flask, and FastAPI.- Design and implement high-performance and secure APIs.- Collaborate with frontend developers, QA engineers, product managers, and other stakeholders.- Write clean, maintainable, reusable, and well-documented code.- Perform code reviews and...SeniorFull time
- ...Full-TimeRole Overview :We are looking for an experienced MLOps Engineer with 3+ years of experience to build, automate, deploy, and maintain... ...ML systems. The ideal candidate will work closely with Data Scientists, ML Engineers, Software Engineers, and DevOps teams to...Full time
- ...Jenkins, GitLab CI, GitHub Actions)- Kafka / RabbitMQ (Preferred)- OpenTelemetry, Prometheus, Grafana, ELK (Good to Have)- Design Patterns, Data Structures & Algorithms- Production Support & Performance OptimizationJob Responsibilities : - Design, develop, and deploy scalable...
- About the Role :We are looking for an experienced Senior Test Engineer AI with strong expertise in software quality engineering, test automation... ...pipelines, AI agents, model integrations, backend services, and data-driven workflows. The ideal candidate should be comfortable...SeniorContract work
- AI Model design and build : - Work closely with data scientists and business to design and implement AI algorithms, frameworks and architectures... ...transform, and load data from various sources.AI model Feature Engineering : - Integrate structured and unstructured data from internal and...
- Job Role : Test Engineer - AIExperience : 6+ YearsLocation : BangaloreJob Summary : We are looking for an experienced Test Engineer AI to design... ..., perform root-cause analysis, and work closely with developers, data scientists, and ML engineers to resolve issues.- Develop test...
- About the Role : We are looking for an Azure AI Engineer to build, deploy, and enhance enterprise-grade AI solutions on Microsoft Azure. This role involves working across Generative AI, LLM applications, AI agents, search, document intelligence, and cloud-based AI services.The...
- ...SAST, OSS technologies- Ability to perform Python code reviews with minimal assistance- Expertise in monitoring, alerting, reporting, data analysis is desired.- Experience with application build environments like Jenkins, GitHub Actions, Teamcity etc.- DevOps container/orchestration...
- Leading technology / fintech platform is seeking a Systems Engineer to own enterprise infrastructure across messaging, caching, and traffic management platforms.The role focuses on reliability, scalability, availability, performance, and operational resilience of mission-critical...Senior
- Job Summary : As a Python Developer with Databricks, you will be responsible for developing and maintaining scalable data pipelines, managing cloud environments on Azure, and ensuring smooth integration with APIs.The ideal candidate will be proficient in Python, Databricks (...
- ...risk : legacy customizations, integrations, permission structures, data volume, prior migration history.- Assess source environments (on-... ...patterns into reusable playbooks/checklists.- Mentor migration engineers on risk recognition, not just tool execution.REQUIRED SKILLS : -...SeniorRemote job
- Position : AI/ML Engineer (Azure AI, Gen AI)Overall/Total Experience : 3 - 7 years onlyLocation : BengaluruWorking Days : 5 Days from officeNotice Period Requirement : 30 Days (Maximum)Client's Company Size : Startup / Small EnterpriseRoles & Responsibilities :- Azure AI Deployment...
- ...Tooling and MCP Integration: Design and implement MCP-connected data sources, agentic pipelines, and AI orchestration layers using frameworks... ...to ship fast and reliably.Requirements:- 3+ years of software engineering experience spanning both backend and frontend development.-...
- ...engagement, omnichannel content operations, digital experience platforms, data & AI ecosystems, and cloud modernization initiatives.Key... ...Lead and mentor cross-functional teams including architects, AI engineers, program managers, data engineers, MarTech specialists, and consulting...
- About the Role:We are looking for an SDE 3 / Senior Backend Engineer with 6+ years of backend engineering experience and strong expertise in... ...microservices.- Own server-side architecture, business logic, data models, APIs, and integrations.- Drive HLD and LLD for new services...Senior
- ...and impactful solutions for marketing teams. The company is currently building its core team in Bangalore.Role Overview:As a Data Platform Engineer, you will contribute to building the technology and data foundation for Different AI's products. The role involves working in...
- ...test methodologies, tools, and simulators at the system and node level.- Solid understanding of the Linux operating system and optimizing data processing paths using DPDK and Smart Network Interface Cards.- Experience with CI/CD principles and tools, such as Jenkins and...Senior
- Job Description : Senior Data Scientist (AI/ML).Experience : 5-7 Years.Work mode : On-site.Location : Bangalore.Job Summary : We are... ...and advertising. You will partner with business stakeholders and engineering teams to translate use cases into scalable models, produce MLOps...SeniorFlexible hoursAfternoon shift
- ...architecture workshops with customers.- Design scalable AI/GenAI solutions using Vertex AI and Gemini Enterprise.- Architect enterprise data platforms using BigQuery.- Design cloud-native solutions using GKE, Cloud Run, and AlloyDB.- Drive cloud modernization and enterprise...SeniorHybrid workWork at officeImmediate start
- ...platforms that enable authentication, authorization, and access governance for both human and non-human identities.What Youll Do : - Engineer, harden, and operate enterprise and multidomain Active Directory environments supporting critical business workloads.- Lead Active Directory...SeniorHybrid work
- ...7+ years experience.- Strong understanding of Delta Lake, Parquet, and OneLake storage.- Knowledge of Spark Notebooks, KQL, and Data Engineering within Fabric.- Experience with source control integration (Git) and CI/CD pipelines.- Familiarity with Azure Data Factory, Azure...Senior
- Role Gen AI GCP Engineer.Location : Gurgaon, Bangalore and Chennai.Experience : 4-8 years.Qualifications :Must have :- BE/B.Tech/MCA/MS-IT/... ...Cloud Functions, BigQuery).- Collaborate with product managers, data scientists, and other engineers to understand requirements and translate...Full time
- Job Description: Senior Support Engineer (PostgreSQL, AlloyDB, AlloyDB AI/Insight Studio).Position: Senior Support Engineer.Experience: 310... ...Studio to support mission-critical cloud database platforms and data-driven applications. The ideal candidate will be responsible for...SeniorFull time
- ...operations : triage, alert response, and adherence to incident response playbooks.- Coach, mentor, and support career growth for India-based engineers; hire and develop top technical talent.Tech Stack & Requirements : - 8+ years in IT engineering or Service Desk operations,...SeniorFlexible hours
- Role Overview :As a Senior Engineering Manager in Bangalore, you will spearhead the development of high-scale payment infrastructure, serving... ...engineering teams, collaborating closely with product managers, data scientists, and cross-functional stakeholders to deliver robust,...SeniorHybrid work
- ...Founder and drive product strategy across one or more of our apps. You will be the connective tissue between business goals, data insights, and engineering execution. If you love dissecting user behaviour, running rapid experiments, and shipping products that millions of people...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Data Engineer. Be the first to apply!
