Senior Data Engineer (AWS, SQL, Python)
Infometry
Job Summary : We are seeking an experienced Senior Data Engineer with strong expertise in Databricks, Apache Airflow, SQL, and Python to design and optimize data pipelines, ETL workflows, and cloud-based data solutions. The ideal candidate will have deep experience in big data processing, cloud-based analytics, and automation to drive efficient and scalable data engineering solutions.Key Responsibilities : - Design, develop, and optimize data pipelines using Databricks and Apache Airflow.- Implement PySpark-based transformations and processing in Databricks for handling large-scale data.- Develop and maintain SQL-based data pipelines, ensuring performance tuning and optimization.- Create Python scripts for automation, data transformation, and API-based data ingestion.- Work with Airflow DAGs to schedule and orchestrate data workflows efficiently.- Optimize data lake and data warehouse performance for scalability and reliability.- Integrate data pipelines with cloud platforms (AWS, Azure, or GCP) and various data storage solutions.- Ensure adherence to data security, governance, and compliance standards.Required Skills & Qualifications : - 8-9 years of experience in Data Engineering or related fields.- Strong expertise in Databricks (PySpark, Delta Lake, DBSQL).- Proficiency in Apache Airflow for scheduling and orchestrating workflows.- Advanced SQL skills for data extraction, transformation, and performance tuning.- Strong programming skills in Python (pandas, NumPy, PySpark, APIs).- Experience with big data technologies and distributed computing.- Hands-on experience with cloud platforms (AWS / Azure / GCP).- Expertise in data warehousing and data modeling concepts.- Understanding of CI/CD pipelines, version control (Git)- Experience with data governance, security, and compliance best practices.- Excellent troubleshooting, debugging, and performance optimization skills. (ref:hirist.tech)
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (AWS, SQL, Python) in Bangalore vacancy
- ...Mode : Work from office Job Description: Key responsibilities:Data management: Collect, organize, and maintain data from various sources... ...field. # Technical skills: # Database management (e.g., SQL) # Proficiency in data analysis # Strong skills in advanced Excel...SQLWork at officeShift work
- ...front-end UI, back-end services, APIs, and data layer.- Build and consume well-structured... ...Collaborate with product, design, and other engineers, and communicate progress and tradeoffs... ...experience in at least one server stack Node.js, Python (Django / FastAPI / Flask), or .NET / C#.-...SuggestedContract work
- Description : We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising... ...Storage (GCS).- Experience with Kubernetes (K8s).- Strong SQL skills and understanding of distributed data processing.-...SeniorSQL
- ...fundamentals in at least one modern language (JavaScript/TypeScript, Python, or similar) you can read and reason about code, not just generate... ...Basic web skills : a frontend framework (React a plus), and some SQL/database understanding.- Git basics, and the habit of testing and...SQLInternship
- Job Summary :We are seeking a highly skilled and experienced Senior Full Stack Engineer to join our dynamic and innovative team. The ideal candidate... ...development.- Extensive experience with MongoDB, including data modelling and query optimization.- Hands-on experience with...Senior
- Data Engineering & Architecture : - Serve as a hands-on technical leader in the design of scalable... ...platform engineering, including 5+ years in senior technical leadership roles.- Proven... ...-relational databases (Teradata, Oracle, SQL Server, DB2, Redshift, NoSQL).- 4. Programming...SQLLong term contract
- ...collaborating with cross functional teams to design, build, and optimize data pipelines and infrastructure.Responsibilities:- Design, develop,... ...industry trends, recommending innovative solutions to enhance data engineering capabilities.Total Experience: 6-9 years (ref:hirist.tech)Senior
- ...the Role : We are seeking an experienced Data Modeler with strong expertise in designing... ...data analysis, data mapping, and reverse engineering of existing systems to create optimized models... ...& Requirements : - Strong experience with SQL (SQL Server, Snowflake).- Expertise in...SQL
- Location : BangaloreWork Mode : OnsiteEmployment Type : Full-TimeJoining : Immediate Joiners PreferredJob Description :We are looking for an experienced Java + Angular Full Stack Developer with strong hands-on expertise in Java backend development and Angular frontend development...Full timeImmediate start
- ...database performance, capacity, availability, and reliability.- Perform SQL query optimization and database performance tuning.- Implement and... ...and database design.- Automate routine DBA activities using Shell/Python scripting.- Participate in production deployments and provide L2/L...SQLFull timeImmediate start
- ...credit card systems.Key Responsibilities : - Manage the implemented application to ensure availability, confidentiality, and integrity of data.- Build relationships and manage functional teams and vendors across global locations.- Coordinate with stakeholders (business, support...Senior
- ...remediation as per the guidance from products and engineering teams.Qualifications & Skills Experience :... ...including SD-WAN, ZTNA, SWG, FWaaS, CASB, Data Loss Prevention (DLP), and sophisticated... ...data breaches.- Strong experience with SQL and data visualization tools like Tableau,...SQLHybrid work
- Role : o9 Senior Functional ConsultantHire type : Full-timeNotice Period : ImmediateLocation... ...educational background from reputed engineering and management schoolsRequired Skills :... ...orientation- Ability to analyze large amount of data; R, Python, SQL knowledge is preferred. (ref:hirist...SeniorSQLFull timeFor subcontractorHybrid workRemote jobRelocation
- ...portfolio of risk, governance, data, and analytics platforms. This... ...will lead a results-driven engineering and data organization, serve as a key technology partner to senior business leaders, and own the... ...as Apache Spark, Apache Kafka, Python, SQL, and microservices-based...SQLLong term contractContract workFor contractors
- ...- 15 yearsRequirements : - 10+ years of database experience MySQL, Postgress SQL, MS-SQL, Hbase, Casandra, MongoDB etc.- Knowledge on CEPH is mandatory.- Experience as a software developer or data architect or in a data management role.- Experience working with at least two...SQL
- ...lifecycle communications.- Develop Automation Studio workflows for data imports, segmentation, and campaign execution.- Create... ...AMPScript, Dynamic Content, and Data Extensions.- Develop and optimize SQL queries for segmentation, reporting, and automation.- Integrate Marketing...SQL
- Job Description :We are seeking an experienced AWS Data Engineer to lead and execute a large-scale migration from Matillion ETL to a modern... ...Tasks, Performance Tuning)- AWS Lambda and Step Functions- Programming language s: Python, SQL, Spark- Git experience (ref:hirist.tech)SQL
- Position : Mobile Application Test Engineer Experience : 3 - 5 Years Location : Bangalore Work Model : Hybrid 2 Days Work from Office per... ...testing and REST APIs.- Basic-to-good programming knowledge in Java, Python, JavaScript, or similar languages.- Experience with Git and...Full timeHybrid workWork at office
- ...communication between frontend interfaces and backend microservices.- Optimize database performance and query efficiency in MySQL to ensure rapid data retrieval and system stability.- Containerize applications using Docker to streamline deployment workflows and maintain consistency...Long term contract
- Job Description :We are hiring a Senior Enterprise Architect to lead high-impact digital transformations and shape the future of enterprise... ...goals and cutting-edge technology - especially in modern data, cloud, and agentic AI - we want to hear from you.What You'll Do...Senior
- ...Series Forecasting- Experience in feature engineering, data preprocessing, and model evaluation-... ...monitoring, and debugging- Proficient in Python with ability to write clean, production-ready... ...during the interview process.- Proficient in SQL: window functions, CTEs, conditional...SQL
- Job Title : webMethods Upgrade ExpertLocation : Bangalore, Gurgaon (Onsite)Notice Period : Immediate Joiners PreferredExperience : 3 - 12 YearsCompany : GinimindsJob Description : We are looking for an experienced webMethods Upgrade Expert to join our Integration Practice team...Immediate start
- ...Role Description:Amtech LLC is seeking a Senior AI Engineer to build and scale the Agentic Platform... ...layer across packaging and labels, and data that is callable by any AI, on any screen... ...formal people - management role.- Strong Python programming skills.- Practical...SeniorFull time
- ...47 (Matrix Partners).Job Description :As a Senior Software Development Engineer you are responsible to develop scalable applications... ...years of experience with good knowledge of data structures and algorithms.- Strong coding skills in Python & Java.- Good startup experience.-...Senior
- ...across India, solving meaningful problems at scale.We're building products that impact everyday lives, and we're looking for experienced engineers who thrive on ownership, performance, and shipping high-quality software.What You'll Do :- Architect, build, and scale high-...Senior
- ...internal platform : the tools, automations and data the team runs on. The mandate is to help a... ...teams : support, marketing, hiring, engineering, and the founders themselves. You find where... ...built and later retired- Working hands : SQL, APIs, and at least one automation or internal...SQLFull timeWork at officeRelocation
- Position : Senior Frontend Engineer (ReactJS)Overall/Total Experience : 3 - 5 yearsLocation : Bengaluru (Only for Candidates living in Bengaluru)Working Days : 5 Days Working from OfficeNotice Period Requirement : 30 Days (Maximum)Client's Company Size : Startup / Small EnterpriseInterview...Senior
- Role Overview : We are seeking a seasoned Azure Databricks Engineer to join our high-performing data engineering team in Bangalore/Chennai. In this role, you... ...and cleaning for downstream consumption.- Optimize SQL queries and Spark jobs to improve system performance, reduce...SQLHybrid work
- Role : Senior Automation QA EngineerAbout the Role : We are looking for a Senior Automation QA Engineer to drive our QA strategy and automation standards.Responsibilities : - Define... ...Good to have : a scripting language (Bash, Python) and performance/monitoring tools (...Senior
- ...modern GenAI technologies.- Develop solutions involving RAG, prompt engineering, embeddings, and vector databases.- Evaluate and integrate... ...prompt engineering, and AI application development.- Experience with Python and commonly used AI/ML frameworks.- Knowledge of vector...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (AWS, SQL, Python). Be the first to apply!
