Data Engineer (AWS, SQL)
Rs 5 - 10 lakhs p.a.Wissen Infotech
We are seeking a skilled Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes. Key Responsibilities
Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.
Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).
Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.
Ensure data quality and consistency by implementing validation and governance practices.
Work on data security best practices in compliance with organizational policies and regulations.
Automate repetitive data engineering tasks using Python scripts and frameworks.
Leverage CI/CD pipelines for deployment of data workflows on AWS.
Required Skills and Qualifications
Professional Experience: 5+ years of experience in data engineering or a related field.
Programming: Strong proficiency in Python, with experience in libraries like pandas, pySpark, or boto3.
AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:
AWS Glue for ETL/ELT.
S3 for storage.
Redshift or Athena for data warehousing and querying.
Lambda for serverless compute.
Kinesis or SNS/SQS for data streaming.
IAM Roles for security.
Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.
Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.
DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and Code Pipeline.
Version Control: Proficient with Git-based workflows.
Problem Solving: Excellent analytical and debugging skills.
Education
~ Bachelors or Masters degree in Computer Science, Engineering, or a related field.
- Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Junior Data Engineer to join our Information Technology team. This position will work on a team to accomplish tasks and projects that are instrumental to the company's success...SuggestedFull timeContract workInternshipWork at officeLocal areaFlexible hours
Medpace
Mumbai1 day ago - ...Position Summary: Job Title: Senior Data Engineer Location: India Project: Enterprise Data Hub (EDH) About the Role We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable...SuggestedFull time
- ...financial services, airline and hotel brand’s reward programmes and loyalty initiatives. Purpose of the job We are seeking a Data Engineering Manager who is passionate about building great teams, shipping products fast, and fostering an inspiring engineering culture. You...SuggestedHybrid workWorldwide
Rs 5 - 15 lakhs p.a.
...About the Role: Lead and manage a team of engineers, providing mentorship and fostering a collaborative environment. Design, implement, and maintain scalable data pipelines and systems to support business analytics and data science initiatives. Collaborate with cross...SuggestedReuters
Mumbai10 days ago- ...terms of both products and services. Role Overview As a Data Applications Lead, you'll own end-to-end delivery of data modules... ...bidding, reporting, and analytics. You will lead a small team of engineers and work closely with data science, analytics, and platform engineering...SuggestedWork at office
Media.net
Mumbai1 day ago Rs 4 - 7 lakhs p.a.
...Technical Skills & work experience: MH: Proven hands-on experience of data architecture and engineering for enterprise grade Datawarehouse/lake/lake-house with overall experience between 7 - 18 years MH: Demonstrated ability to understand technology and architectural...Prudential Group
Mumbai16 days ago- About the Role :We are seeking a talented Lead Data Engineer to join our team and play a pivotal role in transforming raw data into valuable insights. As a Data Engineer, you will design, develop, and maintain robust data pipelines and infrastructure to support our organization...
Rs 11 - 20.5 lakhs p.a.
...We are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a...Burns Mcdonnell
Mumbaia month ago- ...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure delivering solutions that accelerate progress... ...Build Dream Teams. Who You Are: Galaxy is hiring a Data Engineering Manager to lead and grow our Data Engineering team. This role...Full timeWork at officeLocal area
- ...and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorgan Chase within the Finance Technology Team, you are an integral part of an agile team that works to enhance, build, and...
JP Morgan Chase & Co.
Mumbai23 days ago Rs 8 - 13 lakhs p.a.
...Key Responsibilities Design & Implementation: Design and implement robust, scalable data engineering pipelines within GCP , specifically tailored for web analytics. Data Integration: Integrate a variety of marketing & enterprise data sources, including AWS Aurora...Epsilon Data Management
Mumbaia month ago- ...Job Purpose The role incumbent will be responsible for independently managing and driving key technology projects relating to Data Management & Governance, business change requests and technology initiatives for key systems. Create Data Technology Road Map that enables solid...
godrej capital
Mumbai11 days ago - ...What's the role As a Lead GIS Data Engineer , you will shape the architecture, technical direction, and evolution of spatial data processing solutions that support map maintenance and geospatial data products. You will lead domain-level improvements in automation, data...Long term contract
HERE Technologies
Mumbai4 days ago - ...ROLE- Lead Data Engineer LOCATION- Mumbai - Lower Parel / Pune Experience- 8+ yrs Job Summary: We are seeking a technically strong and delivery-focused Lead Engineer to support and enhance enterprise-grade data and application products under the Durables model....Full time
- ...experience. To partner with us in this mission, we are looking for a talented to join our Experience team Name in Mumbai. Lead/Data Engineer Note: The title will depend on (1) Experience (2) Expertise and (3) Performance. So, the title could be: (Senior Manager)...Long term contractPart timeFixed term contractWork at office
- ...Responsibilities: 1. Data Engineering & Pipelines Design build and maintain robust data data pipelines for social marketing and product data sources (APIs event streams batch systems) Develop scalable ETL/ELT workflows / microservices using Python and SQL...Full timeWork at officeRemote jobWeekend work
- ...process adherence Provide responsive action to any high criticality operational incidents and manage resolution. Identify and manage data quality risks and define mitigation/remediation process to ensure highest quality solutions KRA3 Build and maintain Data Lake...Full time
Rs 5 - 10 lakhs p.a.
...description We are looking for a highly motivated individual with strong organizational and technical skills for the position of Lead Data Engineer/ Data Engineering Manager (Snowflake). You will play a critical role working on cutting edge of Data Engineering and analytics,...Hybrid workWork at officeFlexible hours2 days week3 days weekReuters
Mumbai10 days agoRs 3 - 7 lakhs p.a.
...We are seeking a Data Engineer to help build and integrate a Generative AI-powered conversational assistant, into our website and mobile app. This role is crucial in handling data pipelines, model training, and infrastructure setup to deliver a seamless, privacy-compliant...Permanent employmentFull timePHOTON
Mumbaia month ago- ...AB-NPC1-L91969 BIU:Data Engineer INTERNAL USAGE: No. of Vacancies: 1 Reports to: Is a Team leader Team Size: 8-15 Grade: SM-TRIAD Business: BIU Department: BIU Sub - Department: BIU Location: Mumbai/Bangalore...
Axis Bank
Mumbai7 days ago Rs 2 - 5 lakhs p.a.
...Seeking for a strong data analyst who can perform independent. Good to have Prior experience in banking domain is plus and understanding the finance various data transactions. Should be strong in the below: Python Pyspark SQL Airflow Trino Hive Offshore...PHOTON
Mumbaia month ago- ...NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive... ...organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Bangalore, Mahrshtra (IN-MH), India (...
NTT Data
Mumbai15 days ago Rs 5 - 15 lakhs p.a.
...About the Role: In this role as a Data Engineer, you will: Design, develop, optimize, and automate data pipelines that blend and transform data across different sources to help drive business intelligence, data science, and self-service data solutions. Work closely...Work at officeShift work2 days weekReuters
Mumbai10 days agoRs 2 - 3 lakhs p.a.
...Role & responsibilities Analyse and organize raw data Build data systems and pipelines Combine raw information from different... ...of T-SQL programming ~ BS degree in Computer Science, Engineering or a related subject ~ Sense of ownership and pride in your performance...Sbicap Securities
Mumbaia month agoRs 8 - 12.5 lakhs p.a.
...Key Deliverables: Design and maintain robust ETL/ELT pipelines and cloud-based data systems Ensure data reliability, quality, and compliance across maritime operations Collaborate with data scientists to enable ML models and analytical use cases Monitor, troubleshoot...Fleet Management
Mumbaia month ago- ...that extends Excel capabilities to optimize outcome time, minimize user errors, and enhance reliability and accuracy with diverse source data types. Built on a robust .NET core architecture, XL++ works on all Excel versions and processes large datasets efficiently. It features...Full time
XL++
Mumbaia month ago Rs 5 - 10 lakhs p.a.
...We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle...Permanent employmentFull timePHOTON
Mumbaia month ago- ...AB-NPC1-L91969 BIU:Data Engineer INTERNAL USAGE: No. of Vacancies: 1 Reports to: Is a Team leader Team Size: 8-15 Grade: SM-TRIAD Business: BIU Department: BIU Sub - Department:...
Axis Bank
Mumbai7 days ago - ...analytics team leaders youwill support our businesswith excellent data models to uncover trends that can drive long-term business... ...is a plus Purpose of Role The Visualization & Semantic engineer will be an expert in designing implementing and optimizing the Semantic...Long term contractFull timeRelocation package
- ...Essential: Technical: Expert-level SQL and Python programming Strong Data modelling and database design skills Proficiency in ETL/ELT processes Understanding of different data modelling techniques (e.g Kimban star and snowflake schemas etc) Analyse organise...Full timeRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (AWS, SQL) . Be the first to apply!
