Data Engineer
Scientist Technologies
Job description Location- Bangalore Experience- 5-7 Yrs Overview: Data Engineer with experience in designing, building, and optimizing scalable data pipelines and data models. Strong expertise in SQL, Azure Data Factory (ADF), and Python for data processing, transformation, and integration across multiple data sources. Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory (ADF) to ingest, transform, and load data from various sources (APIs, databases, files). Write optimized and complex SQL queries for data extraction, transformation, and performance tuning. Develop data processing scripts using Python (Pandas, PySpark) for data cleansing, transformation, and automation. Build and maintain data models (star schema, snowflake schema) for analytics and reporting. Ensure data quality, consistency, and integrity across systems. Optimize database performance through indexing, partitioning, and query tuning. Integrate data from multiple systems like SQL Server, APIs, and cloud storage. Collaborate with stakeholders to understand business requirements and translate them into data solutions. Monitor and troubleshoot data pipelines and workflows. Technical Skills: SQL: Advanced query writing, joins, CTEs, window functions, performance tuning Azure Data Factory (ADF): Pipelines, triggers, data flows, linked services Python: Pandas, NumPy, PySpark (optional) Data Modeling: Star schema, Snowflake schema, normalization, dimensional modeling Databases: SQL Server / Snowflake / Azure SQL Cloud: Azure Data Services Version Control: Git / Bitbucket Preferred Qualifications: Experience with data warehousing concepts Knowledge of ETL best practices Familiarity with big data tools (Spark, Databricks) Understanding of API integrations
Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Kakinada vacancy
- Job Description : Design, develop, and optimize database-centric solutions on a high-volume data platform. Comfortable with at least one language with Python. Work extensively with SQL in a large-scale production environment Develop and improve ETL/data pipelines supporting...Suggested
- ...superior products and realise better customer value. We also offer data-driven solutions and AI-based products for businesses operating... ...domains. Experience - 6 - 10 years We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for...Suggested
- Lead Data Engineer - Andheri, Mumbai Experience: 8-12 years Qualification: Bachelor’s in Engineering/Computer Science or related field We are hiring a Lead Data Engineer to design, develop, and manage scalable data pipelines using modern cloud technologies. This role focuses...Suggested
- Role: AWS Data Engineer Experience: 7-8 years Location: Pan India (Remote - UK Shift) 7-8 years of experience in data engineering Strong expertise in SQL (complex queries, optimization) Hands-on experience in PySpark for large-scale data processing Experience with AWS services...SuggestedRemote job
- About the Job We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support...Suggested
- AWS PySpark Redshift Data Engineer Contract India (Offshore) Technet IT has partnered with a global technology services organisation supporting a portfolio of enterprise life sciences clients (large-scale, multi-national environment) to hire an experienced AWS PySpark Redshift...Long term contractContract work
- ...Minimum Requirements ~ Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience ~5+ years of experience working in data integration, pipelines, data modeling, ~ Experience designing and deploying code...
- Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures in the AWS cloud environment. This role will collaborate...
- Job Title: Data Engineer Work Mode: Remote Location: Gurgaon Hiring Alert | Data Engineer (3–4 Years Experience) We are looking for a talented Data Engineer to join our growing team! If you have strong expertise in SQL and Power BI , along with experience...Remote jobFlexible hours
- We are looking for a Data Engineer / BI Developer who enjoys working with data end-to-end, from structuring raw data to building meaningful dashboards that drive decisions. This role sits at the intersection of data engineering and business intelligence, requiring strong SQL...
- We are looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team. The ideal candidate will have hands-on experience designing scalable data pipelines, workflow orchestration frameworks, and large-scale...
- Job Summary We are looking for a skilled Data Engineer with strong experience in Google Cloud Platform (GCP) to design and build scalable data pipelines. The ideal candidate will have hands-on expertise in processing JSON data structures (including complex 3×3 nested formats...
- ...Ivy League University Alumni, Ex-Googlers, and successful entrepreneurs. Our Team: Our team of 20+ employees consist of data scientists, AI/ML Engineers, and mathematicians from top engineering and research institutes such as IITs, CERN, IISc, UZH, Ph.Ds. Our team includes...
- ...Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up. You will own the end-to-end architecture... ...through the Medallion layers to serving — and establish the engineering standards that will guide the entire data organization. This...Full time
- .../ Remote Required Skills & Experience Strong experience with big data technologies such as Apache Spark, Hadoop, and Hive. Hands‑on experience... ...world constraints. Job Description We are seeking a skilled Data Engineer to design, build, and optimize large‑scale batch data pipelines...Contract workRemote job
- Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will...
- Job Title: Data Engineer Work Location: Any Infosys Development Center (Preferred: Bangalore, Karnataka) Experience: Relevant Experience: 5+ Years Total Experience: 6-8 Years Domain: Banking Additional Details Work Mode: Hybrid Shift Timing: General Shift (10:00 AM - 7:15 PM...Hybrid workShift work
- We’re seeking a Data Engineer with at least one year of hands‑on experience in data engineering and analytics to join our collaborative team. In this role, you’ll build and maintain end‑to‑end ETL pipelines, design data models, and transform raw data into actionable insights...
- Job Title: Data Engineer - AWS & Databricks Job Summary: We are looking for a results-driven Data Engineer with strong expertise in Amazon Web Services (AWS) and Databricks to build scalable and efficient data solutions. The candidate will be responsible for developing robust...
- Job Tittle: Data Engineer Experience: 6-10 Years We are seeking a Senior Data Engineer to design, build, and maintain the core infrastructure powering our data-driven ecosystem. In this role, you will own the end-to-end data pipeline, converting complex business needs into...
- Azure Data Engineer (Contract) – INDIA – Fully Remote – 6 Months We’re hiring an experienced Azure Data Engineer to support a growing analytics platform and help scale modern data pipelines in a cloud-first environment. This is a hands-on role focused on building reliable...Contract workRemote job
- ...key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale. Position Title: Data Engineer. Role Summary: The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise...
- Hope you are doing good Our Client Is Looking For an MDM Data Engineer Find below the Job Description. Kindly reply to me back with your updated resume, contact details, and the best time to reach you. Job Term: Contract - (6+ months) Project Location : Remote Work Interview...Contract workRemote job
- Skill: Power Bi Data Engineer Location: Pune (Shivaji Nagar Office) Experience: 7 to 12 years Np: Immediate to 30 Days Job Description: Seeking a Senior Specialist with 7 to 11 years of experience in Power BI, SQL and data analysis to drive data visualization and analytics...Work at officeImmediate start
- ...Must Haves: -3+yrs Python experience for data engineering and backend development - API building using FastAPI - Azure AI Search for building scalable search and retrieval solutions - Strong SQL expertise Day to Day: This person will be responsible for designing...Remote job
- Job Purpose We are seeking a highly skilled Senior Data Engineer (Contractor) to design, build, and optimize scalable data platforms and pipelines. This role will play a critical part in developing modern data lakehouse architectures on AWS, enabling advanced analytics and...For contractors
- ...with hyper-focused, domain-centered teams and cutting-edge tech, data, and analytics. Our real-world practitioners work collaboratively... ...outcomes Job Description: Mode of work: Remote Role: Senior Data Engineer 9 to 15 years of prior experience as a software engineer or data...Remote jobShift work
- Avigna is hiring Data Engineer Our IT Delivery Center aims to build strong and sustainable solutions for customers across Europe. We are looking for a Data Engineer to join the team to build, support, and drive customer innovations, bringing efficiency to processes through...Remote job
- ...provide on-demand video interviews service to employers and job-seekers. We looking for part time remote interviewer for Snowflake Data Engineer skills. Please apply immediately if you are interested. you will get a call from our team member. PLEASE REVIEW THE DETAILS, AND...Part timeFreelanceImmediate startRemote job
- ...leveraging global best practices and a strong partner ecosystem, SigmaT empowers organizations to reach their fullest potential. Role: Data Engineer (GCP + Python + BigQuery) Experience: 5-8 years Location: Chennai (Hybrid - 3 days WFO) Open Positions: 3 Salary: up to 18 LPA...Full timeHybrid workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
