Data Engineer
Scientist Technologies
Job description Location- Bangalore Experience- 5-7 Yrs Overview: Data Engineer with experience in designing, building, and optimizing scalable data pipelines and data models. Strong expertise in SQL, Azure Data Factory (ADF), and Python for data processing, transformation, and integration across multiple data sources. Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory (ADF) to ingest, transform, and load data from various sources (APIs, databases, files). Write optimized and complex SQL queries for data extraction, transformation, and performance tuning. Develop data processing scripts using Python (Pandas, PySpark) for data cleansing, transformation, and automation. Build and maintain data models (star schema, snowflake schema) for analytics and reporting. Ensure data quality, consistency, and integrity across systems. Optimize database performance through indexing, partitioning, and query tuning. Integrate data from multiple systems like SQL Server, APIs, and cloud storage. Collaborate with stakeholders to understand business requirements and translate them into data solutions. Monitor and troubleshoot data pipelines and workflows. Technical Skills: SQL: Advanced query writing, joins, CTEs, window functions, performance tuning Azure Data Factory (ADF): Pipelines, triggers, data flows, linked services Python: Pandas, NumPy, PySpark (optional) Data Modeling: Star schema, Snowflake schema, normalization, dimensional modeling Databases: SQL Server / Snowflake / Azure SQL Cloud: Azure Data Services Version Control: Git / Bitbucket Preferred Qualifications: Experience with data warehousing concepts Knowledge of ETL best practices Familiarity with big data tools (Spark, Databricks) Understanding of API integrations
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Aligarh vacancy
- ...Job Description : Design, develop, and optimize database-centric solutions on a high-volume data platform. Comfortable with at least one language with Python. Work extensively with SQL in a large-scale production environment Develop and improve ETL/data pipelines...Suggested
- ...Superpowers End-to-End Ecosystem Thinker: You build modular, reusable data products across ingestion, transformation (ETL/ELT), and... ...performance benchmarks, not just slideware. Al-Ready Orchestrator: You engineer the bridge between structured data and Unstructured/Vector stores...Suggested
- Role: AWS Data Engineer Experience: 7-8 years Location: Pan India (Remote - UK Shift) 7-8 years of experience in data engineering Strong expertise in SQL (complex queries, optimization) Hands-on experience in PySpark for large-scale data processing Experience with AWS services...SuggestedRemote job
- ...Minimum Requirements ~ Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience ~5+ years of experience working in data integration, pipelines, data modeling, ~ Experience designing and deploying code...Suggested
- About the Job We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support...Suggested
- Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures in the AWS cloud environment. This role will collaborate...
- We are hiring a Data Engineer/ Software Engineer with 3-5 years of relevant experience in data engineering. About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured...Full time
- Key Responsibilities: * Design and develop end-to-end data solutions using Microsoft Fabric components (Data Factory, Synapse Data Engineering, Data Warehouse, Real-Time Analytics). * Build scalable and efficient ETL/ELT pipelines for structured and unstructured data. * Develop...
- We are looking for a Data Engineer / BI Developer who enjoys working with data end-to-end, from structuring raw data to building meaningful dashboards that drive decisions. This role sits at the intersection of data engineering and business intelligence, requiring strong SQL...
- Hope you are doing good Our Client Is Looking For an MDM Data Engineer Find below the Job Description. Kindly reply to me back with your updated resume, contact details, and the best time to reach you. Job Term: Contract - (6+ months) Project Location : Remote Work Interview...Contract workRemote job
- Job Description Infiligence is a multi national AI-led Platform Engineering company with offices in Chennai, Calgary, and Pleasanton, California... .... Key Responsibilities Design, develop, and maintain scalable data pipelines for batch and real-time data processing using Azure (...Worldwide
- .../ Remote Required Skills & Experience Strong experience with big data technologies such as Apache Spark, Hadoop, and Hive. Hands‑on experience... ...world constraints. Job Description We are seeking a skilled Data Engineer to design, build, and optimize large‑scale batch data pipelines...Contract workRemote job
- Job Role: We are seeking a highly skilled Snowflake Cortex / GenAI Data Engineer to support the delivery of AI-enabled analytics solutions on Snowflake. This role is ideal for an experienced data engineer with hands-on exposure to Snowflake Cortex, LLM-driven analytics, and...
- Job Title: Data Engineer Work Mode: Remote Location: Gurgaon Hiring Alert | Data Engineer (3–4 Years Experience) We are looking for a talented Data Engineer to join our growing team! If you have strong expertise in SQL and Power BI , along with experience...Remote jobFlexible hours
- ...Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up. You will own the end-to-end architecture... ...through the Medallion layers to serving — and establish the engineering standards that will guide the entire data organization. This is...Full time
- ...Job Purpose We are seeking a highly skilled Senior Data Engineer (Contractor) to design, build, and optimize scalable data platforms and pipelines. This role will play a critical part in developing modern data lakehouse architectures on AWS, enabling advanced analytics and...For contractors
- ...network across Americas, EMEA and Asia Pacific. About the Role: Position Title: Security Engineer Corporate Title: AVP Location: Bengaluru. Job Profile / Position details: As a Security & Data Engineer, you will be responsible for designing, implementing, and maintaining secure...Hybrid workWorldwide
- Azure Data Engineer (Contract) – INDIA – Fully Remote – 6 Months We’re hiring an experienced Azure Data Engineer to support a growing analytics platform and help scale modern data pipelines in a cloud-first environment. This is a hands-on role focused on building reliable...Contract workRemote job
- We’re seeking a Data Engineer with at least one year of hands‑on experience in data engineering and analytics to join our collaborative team. In this role, you’ll build and maintain end‑to‑end ETL pipelines, design data models, and transform raw data into actionable insights...
- Avigna is hiring Data Engineer Our IT Delivery Center aims to build strong and sustainable solutions for customers across Europe. We are looking for a Data Engineer to join the team to build, support, and drive customer innovations, bringing efficiency to processes through...Remote job
- Job Summary We are looking for a skilled Data Engineer with strong experience in Google Cloud Platform (GCP) to design and build scalable data pipelines. The ideal candidate will have hands-on expertise in processing JSON data structures (including complex 3×3 nested formats...
- ...Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will...
- Engineer the Data Backbone for AI with goML At goML, we build modern Generative AI, AI/ML, and Data Engineering solutions that help enterprises turn data into intelligent, scalable systems. Our mission is to bridge advanced data platforms with real-world business needs—enabling...Remote jobFlexible hours
- ...with hyper-focused, domain-centered teams and cutting-edge tech, data, and analytics. Our real-world practitioners work collaboratively... ...outcomes Job Description: Mode of work: Remote Role: Senior Data Engineer 9 to 15 years of prior experience as a software engineer or data...Remote jobShift work
- We are looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team. The ideal candidate will have hands-on experience designing scalable data pipelines, workflow orchestration frameworks, and large-scale...
- Job Title: Data Engineer Work Location: Any Infosys Development Center (Preferred: Bangalore, Karnataka) Experience: Relevant Experience: 5+ Years Total Experience: 6-8 Years Domain: Banking Additional Details Work Mode: Hybrid Shift Timing: General Shift (10:00 AM - 7:15 PM...Hybrid workShift work
- ...key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale. Position Title: Data Engineer. Role Summary: The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise...
- ...provide on-demand video interviews service to employers and job-seekers. We looking for part time remote interviewer for Snowflake Data Engineer skills. Please apply immediately if you are interested. you will get a call from our team member. PLEASE REVIEW THE DETAILS, AND...Part timeFreelanceImmediate startRemote job
- Job Title: Data Engineer - AWS & Databricks Job Summary: We are looking for a results-driven Data Engineer with strong expertise in Amazon Web Services (AWS) and Databricks to build scalable and efficient data solutions. The candidate will be responsible for developing robust...
- JD - Data Engineer - (Contract) This is a contractual position for D Square Consulting Services Pvt Ltd Experience - 5-7 Years Location - Bangalore Work mode - Hybrid Notice period: Immediately to 30 days Job Summary We are seeking a skilled Data Engineer to join our dynamic...Contract workHybrid workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
