Data Engineer
AS Technology Corporation
Experience: 6-10 Years Budget: 28-29 LPA Location: Kochi, Thiruvananthapuram Client: Fiserv Mandatory skills: Azure Data Factory,Pyspark,Azure, Python, ETL Developement Job description Develop and manage ETL workflows using Azure Data Factory (ADF). Design and implement data pipelines using PySpark on Azure Databricks. Work with Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage for data ingestion and transformation. Optimize Spark jobs for performance and scalability in Databricks. Automate data workflows and implement error handling & monitoring in ADF. Collaborate with data engineers, analysts, and business teams to understand data requirements. Implement data governance, security, and compliance best practices in Azure. Debug and troubleshoot PySpark scripts and ADF pipeline failures. 4+ years of experience in ETL development with Azure Data Factory (ADF). Hands-on experience with Azure Databricks and PySpark for big data processing. Strong knowledge of Azure services Proficiency in Python and PySpark for data transformation and processing. Experience with CI/CD pipelines for deploying ADF pipelines and Databricks notebooks. Strong expertise in SQL for data extraction and transformations. Knowledge of performance tuning in Spark and cost optimization on Azure.
Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Kochi vacancy
- We are seeking a seasoned Lead Data Engineer to join our technical leadership team in Kochi . This is a high-priority, mission-critical role designed for a professional who excels at building scalable data architectures and leading engineering excellence from the front. Note...SuggestedImmediate start
- ...Job Description : Design, develop, and optimize database-centric solutions on a high-volume data platform. Comfortable with at least one language with Python. Work extensively with SQL in a large-scale production environment Develop and improve ETL/data pipelines...Suggested
- ...Superpowers End-to-End Ecosystem Thinker: You build modular, reusable data products across ingestion, transformation (ETL/ELT), and... ...performance benchmarks, not just slideware. Al-Ready Orchestrator: You engineer the bridge between structured data and Unstructured/Vector stores...Suggested
- ...financial transactions daily. You will work at the intersection of big data processing and database excellence, ensuring our platform meets... ...Qualifications: •10 years of hands-on experience in data engineering with strong database expertise. •At least 5 years of experience...Suggested
- Position Summary: As a Data Engineer Manager at McCormick, you will play a pivotal role in the build and delivery of data products from simple to complex and supporting McCormick business units with their data and analytics needs. Your responsibilities will include leading...Suggested
- About the Job We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support...
- ...Minimum Requirements ~ Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience ~5+ years of experience working in data integration, pipelines, data modeling, ~ Experience designing and deploying code...
- Role: AWS Data Engineer Experience: 7-8 years Location: Pan India (Remote - UK Shift) 7-8 years of experience in data engineering Strong expertise in SQL (complex queries, optimization) Hands-on experience in PySpark for large-scale data processing Experience with AWS services...Remote job
- Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures in the AWS cloud environment. This role will collaborate...
- ...Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will...
- Hope you are doing good Our Client Is Looking For an MDM Data Engineer Find below the Job Description. Kindly reply to me back with your updated resume, contact details, and the best time to reach you. Job Term: Contract - (6+ months) Project Location : Remote Work Interview...Contract workRemote job
- ...Kochi, Thiruvananthapuram Client: Fiserv Mandatory skills: Azure Data Factory,Pyspark,Azure, Python, ETL Developement Job description Develop... ...error handling & monitoring in ADF. Collaborate with data engineers, analysts, and business teams to understand data requirements. Implement...
- ...leveraging global best practices and a strong partner ecosystem, SigmaT empowers organizations to reach their fullest potential. Role: Data Engineer (GCP + Python + BigQuery) Experience: 5-8 years Location: Chennai (Hybrid - 3 days WFO) Open Positions: 3 Salary: up to 18 LPA...Full timeHybrid workImmediate start
- We’re seeking a Data Engineer with at least one year of hands‑on experience in data engineering and analytics to join our collaborative team. In this role, you’ll build and maintain end‑to‑end ETL pipelines, design data models, and transform raw data into actionable insights...
- We are hiring a Data Engineer/ Software Engineer with 3-5 years of relevant experience in data engineering. About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured...Full time
- ...Azure Data Engineer (Contract) – INDIA – Fully Remote – 6 Months We’re hiring an experienced Azure Data Engineer to support a growing analytics platform and help scale modern data pipelines in a cloud-first environment. This is a hands-on role focused on building reliable...Contract workRemote job
- Hello, Greetings from GreatHR Solutions !! WE are hiring for Data ENgineer in CHennai which is Hybrid setup , if you feel this job interesting kindly share your resume to ****@*****.*** Role: Data Engineer (GCP + Python + BigQuery) Experience: 5-8 years Location: Chennai...Hybrid workImmediate start
- Skill: Power Bi Data Engineer Location: Pune (Shivaji Nagar Office) Experience: 7 to 12 years Np: Immediate to 30 Days Job Description: Seeking a Senior Specialist with 7 to 11 years of experience in Power BI, SQL and data analysis to drive data visualization and analytics...Work at officeImmediate start
- ...About KeyValue KeyValue is a trusted product engineering partner for Start Ups & Scale Ups - unlocking their passion, developing ideas,... ...the domains, features and metrics Design and build scalable data pipelines to handle data from different sources Extract data...
- ...Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up. You will own the end-to-end architecture... ...through the Medallion layers to serving — and establish the engineering standards that will guide the entire data organization. This is...Full time
- JD - Data Engineer - (Contract) This is a contractual position for D Square Consulting Services Pvt Ltd Experience - 5-7 Years Location - Bangalore Work mode - Hybrid Notice period: Immediately to 30 days Job Summary We are seeking a skilled Data Engineer to join our dynamic...Contract workHybrid workImmediate start
- Job Title: Data Engineer Work Location: Any Infosys Development Center (Preferred: Bangalore, Karnataka) Experience: Relevant Experience: 5+ Years Total Experience: 6-8 Years Domain: Banking Additional Details Work Mode: Hybrid Shift Timing: General Shift (10:00 AM - 7:15 PM...Hybrid workShift work
- Avigna is hiring Data Engineer Our IT Delivery Center aims to build strong and sustainable solutions for customers across Europe. We are looking for a Data Engineer to join the team to build, support, and drive customer innovations, bringing efficiency to processes through...Remote job
- Job Description Infiligence is a multi national AI-led Platform Engineering company with offices in Chennai, Calgary, and Pleasanton, California... .... Key Responsibilities Design, develop, and maintain scalable data pipelines for batch and real-time data processing using Azure (...Worldwide
- We are looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team. The ideal candidate will have hands-on experience designing scalable data pipelines, workflow orchestration frameworks, and large-scale...
- ...provide on-demand video interviews service to employers and job-seekers. We looking for part time remote interviewer for Snowflake Data Engineer skills. Please apply immediately if you are interested. you will get a call from our team member. PLEASE REVIEW THE DETAILS, AND...Part timeFreelanceImmediate startRemote job
- ...with hyper-focused, domain-centered teams and cutting-edge tech, data, and analytics. Our real-world practitioners work collaboratively... ...outcomes Job Description: Mode of work: Remote Role: Senior Data Engineer 9 to 15 years of prior experience as a software engineer or data...Remote jobShift work
- ...'re looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE Data Engineer role focuses on building and evolving scalable data solutions on Google Cloud Platform to support complex data ecosystems. You will...Full timeLocal areaRemote job
- ...JOB DESCRIPTION Are you passionate about leveraging data and analytics to drive operational impact in the energy sector? At NOV, we... ...drilling and rig equipment solutions. We are seeking a talented Data Engineer who not only excels at building scalable data architectures but...Full timeHybrid work
- ...Job Title: Data Engineer Work Mode: Remote Location: Gurgaon Hiring Alert | Data Engineer (3–4 Years Experience) We are looking for a talented Data Engineer to join our growing team! If you have strong expertise in SQL and Power BI , along with experience...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
