Data Engineer ID94415
AgileEngine
We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.
The mandatory requirements are 3+ years of Python, advanced SQL, Snowflake data modeling, and hands-on experience with Airflow, Spark/PySpark, and AWS S3.
RECRUITMENT PROCESS
1. Application — Share a few details about your experience and background.
2. Coding Challenge — If applicable, complete it in the coding language you are most comfortable with.
3. Video Interview — Record a short video introduction in English.
4. Technical Interview or Hiring Manager Interview — Discuss your experience and fit for the role.
5. Offer — If it’s a match, you’ll receive an offer.
WHAT YOU’LL GAIN
• Remote work — Work from where you feel most productive.
• Local presence in India — Work in a structured and compliant environment aligned with Indian regulations.
• Competitive compensation in INR — Receive compensation in INR, plus support for learning, education, and wellness.
• Exciting projects — Work with modern technologies for global clients and fast-growing companies.
MUST HAVES
• Strong software engineering fundamentals.
• 3+ years of hands-on Python development experience.
• Advanced SQL , including complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling.
• Apache Airflow — developing and testing pipelines in Airflow and Python.
• Apache Kafka.
• Apache Spark , including hands-on PySpark experience.
• Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• Testing strategy experience, with the ability to hands-on debug and test code.
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.
• Upper-intermediate English level.
NICE TO HAVES
• Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization).
• Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations).
• Experience using AI tools for development.
WHAT YOU WILL DO
• Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
• Execute the migration of approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
• Ensure data quality and reliability throughout the migration process.
• Support workflow scheduling and monitoring in Apache Airflow 3.
• Execute time-sensitive migrations, including Airflow 2 to 3, Confluent region migration, and the move to Iceberg.
• Help accelerate the migration initiatives targeted for completion by the end of March 2027.
Rs 12 lakh p.a.
...Summary We are seeking a highly skilled Salesforce Data Cloud Developer to drive our IT Services initiatives. This pivotal role focuses... ...environment to meet specific business requirements. Engineer and optimize Data Streams and integrations for Salesforce Data Cloud...SuggestedFull time- ...too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Azure Data engineers As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges...SuggestedFlexible hours
- ...too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Senior AWS Engineer As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with...SuggestedFlexible hours
Rs 6 lakh p.a.
Full Stack Developer (.NET Core + Angular) Location: 2- 4 weeks in Kolkata (Knowledge Transfer & Onboarding), then Remote from Bhubaneshwar Experience: 2+ years Why Join? You won’t just be coding; you’ll be shaping solutions that make a real impact....SuggestedRemote job- ...Overview : We are looking for an experienced Databricks Platform Engineer to manage, maintain, secure, and optimize enterprise-scale Databricks... ...policies, jobs, and access controls.- Manage Unity Catalog, data governance, permissions, and workspace security.- Monitor platform...Suggested
- Responsibilities:- Leading data architecture and delivery workstreams from design through implementation for complex client programs.... ...scope, risk, and timeline decisions.- Coaching team members on engineering standards, data management practices, and issue resolution methods...Hybrid work
- ...technology domain, especially in healthcare interoperability, clinical data modelling, data transformation, and integration workflows. The... ...good to have but not mandatory. Experience with integration engines or healthcare integration tools such as Mirth Connect, NiFi, or...
- ...finance processes such as billing validation, invoice submission, and dispute resolution. Proficiency in MS Excel (lookups, pivots, data validation) and ability to prepare basic reports or trackers. Ability to analyse data, spot inconsistencies, and resolve billing-related...Work at office
- Company Description We are more than 230,000 hospitality experts placing people at the heart of what we do, creating emotion for our guests, and nurturing passion for service and achievement beyond limits. Building on the strength of our teams and of our integrated ecosystem...Permanent employmentFull timeWorldwide
- POSITION SUMMARY Prepare drink orders for guests according to specified recipes using measuring systems. Issue, open, and serve wine/champagne bottles. Set up and maintain cleanliness and condition of bar, bar unit, tables, and other tools. Prepare fresh garnishes for...Full timeShift work
- We are more than 230,000 hospitality experts placing people at the heart of what we do, creating emotion for our guests, and nurturing passion for service and achievement beyond limits. Building on the strength of our teams and of our integrated ecosystem of leading brands...Full timeWorldwide
Rs 2.4 lakh p.a.
...Actively hiring Full Stack Engineer Start Date Starts Immediately CTC (ANNUAL) ₹ 2,40,000 ₹ 2,40,000 /year Experience...Immediate start- ...own and other teams. Provide input to application development/engineering methodologies, standards and leading practices. Anticipate... ...society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust...
- ...We are looking for a Senior Java Engineer to build and maintain Java and Spring Boot services for a high-stakes, distributed payments platform... ...• Strong JPA/Hibernate experience with MySQL/Aurora (Spring Data JPA), including transactional design and optimistic locking....Full timeLocal areaRemote job
- About the role :You will set up and manage data governance, data catalog and data quality on cloud platforms, using Collibra Data Quality... ...to business and technology teams- Work with data owners, data engineers and compliance teams to meet governance requirementsWhat you need...
- About the role : You will design, build and maintain ETL data pipelines using Ab Initio to move and transform large volumes of data for reporting and analytics.What you will do : - Design, develop and maintain ETL graphs and plans using Ab Initio- Extract data from multiple...
- ...legal and regulatory requirements to clients TPRM practices. Participate in technology enhancement requirements such as Automation, Data Analytics, AI to support TPRM processes. Understand the process gaps and propose preventive/corrective action where appropriate....Contract workWorldwide
Rs 10 - 12 lakhs p.a.
...About the Role We are looking for a highly organized and proactive Technical Project Manager to support technical and engineering projects from planning through execution. This opportunity is particularly suitable for candidates with a strong technical or engineering...Full time- ...Responsibilities Design and develop scalable batch and incremental data pipelines using Fabric Data Factory or Azure Data Factory.... ...source-system teams. Perform peer reviews and mentor Level 1 engineers. Requirements Strong SQL skills, including joins, window functions...Full time
- ...hands-on experience in SNP configurations, Strong support experience in resolving complex issues related to Core Interface (CIF), Master Data, Demand and Supply Planning, Net change planning Sub-Contracting.- Experience in Heuristic/Optimizer and analysing its results, Alerts...Flexible hours
- ...Job Description We are seeking an experienced and strategic Data Lead with strong expertise in Microsoft Fabric, enterprise data... ...The Data Lead will collaborate with business stakeholders, data engineers, analysts, governance teams and enterprise Leads to deliver secure...Full timeHybrid workWorldwideFlexible hours
- ...to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Lead AI Engineer to architect generative AI workflows that accelerate cloud configuration and remediation. Using RAG, vector databases, and LLM APIs,...Full timeLocal areaRemote jobFlexible hours
- ...develop SAC models, stories, dashboards, and planning solutions based on business needs.- Configure SAC Planning capabilities including data actions, allocations, and version management, where applicable.- Work on data integration and connectivity between SAC and source...
- ...We are looking for a Senior Java Engineer to develop and maintain backend services for distributed billing and account management systems... ...Apollo Java/Kotlin Client, event-driven systems, and strong Spring Data JPA and CI/CD experience. RECRUITMENT PROCESS 1....Full timeLocal areaRemote job
- ...accurate mapping of IT infrastructure and business services.- CMDB Health & Governance : Establish CMDB architecture best practices, ensuring data integrity, accuracy, and health using the Common Service Data Model (CSDM) framework.- Technical Leadership : Act as the Subject Matter...
- Position Summary : The Data Analyst plays a pivotal role in applying advanced analytical, statistical, and optimization techniques for... ...such as Operations Research, Computer Science, Statistics, Engineering or any other highly quantitative discipline.- Around 3+ years' experience...
- Role : Forward Deployed Engineer (FDE) specializing in Gemini Enterprise, Agentic AI, and Multi-Agent Systems.Responsibilities : - Design,... ...Code Vs No Code design based on customer's problem statement and data sources.- Design and deploy custom agents using the Agent Development...Long term contractTemporary workLocal area
Rs 5 - 10 lakhs p.a.
Job Title: Lead Generation Executive – Non-IT Staffing Sales Location: Kolkata (Salt Lake – Work From Office) Industry: Non-IT / General / Contract Staffing Experience: Minimum 6 months – 3 years of relevant experience About 2COMS 2COMS Group ...Minimum wageLong term contractPermanent employmentFull timeContract workWork at office- ...Claude and Agentforce. This person bridges business stakeholders and engineering teams, translating priorities into solid solution design. Strong... ...establish engineering best practices. - Collaborate with data, product, and business teams to prioritize high-value use cases...Long term contractFull timeLocal areaRemote job
- Role Overview : We are seeking an Assistant Manager - Data Science to build and scale advanced analytics solutions for the General Trade... ...opportunities and process improvement areas.- Partner with data engineering, business analytics, sales operations and technology teams to...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer ID94415. Be the first to apply!
