#111 - Data Engineer
Lifted, an Upwork Company™
We are seeking a hands-on Data Engineer to support a large-scale data platform modernization initiative. You will migrate approximately 1,000 datasets to Snowflake, adapt existing pipelines, and help deliver reliable orchestration with Apache Airflow 3. The architecture and technical approach are already defined, with the role focused on implementation and migration delivery through March 2027. Enterprise experience strongly preferred. Key Responsibilities - Migrate pipelines from Apache Airflow 2 to Apache Airflow 3. - Migrate Confluent connections between cloud regions. - Migrate pipelines from Hive to Iceberg using Snowpark Connect. - Adapt existing data pipelines to Snowflake while maintaining data quality and reliability. - Support workflow scheduling and monitoring in Apache Airflow. - Partner with the team to execute time-sensitive data migrations. Must-Have Skills - 2+ years of experience. - Strong software engineering fundamentals. - Hands-on Python development experience. - Advanced SQL, including complex joins, CTEs, window functions, and performance tuning. - Snowflake data modeling. - Apache Airflow experience developing and testing pipelines in Airflow and Python. - Apache Kafka experience. - Apache Spark experience, including hands-on PySpark. - Experience with Iceberg and Parquet data formats.
- AWS experience, particularly S3 data lakes, partitioning, and lifecycle policies. - Testing strategy experience and the ability to debug and test code hands-on. - At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark. - Strong communication skills. - Ability to work independently. Nice-to-Have Skills - Hands-on Snowflake migration experience, including data warehouse modernization and performance and cost optimization. - Apache Airflow migration experience, including version upgrades, executor changes, or platform migrations. - Experience using AI tools for development. Required Tools & Platforms - Python and SQL. - Snowflake, Apache Airflow, Apache Kafka, and Apache Spark/PySpark. - Iceberg and Parquet. - AWS S3. - The migration environment also includes Confluent, Hive, and Snowpark Connect. Location, Time & Engagement - Open to candidates in eligible EMEA and APAC locations. - Coverage until 12:00 PM Pacific Time is required. - Remote contract engagement for 40 hours per week. - Expected engagement through March 31, 2027; start date to be confirmed. - Two openings are available. - This is not currently a contract-to-hire opportunity.
- ...Stack Developer with strong Angular and .NET expertise who knows how to leverage AI to build and ship features faster. Join a growing engineering team developing a healthcare revenue cycle management platform that streamlines insurance claims, billing, and financial workflows...SuggestedFull time
- Java Full-Stack Developer Location: Remote, USA Employment type: Contract Indicative rate: $65–$75/hr Contract opportunities for Java full-stack developers building and enhancing enterprise web applications. Work may span backend services and APIs, frontend features...SuggestedFull timeContract workRemote job
- ...staff, and fundraise; while managing the complex requirements around data privacy, accessibility, hosting and security. Finalsite products... ...Summary of Responsibility The Senior Application Security Engineer is responsible for identifying, triaging, and remediating security...SuggestedPermanent employmentFull timeRemote job
- Entry-Level Java Software Developer Location: Remote, USA Employment type: Contract Indicative rate: $20–$30/hr Contract-oriented entry-level opportunity combining structured, hands-on software development training with subsequent project experience. Training covers...SuggestedFull timeContract workRemote job
- ...strong interest in AI to join us in building AI Xplore - a hands-on platform for learning, practicing, and building real-world AI engineering skills. Technical Skills & Experience Required: Experience: 0–3 years Strong knowledge of Next.js Experience with React...Suggested
- ...goals and deliver meaningful project contributions. Requirements: Open to students pursuing computer science, software development, data science, or related technology programmes. Eligible academic backgrounds include B.Tech/BE, M.Tech/ME, integrated B.Tech-M.Tech...Remote jobInternship
- ...analytical and detail-oriented candidate to join the Analytics team in Gurugram. As part of the team, you will work with data science, product, engineering, and customer success teams to drive complex data and trend analyses to propose ways to improve and, thereby...Full time
- ...Java Backend Developer Location: Remote, USA Employment type: Contract Indicative rate: $80–$90/hr Contract roles for Java engineers developing, modernizing, and supporting enterprise backend applications and services. Work may include API development, integrations...Full timeContract workRemote job
- ...happen and improve the daily lives of millions of people by bringing quality software to the federal space. We’re looking for a VP of Engineering to lead and scale Oddball’s engineering practice across our federal digital modernization portfolio — someone who brings proven...Full timeContract workFor contractorsRemote jobFlexible hours
- ...is complex, high-stakes and full of edge cases. As our Staff AI Engineer, you’ll set the technical direction for how we build, evaluate and... ...matters most. Design and build production LLM and NLP systems, data pipelines and ML services. Guide critical core components through...Full timeLocal areaRemote job
- ...Aalteon is hiring for Data Analyst Intern About the Company Aalteon is offering a practical remote learning opportunity for aspiring data professionals. The internship gives candidates hands-on exposure to business data, reporting workflows, and analytical problem-solving...Remote jobInternship
- Java Developer – Specialized Platforms and Integrations Location: Remote, USA Employment type: Contract Indicative rate: $80–$90/hr Contract Java development work supporting specialized enterprise platforms, integrations, and domain-specific applications. Assignments...Full timeContract workRemote job
- ...software company specialising in technology for the energy and commodity markets. They are looking for a hands-on Principal Software Engineer to join a small engineering team building complex software for the European energy and trading market. This is a technical leadership...Long term contractFull time
- ...With Jitterbit, organizations can streamline operations, enhance data accessibility, and deliver on a growing list of IT needs more... ...innovation for organizations globally. About the team: At Jitterbit, engineering is at the heart of everything we do. We take pride in writing...Full timeRemote jobFlexible hours
Rs 21 - 26 lakhs p.a.
...and procurement workflows. This pivotal role demands an expert capable of navigating complex SAP ECC environments while driving seamless data migration and system integration projects. The ideal candidate will serve as a critical bridge between technical execution and business...Full timeRs 18 lakh p.a.
...Services division. This pivotal role demands a professional with over six years of specialized expertise to drive system architecture, data integrity, and migration strategies. The successful candidate will be instrumental in executing complex data migration projects, ensuring...Full timeRemote job- ...PaPM experience, preferably with 1 - 2 end-to-end implementations.- Experience delivering multiple SAP PaPM use cases.- Expertise in PaPM data modelling, calculation logic, allocation functions, formulas, drivers, and business rules.- Understanding of cost and revenue...Full timeImmediate start
- Role : Microsoft Dynamics 365 F&O Data ArchitectJob Role : Microsoft Dynamics 365 F&O Data ArchitectTotal Experience : 8 - 14 yearsKey... ..., cutover, and production readiness- Collaborate with BI, Data Engineering, Finance, Supply Chain, and ERP teamsIdeal Candidate : An experienced...
- ...Key Responsibilities : - Design, implement, and maintain Oracle HCM Cloud security models to safeguard sensitive HR and organizational data.- Configure and manage Data Roles, Job Roles, Duty Roles, Privileges, and Role Hierarchies in accordance with the principle of least privilege...
- ..., BAPI, BADI, Web Services, and ABAP Proxies.- Monitor interfaces, troubleshoot errors, perform root cause analysis, and ensure smooth data processing using SAP AIF.- Support end-to-end integration scenarios between SAP and external systems.- Collaborate with middleware teams...Full timeRemote job
- Key Responsibilities :- Develop and maintain responsive web applications using React.- Build interactive tools and user interfaces for online learning experiences.- Create reusable components and maintain clean, scalable frontend code.- Integrate frontend applications with backend...
- ...platform Write a lot of asynchronous, template, network and thread-safety code WHAT WE LOOK FOR IN YOU: Solid understanding of data structures, algorithms, and object-oriented programming in C++ Understanding of Linux system internals Decent level of written and...Full timeHybrid workRemote jobFlexible hours
- ...builders doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to work... ...improved engagement Have designed and run A/B tests, using data to decide what to build next Comfortable with ambiguity and fast...Immediate startRemote job
- ...solutions that use artificial intelligence and modern software engineering to solve meaningful business problems. As a Python Developer Intern... ...team standards. Assist with debugging, documentation, data handling, API integration, and feature implementation. Collaborate...Paid InternshipFull timeInternshipRemote job
Rs 3.6 - 7 lakhs p.a.
...Actively hiring Data Analyst (Kannada Speaker) Start Date Starts Immediately... ...4. Have working knowledge of search engines, map applications, and social media platforms 5....Remote jobPart timeLocal areaImmediate startWork from homeHome officeFlexible hoursRs 2.1 - 4.6 lakhs p.a.
...Actively hiring Associate Data Scientist Start Date Starts Immediately CTC (ANNUAL) ₹ 2,10,000 - 4,60,000 ₹ 2,10,000 - 4,60,000 /year...Remote jobPart timeInternshipImmediate startWork from home- About the Company SG Technologies develops modern software solutions and web applications. The company is offering a practical, project-oriented opportunity for aspiring developers to build experience across the MERN stack while receiving guidance and feedback from its development...Permanent employmentInternshipRemote job
- ...technical debugging. You will solve and validate complex backend engineering problems, develop reproducible implementation and testing... ...experience. Deep understanding of backend service design, APIs, data systems, concurrency, and production software architecture. Experience...Hourly payContract workRemote jobFlexible hours
- ...Improve code quality, reduce technical debt, and increase developer productivity. Collaborate with product managers, designers, and engineers across multiple platforms and domains. Mentor engineers and provide technical, industry, and leadership guidance. Develop...Full time
- ...technical tasks Write a lot of asynchronous, template, network and thread-safe code WHAT WE LOOK FOR IN YOU: Strong knowledge of data structures, algorithms, and a competitive programmIng background Experience with C or C++ Understanding of Linux system internals...Full timeRemote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to #111 - Data Engineer. Be the first to apply!
