#111 - Data Engineer
Lifted, an Upwork Company™
We are seeking a hands-on Data Engineer to support a large-scale data platform modernization initiative. You will migrate approximately 1,000 datasets to Snowflake, adapt existing pipelines, and help deliver reliable orchestration with Apache Airflow 3. The architecture and technical approach are already defined, with the role focused on implementation and migration delivery through March 2027. Enterprise experience strongly preferred. Key Responsibilities - Migrate pipelines from Apache Airflow 2 to Apache Airflow 3. - Migrate Confluent connections between cloud regions. - Migrate pipelines from Hive to Iceberg using Snowpark Connect. - Adapt existing data pipelines to Snowflake while maintaining data quality and reliability. - Support workflow scheduling and monitoring in Apache Airflow. - Partner with the team to execute time-sensitive data migrations. Must-Have Skills - 2+ years of experience. - Strong software engineering fundamentals. - Hands-on Python development experience. - Advanced SQL, including complex joins, CTEs, window functions, and performance tuning. - Snowflake data modeling. - Apache Airflow experience developing and testing pipelines in Airflow and Python. - Apache Kafka experience. - Apache Spark experience, including hands-on PySpark. - Experience with Iceberg and Parquet data formats.
- AWS experience, particularly S3 data lakes, partitioning, and lifecycle policies. - Testing strategy experience and the ability to debug and test code hands-on. - At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark. - Strong communication skills. - Ability to work independently. Nice-to-Have Skills - Hands-on Snowflake migration experience, including data warehouse modernization and performance and cost optimization. - Apache Airflow migration experience, including version upgrades, executor changes, or platform migrations. - Experience using AI tools for development. Required Tools & Platforms - Python and SQL. - Snowflake, Apache Airflow, Apache Kafka, and Apache Spark/PySpark. - Iceberg and Parquet. - AWS S3. - The migration environment also includes Confluent, Hive, and Snowpark Connect. Location, Time & Engagement - Open to candidates in eligible EMEA and APAC locations. - Coverage until 12:00 PM Pacific Time is required. - Remote contract engagement for 40 hours per week. - Expected engagement through March 31, 2027; start date to be confirmed. - Two openings are available. - This is not currently a contract-to-hire opportunity.
- About the Company The Tann Mann Gaadi is seeking an Angular Developer Intern to contribute to technology projects in a remote, work-from-home environment. This is an unpaid, part-time opportunity designed for someone with two years of experience who can work after regular...SuggestedRemote jobPart timeInternshipWork at officeWork from home
- ...operate scalable systems that power payments ecosystems, host/guest protections as well as community partner experiences applying core engineering principles that leverage both time-tested and cutting edge technology. The Difference You Will Make: As a Senior Staff...SuggestedLong term contractCasual workWork at officeRemote job
€ 63.000 p.a.
...About the Team Netlify’s engineering teams build the products, platforms, and infrastructure that empower millions of developers and builders to create, deploy, and scale modern web applications. From AI-powered workflows to edge infrastructure and developer experience, our...SuggestedRemote jobWorldwideRs 20 - 60 lakhs p.a.
...Mid-level data science role at Jobgether. Needs 4+ years and an M.Sc, B.Tech or B.E.. Remote; pays ₹20–60 LPA. What you'll do Lead... ..., including Lakehouse, Data Warehouse, Data Factory, Data Engineering, Real-Time Intelligence What you need SQL Python ETL...SuggestedFull timeRemote job- ...Senior data science role at Jobgether. Needs 5+ years and a degree. Remote. What you'll do Design, develop, and productionize machine... ...end-to-end ML development, covering data preparation, feature engineering, model development, validation, hyperparameter tuning, and...SuggestedFull timeRemote job
- ...Mid-level software engineering role at Jobgether. Needs 4+ years and a BBA. Remote. What you'll do Take ownership of Salesforce as the enterprise CRM platform across Marketing, Sales, Customer Service, Analytics, and Technology functions Define and execute the CRM strategy...Full timeRemote jobUS shift
- ...Senior software engineering role at Jobgether. Needs 5+ years and a B.Tech, B.E. or B.Sc. Remote. What you'll do Configure and implement... ...transportation networks, carrier structures, rates, and master data Customize SAP TM functionalities and support integration with...Full timeRemote job
- Senior DevOps and cloud role at Jobgether. Needs 5+ years. Remote. What you'll do Design, develop, maintain, and optimize AWS cloud infrastructure using Terraform and Infrastructure as Code (IaC), improving platform reliability, scalability Manage and enhance core AWS...Full timeRemote job
- ...Senior data science contract role at Jobgether. Needs 5+ years. Remote. What you'll do Design, develop, and implement scalable data engineering solutions using the Databricks platform and modern cloud-based data lakehouse architectures Build and maintain advanced data...Contract workRemote job
- ...Mid-level software engineering role at Jobgether. Needs 4+ years and a B.Sc, B.Tech or B.E.. Remote. What you'll do Design, develop, and... ...flows, Dialog Engine Bot Flows Build, configure, and optimize Data Actions, workflows, and integrations between Genesys Cloud,...Full timeRemote job
- ...Senior software engineering role at Jobgether. Needs 6+ years and a degree. Remote. What you'll do Design, develop, and deploy model-driven... ...automate business processes, reduce manual tasks, and improve data flow across enterprise systems Architect end-to-end solutions...Full timeWork at officeRemote job
- ...Senior software engineering role at Jobgether. Needs 6+ years and a B.Sc, B.Tech or B.E.. Remote. What you'll do Design, develop, and deploy... ...streamline business processes, reduce manual tasks, and improve data exchange across enterprise systems Architect end-to-end...Full timeWork at officeRemote job
- ...Senior software engineering role at Jobgether. Remote. What you'll do Design, build, and improve internal developer platforms, CI/CD pipelines, and reusable tools that streamline software development, testing, and deployment Create standardized development environments...Full timeRemote job
- ...Jobgether. Needs 5+ years. Remote. What you'll do Cross-Functional Collaboration: Partner with IT Operations, DevOps, and Software Engineering teams to coordinate remediation activities, provide technical guidance Develop autonomous AI agents and intelligent automation...Full timeRemote job
- ...Senior software engineering role at Jobgether. Needs 5+ years and a B.Sc, B.Tech or B.E.. Remote. What you'll do Maintain accurate, secure, and reliable workforce records, ensuring associate data meets established quality and governance standards Monitor and improve...Full timeRemote job
- ...Senior data science role at Jobgether. Needs 5+ years and a B.Sc, B.Tech or B.E.. Remote. What you'll do Support the end-to-end operation of clinical data pipelines across cloud-based data lakes and data warehouses, including development, monitoring, maintenance Develop...Full timeRemote job
- ...Data science role at Jobgether. Remote. What you'll do Design, develop, and maintain the semantic layer supporting Databricks Genie... ...Good to have dbt Power BI Tableau Looker Prompt engineering AWS Job details Location: Remote, anywhere in India...Full timeRemote job
Rs 3.6 - 5.1 lakhs p.a.
...features and scripts based on project requirements, keeping code organized and easy to maintain. 2. Use relevant Python libraries to handle data, automate routine tasks, or support application functionality. 3. Create and update web pages with HTML and CSS, ensuring layouts are...Remote jobPart timeInternshipImmediate startWork from homeRs 2.8 - 4 lakhs p.a.
Actively hiring Full Stack Developer Start Date Starts Immediately CTC (ANNUAL) ₹ 2,80,000 - 4,00,000 ₹ 2,80,000 - 4,00,000 /year ...Remote jobImmediate startWork from home- ...Responsibilities of the Intern: Perform basic exploratory data analysis (EDA) to identify patterns and insights Create simple visualizations, charts, and dashboards to present findings Support the team in preparing data-driven reports and presentations Work with...Internship
- Roles and Responsibilities: Contribute to the development of front-end features for web applications. Assist with building and maintaining server-side application functionality. Support the integration of front-end components with back-end services. Help implement...Remote jobInternship
- ...equivalent certifications / experience required in Computer Science, Engineering, or related subject preferred ~3+ years IT development... ...Azure Functions, APIM) ~ Strong experience with Dataverse (common data service) and Data modeling ~ Data migration and data integration...Full timeTemporary work
- ...York City, and we are solving some of the biggest challenges in youth sports today. The Position: We’re looking for a Software Engineer to join the Ads team, which builds the systems that power display and video advertising across GameChanger’s Android, iOS, and web apps...Long term contractFull timeTemporary workImmediate startRemote jobWork from homeShift work
- ...company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google... ...for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to...Full timeContract workTemporary workRemote job
- ...industry-leading safety standards and years of proven deployment data, we’re pioneering a new era of automation that enhances human... ...reaches production, passes through systems Infrastructure Release Engineering owns: the Bazel build system and CI runner platform our developers...Long term contractFull timeTemporary workHybrid workRelocation packageRemote jobFlexible hours
- ...software and professional services for: - AI-powered multimodal data harmonization and analytics for drug discovery and development -... ...Effectively leverage AI-assisted development tools, ing prompt engineering and context management techniques to improve productivity and code...Full time
- ...Senior software engineering role at 99brightminds. Needs 6+ years. Remote. What you'll do Design, develop, and deploy scalable enterprise... ...Write and optimize SOQL/SOSL queries for complex data structures while respecting governor limits What you need...Full timeRemote job
- ...Danaher seeks a Data Analyst to maintain workforce data accuracy and security in Workday, supporting HR operations across compliance, audits, and integrations. The role focuses on delivering audit-ready data, eliminating recurring defects, and ensuring integration reliability...
- ...founder and CTO at Kayzen, and I am now looking for a Senior Software Engineer who will be a part of the platform engineering team. But wait,... ...over buying decisions, and AI capabilities that connect campaign data to the AI assistants teams already use. Kayzen’s vision is to...Full timeWork at officeRemote jobWork from homeHome officeFlexible hours
- ...others. We’re a team of 170+ across 26 states and 7 countries, headquartered in New York City. Lithic is hiring a Senior Software Engineer for our Issuing team to work cross-functionally with product, solutions, compliance and support to build reliable, developer-...Full timeWork at officeRemote job3 days week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to #111 - Data Engineer. Be the first to apply!
