Data Engineer ID89384
AgileEngine
We are looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.
The mandatory requirements are 5+ years of hands-on experience with Databricks and PySpark, advanced SQL, GCP, Delta Lake, modern lakehouse architectures, and an upper-intermediate English level.
RECRUITMENT PROCESS
1. Application — Share a few details about your experience and background.
2. Coding Challenge — If applicable, complete it in the coding language you are most comfortable with.
3. Video Interview — Record a short video introduction in English.
4. Technical Interview or Hiring Manager Interview — Discuss your experience and fit for the role.
5. Offer — If it’s a match, you’ll receive an offer.
WHAT YOU’LL GAIN
• Remote work — Work from where you feel most productive.
• Local presence in India — Work in a structured and compliant environment aligned with Indian regulations.
• Competitive compensation in INR — Receive compensation in INR, plus support for learning, education, and wellness.
• Exciting projects — Work with modern technologies for global clients and fast-growing companies.
WHAT YOU WILL DO
• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.
• Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and reusable frameworks and components to support new business requirements and datasets across multiple use cases.
• Implement data quality checks, monitoring, validation, exception handling, and production controls.
• Optimize PySpark and SQL workloads for performance, reliability, and scalability.
• Support testing, deployment, productionization, troubleshooting, and ongoing enhancement of data and agentic solutions.
• Collaborate with business, data engineering, and platform teams to identify further automation opportunities.
MUST HAVES
• 5+ years of strong hands-on experience with Databricks and PySpark .
• Advanced SQL and data-processing skills.
• Hands-on experience with GCP , particularly BigQuery .
• Experience with Delta Lake and modern data lake/lakehouse architectures.
• Strong understanding of ETL/ELT, data pipeline design, performance optimization, and data quality.
• Experience building reliable, scalable, production-grade data solutions.
• Strong analytical and troubleshooting skills.
• Understanding of software engineering practices, including testing, version control, deployment, monitoring, and production support.
• Upper-intermediate English level.
NICE TO HAVES
• Experience developing or integrating AI/agentic workflows, AI agents, or workflow automation solutions.
• Experience applying AI to automate data engineering, validation, troubleshooting, or operational processes.
• Familiarity with orchestration and automation frameworks.
• Experience developing reusable data engineering frameworks and platform components.
• Exposure to productionizing AI-enabled solutions with appropriate validation, monitoring, and human oversight.
- ...We are seeking dynamic Portfolio Data Analysts to join our team and collaborate closely with our founders, financial analysts, product managers, and engineers. In this role, you'll play a pivotal part in supporting our client onboarding and success team. You'll need a strong...Suggested
- .... Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including...Suggested
- ...owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating...SuggestedFull time
Rs 15000 - Rs 20000 per month
...operationalize generative AI, computer vision, and NLP at scale. Our engineers build production-grade AI systems that drive automation, enhance... ..., and serving on cloud GPU/TPU instances. Build scalable data pipelines for fine-tuning, validation, and evaluation using Python...Suggested- ...We’re helping machine builders and manufacturers create smarter, faster, and more efficient automation systems. As an Application Engineer – Motion Control & Automation, you’ll design motion control solutions, solve engineering challenges, and contribute to industrial automation...SuggestedFull time
- ...secure AI and agentic AI: the models, agents, tools, MCP servers, data pipelines, and identities across both our products and our... ...role: you are strong across every domain of security and privacy engineering, you operate with minimal direction in ambiguity, and you mature...Full timeLocal areaShift work
Rs 4 - 5 lakhs p.a.
..., cost per request). Contribute to agentic and tool-calling workflows where LLMs invoke internal APIs and business tools. Data & Engineering Write production-grade Python; build reproducible feature pipelines and transformations over the lakehouse/warehouse. Own...Full timeInternshipRs 0.38 lakh p.a.
Ground crew or ground staff work in the aviation industry where they are engaged in various roles at the airport. Ground staff ensures the safety and comfort of passengers, including checking in baggage, providing information, assisting disabled passengers, confirming reservations...Full time- ...owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating...Full time
Rs 4.9 - 6 lakhs p.a.
Actively hiring Academic Advisor Start Date Starts Immediately CTC (ANNUAL) ₹ 4,90,000 - 6,00,000 ₹ 4,90,000 - 6,00,000 /year ...Immediate start- ...development using Apex, Flows, Lightning Web Components (LWC), and Visualforce. • Strong understanding of Salesforce architecture, data models, security, sharing models, and platform best practices. • Extensive hands-on experience with Salesforce customization,...Full timeLocal areaRemote job
- ...We are looking for a Software Engineer for a 6-month engagement to own infrastructure-as-code and deployment pipelines while building backend... ...window for permissioning flows. • Support the entitlements data migration aligned to approximately 8,800 new Segment Accounts....Full timeLocal areaRemote job
- ...Position Overview We are looking for a Data Engineer with hands-on experience in building scalable data pipelines and data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have strong expertise in Python, PySpark, SQL, Databricks,...
- ...Position Overview We are looking for a Senior Data Engineer with strong hands-on experience in Databricks and a solid understanding of Data Governance concepts. The ideal candidate should have 7+ years of overall experience, including a minimum of 5 years of Databricks...
- Job Description - Data Analyst * Should have good analytical thinking and deep dive into data analysis. * Should have relevant knowledge about SQL server (MSSQL), MySQL database, Python libraries and its functionalities. * Able to query the database and extract the relevant...
- Senior AI Engineer - Ruby on RailsTechjaysCoimbatore / ChennaiHybridImmediate - 30 Days NoticeAbout Techjays : We're the AI Reimagination Company. Techjays helps global enterprises rebuild the way they operate using AI at the core. We're an Anthropic partner, which means our...Hybrid workWork at officeRemote jobFlexible hours
- Senior AI Engineer - .NET / C#Hybrid | 6+ Years | Immediate - 15 Days Notice.About Techjays : We build production-grade AI systems for enterprise clients across the US, UK, and Australia. As an Anthropic partner, we work at the frontier of AI - not experiments, but real systems...Hybrid workImmediate start
- ...of releases, approvals, incidents, and security activities.Must-Have Requirements : - 8+ years of overall infrastructure or release engineering experience.- 5+ years of direct ownership of production release and deployment pipelines, including rollback procedures.- 5+ years...Hybrid workWork at officeImmediate startRemote jobFlexible hours
- ...0 days preferred.About The Role : We are looking for a Senior AI Engineer with strong Python development skills and hands-on experience building... ...vector databases and relational databases to build efficient data retrieval systems.- Design and implement REST APIs, asynchronous...Hybrid workImmediate start
- ...global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the... ...Job Description Overview We are seeking a mid-level Data Consultant to design, implement, and maintain robust data...Full time
- ...commercial real estate transitional lending and real estate credit operations.Scope :- Database design for loan, borrower, lender, and deal data- Loan Origination System (LOS): borrower onboarding, underwriting workflows, document processing, draw management- CRM/lead management...Part time
Rs 10000 - Rs 15000 per month
Junior Software Developer Start Date Starts Immediately CTC (ANNUAL) ₹ 3,00,000 - 6,00,000 ₹ 3,00,000 - 6,00,000 /year ...InternshipImmediate start- ...external system integrations. Good understanding of JSON, XML and data serialization/deserialization . GraphQL Good hands-on... ...such as Entity Framework / Entity Framework Core . Backend Engineering Experience designing and implementing scalable and...
- ...integrating enterprise systems.- GenAI, Agentic AI, RAG and AI solution development.- Prompt engineering, evaluation and model tuning.- Vector databases, embeddings, LLM APIs, data analytics.- Python + API integration on cloud services (Azure/AWS).Requirements:- 5+ yrs engineering...
- ...We are seeking a Software Engineer in Testing to perform quality assurance testing activities for Guidewire ClaimCenter applications,... ...functional, integration, regression, and end-to-end testing, validating data and system integrations, and collaborating with business and...
- ...We are looking for a Senior Java Engineer to build and maintain Java and Spring Boot services for a high-stakes, distributed payments platform... ...• Strong JPA/Hibernate experience with MySQL/Aurora (Spring Data JPA) , including transactional design and optimistic locking....Full timeLocal areaRemote job
- FyerX is hiring experienced ServiceNow Developers for one of our clients in Coimbatore. We are looking for professionals with 3–6 years of experience in ServiceNow development, customization, workflow automation, and integrations. The ideal candidate should have strong...Full timeWorking Monday to Friday
Rs 15 lakh p.a.
...Manufacturing Execution and Manufacturing Integration solutions. The position demands a deep understanding of business logic implementation and data service integration to ensure seamless connectivity between enterprise systems and shop floor operations. The successful candidate will...Full timeRs 15 lakh p.a.
...resolving complex technical and functional challenges. Oversee and refine intercompany Purchase Order and Sales Order processes to ensure data integrity and operational speed. Facilitate the integration of 3PL and 4PL partners into existing supply chain frameworks to enhance...Full timeRs 15 lakh p.a.
..., you will bridge the gap between cloud-based SuccessFactors applications and on-premise or other cloud SAP systems, ensuring seamless data flow and operational efficiency. The ideal candidate will possess deep expertise in the SAP Business Technology Platform (BTP) and will...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer ID89384. Be the first to apply!
