Senior Data Engineer - Microsoft Fabric/Databricks
https://vysystems.com/
Job Details : Position : Senior Data EngineerLocation : PuneExperience : 8+ YearsEmployment Type : ContractJob Description : We are looking for an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Databricks, PySpark, and modern data engineering technologies. The ideal candidate will be responsible for designing scalable data pipelines, migrating legacy SQL Server workloads, and building robust lakehouse solutions using Medallion Architecture.Key Responsibilities : - Design and develop Bronze, Silver, and Gold data pipelines using Microsoft Fabric and Databricks.- Implement Cascade 1.0 & 2.0 merge logic in the Silver layer, including handling new and null columns.- Migrate legacy SQL Server tables, views, stored procedures, and SSIS ETL workloads into Microsoft Fabric notebooks and pipelines.- Develop PySpark transformations and Delta Lake models with a focus on performance and cost optimization.- Build data quality checks, data lineage, and source-to-target reconciliation processes.- Collaborate with BI developers, report engineers, and QA teams to deliver governed semantic models.- Design and implement scalable and reliable data engineering solutions following best practices.- Optimize data pipelines and processing workloads for performance, scalability, and cost efficiency.Required Skills : - Microsoft Fabric - Lakehouse, Pipelines, OneLake- Azure Databricks- PySpark- SQL / T-SQL- Delta Lake- Azure Data Factory (ADF)- Power BI - Datasets / Semantic Models- Medallion Architecture - Bronze, Silver, Gold- Data Pipeline Development- SQL Server and ETL Migration- Strong understanding of data engineering concepts and cloud-based data platforms.Preferred Experience : - Experience migrating legacy SQL Server and SSIS workloads to Microsoft Fabric.- Hands-on experience with Microsoft Fabric notebooks and pipelines.- Experience with data quality, reconciliation, and lineage.- Experience working with enterprise BI and reporting teams. (ref:hirist.tech)
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Microsoft Fabric/Databricks in Bangalore vacancy
- ...decisions and improve outcomes. Through our unparalleled science, data, technology and laboratory network, we advance diagnostics,... ...on quality Demonstrated ability to collaborate Knowledge of Microsoft Office applications Flexible and able to work under tight timelines...SuggestedFull timeFlexible hoursShift work
- ...The Role The Role: As a Senior Technical Consultant (Shift Lead) in the Shared Data/ODSP Factory, you will lead on‑shift... ...of collaboration content across Microsoft 365, typically SharePoint Online... ...“late surprises”. - Coaches engineers to solve problems systematically...MicrosoftRemote jobHybrid workFlexible hoursShift workRotating shift
- ...insurance, closing/settlement, property data and technology solutions. First American... ...Leverages technology product stack across Microsoft platform predominantly to develop, enhance... ...a highly motivated and skilled Software Engineer with 5–8 years of professional experience...SeniorMicrosoftFull time
- ...operational toil, and enable modern, cloud‑first identity capabilities at enterprise scale. What You’ll Do: Directory Platform Engineering & Operations Engineer, harden, and operate enterprise and multidomain Active Directory environments supporting critical...SeniorHybrid work
- Job Description: Customer relationship manager Location: E-city focus towers Department: Service Reports To: Lead-HO Service Role Summary Responsible for handling, tracking, and closing customer complaints related to two-wheeler vehicles and service quality...SuggestedWeekend work
- ...research and contextual analytics. We empower enterprises with data-driven insights, leveraging advanced AI, machine learning, and cloud... ...preferred.Education :- Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical field.Technical Expertise...
- ...seeking a highly skilled and experienced AI/ML Engineer to design, develop, and deploy scalable... ...engineering techniques.- Create scalable data pipelines for model training, evaluation,... ..., SageMaker, Vertex AI, Azure ML, or Databricks.- Experience with cloud platforms (AWS, Azure...Full time
- Job Description : Role : Senior Python DeveloperPosition : Senior Python DeveloperExperience : 7+ YearsLocation : BangaloreEmployment Type... ...and secure APIs.- Collaborate with frontend developers, QA engineers, product managers, and other stakeholders.- Write clean, maintainable...SeniorFull time
- ...:We are looking for an experienced MLOps Engineer with 3+ years of experience to build, automate... ...ideal candidate will work closely with Data Scientists, ML Engineers, Software... ...with at least one cloud platform :i. AWSii. Microsoft Azureiii. Google Cloud Platform (GCP)- Knowledge...MicrosoftFull time
- ...Jenkins, GitLab CI, GitHub Actions)- Kafka / RabbitMQ (Preferred)- OpenTelemetry, Prometheus, Grafana, ELK (Good to Have)- Design Patterns, Data Structures & Algorithms- Production Support & Performance OptimizationJob Responsibilities : - Design, develop, and deploy scalable...
- About the Role :We are looking for an experienced Senior Test Engineer AI with strong expertise in software quality engineering, test automation,... ...pipelines, AI agents, model integrations, backend services, and data-driven workflows. The ideal candidate should be comfortable...SeniorContract work
- AI Model design and build : - Work closely with data scientists and business to design and implement AI algorithms, frameworks and architectures... ...transform, and load data from various sources.AI model Feature Engineering : - Integrate structured and unstructured data from internal and...
- Job Role : Test Engineer - AIExperience : 6+ YearsLocation : BangaloreJob Summary : We are looking for an experienced Test Engineer AI to design... ..., perform root-cause analysis, and work closely with developers, data scientists, and ML engineers to resolve issues.- Develop test...
- ...are looking for an exceptional Director Databricks Practice to establish, build and lead a... ...opportunity for a technically strong data engineering leader who can combine hands-on Databricks... ...excellence and innovation within the Microsoft and Databricks ecosystem.- Define technical...Microsoft
- ...right in cloud, artificial intelligence, and data. This convergence of talent and expertise... ...becomes clarity, and AI becomes an engine for growth. Our ultimate vision is to be the... ...Deployment Manager, AWS Cloud Formation or Microsoft Azure Automation.- Experience working with...Long term contractShift work
- About the Role : We are looking for an Azure AI Engineer to build, deploy, and enhance enterprise-grade AI solutions on Microsoft Azure. This role involves working across Generative AI, LLM applications, AI agents, search, document intelligence, and cloud-based AI services....Microsoft
- ...SAST, OSS technologies- Ability to perform Python code reviews with minimal assistance- Expertise in monitoring, alerting, reporting, data analysis is desired.- Experience with application build environments like Jenkins, GitHub Actions, Teamcity etc.- DevOps container/orchestration...
- Leading technology / fintech platform is seeking a Systems Engineer to own enterprise infrastructure across messaging, caching, and traffic management platforms.The role focuses on reliability, scalability, availability, performance, and operational resilience of mission-critical...Senior
- Job Summary : As a Python Developer with Databricks, you will be responsible for developing and maintaining scalable data pipelines, managing cloud environments on Azure, and ensuring smooth integration with APIs.The ideal candidate will be proficient in Python, Databricks (...
- ...customizations, integrations, permission structures, data volume, prior migration history.- Assess... ...legacy file servers, other tenants, non-Microsoft platforms) for migration risk.- Design... ...playbooks/checklists.- Mentor migration engineers on risk recognition, not just tool...SeniorMicrosoftRemote job
- Position : AI/ML Engineer (Azure AI, Gen AI)Overall/Total Experience : 3 - 7 years onlyLocation : BengaluruWorking Days : 5 Days from officeNotice... ...AI Services with enterprise applications, APIs, databases, Microsoft 365, and Power Platform.- Operations & Optimization : Monitor AI...Microsoft
- ...Integration: Design and implement MCP-connected data sources, agentic pipelines, and AI... ...reliably.Requirements:- 3+ years of software engineering experience spanning both backend and... ...factor exposures, and P&L.- Familiarity with Databricks, Delta Lake, or Auto Loader for scalable...
- ...engagement, omnichannel content operations, digital experience platforms, data & AI ecosystems, and cloud modernization initiatives.Key... ...Lead and mentor cross-functional teams including architects, AI engineers, program managers, data engineers, MarTech specialists, and consulting...
- About the Role:We are looking for an SDE 3 / Senior Backend Engineer with 6+ years of backend engineering experience and strong expertise in Java,... ...microservices.- Own server-side architecture, business logic, data models, APIs, and integrations.- Drive HLD and LLD for new...Senior
- ...and impactful solutions for marketing teams. The company is currently building its core team in Bangalore.Role Overview:As a Data Platform Engineer, you will contribute to building the technology and data foundation for Different AI's products. The role involves working in...
- Job Title : Senior Developer (5G RAN - L1 / L2)Location : BangaloreExperience : 5+ years in eNB/gNB software development, particularly designing... ...Solid understanding of the Linux operating system and optimizing data processing paths using DPDK and Smart Network Interface Cards.-...Senior
- ...backend services using .NET Core and REST APIs.- Implement robust data handling using Entity Framework, CQRS, and Repository patterns.-... ...Framework, LINQ, CQRS pattern, Repository pattern.- Cloud Platform: Microsoft Azure (Functions, App Services, SQL Database, Blob Storage,...
- Job Description : Senior Data Scientist (AI/ML).Experience : 5-7 Years.Work mode : On-site.Location : Bangalore.Job Summary : We are looking... ...advertising. You will partner with business stakeholders and engineering teams to translate use cases into scalable models, produce...SeniorFlexible hoursAfternoon shift
- Role : Senior Solution Architect Google Cloud (Vertex AI, GCP)Company : Auxo AIExperience : 1015 YearsPositions : 1Location : Hyderabad /... ...solutions using Vertex AI and Gemini Enterprise.- Architect enterprise data platforms using BigQuery.- Design cloud-native solutions using...SeniorHybrid workWork at officeImmediate start
- ...platforms that enable authentication, authorization, and access governance for both human and non-human identities.What Youll Do : - Engineer, harden, and operate enterprise and multidomain Active Directory environments supporting critical business workloads.- Lead Active Directory...SeniorHybrid work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Microsoft Fabric/Databricks. Be the first to apply!
