TVARIT - Senior Data Engineer - Azure Databricks
Tavrit
Job Title : Senior Data EngineerLocation : PuneJob Type : Full-TimeAbout TVARIT :TVARIT GmbH specializes in developing and delivering cutting-edge artificial intelligence (AI) solutions for the metal industry, including steel, aluminum, copper, cast iron, and more. Our software products empower customers to make intelligent, data-driven decisions, driving advancements in Predictive Quality (PsQ), Predictive Maintenance (PdM), and Energy Consumption Reduction (PsE), etc. With a strong portfolio of renowned reference customers, state-of-the-art technology, a talented research team from prestigious universities, and recognition through esteemed awards such as the EU Horizon 2020 AI Prize, TVARIT is recognized as one of the most innovative AI companies in Germany and Europe. We are seeking a self-motivated individual with a positive "can-do" attitude and excellent oral and written communication skills in English to join our team.Job Description :We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and optimize scalable ETL pipelines for manufacturing analytics. The role involves working with high-frequency industrial data to enable real-time and batch data processing.Key Responsibilities :- Build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.- Perform data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics.- Design and maintain cloud-based data architectures, including data lakes, lakehouses, and warehouses, following Medallion Architecture.- Deploy and optimize data solutions on Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.- Develop and optimize ETL/ELT pipelines for structured and unstructured data from IoT, MES, SCADA, LIMS, and ERP systems.- Automate data workflows using CI/CD and DevOps best practices, ensuring security and compliance with industry standards- Monitor, troubleshoot, and enhance data pipelines for high availability and reliability.- Utilize Docker and Kubernetes for scalable data processing.- Collaborate with automation team, data scientists and engineers to provide clean, structured data for AI/ML models.Desired Skills and Qualifications :- Bachelors or Masters degree in Computer Science, Information Technology, or a related field from IIT/NIT/BITS/IIIT- 7+ years of experience in core data engineering, with a strong focus on cloud platforms such as Azure (preferred), AWS, or GCP- Proficiency in PySpark, Azure Databricks, Python and Apache Spark, etc.- 2 years of team handling experience.- Expertise in relational databases (e.g., SQL Server, PostgreSQL), time series databases (e.g. Influx DB), and NoSQL databases (e.g., MongoDB, Cassandra)- Experience in containerization (Docker, Kubernetes).- Strong analytical and problem-solving skills with attention to detail.- Good to have MLOps, DevOps including model lifecycle management- Excellent communication and collaboration skills, with a proven ability to work effectively as a team player.- Comfortable working in a dynamic, fast-paced startup environment, adapting quickly to changing priorities and responsibilities. (ref:hirist.tech)
- Description :We are looking for passionate Data Engineers / Senior Data Engineers to design, build, and operate scalable data platforms and pipelines... ...maintain scalable ETL/ELT pipelines using PySpark, SQL, and Databricks- Implement Medallion Architecture (Bronze, Silver, Gold)...Suggested
- ...015, Fresh Gravity helps businesses make data-driven decisions. We are driven by data and... ...are Fresh Gravity. Requirements • Databricks Platform Proficiency: Deep understanding... ...Spark SQL, DataFrames, and RDDs. • Data Engineering with Delta Lake: Knowledge of Delta Lake...SuggestedFull time
- Job Description : We are looking for a Senior Data Engineer to join our Data & AI Practice, working on modern data platforms for enterprise and regulated... ...cloud native data platforms, primarily on AWS (with Azure exposure where required)- Working with technologies such as Databricks...Suggested
- ...workflows Qualifications: ~4+ years of experience working in Matillion ~ Experience in developing features for enterprise level data warehouse and knowledge of data warehousing concepts ~ Ability to deliver support services to meet SLAs, Good debugging skills ~...SuggestedShift workRotating shift
- Job Description :We have received an urgent requirement for Azure Databricks Data Engineers. We currently have approximately 12 open positions and require strong candidates with extensive experience in Azure Data Engineering, Databricks, Streaming, and Lakehouse architecture...SuggestedImmediate start
- The Opportunity:As a Senior Data Engineer, you will design, build and operate scalable data platforms and pipelines for global customers. You... ...Medallion Architecture (Bronze, Silver, Gold) using Delta Lake and Databricks components such as Delta Live Tables (DLT), Delta Sharing...
- We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers... ..., streaming pipelines, and AI-driven data platforms using Databricks, PySpark, Azure, and Kafka.This role requires strong hands-...Hybrid workFlexible hours
Rs 15 - 20 lakhs p.a.
...Hyderabad Job Type: full-time We are seeking an experienced Data Engineer with 5–10 years of expertise in building and managing modern... .... ~ Experience working with cloud platforms such as AWS, Azure, or GCP. ~ Knowledge of CI/CD pipelines, Git, and modern software...Full timeWeekday work- ...Responsibilities Designing and building optimized data pipelines using cutting-edge technologies... ...Possess a product/engineering mindset to drive impactful data solutions... ...Proficient Seniority Senior...
- ...incredible career growth opportunities.About the Role : As a Senior Data Engineer on the Data Science team, you'll be embedded with data... ...operational decisions. You'll spend most of your time in DBT and Databricks designing models, building features, and shipping pipelines...Shift workNight shift
- ...and teamwork come together to support the most exciting missions in the world! Description: We are seeking a talented Sr. Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber...
- ...future – we create it. Embark on a transformative journey as a Senior Data Engineer, we are seeking a highly experienced Senior Data Engineer... ...Iceberg, dbt, and strong working knowledge of Snowflake and Databricks within an AWS ecosystem. To be successful in this role,...Long term contractPermanent employmentTemporary work
- About the role : As a Senior Data Engineer BI Analytics & DWH, you will lead the design and implementation of enterprise-grade business intelligence... ....You will leverage your deep expertise in Snowflake and/or Databricks, modern ETL/ELT frameworks, and cloud-native architectures...
- ...Leads projects for design, development and maintenance of a data and analytics platform. Effectively and efficiently process, store... ...experienced team members. Competencies: System Requirements Engineering - Uses appropriate methods and tools to translate stakeholder needs...Relocation packageRemote job
- ...Job Description We’re looking for a smart, adaptable Senior Software Engineer to help build and evolve our real-time data ingestion platform. You’ll work at the intersection of software engineering and data infrastructure, designing and maintaining scalable systems that...Hybrid workWork at officeLocal areaRemote job
- ...Join Barclays as a Senior Data Engineer. At Barclays, we are building the bank of tomorrow. As a Strategy and Transformation Lead you will build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to...Long term contractTemporary work
- ...Req ID: 375086 NTT DATA strives to hire exceptional, innovative and passionate... ...apply now. We are currently seeking a Senior Data Engineer to join our team in Pune, Mahārāshtra (IN... ...with Terraform for provisioning Azure or Fabric resources Knowledge of Delta...Contract workHybrid workWork at officeRemote jobFlexible hours
- ...Company Description We're Nagarro. We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist...Full time
- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI... ...potential with AI. Type: Remote Full-time Senior Data Engineer Are you an experienced Data... ...modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking...Full timeLocal areaRemote job
- ...AI, regulatory expertise, and the world’s largest supply chain data network to help organizations reduce risk, lower operational... ...analytics. Job Description Position Summary As a Senior Data Engineer at Assent, you will play a critical role in advancing our data...Full timeHybrid workFlexible hours
- Description Senior Data Engineer AArete is one-of-a-kind when it comes to consulting firm culture. We’re a global, innovative management and technology consulting firm with offices in the U.S., India, and Europe. Our name comes from the Greek word for excellence...Full timeContract workHybrid workWork at officeFlexible hoursNight shift
- ...develop, and maintain interactive dashboards, reports, and documents using MicroStrategy.- Build and manage schema objects, metadata, and data models to support reporting needs.- Collaborate with business stakeholders to gather, analyze, and translate reporting requirements...
- ...within our DNA. Invest in us and we’ll invest in you! Job Description About the Role We are looking for a Senior Databricks Data Engineer to join Version 1’s Data Practice, focused on building scalable, high-performance data platforms using Databricks and modern...Full timeLocal areaRemote jobFlexible hours
- Job Summary : We are seeking a skilled Data Engineer who can be responsible for extract data from various source systems into Snowflake. Use... ...data modeling and architecture design.- Experience working with Azure databases.- Ability to take full ownership (End to End) of...Full time
- ...Design, develop, and maintain complex data pipelines using Azure Data Factory (ADF) and other Azure... ...data processing workflows using Azure Databricks with Spark and PySpark- Implement and... ...and provide technical guidance on data engineering best practices- Stay current with...
- ...Position Overview Job Title: Senior ETL Developer (Pentaho) Location: Pune, India Corporate Title: AVP Role Description... ...The Senior ETL Pentaho Developer provides technical expertise in data management, data modeling and db design, data integration, data movement...Full timeFlexible hours
- Job Role : Data Engineer Azure.Experience : 7+ Years.Location : Bangalore.Key Responsibilities :- Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse Analytics.- Build scalable data processing solutions using Python, PySpark, and Spark.- Implement...
- ...transformation through: Cloud, Data & AI, Enterprise Applications,... ...: Top 3 Service Providers, Azure Expert Status, Fastrack & Inner... ...looking for a skilled Azure Data Engineer with strong expertise in Azure... ...Azure Data Factory Azure Databricks Data Warehouse Design Principles...Full time
- ...possible before the AI era. Our software engineering teams are highly valued by customers,... ...part of our journey!About the role : As a Senior Data Engineer BI Analytics & DWH, you will contribute... ...and ELT processes using tools such as Azure data factory, Databricks, or similar...Full time
- Description : Hiring : Senior Python PySpark DeveloperLocation : Pune... ...and optimize large-scale data processing systems across cloud... ...experience- Solid SQL & data engineering fundamentals- Hands-on with Hadoop... ...tools)- Exposure to AWS / Azure / GCPGood to Have : Kafka / Spark...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to TVARIT - Senior Data Engineer - Azure Databricks. Be the first to apply!
