Senior Data Scientist & Senior Data Engineer
Full-time
N-iX
About the project:
Data solution to gather and transform data from multiple heterogeneous systems across our clients organization into the Azure Data Lakehouse using Databricks and ADF.
Design complex ETL processes of various data sources in the data Lakehouse
Build new and maintain existing data pipelines using Python to improve efficiency and latency
Improve data quality through anomaly detection by building and working with internal tools to measure data and automatically detect changes
Identify design and implement internal process improvements including re-designing infrastructure for greater scalability optimizing data delivery and automating manual processes
Perform data modeling and improve our existing data models for analytics
Collaborate with SMEs architects analysts data scientists and others to build solutions that integrate data from many of our enterprise data sources
Partner with stakeholders including data design product and executive teams and assist them with data-related technical issues Requirements:
3-5 years of commercial experience in building and maintaining complex data pipelines
Proficiency in Python and SQL
Well-versed in the optimization of ETL processes
Solid knowledge of relational SQL and NoSQL databases: PostgreSQL/Redshift/MongoDB Snowflake
Good knowledge of cloud services (Azure)
Solid expertise in data processing tools for Azure: Elasticsearch Azure Data Factory Databricks Azure Synapse
Decent knowledge of CI/CD (Docker Jenkins Terraform Git)
Good understanding of algorithms and data structures
Experience in the schema and dimensional data design
English level: upper intermediate
Microsoft Azure certification
Flexible working format - remote office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program tech talks and trainings centers of excellence and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Corporate events and team buildings
not applicable for freelancers
Required Experience:
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Data Scientist & Senior Data Engineer in Bangalore vacancy
- Proficient in using DBT to develop and manage complex data models and transformations and to integrate with external data sources by bringing in data to external stage. Able to develop DBT incremental models with different incremental techniques. And able to structure...SeniorFull time
- ...-to-End Development: Architect build and maintain ETL processes using Apache Spark and Python to efficiently ingest transform and load data from diverse sources. Data Integrity: Implement robust data quality checks monitoring systems and error handling to ensure data accuracy...SeniorFull time
- About the role : We are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics.The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems...Senior
- ...Job Purpose and Impact ~ The Senior Professional Data Engineering designs builds and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions ensuring high-quality financial data pipelines and...SeniorFull time
- ...Job Purpose and Impact ~ The Senior Professional Data Engineering job designs builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision this job ensures that large sets of data are efficiently processed and made accessible...SeniorFull time
- Description : Role : Senior Data EngineerExperience : 7-10 yearsLocation : BangaloreJob Description :Core Responsibilities : - Architect... ...scalability of Snowflake workloads.- Define and enforce data engineering best practices, coding standards, and review processes.- Design...Senior
- ...evolving and innovating. Join us and be part of a company that values creativity agility and impactful work. Were looking for a Senior Data Engineer to design and maintain scalable data pipelines and infrastructure. Youll work with Airflow Databricks Spark Python...SeniorFull timeWorldwide
- Description : About the job : Role Overview : As a Subject Matter Expert, youll provide deep technical expertise in data and AI domains, Implement and help in designing scalable solutions, and resolve complex issues.The role includes mentoring junior members and driving project...Senior
- ...Job Title : Senior Data Engineer Experience : 7-12 Years Location : Bengaluru Shift Time : 8:00am to 5:00pm or 1.30pm to 10.30pm Roles & Responsibilities: Design and maintain scalable automated data pipelines and ETL processes on Microsoft Azure. Oversee...SeniorFull timeShift work
- ...Roles & Responsibility Key Responsibilities: Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data. Enhancing infrastructure for scalability, automation, and data delivery improvements. Developing real-time and batch...SeniorFull time
- ...What awaits you Join our Data Engineering team to design and industrialize robust data pipelines and semantic layers for advanced analytics... ...that power intelligent applications and insights. As a Senior Data Engineer you will work across all phases of developmentfrom...SeniorFull time
- ...Design, build, and maintain robust, scalable data pipelines supporting both batch and real-... ...and best practices for cloud-native data engineering solutions.Medallion Architecture... ...effectively with clients, internal teams, and senior stakeholders.- Strong problem-solving mindset...Senior
- Senior Data Engineer Position Description Company Profile: - At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976,...SeniorPermanent employmentFull timeNo agency
- ...DESCRIPTION Our organization builds the data foundations that power the future of online shopping. With ever expanding selection... ...next generation of CX powered by LLM's at enterprise scale. As a senior engineer, you'll be a technical leader responsible for architectural...SeniorFull time
- ...Bachelor/Masters degree in Computer Science Engineering or a related field. 7 years of working experience in the field of Data & Analytics preferably in the CPG industry 7 years of proficient coding experience with Python for data engineering including SQL and...SeniorFull time
- ...Job Title: Sr. Data Engineer About Us Capco a Wipro company is a global technology and management consulting firm. Awarded with Consultancy... ...non-hierarchical structure that will enable you to work with senior partners and directly with clients A diverse inclusive...SeniorFull timeHybrid workLocal area
- ...Understands the business vision from the data solutions and works with all project stakeholders... ...an enterprise solution in data engineering area. This will mostly include green field... ...PyTest - SkillRoles and Responsibilities :The Senior Data Engineer is the one who designs and...Senior
- Senior Data Engineer (Hybrid) Job Type - Permanent Work Mode - Domlur Bangalore (4 days from office & 1 day WFH) Budget - 20LPA - 21LPA Experience- 5 Years Skillset Required 5 years of experience in software development with a strong foundation in distributed...SeniorPermanent employmentFull timeHybrid workWork at officeWork from home
- ...Auxo is looking for a Senior Data Engineer – GCP Native Platform to design, build, and operate scalable, production-grade data platforms for our enterprise clients. This is a hands-on delivery role, not a support function. You will own end-to-end data pipeline engineering...SeniorFull time
- ...Term success and combine global reach with local client attention to serve them in over 50 Countries. Position: Senior Data & Streaming Engineer Location: Bangalore Work Type: Hybrid Job Type: Full Time Job Description: We are seeking an...SeniorLong term contractFull timeFor contractorsHybrid workLocal area
- ...As a Senior Data Engineer you will drive the technical implementation of data pipelines and migration processes from Amazon RDS into Google BigQuery. You will work independently while collaborating closely with the Engineering Manager and Product stakeholders. You will mentor...SeniorFull timeRemote job
- ...too. The Brief Were building a modern data platform that powers Maersks AI and analytics... ...To make that happen were hiring platform engineers with strong data infrastructure expertise... ...to perform a job please contact us by emailing . Required Experience: Senior IC...SeniorFull time
- About the Role : We are seeking a highly experienced and strategic Sr Data Engineer for the development and optimization of our modern cloud data platform infrastructure. This role is ideal for someone who thrives in a fast-paced environment, is passionate about data architecture...Senior
- Description :Job Summary :We are looking for a Senior Analytics Engineer / Senior Data Engineer (6+ yrs ) with strong hands-on experience in dbt, SQL, and Airbyte to design, build, and maintain reliable analytics-ready data pipelines.The role focuses on transforming raw data...Senior
- ...Turn complex data into actionable insights that power Swiss Re's digital transformation... ...journey! Join our innovative team where your engineering expertise will directly shape enterprise-... ...solutions. About the Role As a Senior Data Engineer, you'll architect and build...SeniorHybrid workWork at office3 days week
- ...The proliferation of machine log data has the potential to give organizations unprecedented... ...of heterogeneous data. As a Sr Data Engineer you will actively contribute to execute for... ...the Global Head of IT and reporting to our Senior Manager of Data Engineering. You are a...SeniorFull time
- ...Job Summary NetApp is developing a portfolio of data-centric storage platforms and services to help the worlds leading organizations... ...invoices that are charged in a subscription manner As a Senior Data Engineer in the NetApps Keystone organization you will be responsible...SeniorFull time
- ...deliverables, gaining a full understanding of the Property & Casualty data and the business logic required to deliver analytics solutions.... ...-the-art technologies as part of a growing global team of data engineering professionals. You are a self-starter with strong problem-...SeniorFull timeWork at office
- ...the lookout for more curious and creative engineers who want to create change one line of high... ...What youll do This role is part of Data and Analytics team which provides competence... ...ordinary people with the drive to make a difference. Required Experience: Senior IC...SeniorLong term contractFull time
- Senior Google Data Engineer Position Description Google Cloud Data Engineer Job Description: We are seeking a highly skilled Senior Data Engineer with extensive experience in Google Cloud Platform (GCP) data services and big data technologies. The ideal candidate...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Scientist & Senior Data Engineer. Be the first to apply!
