Data Engineer
Full-time
Datamatics Technologies
Job Description – Data Engineer
Employment Type: Full-Time
Work Location: KSA
Experience Required: Hands-on experience with Spark development, Informatica integration solutions, and enterprise data platforms.
Years of Experience: 5 to 10
Role Overview
We are looking for a Data Engineer to build, configure, and optimize data ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform. The ideal candidate will have strong hands-on experience with Spark-based development, enterprise data lake/lakehouse implementations, and Informatica-based integration solutions.
Key Responsibilities
- Design and develop scalable data ingestion and transformation pipelines.
- Build, optimize, and maintain Spark-based ETL/ELT workloads.
- Develop and manage data models and datasets using Apache Iceberg tables.
- Implement and support data integration workflows using Informatica.
- Enable analytics and data consumption through Denodo, Starburst, and/or Dremio.
- Develop secure, governed, and scalable data pipelines aligned with enterprise standards.
- Support batch and near real-time data processing requirements.
- Implement data quality, metadata management, and validation controls.
- Collaborate with Platform Engineers on deployment, integration, and operationalization activities.
- Support migration, testing, and production rollout initiatives.
- Troubleshoot and optimize data pipeline performance, reliability, and scalability.
Must-Have Skills
- Apache Spark (PySpark and/or Scala Spark)
- Apache Iceberg
- Informatica Data Integration
- MinIO Object Storage
- Denodo
- SQL and Data Modeling
- Data Warehousing Concepts
- ETL/ELT Development
- Git Version Control
Good-to-Have Skills
- Starburst and/or Dremio
- Data Governance and Metadata Management
- Data Quality Frameworks
- CI/CD for Data Pipelines
- Python
- Kafka or Streaming Technologies
- Lakehouse Architecture Patterns
- Experience with enterprise data lake and lakehouse implementations
- Performance tuning and optimization of large-scale data workloads
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Chennai vacancy
- ...Position Overview We are looking for an experienced Software Engineer – Premium Engineer III with expertise in SAP S/4HANA,... ...support commodity price evaluation. Configure and manage market data feeds and exchange rate integrations to automate commodity market...SuggestedFull timeContract workHybrid workWork at officeImmediate start
- About the Role What if we tell you, your writing will change lives? As a Junior Curriculum Developer at Team Everest, you will create content that helps 1000s of students and volunteers. You will write curriculum which will be used to teach college students to impart...SuggestedFull timeWork at officeImmediate startWorking Monday to Friday
- About the Role Can you turn any topic into a curriculum? It could be a topic you know well or something you have never heard of before! Your job is to research it, understand it, and turn it into a curriculum that is simple, interesting, and easy to follow. ...SuggestedFull timeWork at officeImmediate startWorking Monday to Friday
- ...enterprise Java application, used by Client Services and Product Engineering teams. This role sits between IT operations, QA, and R&D, closer... ..., thread dumps)- Hands-on WildFly (standalone configuration, data sources, JDBC drivers, deployments); Quarkus or containerized Java...Suggested
- ...be responsible for designing, developing, and optimizing scalable data warehouse solutions, ensuring data quality, performance, and... ...production issues and perform root cause analysis.- Collaborate with data engineers, architects, and business stakeholders to deliver effective data...Suggested
- Description :Job Title : Voice AI Engineer (Machine Learning & NLP)Locations : Gurugram (Sector 54) / Chennai (T. Nagar) Hybrid (4 Days In-... ...low latency responses, critical for a seamless voice experience.- Data Engineering : Clean, prune, and collect datasets to analyze model...Hybrid workWork at office
- About the company:Aptlogica Technologies is a Pune-based technology company delivering AI/ML, Generative and Agentic AI, product engineering and cloud solutions for enterprise clients, alongside its own learning-technology products.About the role:Design and build production...Hybrid work
- ...including tables, views, stored procedures and functions. Write clean, modular and maintainable code in line with coding, security and engineering standards. Create unit test cases and participate in component, integration, regression and performance testing. Participate...Work at officeWorldwideFlexible hours
- ...Python and R, with a special focus on time series modeling to support running econometric models; Developing scripts/code to automate data reports; Using strong analytical, critical thinking and problem-solving skills to lead or facilitate discussions across various...Work at officeFlexible hours
- ...integration, and innovation, with a presence in Europe, Asia, and North America. Through our business areas, SAP Business Solutions, Data Analytics and Technology Platform, we are recognized by our clients for helping them enhance their operational performance. Within...Permanent employmentFull timeContract workRelocation packageWork at officeRelocationFlexible hours
- ...convincing the required stake holders. FTG and Spares planning, Procurement and Establishing to mfg the new product. Developing Engineering Specification Test facilities and Smooth Ramup of the Required vol / shift. Addressing manufacturing concerns by Establishing Ergonomics...Shift work
Rs 4.9 - 6 lakhs p.a.
Actively hiring Academic Advisor Start Date Starts Immediately CTC (ANNUAL) ₹ 4,90,000 - 6,00,000 ₹ 4,90,000 - 6,00,000 /year ...Immediate start- We are looking for AI Engineers for a strategic initiative to build Agentic AI use cases around Trading Surveillance. Ideal candidate is someone... ...in production Design and maintain data pipelines, ETL/ELT workflows, and data infrastructure to support...
- ...Location: Hinjewadi Phase 1 - Pune Shift Time: EMEA Overview: Role Description : About the Role As a Frontend Engineer specializing in React.js at Capco, you will be at the heart of designing and developing modern, high-performance, and accessible user...Local areaShift work
- ...AstraZeneca seeks a Lead Engineer for SIEM and Detection Platforms in Chennai to design and oversee enterprise-scale threat detection strategies across cloud, on-premises, and operational technology environments. This role combines detection engineering leadership with platform...
Rs 2.5 - 3 lakhs p.a.
...Careers is seeking a dynamic individual to join our innovative team and contribute to cutting-edge projects in the architecture and engineering industries. Key Responsibilities: 1. Collaborate with senior developers to design and develop AutoCAD 3D Electrical Design...Immediate start- ...Manage the use of AI-assisted testing tools and ensure strong prompt-engineering practices across testing teams. Collaborate with development... ...-matter expertise in FX Spot, FX Forward, FX Swap, NDF, market data, venues, FX algorithms, market making, agency-based workflows,...Full time
- ...Job Title: Head of Engineering Location : Vengal, Tiruvallur Reporting : Plant Director Job Purpose: This position will lead the development, optimization, and continuous improvement of manufacturing processes to achieve operational excellence, quality,...Full timeFlexible hours
- ...Description We are seeking an experienced and visionary Chief Engineer to lead our engineering operations in Chennai, India. In this pivotal... ...Analyze engineering performance metrics and implement data-driven improvements to enhance operational effectiveness Collaborate...Permanent employmentFull timeWorldwide
- ...and fine-tuning workflows tailored to client-specific domains and data.- Develop computer vision pipelines for manufacturing use cases... ...responsible AI practices at enterprise scale.- Collaborate with data engineers, platform architects, and business stakeholders to define AI...
- ...backend solutions using Python and modern Python frameworks to support data-intensive applications and automation workflows.- Lead code reviews and technical design sessions to maintain high engineering standards and mentor junior developers within the team.- Collaborate with...
- ...and messaging workflows using RabbitMQ and implement caching and data-handling solutions using Redis.- Design and develop modern,... ...integrations that improve operational efficiency.- Apply software engineering best practices for code quality, modular architecture, testing,...
- ...develop, train and troubleshoot to enhance our clients’ journey around Data Virtualization. Your mission: to help Denodo users achieve and... ...data processing endeavors utilizing our products As a Staff Data Engineer you will successfully employ a combination of high technical...Fixed term contractRemote job
Rs 15000 - Rs 20000 per month
*Job Opening: Angular Developer*- Chennai - Madipakkam *Company:* Leading Tourism Brand *Location:* Madipakkam, Chennai (Work From Office) *Experience:* 1-2Years *Salary:* Rs.15,000- Rs. 20,000per month *Joining:* Immediate Joiners Preferred *About the Role:* ...Work at officeImmediate start- ...and business challenges. Requirements ~7+ years of Software Engineering experience. ~ BS in Engineering or Computer Science, or... ...driven development, software maintenance, architectural principles, data manipulation, and optimization techniques. ~ Experience with payment...Full timeImmediate startHome officeFlexible hours
- ...LPARs. Perform problem diagnostics and resolution. Create and oversee jobs for daily, weekly, and monthly backups. Participate in Data Center migration projects using multiple methodologies. Perform data and volume recovery. Perform data migrations between storage...Hybrid work
Rs 24 lakh p.a.
...Data Migration Engineers Summary We are seeking an experienced Data Migration Engineer to lead critical data transformation initiatives within our IT Services sector. This pivotal role involves orchestrating the seamless transfer of complex datasets from legacy systems...Full time- Lead Data Scientist - Fraud Analytics / AML | Banking / BFSILocation : Chennai (Onsite)Experience : 8 - 12 yearsIndustry : Banking / BFSI... ...fraud detection rules and scenarios using Business Rules Engines (BRE).- Analyze false positives, false negatives and model performance...
- ...and optimizing both legacy and modern systems, building robust data-driven applications, and leveraging AI to enhance business-as-usual... ...:- Bachelor's or Master's degree in Computer Science, Software Engineering, Financial Technology or a related field. (ref:hirist.tech)
- Angular DeveloperExp : 4 - 6 yearsLocation : Chennai (WFO)Job Description : - Strong proficiency in JavaScript/TypeScript.- Expertise in AngularJS for front-end development with CSS with strong debugging skills.- Solid understanding of MySQL procedures and relational database...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
