Data engineer (scraping & pipeline stabilization) jobs in Delhi

 ...About the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You'll build robust, self... 

 ...opportunity for you to take your software engineering career to the next level. As a...  ...visualizations and reporting from large, diverse data sets in service of continuous improvement...  ...development, testing, and operational stability Proficient in coding in python Strong... 

 ...Description We are seeking a Senior Software Engineer (SSE) with strong expertise in Kafka,...  ...to lead and contribute to our healthcare data engineering initiatives. This role is...  ...pivotal in building scalable, real-time data pipelines and processing large-scale healthcare... 

Job Summary :We are seeking a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and architectures that support our analytics, data science, and business intelligence initiatives. The ideal candidate will have strong expertise in data... 

 ...ready to use your domain knowledge to advance AI Join us as a PhD Data Partner and work remotely with flexible hours. We are seeking...  ...Requirements: A completed PhD (or local equivalent) in Mechanical Engineer is essential Strong proficiency in English writing with... 

 ...Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data bricks. Develop complex ETL processes using Python scripts and SQL queries to process... 

 ...Our platform manages over 470 terabytes of data distributed across five databases,...  ...seeking a talented and motivated tech data engineer to join our team who will be responsible...  ..., Jenkins, Docker, Kubernetes, and CI/CD pipelines for deployment ~ Communication: Excellent... 

 ...Job Description : Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark...  ...to-date with emerging technologies and best practices in data engineering. Document data workflows, processes, and technical... 

 ...large scope where analysis of situations or data requires a review of a variety of factors...  ...s degree in Computer Science, Software Engineering, Information Technology or related field....  ..., high availability, high volume data pipelines in enterprise or SaaS environments, preferred... 

 ...We are looking for a  Data Ops Engineer-II  to help our customers explore their healthcare data, understand how to improve the health of the population and bring down the cost of healthcare.   A Day in the Life at Innovaccer Create world class customer facing documentation... 

 ...Description We are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will be responsible for designing and implementing robust data pipelines, managing large datasets, and collaborating with various stakeholders to ensure optimal data... 

 ...Responsibilities: Develop and maintain automated data extraction and parsing systems Monitor...  ...Design scalable, high-performing data pipelines and ETL workflows Support operations...  ...skills with hands-on experience in scraping frameworks Proficient in relational databases... 

Key deliverables: # Enhance and maintain the MDM platform # Monitor and optimize system performance # Troubleshoot and resolve technical issues # Support production incident resolution Role responsibilities: # Develop and refactor Python and SQL code # Integrate...

 ...Key Deliverables : # Build scalable data pipelines integrating Oracle and SQL Server data. # Automate data ingestion and processing for AI/ML workflows. # Optimize data storage, compute performance, and security compliance. # Collaborate with AI/ML teams for model-... 

 ...optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions...  ..., Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow... 

 ...will work alongside the LiveOps Lead and the LiveOps Engineer (Data Science) to maintain and improve data pipelines within the company. You will ensure organic...  ...and managing the work with responsibility to ensure stability, continuity and availability of the models, in... 

 ...these ETL Tools: Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, Data Proc Must have SQL PL/SQL Scripting...  ...Should have experience on any of the RDBMS Holding GCP Data Engineer certifications would be an added advantage Must have Hadoop knowledge... 

 ...We are seeking an experienced Data Engineer to join our team in India. The ideal candidate will have a strong background in data processing and pipeline development, with a focus on building scalable and efficient data architectures. Responsibilities Design, construct,... 

 ...Design and Model DWH, pipelines and data products. Create new ETL processes and optimize existing ones, ensuring quality data deliverables...  ...teams. Qualifications Minimum 3-4 years experience in a Data Engineering or BI position . Strong proficiency in SQL for querying,... 

Experience required: 3-6 years Skills: AWS Glue, Postgre SQL, Python, SRE, PySpark, Kafka and AWS services like Lambdas and stepfunction. Willing to work on the shift as required Willing to learn SRE Strong problem-solving skills Good to have knowledge on AWS infrastructure...

 ...We are seeking a Data Engineer to help build and integrate a Generative AI-powered conversational assistant, into our website and mobile app. This role is crucial in handling data pipelines, model training, and infrastructure setup to deliver a seamless, privacy-compliant experience... 

 ...mission to make a lasting, positive impact. ERM is seeking a Data Engineer to join our Digital Products team. This is an exciting...  ...cutting-edge climate science by engineering high-performance data pipelines and workflows in Azure and Microsoft Fabric. The successful candidate... 

 ...Description We are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will have extensive experience...  ...analysts to understand data requirements. Optimizing data pipelines for performance and efficiency. Ensuring data quality and... 

 ...maintain the MDM platform to support business needs # Develop data pipelines using Snowflake, Python, SQL, and orchestration tools like...  ...reliability Role responsibilities: # Collaborate with data engineering and analytics teams for scalable solutions # Apply DevOps... 

 ...Key Deliverables : # Build and optimize scalable data pipelines and infrastructure. # Automate data ingestion, transformation, and integration processes. # Collaborate with AI/ML teams to ensure quality data access. # Enhance performance and cost-efficiency in data... 

 ...Proficiency in Python, Java, or SQL for data processing and automation. Hands-on experience with cloud platforms (especially Azure...  ...Leadership & Collaboration: Proven ability to lead complex data engineering projects. Strong mentorship skills and experience guiding... 

 ...We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions...  ...integration. ~ Experience with  ETL development  and data pipeline orchestration tools (e.g., Apache Airflow, Luigi). ~ Strong... 

 ...Job Description : Join our team as a Data Science Engineer Intern, where you'll gain hands-on experience in building machine learning models...  ...and model development. Contribute to building data pipelines using cloud technologies and big data tools. Monitor and... 

 ...Design, build, and optimize scalable ETL pipelines using Apache Airflow or similar frameworks...  ..., or similar tools to enable distributed data processing and real-time streaming...  ...data scientists, analysts, and software engineers to support data-driven decision-making, while... 

 ...not require to have a degree, as long as they have the required skillset/experiences from the job description. We are looking for a Data Engineer with MFG experience for a staff augmentation role. These are the requirements for the role: ~ Expert in Azure Data Factory...