Get new jobs by email
Rs 3 - 5.5 lakhs p.a.
...join and Aggregate window Functions) Excellent Communication Skills Basics of Streaming pipeline basics of Spark Session, Streaming processing, and transformation of streaming data. Spark Streaming, kafka , hive etc. Spark or any Streaming technology Basics of...SuggestedRs 2 - 5 lakhs p.a.
...Job Description : Develop and maintain data pipelines, ELT processes, and workflow... ...technologies and best practices in data engineering. Document data workflows, processes, and... ...frameworks and practices. ~ Knowledge of data streaming and real-time data processing...SuggestedPermanent employmentFull timeRs 5 - 10 lakhs p.a.
...We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions... ...databases, NoSQL databases, batch files, and real-time data streams. Implement efficient data transformation and aggregation...SuggestedRs 6 - 11 lakhs p.a.
...Developing ETL pipelines involving big data. Developing data processinganalytics applications... ..., compute, ETL, DWH, Analytics and streaming. Clear understanding and ability to... ...PySpark, Python and related libraries. Data Engineer AEP Comptency Experience of developing...SuggestedRs 15 - 25 lakhs p.a.
...JobType: full-time We are seeking a skilled and motivated Data Engineer with a strong foundation in data engineering and exposure to... ...TensorFlow, PyTorch, or Scikit-learn is a plus. Knowledge of streaming technologies like Kafka or Kinesis is desirable. Strong...SuggestedFull timeWeekday workRs 3 - 7 lakhs p.a.
...Design, develop, and optimize large-scale data processing pipelines using PySpark. ~... ...Skills: ~5–7 years of experience in data engineering. ~ Strong hands-on experience with... ...experience with Apache NiFi. Real-time streaming pipeline development experience. Exposure...SuggestedRs 2 - 12 lakhs p.a.
...experience 9+ years. Excellent knowledge and experience in Big data engineer. Strong working experience with architecture and... ...testing, data lineage tracking, and automation. Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink). Experience with...SuggestedRs 1 - 4 lakhs p.a.
...Deliverables: Design and implement scalable, secure enterprise-grade data platforms Build real-time and batch data pipelines to support... ...distributed systems architecture Collaborate on real-time streaming solutions using Flink, Kafka, or Kinesis Implement DevOps...SuggestedFreelanceRs 4 - 7 lakhs p.a.
...other GCP services. Build and maintain data lakes and data warehouses using... ...Eventarc for real-time data processing and streaming pipelines. Ensure data governance ,... ...tools, features, and trends in cloud data engineering. Qualifications and Requirements: ~...SuggestedRs 2 - 5 lakhs p.a.
...Seeking for a strong data analyst who can perform independent. Good to have Prior experience in banking domain is plus and understanding the finance various data transactions. Should be strong in the below: Python Pyspark SQL Airflow Trino Hive Offshore...SuggestedRs 5 - 6 lakhs p.a.
...Polars library Understanding of SparkSQL (this is more important than Polars) Good English communication Ability to work in a collaborative environment Experience with US healthcare data preferred Understanding of SparkSQL (this is more important than Polars)...Suggested- ...Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy...SuggestedFull timeWork at office
Rs 2 - 3 lakhs p.a.
...Responsibilities :- Analyze and organize raw data Build data systems and pipelines (Apache Nifi) Evaluate business needs and objectives... ...Requirements and skills:- ~2-3 year of experience as a data engineer ~ Technical expertise with data models, data mining, and...Suggested- JOB_POSTING-3-80314-2 Job Description Role Title: Data Engineer (L8) COMPANY OVERVIEW: Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry's most complete digitally enabled product suites. Our experience, expertise...SuggestedWork at officeWork from homeFlexible hours
- ...Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy...SuggestedFull timeWork at office
Rs 4 - 7 lakhs p.a.
...Response Informatics is looking for Data Engineer TPC to join our dynamic team and embark on a rewarding career journey Responsibilities : Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure...Rs 3 - 7 lakhs p.a.
...We are seeking a Data Engineer to help build and integrate a Generative AI-powered conversational assistant, into our website and mobile app. This role is crucial in handling data pipelines, model training, and infrastructure setup to deliver a seamless, privacy-compliant...Permanent employmentFull time- ...Job Title: AWS Data Engineer Location: Any ~3+ years of experience in data engineering with a strong focus on AWS technologies. ~ Proficiency in Python, SQL, PySpark, and data modeling. ~ Hands-on experience with AWS services such as Glue, Redshift, Lambda, S3,...
Rs 6 - 9.5 lakhs p.a.
...Core Responsibilities: Lead and manage cross-functional data engineering teams to ensure successful delivery of data projects. Architect, design, and implement scalable, efficient data pipelines and ETL workflows. Develop reusable, high-performance code for data transformation...- Job Summary :We are looking for an experienced GCP Data Engineer with strong expertise in Google Cloud Platform (GCP) data services, Python... ...Git or other version control systems.- Integrate Kafka-based streaming pipelines and API-based data integrations when required.Required...
Rs 2.5 - 9 lakhs p.a.
~ with engineers, product managers, and technical program managers across teams. ~ Understand the trade-offs between consistency, durability... ...enterprise-class experience with large-scale cloud solutions in data science/analytics projects and engineering projects. ~ Expert...Rs 3 - 6 lakhs p.a.
...problems of moderate to large scope where analysis of situations or data requires a review of a variety of factors. Exercises judgment... ...EDUCATION : Bachelor s degree in Computer Science, Software Engineering, Information Technology or related field. Relevant coursework...Rs 4 - 9 lakhs p.a.
...Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines,... ...Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow automation....Permanent employmentFull timeRs 8 - 9 lakhs p.a.
~ Design, implement, and optimize end-to-end data pipelines for ingesting, processing, and transforming large volumes of structured and... ...). ~ Experience in Databricks and Delta tables. ~ Data engineering experience with Spark/Scala/Python. ~ Experience in Microsoft...Rs 4 - 7 lakhs p.a.
...We are seeking a proactive Senior Snowflake PySpark Developer to lead the design and maintenance of data pipelines in cloud environments. You will be responsible for building robust ETL processes using Snowflake, PySpark, SQL, and AWS Glue . This role requires strong expertise...Rs 5 - 9.5 lakhs p.a.
...Key Responsibilities Design and develop scalable data architecture and infrastructure Lead the implementation of data warehousing... ...secure, reliable, and high-performing Lead and mentor data engineering teams Oversee data integration, transformation, and pipeline...Rs 12 - 20.5 lakhs p.a.
• Lead the design and development of scalable data infrastructure with a focus on data warehousing solutions. • Architect and optimize... ...scale data processing and analytics. • Manage and mentor data engineering teams while ensuring best practices in data engineering and...Rs 5 - 7 lakhs p.a.
...Required Skills and Experience: Hands-on Experience in GCP Data Components: BigQuery Data Fusion Cloud SQL Data Management: Understanding of Data Lake and Data Warehouse concepts. Experience in Data Architecture design and Implementation on GCP. Project...Rs 5 - 8 lakhs p.a.
...Solution Architecture & Implementation: Implement and architect data solutions on Google Cloud Platform (GCP) , leveraging its... ...languages such as Java and Python . Required Skills: GCP Data Engineering Expertise: Strong experience with GCP Data Engineering ,...- ...Role description MDM Lead Architect Job Summary Seeking a MDM LeadArchitect with 12+ years of experience in Data Governance and enhance data management frameworks Role Responsibilities Leading and driving MDM projects across a global enterprise Design...
