Average salary: Rs1,065,416 /yearly
More statsJob Description :- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.Good to Have:- Airflow- Good aptitude, strong problem-solving abilities, and analytical...
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal... ...of data sources using SQL and AWS - big data technologies- Build analytics tools... ...workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream...
...American Express.Location : Gurgaon (Hybrid)Big Data with Talend Job Description :We are looking for a talented Big Data Engineer with hands-on experience in Talend to join our... ...data warehousing concepts.- Experience with Hadoop, Spark, and other big data technologies.- Excellent...
...Job Title: Big Data Engineer
Duration: Full-time on OmegaHires Payroll
Location: Gurugram (Should be located near NCR to attend office for 3 days a week)
Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk...
Your Skills & Experience :- Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other...
Rs 5 - 10 lakhs p.a.
# Hiring Alert #
We are looking for Immediate Joiners
Skills:
Big Data with GCP
GCP; Hive; PySpark; Python
GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization...
Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per... ...stakeholders as SME for data engineering- Engages in technical problem... ...with managing and transforming big data sets using pyspark, spark... ...of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise...
...in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and... ...Proficiency in SQL and database management.- Experience with big data technologies such as Hadoop, Spark, or Kafka.- Strong problem-solving and...
...】
l Responsible for the architecture design of Google Cloud's big data and the application of new technologies on the platform, from both... ...common operational issues of commonly used components in the Hadoop ecosystem, such as Flink, Kafka, HBase, Hive, HDFS, Spark, and Yarn...
Job Description :Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow...
Must-Have : - 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting...
...designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.-... ...in Agile environment to identify data engineering requirements and implement data solutions.... ...in working with efficient Data Models in a big data ecosystem.- Experience with Docker/containerization...
Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements... ..., and implementing Azure Cloud based big data solutions for clients. Your role... ...Streaming , SQL), Storm or Flink etc.- Expert in Hadoop eco-system with Azure cloud distribution...
Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate... ...Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement...
Data Modeler Responsibilities : As a data modeler, you will be responsible to understand... ...in new environments.- Perform reverse engineering of physical data models from databases... ...in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
...Required: 4-5 yrs. Location: Gurgaon
Immediate Joiners only
JOB DESCRIPTION:
Skillset:
Should have strong experience in big data technologies.
Basic skills in data pipeline – experience in building data pipelines for data migration
Big Data – Pyspark,...
Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and...
...We are looking for Big Data Architect || Immediate Joiner Remote work- 5 Working Days
Duration: Permanent-Fulltime.
Primary Skills... ...& Experience:-
Bachelor's degree in Computer Science, Engineering, or related field.
Proven experience as a Data Engineer, Big...
Responsibilities : - Design and implement scalable data pipelines and engineering infrastructure to support machine learning systems at scale.- Collaborate... ..., AWS, GCP).- 2 years of experience in Python, Databricks/Hadoop.- 2 years of experience in MLOps.Good to have :- Curiosity,...
...requirements of the analytic solutions- Data requirements of the analytic... ...stakeholders as SME for data engineering- Engages in technical problem... ...managing and transforming big data sets using pyspark, spark... ...of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise...
Job Description :Responsibilities : - Support critical project initiative to migrate programming codes, processes, data, and reports from YellowBrick / dBeaver Big Data environment to Google Cloud Platform Big Data environment. - Expert in SQL, Google BigQuery and Google Cloud...
Rs 5 - 7 lakhs p.a.
...business process and application requirements. Must have Skills : Big Data Analysis Tool and Techniques Good to Have Skills : Amazon Web... ...Requirements : Key Responsibilities : A:Should be able to work on Hadoop echo services ie HDFS, Hive, Impala, Yarn, Sentry, Oozie etc B:...
...and maintenance of scalable and efficient data architectures that support the collection,... ...data structures. - Collaborate with data engineers to build and optimize data pipelines for ingesting... ...cloud platforms (e.g., AWS, Azure, GCP), big data technologies (e.g., Snowflake,...
...Architect in our Professional Services team, you will work with customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training...
We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on... ...team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our...
...design, software development and automated testing Proficient in Big Data technologies - Designs, codes, tests, corrects and documents... ...specifications using agreed standards and tools, to achieve a well engineered result - Proficient and Hands-on Data Warehousing,- Experience...
...Impetus Technologies is a digital engineering company focused on delivering... ...in 1991, we are cloud and data engineering leaders providing... ...Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of... ...experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark...
...Title: Data Engineering Analyst Location: Gurugram
Skills:-Scala, Airflow, Spark, Hive, Hadoop, Data engineering concepts
Our mission is to partner with our Machine Learning... ...and Scala (or Java)
Knowledgeable in Big Data technologies, in particular Hadoop, Hive...
...experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.
~ Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.
~ Exposure to enterprise application development is a must....
...design, and world-class product engineering.The future of business is... ...Summary : As Senior Associate L2 in Data Engineering, you will... ...understanding of data integration and big data design principles in... ...Analytics pipelines and exposure to Hadoop ecosystem components. You are...