Average salary: Rs800,000 /yearly
More statsSearch Results: 80,967 vacancies
Responsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business...
Job Description :- Must have working experience Designing, building, installing, configuring and supporting of Hadoop.- Good to have Teradata, Cloud & Snowflakes Knowledge- Must have working experience in IntelliJ IDEA, AutoSys(Control M), WinSCP, Putty & GitHub.- Translate...
...leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing...
...BigData-Hadoop/Scala Engineer
Position Overview
Job Title: Data Engineer (ETL, Big Data, Hadoop, Spark, GCP)
Corporate Title:Assistant Vice President
Location- Bangalore, India
Role Description
Senior Engineer is responsible for developing and delivering...
...driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be... ...in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3. Hands on and working knowledge in Python4....
...extraordinary and make a real difference for companies and the planet .
About the role....
Managing, Installing & config. of Hadoop (hive, hdfs, Ambari & Nifi) . Designing the architecture and to integrate with o9 Product. Involved in Hadoop maintenance & monitoring...
...Platforms team, enables Visa's revenue growth through flexible pricing engines and global revenue platforms built on next-generation... ...writing complex database queries and scripts for RDBMS (like Oracle), Hadoop (like HBase, Hive etc) and NoSQL (like MongoDB).
• Must have working...
Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain... ...updated with emerging technologies and best practices in data engineering, and proactively identify opportunities for process optimization...
...Python or Scala.- Hands-on experience on the Big Data stack like Hadoop, Mapreduce, Spark, Hbase, and ElasticSearch.- Good understanding... ...new concepts and technology and translate them into large scale engineering developments- Excellent experience in Application development...
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble... ..., dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly...
Skills : Hadoop, Java, Python, Scala, SqlRequirements :- 3-4+ yrs as a backend developer- Worked in a good startup or good engineering colleges- Working with an early-stage startup in a role that involves- Building scalable systems to extract information from 15Mn+ domains....
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
...highly skilled Data Science team. Lead on projects from a data engineering perspective, working with our clients to model their data landscape... ...of experience, with at least 3+ years in Big Data technologies (Hadoop / Spark / Relational DBs) and similar experience in working on...
Job Description :The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate... ...such as MS SQL Server, PostgreSQL, MongoDB, Cassandra, Redis, Hadoop, Spark, Hive, Teradata, or MicroStrategy- A high-level understanding...
...and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from... ...streaming data architectures- Experience using big data technologies (Hadoop, Hive, HBase, Spark and others).- Strong knowledge of SQL (MSSQL...
Job Description :As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You... ...experience in building Data Pipelines using Scala, Spark, Hadoop, HiveQL etc.Have experience with streaming frameworks such as Kafka...
...development using Scala, Java, or Python to build solutions in Hadoop, Spark, and Hive technologies.
Design, develop, and maintain... ...Soft Skills:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Strong critical thinking and problem-...
Responsibilities for Data Engineer:- Create and maintain optimal data pipeline architecture,.- Assemble large, complex data sets that meet... ...the following software/tools:- Experience with big data tools: Hadoop, Spark, Kafka, etc.- Experience with relational SQL and NoSQL databases...
...in Requirement Gathering, Estimating, Managing large scale Data Engineering Projects.
Requirement Analysis: Understand and translate business... ...Technical Skills:
Extensive experience in big data tools: Hadoop, Hive, and Spark.
Proficiency in Scala, Python, SQL, and...
...Experience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.
Education: BE (IT/... ...maintain systems in both cloud and physical environments. Big Data Engineers must also be able to collaborate with other IT professionals, including...
