Average salary: Rs1,518,678 /yearly
More statsSearch Results: 12,115 vacancies
...At least 3 years of experience building production-grade data processing systems as a Data Engineer
In-depth knowledge of:
The Hadoop ecosystem.
Building applications with Apache Spark;Experience with Spark Streaming
Columnar storage solutions like Apache HBase;...
...Education Desired :
Bachelor's Degree Travel Percentage :
0% Hadoop Administrator - Bangalore/ Pune/Chennai/Gurgaon- 6-12 Years... ...processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems.
Cross-...
...Development team to implement data strategies, build data flows and develop conceptual data models.- Recognize the need for a specific... ...like Collibra, Alteryx and Solidatus- Experience in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience...
Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process...
Primary skills expected :- Data engineering problem solving. - Able to understand requirement and to provide detailed implementation steps considering dependencies with - (upstream systems, downstream systems, and other modules).- PySpark data ingestion and transformation Batch...
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
...organization, leveraging the Azure Machine Learning platform to develop, deploy, and maintain machine learning solutions. This position is... ...databases- Proficiency in big data technologies such as Spark or Hadoop- Excellent understanding of machine learning algorithms and techniques...
Candidate should have minimum 5years of experience as Big Data Engineer Candidate must have exp into Hadoop and Scala both Only candidates who can join Immediately or within 15 days will be considered for this role
Candidate should be available for face to face interview...
...Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.
? Experience in Sqoop / Hadoop
? Microsoft Excel (for metadata files with requirements for ingestion)
? Any other certificate in Azure...
...least 4+ years in Scala or PySpark
Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory
Strong Unix and Shell... ...understanding the requirements and design of the product/ software
# Develop software solutions by studying information needs, studying...
...Job Title: ETL Developer
Location: Pune
About Barclays
Barclays is a British universal bank. We are diversified by business, by... ...:
• Ab
Initio (batch and real-time), Mongo DB, BigData – Hadoop, SQL, Oracle & Teradata, Unix basics and shell scripting
•...
Job Summary: As the Snowflake Developer, you will work with the development team to create technical designs, write code, and unit test new... ...Java, JavaScript- Root cause analysis of models with solutions, Hadoop, Spark, and other warehousing tools- Managing sets of XML, JSON,...
...5 years of expertise in Big Data technologies, SQL, Spark, Hive, Hadoop, and Python. The ideal candidate will play a pivotal role in the... ...analysis of large-scale data sets.
Responsibilities:
1. Design, develop, and implement scalable and efficient data processing solutions...
...Spark & Scala Developer Exp- 7-13 yrs
Shift- Malaysian / EUR
Full time Contract Opportunity
Fully Remote
please share resume... ...performance optimization
Data Modelling, Data Warehousing, Hadoop, Hive, ETL
SQL database integration ,Microsoft, Oracle,...
...Hands-on experience with Azure ecoystem
Deep experience in developing data processing tasks using PySpark such as reading data from external... ...with Azure Filesystem operations
Good knowledge of Hadoop, Hive, and Cloudera/ Hortonworks Data Platform
Key Responsibilities...
...right actions.
Role Description
TigerGraph Development: Develop and maintain TigerGraph-based solutions, including graph data... ...teamwork skills.
Experience with related technologies (e.g., Apache Hadoop, Spark) is a plus.
Knowledge for Database, MySQL, Resource...
...understanding of Data Warehouse, Big Data, Dimensional Modeling, Hadoop- A good understanding of the best practices and business... ...team understand the business flow and impact of the features being developed.- Understand the business requirements and break the requirements...
...Job description The Ab Initio Senior Designer/Developer will be responsible for working with our leading on-site consultants at as a hands... ..., Express It, Micrographs, Web Services, EME, etc.) Work with Hadoop HDFS file system is also a strong plus. (not connecting to Hadoop...
Rs 1.8 - 3 lakhs p.a.
...Job Description of Java Developer
Requirement: 1to 2 year experience in java development
Very good skills in java development... ...Having experience on cloud computing
Having knowledge of Hadoop technology
Package: 1.8 to 3.0 lac PA
JAva,Java Developer...