Average salary: Rs2,131,412 /yearly
More statsSearch Results: 90 vacancies
...Role : Technical and functional Hadoop specialist 2-8 years of relevant industry experience
Skills
General operational expertise such... ...MapR etc.),
Understanding on Apache Spark, HDFS, Map Reduce, Hive, Nifi, Sqoop, Python or Scala, or any programming languages based...
...distributed data processing systems with one or more technologies such as MS SQL Server, PostgreSQL, MongoDB, Cassandra, Redis, Hadoop, Spark, Hive, Teradata, or MicroStrategy- A high-level understanding of automation in a cloud environment: AWS experience preferred.-...
....
Key Responsibilities:
Lead the administration of Hadoop clusters ensuring the smooth functioning of the Hadoop ecosystem.... ...Experience with Hadoop ecosystem components such as HDFS YARN MapReduce Hive Pig and HBase.
Experience with Linux/Unix operating systems...
..., with a strong focus on large-scale data platforms and data products.- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java programming language.- Experience leading and managing teams of data engineers- Excellent...
Job Description :- 4+ years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs- Python scripting with focus on data transformation...
...distributed training of deep learning models can be beneficial.- Familiarity with distributed computing and big data technologies like Hadoop and Spark.- Familiarity with machine learning operations (MLOps) principles and tools for managing the ML lifecycle.- Should have...
...data modeling- Strong SQL query-writing skills- Strong analytical, profiling and troubleshooting skills- Strong knowledge with Big Data/Hadoop platform- Strong knowledge Unix shell and experience with Python- Experience in data integration and data conversions- At least 5...
...Experience in Data Visualization Tools like Tableau, Pentaho BA Tools .
Experience on the Hadoop ecosystem - Programmed or worked with key data components such as HIVE, Spark and Sqoop moving and processing terabyte level of data.
Digital Marketing/Web analytics...
...and functional programming concepts.
Big Data Technologies : Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including streaming technologies (Kafka, Spark Streaming, Flink, etc.).
Database Expertise...
..., and data pipeline and orchestration of such tools as Apache Airflow and Nifi.
o Large Scale/ Big Data technology, such as Hadoop, Spark, Hive, Impala, PrestoDb, Kafka.
o Fast and distributed data processing in Ray, Dask, DuckDb, Polars, cuDF
o Building performant...
...and Kubernetes
Experience with NoSQL databases such as MongoDB and Redis
Proficiency with big-data technologies like Spark, Hadoop M/R, Hive or Pig is a plus
What you'll Get:
Challenging problems to solve
Opportunities to learn cool new things
Work that...
...ETL development or related roles.
work with big data technologies and cloud data platforms is highly desirable.
with Hadoop ecosystem and Hive for big data processing and analysis.
with Snowflake cloud data platform to implement data warehousing solutions.
command...
...and NoSQL Databases: PostgreSQL, MySQL, MongoDB, Elasticsearch, Hive, Cassandra, Redis
Experience with Agile & DevOps methodologies... ...Gitlab/Github/AzureRepos
Familiarity with one or more SQL-on-Hadoop technology (Hive, Spark SQL, Presto).
Real-time streaming distributed...
...proficiency in big data infrastructure technologies such as MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, etc., to support the... ...Experience working with big data technologies and frameworks such as Hadoop, Spark, Kafka, etc.
~ Knowledge of data modelling, data...
....
Preferred Skills
Azure Data Lake experience.
Experience in Hive, Databricks, Unix/Linux Shell scripting
Experience with Airflow on Azure
Background of accessing big data preferably Hadoop clusters desirable
Background on Data certification and familiarity...
...jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..- Developed Python and... .../RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..- Re - write some...
Rs 15 - 18 lakhs p.a.
...experience (C, C++, UNIX, Java, Linux,R, Python ).
Exposure or knowledge in cloud (AWS/GCP/Azure) or big data technologies such as Hadoop ,Hive MapReduce etc.
Experience working with large data streaming technologies (like Spark etc. )
Job location : Mumbai...
...Anomaly detection etc. • Demonstrable experience in exploratory data analysis (Jupyter, RStudio), distributed data frameworks (Hadoop, Spark, Hive, etc.), code review and version control tools, batch and streaming data pipeline orchestration (Airflow, ML flow, Kafka), containerization...
...worked in distributed computing and enterprise environments like Hadoop, GCP/AWS/Azure Cloud.
~ Well versed with various Data Integration... ...toolsets like S3, Cloud Storage, Athena, Glue, Sqoop, Flume, Hive, Kafka, Pub-Sub, Kinesis, Dataflow, DataProc, Airflow, Composer,...
..., Ansible, Chef, Puppet.
o Experience of running Performance Engineering optimization over DataLake or Data Platforms (Big Data/Hadoop/Hive/Spark)
o Developed data analysis tools or visualization of real world application and network performance.
o A rich experience...
