Search Results: 10 vacancies
...Knowledge of Big Data Processing Cluster (Azure HDInsight / AWS EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-... ...time Streaming)- Experience on Big Data components/services like Hive, HDFS, S3 , Azure Storage, Amazon Athena etc. - Experience on...
Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob... ...and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...
...using Azure or other cloud providers.
Demonstrable knowledge of Big Data Engineering technologies including but not limited to Hadoop, Hive, Spark, NoSQL DBs, SQL, Data Warehousing, ETL/ELT tools, BI Visualization tools, etc.
Demonstrable knowledge of Cloud Services and...
...data warehouses.- Spark: Advanced knowledge of Apache Spark for large-scale data processing.- Hadoop: Solid experience with the Hadoop ecosystem, including HDFS, MapReduce, Hive, and Pig.- Cloud Platforms: AWS Proficiency- Programming Languages: Proficiency in SQL, Python....
...Amazon API Gateway, DynamoDB, SimpleDB, and AWS Route 53.- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.- Experience with Hadoop v2 and Spark.- Experience in real-time streaming data processing with Spark/Kafka/Kinesis.- Management of the Hadoop...
...jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..- Developed Python and... .../RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..- Re - write some...
...programs, which aims to build a data standardized and curation-based Hadoop clusterThis high visibility, fast-paced key initiative will... ...Build integrated solutions leveraging Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.- Build...
...Kinesis, Glue, EMR- Hands-on experience of programming language like Scala with Spark.- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases- Hands on working experience on any of the data engineering analytics platform (...
...providing previously undiscovered solutions to command data challenges- Defining company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models- Working closely with all business units and concerned people to develop strategy for long term data...
...technologies to drive data analytics and insights for the organization.
Qualifications
Proven expertise in Azure Data Bricks ADF ADL Hive Python Spark and PySpark.
Experience with Azure SQL DW and strong TSQL skills.
A solid background in handling both structured and...
