Average salary: Rs1,011,999 /yearly
More stats ...Experience with Apache Kafka for use with streaming data / event-based data- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)-...
...jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..
Developed Python and... .../RDD’s were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Re – write...
Rs 7 - 11 lakhs p.a.
...into reusable Data Asset Technical Experience : A Candidate should have Technical experience in one of the technologies-Hadoop, Juniper, Scala, Spark, Hive, HQL B: Experience of XML,FPML,JSON, Good have BigData exp Banking domain experience C: Party/Client, Trade Financial...
Rs 3.8 - 10.5 lakhs p.a.
...Hadoop Developer Responsibilities:
Meeting with the development team to assess the company’s big data infrastructure.
Designing and... ...the hadoop ecosystem and its components.
In-depth knowledge of Hive, HBase, and Pig.
Familiarity with MapReduce and Pig Latin...
Rs 12 - 20 lakhs p.a.
...Exposure to AWS Cloud, NoSQL Database (Mongo, Cassandra), Message Broker (Active MQ/RabbitMQ/Apache Kafka) and Big Data Technologies (Hadoop/Hive/Spark)
Additionally, must possess capability to review code, produce technical specification document and knowledge of code...
...and good communication skills to lead and run workshops
Strong knowledge of data manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache Nifi and Kafka necessary to build and maintain complex queries, streaming and real-time data pipelines
Data modelling...
Rs 7 - 11 lakhs p.a.
...data processing pipeline Technical Experience: AExperience in Spark query tuning and performance optimization BGood understanding of Hadoop architecture and distributed systems eg CAP theorem partitioning replication consistency and consensus Professional Experience: A Ability...
...transformation systems in batch and near real time environments.
~ Experience with SQL, relational modeling, and big data tools such as Cosmos, Hive, Scope or Spark
~ Experience with ETL, data modeling, and working with Business Intelligence systems.
~ Solid understanding of...
Rs 12 - 16 lakhs p.a.
...and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key Responsibilities : A: Create scala/spark jobs for data transformation and aggregation B: Write Scala doc style...
...Training, Evaluation, GPU vs CPU, XGBoost ML), Python ML Libs(TensorFlow, PyTorch).- Experience in RDMS, ETL, SSIS, Data Warehousing, Hadoop, Talend, Power BI and Tableau.- Experience in leading a team of 3-5 data scientists.- Experience using tools to deploy models into the...
Rs 12 - 16 lakhs p.a.
...applications to meet business process and application requirements. Must have Skills : Python Programming Language Good to Have Skills : Hadoop,Apache Spark Job Requirements : Key Responsibilities : A: Role will be responsible for analysing profiling data in line with business...
...the source data.
~ Has strong knowledge of large-scale search applications and building high volume data pipelines
~ Knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment.
~ Experience working...
Rs 11 - 15 lakhs p.a.
...applications, acting as the primary point of contact. Must have Skills : Microservices and Light Weight Architecture Good to Have Skills : Hadoop,Oracle Database Administration, Job Requirements : Key Responsibilities : A: Provide support during production implementation and for...
...used in existing products. SQL, Advanced Python or R (descriptive / predictive models), Tableau Visualization. - Working knowledge of Hadoop, BigQuery, Presto, Vertica- Apply your expertise in quantitative analysis, data mining, and the presentation of data to uncover unique...
...efficiency and reduce cost.
Must have worked on both Batch and streaming data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda,...
...principles and design patterns to contribute to complex data processing tasks (if applicable).- Manage and maintain data pipelines on Hadoop infrastructure.- Develop and integrate RESTful APIs for data access and consumption.- Automate data processing workflows using DevOps...
...knowledge in implementing RPA and AI/ ML Methods.- Certification in RPA or AI/ML technologies.- Contributions to open-source projects related to natural language processing or machine learning.- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka) (ref:hirist.tech)
...Python is a must- Strong SQL querying skills & data processing using Spark- Hands on experience in data mining with Spark- String expertise in any commercial data visualization tool such as Tableau, Qlik, Spotfire etc.- Good understanding of Hadoop ecosystem (ref:hirist.tech)