Average salary: Rs141,000 /yearly
More statsSearch Results: 18 vacancies
Lead Data Engineer - 6+ years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs- Python scripting with focus on data transformation...
...We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for:
Experience- 5+ Yrs
Location- Hyderabad & Indore
Responsibilities:
Implementing the large scale Spark applications and finetune at runtime
Design and implement...
...and delivering high-quality software solutions that meet the needs of our clients. You will leverage your technical expertise in Apache Spark, NoSQL databases, relational databases, Spring Framework, and cloud technologies to drive innovation and solve complex technical...
...automation, data visualisation (Power BI) and Business intelligence reporting solutions
Knowledge of programming languages such as spark or python
Create technical design documentation which includes current and future functionality, database objects affected, specifications...
...techniques.
Experience in Cloud Computing.
Technical Skills -
Programming language - Java and Scala
Good understanding of Spark Internals
Good understanding of Unix Internals
Should have experience of working in Trading, Telecom, gaming, or Risk engines in...
...particularly in building and managing data infrastructure.
Solid understanding of big data technologies and frameworks such as Hadoop, Spark, Kafka, etc.
Experience with data warehousing and relational database systems.
Strong problem-solving skills and the ability to...
...defining and implementing cloud based large solutions.
Big-data Engineering experience setting up data lakes ( Hadoop, Hive, HDFS, Spark, API's, Collibra, etc)
Applicant must have working experience in AWS IaaS, PaaS, storage, network and database, Analyzing and identifying...
...Snowflake, secure views, dynamic data masking, and RBAC.- Experience with data replication for secure data sharing and failover management.- Strong scripting skills in Spark, PySpark, Snowpark, or SQL are highly desirable.- SnowPro certification is a plus. (ref:hirist.tech)
...Dynamo DB, Document DB, SNS, SQS, Lambda, EKS, Data Zone etc.
~ Thorough understanding of Big Data ecosystem technologies like Hadoop, Spark, Hive, HBase etc. and other competent tools and technologies
~ Understanding in designing analytical solutions leveraging AWS...
...tools such as : Databricks, Sage Maker, Google Colab, Jupyter, etc - Hands on experience with streaming tools such as: Kafka, Flume, Spark Streaming, or Flink - Expectation is that you support the code and products yourself and your team create What You'll Do : - Engineer...
...detailed design conforms to user expectations.
Design, Build and Test data processing pipelines in a GCP environment using Python, Spark, PySpark, Scala code.
Provide support with application testing, UAT, and application migration in GCP.
Areas of expertise we are...
..., you will play a key role in designing, developing, and deploying scalable, high-performance software solutions that leverage Apache Spark, NoSQL databases, Spring Framework, and cloud technologies. You will work closely with our engineering team to build robust and efficient...
...Experience Required- Above 12 Years
Job Description:
Tech Stack: Java 1.6+, Spring Boot, Spring MVC, Hadoop, Hive, HDFS,
Map Reduce, Spark Batch & Spark Streaming, Scala, Kafka
~ Experience developing enterprise-grade data integration solution
~ Good knowledge of Java...
...# Data Processing: Design, develop, and maintain scalable and efficient data processing pipelines using technologies such as Apache Spark, Hive, and Hadoop.
# Programming Languages: Proficient in Python, Scala, SQL, and Shell Scripting for data processing, transformation...
...programming language experience in Java/Scala or Python.
Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.
Understanding on workflow orchestration tools like oozie, Apache Airflow etc.
Experience on working with monitoring and logging...
...Bangalore, Raipur , Indore ,
Role Requirements :-
Tech Stack : Java 1.6+, Spring Boot, Spring MVC, Hadoop , Hive, HDFS, Map Reduce, Spark Batch & Spark Streaming, Scala, Kafka
Proven hands-on Software Development experience
Proven working experience in Java...
...Profound programming language experience in Python.
Knowledge of Hadoop ecosystem and strong hands-on experience on SQL,Hadoop, Hive and Spark.
Must have understanding on messaging services and their integrations.
Good to have experience in streaming technologies such as...
...tools such as: Databricks, Sage Maker, Google Colab, Jupyter, etc
~ Hands on experience with streaming tools such as: Kafka, Flume, Spark Streaming, or Flink
What You'll Do:
Engineer an innovative, durable, robust, and economically viable data platform enabling...
