Average salary: Rs800,000 /yearly
More statsJob Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
...languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of... ...and technology and translate them into large scale engineering developments- Excellent experience in Application development...
...: PYSPARKSecondary : GCP- At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines... ...of providing solutions and tools that iteratively increase engineering efficiencies.- Design should help embed standard processes,...
Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including...
...possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is essential for testing data... ...resolution.- Collaborate with developers and data engineers to troubleshoot issues and ensure timely resolution...
...Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with... ...service offerings.- Should have knowledge and experience of Big Data Technologies (Hadoop ecosystem) and NO SQL databases.- Should have technical...
...PythonMandatory Requirements : - Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.- Strong experience in GCP with multiple... ...of containerization orchestration, and KE engine would be an added advantage.- Familiarity with...
We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams...
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal... ...of data sources using SQL and AWS - big data technologies- Build analytics tools... ...workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream...
...experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data...
...driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should... ...in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3. Hands on and working knowledge in Python4....
...Us : Valiance is a global AI & Data analytics firm helping clients... ...across Machine Learning, Data Engineering & Cloud expertiseWe are seeking a skilled and experienced Big Data Engineer to join our team.... ...expertise in Python, SQL, Pyspark, Hadoop, Hive, Delta Lake, and Airflow....
Responsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to... ...design to develop and implement solutions that adhere to big data architectural guidelines and address business...
...experience.
Your Role and Responsibilities
Understand a data warehousing solution and able to work independently in... ...of the ETL tool like informatica, 5+ years of experience, Big Data technologies’ like Hadoop ecosystem, its various components, along with different tools...
...We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure,... ...Understanding of RDBMS/NoSQL, Oracle , Cassandra , Kafka , Redis, Hadoop, lambda architecture, kappa , kappa ++ architectures with...
...Lead/Senior Big Data Engineer Experience: 6 - 10 Years
Location: Pune
Type: Full-time
Job Profile
We are looking for a Big Data... ...including processing frameworks like Spark,
Akka, Storm, and Hadoop, and the file types they deal with.
● Experience with ETL...
...Job Description
Big Data Engineer
The ideal candidate should be able to demonstrate strong technical aptitude and interest in learning... ...programming languages like Python, Scala, SQL is an asset
Hadoop service knowledge including HDFS, HBase, Hive, Spark is an asset...
...infrastructure, security, and other partners.- 3-5 years in an engineering role.- 1-3 years participating in agile development.- Scrum certification... ...in elastic search is mandatory.- 3-5 Years of experience in Hadoop & Elastic Search mandatory.- 3-5 Years of experience in Spark is...
...energetic, successful and highly skilled Engineers to help shape our technology and product... ...experience for our customers and colleagues, with Big Data and batch/real-time analytical solutions... ...data pipelines on GCP a plus
~ Hadoop Architecture, having knowledge on Hadoop,...
About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining... ...data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement,...
...skills and experience.
Your Role and Responsibilities
As a Big Data Engineer, you will develop, maintain, evaluate, and test big data... ...and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..
Developed Python...
Role : Data EngineerSummary :Drive best possible solutions for clients... ...Lead on projects from a data engineering perspective, working with our... ...sources and systems into Big Data platforms- Create and manage... ...in Big Data technologies (Hadoop / Spark / Relational DBs) and...
...years in a row , Qlik transforms complex data landscapes into actionable insights,... ...opportunities.
The Senior Technical Support Engineer Role
Join us as a Technical Support... ...6 years of relevant experience in Big data / Hadoop Support background.
~ Ability to...
...Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support-... ...data platforms and data products.- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java programming...
...Informatica, Airflow, or Similar- Enterprise Data Modelling and Semantic Modelling & working... ..., or Similar- Logical/Physical model on Big Data sets or modern data warehouse & working... ...Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred...
...Mandatory Skills-- 3+ years' experience in software development with Big data technologies
- Proficiency in at least one of the following... ...in Apache Spark, HDFS and Hive
- Experience of working with Hadoop cluster
- Good communication skills and logical skills
Nice...
Role : Data EngineerLocation : Pune/HyderabadIn this role, you will... ...of the technical team alongside Engineers, Data Scientists and Data Users... ...following technologies (Apache Hadoop, Scala, Apache Spark, Spark... ...management in JIRA.- Understanding of big data modelling techniques using...
Key Responsibilities: - Build and maintain data pipelines to enable faster, better, data-informed decision-making through... ...loading),and data storage solutions. - Experience working with big data technologies such as Hadoop, Apache Hive, Redshift, Kafka, or Apache Spark. - Strong...
...everything we can to make that possible. We dream big together, supporting each other to make... ...the company, identify opportunities for Data Engineering to enhance our business, match the... ...ETL programming.
• Experience working on Hadoop Cloudera distribution and has conceptual...
...Job Description
The Olympus Data Reconciliation and Engineering team is responsible for delivering enterprise... ...global processing hubs. This role, Big Data Engineer, will be responsible for... ...following tools and technologies:
Hadoop, Spark, Kafka
Relational SQL and NoSQL...