...and frameworks (Angular, React).- Strong knowledge of databases, including MySQL, Hbase, Elastic Search, and HDFS.- Familiarity with Hadoop ecosystem and cloud platforms like Azure Data Factory and Snowflake Data Warehouse.- Excellent analytical and problem-solving skills.-...
...- 2 years of experience working with Cloud Platforms (e. g., Microsoft Azure, AWS, GCP).- 2 years of experience in Python, Databricks/Hadoop.- 2 years of experience in MLOps.Good to have :- Curiosity, consultative mindset, and eagerness to explore new technologies.- Ownership...
...datasets- Build processes supporting data transformation, data structures, metadata, dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly scalable - big data- data stores- Building and optimizing - big...
We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability...
Job Description :- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.Good to Have:- Airflow- Good aptitude, strong problem-solving abilities, and analytical...
...understanding of the mechanism necessary to successfully implement a change.Good to have :- Experience in data management and data lineage tools like Collibra, Alteryx and Solidatus- Experience in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
Job Description :1. Technologies should be Hive, PIG, Sqoop, Zookeeper,Cloudera - these are Hadoop Ecosystem tools2. Candidate should have worked in at least one Production project, not only understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at...
...Learning, LLM application development, DevOPS and UI designing.
Expert proficiency interrogating distributed databases (Map/Reduce, Hadoop, Hive, ) is also highly desired should have worked on handling web automation projects.
Positive work attitude with ability to work...
...Title: Data Engineering Analyst Location: Gurugram
Skills:-Scala, Airflow, Spark, Hive, Hadoop, Data engineering concepts
Our mission is to partner with our Machine Learning Science counterparts to use AI/ML to collaboratively transform data assets into intelligent...
...ability to problem solve
Experience in (or a willingness to get to grips with) database interrogation and analysis tools, such as Hadoop, SQL and SAS
Strong problem solving skills with an emphasis on product development
Experience using statistical computer languages...
...to reporting and MI development.
• SQL and SAS expertise ( required to review report build prior to live )
• Tableau, Hive, Impala, Hadoop knowledge
• Credit Risk reporting and analysis experience
• Stakeholder management and strong communication and organizational...
...IIIT etc.)
Good analytical thought process and aptitude for problem solving
Hands on experience using SQL/Pyspark SQL in a big data Hadoop/spark environment
Hands on experience in data cleaning and feature creation using Python / Pyspark
Strong business acumen with a...
...Qualifications:
•Experience with cloud platforms (e.g., AWS, Google Cloud, Azure).
•Familiarity with big data technologies (e.g., Hadoop, Spark).
•Published research in the field of NLP or machine learning.
Other Key Responsibilities
•Adherence to internal QMS...
.../ Python, should have experience in Data Ingestion, Integration and data Wrangling, Computation, Analytics pipelines and exposure to Hadoop ecosystem components. You are also required to have hands-on knowledge on at least one of AWS, GCP, Azure cloud platforms.Role & Responsibilities...
...communication skills and the ability to collaborate effectively with stakeholders at all levels.
•Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure) is a plus.
•Relevant certifications (e.g., Certified Data Scientist, AWS Certified...
...Machine learning: TensorFlow PyTorch or Scikitlearn
Artificial intelligence: AWS SageMaker Azure ML or GCP AI Platform
Big data: Hadoop Spark or Kafka
Programming languages: Python Scala or Java
Desirable skills
Data engineering: Databricks AWS EMR or...
...Studio
• Execution Paradigm – low latency/Streaming, batch
Preferred Qualifications/ Skills
• Data platforms – Big Data (Hadoop, Spark, Hive, Kafka etc.) and Data Warehouse (Teradata, Redshift, BigQuery, Snowflake etc.)
• Visualization Tools - PowerBI, Tableau...
...Very good knowledge of Datawarehouse, SQL and Unix shell scripting.- Knowledge on ETL side of Cloud platforms like AWS or Azure and on Hadoop platform is also an added advantage.- Experience in working with banking domain data is an added advantage.- Excellent technical...
...cloud experience would be a strong bonus.
~ Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.
~ Exposure to enterprise application development is a must.
Roles & Responsibilities
Able to...
...of Data Models like Snowflake Schema and Star Schema and conceptual understanding of Data Warehouse, Big Data, Dimensional Modeling, Hadoop- Exposure of working in Agile framework. Tools : JIRA, ConfluenceResponsibilities :- Support the build of outcome driven Visualisations...
Rs 18 lakh p.a.
...Expertise in scripting languages like Python, Bash, Perl, etc. preferred
• Specialization in database engineering skills – SQL, NoSQL, Hadoop, etc.
• Exposure to warehousing architecture processes – MOLAP, ROLAP, EDW, etc.
• Exposure to Big Data components like Hadoop...
...modeling
· Strong SQL query-writing skills
· Strong analytical, profiling and troubleshooting skills
· Strong knowledge with Big Data/Hadoop platform
· Strong knowledge Unix shell and experience with Python
· Experience in data integration and data conversions
·...
Rs 12 - 16 lakhs p.a.
...conversant with Apache Spark architecture, RDDs, various transformations and actions, spark configuration and tuning techniques B:Knowledge of Hadoop architecture; execution engines, frameworks, applications tools C:Pyspark using Spark MLlib library D:Exposure to Data warehousing...
...Athena, EMR, Spark, S3.
~4+ years of experience as a SQL developer or similar role.
~ Fundamentals of distributed systems like Apache Hadoop, Apache Spark.
~ Should be experienced in data structures, data modeling, data lakes, data architecture.
~ Excellent understanding...
...structures, algorithms, and statistical techniques for data analysis and modeling.
Experience with big data technologies (e.g., Hadoop, Spark) and cloud computing platforms (e.g., AWS, Azure, GCP) is a plus.
Strong problem-solving skills and the ability to think creatively...
...foundation in OOPS and functional programming concepts.
Big Data Technologies : Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including streaming technologies (Kafka, Spark Streaming, Flink, etc.).
Database...
...working with unstructured datasets.
Proficiency in Spark Technology and Elastic pipeline engine.
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases.
Experience with data pipeline and workflow management...
Rs 12 - 16 lakhs p.a.
...and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key Responsibilities : A: Create scala/spark jobs for data transformation and aggregation B: Write Scala doc style...
...Scala(Preferred) or Python
Additional Skills: Exposure to multiple technologies: Java, Big Data, Spark, PySpark, Spark SQL, Scala, Hadoop, HDFS, YARN, Hive, GCP Cloud, Google Cloud Dataflow, Big Query, Dataproc, Elasticsearch, MySQL, Oracle, Cloudera, Azure HDInsight, AWS...
...- Experience in managing Python codes and collaborating with customer on model evolution- Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise).- Superior analytical and problem solving skills - Should be able to work on a problem independently...