Search Results: 4,709 vacancies
Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process...
...Required : 6 To 10 years.Location : Bangalore/Hyderabad/PuneWork Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed...
Contribute in all phases of the development lifecycle
Write well designed, testable, efficient code
Ensure designs are in compliance with specifications
Prepare and produce releases of software components
Support continuous improvement by investigating alternatives...
...coding experience with modern programming or scripting languages (Python) and data processing packages and libraries- 3+ years of hands-on... ...Any Tech GraduateMust-Have Technical Skills : including 3+ years Spark or Scala,- 2+ years of Hadoop/Big Data using tools like Hive,...
...minimize service disruptions.- Develop and maintain scripts using Python and other scripting languages for automation and optimization.... ...technologies.- Proficiency in distributed file and table formats, Spark, Object Storage (preferably Dell ECS), and metadata management.-...
...experience, skills). Mandatory skills : Azure, Azure Cloud, Azure Databricks, Azure Datafactory, Azure Datalake, Python, SQL, Relational databases (Oracle, DB2, SQL Server), Spark, Agile. Job Description :- 3-5 years of IT technology or operations related experience in a large...
...Science, ML or related field.Minimum 5 years of relevant industry experience.Programming languages, frameworks and tools Strong skills: Python, Spark, Java, Kafka/Kafka Stream, KubernetesGood to have: Airflow(or equivalent orchestration frameworks), Deep Learning, Scikit, NLTK,...
...Designing and implementing data pipelines using Azure Data Factory (ADF).- Developing and maintaining data processing scripts using Python, Spark, and Scala.- Building and optimizing data storage solutions using Azure Data Lake Storage (ADLS), Blob Storage, and Synapse.-...
...developing sophisticated data driven software platforms
~ Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas)
~ Contributing to delivery and support of enterprise software
~ Experience with cloud service technologies, ex: AWS...
...Server / DB2 - Must have experience in any Programming language like - Java, Python, etc- Must have experience in Cloud-based development (AWS / Azure / GCP)- Experience in Data Engineering skills like Spark, Bigquery, Hadoop, Airflow etcMandatory (Education) : B.Tech /...
Rs 12 - 16 lakhs p.a.
...process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key Responsibilities... ...categories and best practices C: Experience with Java essential Python, and R highly desired D: Experience with Apache Spark streaming...
...concepts to make way for the new and evolved ones.Requirements :- Someone with at least 3 years of experience building backend systems using Python.- Someone who takes ownership of delivery thereby not only closing your work but also identifying dependencies and making sure they...
...Should have good working experience on : - Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet - Spark - Batch Processing - Setting ETL pipelines - Python or Java programming language is mandatory. - Worked in data Lake , Data warehousing Domain in Cloud...
Rs 12 - 20 lakhs p.a.
...acting as the primary point of contact. Must have Skills : Apache Spark Good to Have Skills : No Technology Specialization Job... ...Creation of simple data model as data product 4 Strong Knowledge in Python 5 Strong Knowledge of Spark Applications lifecycle 6 Exposure to...
Rs 12 - 16 lakhs p.a.
...process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Microsoft SQL Server,Unix to Linux Migration... ...Experience : A:Should have Excellent development experience with Python producing data applications B:Should have 8 years of experience using...
Rs 7 - 15 lakhs p.a.
...Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good To Have Skills : Python Programming Language Job Requirements : Key Responsibilities: a Lead the team and contribute to the design and build of...
...years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects... ...experience in SQL along with at least one scripting knowledge (e.g. Python, Java, Scala, R etc.)- Good to have experience with streaming...
Job Description :- Design and develop real-time data ingestion pipelines using Databricks and Spark Streaming to enable timely processing of large volumes of data.- Implement complex data transformations and aggregations to extract actionable insights from streaming data sources...
...Kafka etc)
- Ability to migration analytics data from DynamoDB to Cloud Spanner, BigQuery
- Hands-on experience in S3, Dataproc, Spark, Python, CloudFunctions, Orchestration using Airflow/Composer
- Ability to handle and migration hundreds of TB of data, code...
...working in an agile environment (e.g.user stories, iterative development, etc.).- Knowledge and working experience in elastic search is mandatory.- 3-5 Years of experience in Hadoop & Elastic Search mandatory.- 3-5 Years of experience in Spark is mandatory. (ref:hirist.tech)
