Average salary: Rs1,519,544 /yearly
More statsSearch Results: 55 vacancies
...Design, develop, and maintain data processing pipelines using Apache Spark and Scala.
Optimize Spark jobs for performance, scalability, and reliability.
Work closely with data engineers and data scientists to implement data-driven solutions.
Develop and maintain...
...a business environment - Proficiency with Linux command line and systems administration - Experience with languages like Python/Java/Scala - Experience with Big Data technologies such as Hive/Spark - Proven ability to develop unconventional solutions, sees opportunities to...
Job:S&C Global Network - AI - Finance - Quantexa Scala
...implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake- Strong programming skills in Python/Scala, Pyspark, SQL- Expertise in implementing design for data ingestion, data transformation, handling data source using batch processing,...
...background with Architecture / design experience for 5+ years.
~ Languages used extensively on the platform are AngularJS, Java, Spark, Scala, Python, C++ with datastores being Postgres, MongoDB, Elasticsearch, Snowflake.
~ Good knowledge of Containers / Kubernetes, CI/CD...
...Architectures independently
~ Strong experience working in the Databricks ecosystem
~ Comfortable writing code in either Python or Scala.
~ Experience working across Cloud Platforms (GCP / AWS / Azure)
~ Documentation and white-boarding skills.
~ Build skills in...
...warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Bachelor's degree in a quantitative/technical field such...
...is for you. We collect billions of events a day, manage petabyte scale data on Redshift and S3, and develop data pipelines using Spark/Scala EMR, SQL based ETL, Airflow and Java services.
We are looking for talented, enthusiastic, and detail-oriented Data Engineer, who...
...data science team.
● Skillful in ETL process and tools.
● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
● Experience in writing Python programs and SQL queries.
● Experience...
...least 5+ years’ experience in application/product development using a broad range of programming technologies including.
Strong in Scala / Java
Strong in Java EE/Spring Web/Spring Boot
Strong in JavaScript, HTML, CSS
Strong in React/Angular
Must have worked with...
...experience working with big data technologies on AWS/Azure/GCP
• 7+ years of experience in the Apache Spark/DataBricks framework (Python/Scala)
• Experience working with different between database structures (e.g., transaction based vs. data warehouse)
• Databricks and AWS...
...development, we would love to hear from you!
Job Requirements: Angular, Css, Mysql, Java Development, Html, Spring, Java, Visio, Scala, Web Service, Javascript, Hibernate, Version Control, Supervision, Scripting Languages, Strong Understanding, Sql, Performance Tuning,...
...Job description
Role: Data Engineer
Experience : 3-5 Years
Skill set:
Pyspark / Scala Spark, Databricks, Python, SQL. Must have cloud knowledge of anyone (Azure, AWS, GCP)
Roles and Responsibilities:
Should have programming skills with the ability...
...She has to work with different sales, presales and partner teams in different geographies, time zones.,Hands on experience with Python, Scala and SQL,Strong depth in Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture...
...Good knowledge in Data Structures and Algorithms
~ Good in SQL, and RDBMS concepts
~Any one of the following programing languages, Scala, Python or Java
~ Knowledge of Big data ecosystem
~ Good understanding of AWS or any cloud platform
Additional Information...
...snowflake schemas.
Programming Languages: Proficiency in programming languages commonly used in data engineering, such as Python, Java, or Scala, as well as experience with SQL for data querying and manipulation.
Cloud Computing: Proficiency in using AWS cloud services for...
...design, development, and use of release automation tooling, DevOps, CI/CD, etc.
~2+ years of experience in software development in Java/Scala/Golang or similar
~3+ years of experience on software delivery technologies like jenkins including experience writing and developing...
...for business stakeholders
~ Ability to work independently, multitask, and drive your own projects
~ Proficiency in Python/PySpark, Scala or Java
~ Proficiency in SQL
~ Experience with Databricks/Spark, AWS ecosystem, Hadoop, Pig, Hive, Flink, or Beam.
~ Experience...
...data, database and enterprise data architecture and delivery
• 8+ years of programming proficiency in a subset of Python, Java, and Scala
• 5+ years of hands-on experience building solutions on distributed processing frameworks such as Spark, Hadoop or Databricks
• 5+...
Rs 12 - 16 lakhs p.a.
...preferred with hands-on experience in two or more of these skills : Azure Synapse Analytics, Azure HDInsight, Azure Databricks with PySpark / Scala / SparkSQL, Azure Analysis Services B Experience in one or more Real-time/Streaming technologies including: Azure Stream Analytics,...