Search Results: 30,751 vacancies
...datasets and related technologies.- Work closely with the Architecture group in delivering technical solutions.- Experience with designing and... ...web apps.- Must have 4+ experience using big data tools such as Spark / PySpark- Must have experience in Airflow pipeline orchestration...
Exp : 4-9 YrsLocation : Mumbai & BangaloreNotice : Immediate-Max 30 daysRole Profile :- Minimum 4 yrs exp out of which Proven experience working with Scala programming language and its ecosystem 3+ years- Strong understanding of functional programming concepts and design patterns...
...Job Description
Mission As a Spark Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support...
...Design, develop, and maintain data processing pipelines using Apache Spark and Scala.
Optimize Spark jobs for performance, scalability, and reliability.
Work closely with data engineers and data scientists to implement data-driven solutions.
Develop and maintain...
...client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with...
...Must have Skills: Apache Spark
Good to Have Skills: Data Warehouse ETL Testing
Key Responsibilities:
A: The resource will write and review complex SQL statements
B: The resource will work on ETL preferably on OWB
C: The resource will work on database related...
...Spark & Scala Developer Exp- 7-13 yrs
Shift- Malaysian
Full time Contract Opportunity
Fully Remote
please share resume at [HIDDEN TEXT]
Responsibilities-
Create Scala/Spark jobs for data transformation and aggregation
Produce unit tests for Spark...
...Location
Offer in hand if any:
Pan Card No:
Notice period/how soon you can join:
- Should have 4-8 years Experienced in Java, Spark SQL and worked in Unix/Linux Background.
- Should have Good Knowledge in Oracle Database SQL Queries and Views.
- Experienced to...
Job roles and responsibilities :- 3+ years served as Data Engineer or DataOps role.- 3+ years of experience working with SQL and Spark.- 2+ years of experience with Microsoft Azure Data Lake, Azure Data Factory, Azure Synapse and SQL Database products or equivalent products...
...understanding of SDLC and agile methodologies
Awareness of latest technologies and trends
Logical thinking and problem solving skills along with an ability to collaborate Technical and Professional Requirements:
Primary skills:Bigdata- Pyspark,Bigdata- Scala,Bigdata- Spark
...EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-...
...knowledge in data structures, algorithms and passion for solving hard problems
•Experience with Big Data technologies (Hadoop, Java, Spark, Kafka, Hive)
•Good knowledge of Unix/Linux and SQL
•Experience with data visualization and business intelligence tools like...
...IPO- Headquarter Location : Mumbai- Nature of Offering : Product & Services- Founding Year : 1991- No of Employees : 5001-10000Role : Spark DeveloperExperiences : 6+ yearsLocation : Bangalore , HyderabadPrimary Skills : spark, apache sparkKey Responsibilities :- Design, develop...
...Pub/Sub.- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)- Experience Developing DAGs in Apache Airflow 1.10.x or... ...: Sharing knowledge and experience with the other groups in the organization, and conducting various technical training sessions...
Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.-...
...learning, statistical analysis, and data visualization tools and technologies- Experience with big data processing frameworks, such as Spark or Hadoop- Strong analytical and problem-solving skills, with the ability to analyze complex data sets and identify trends and...
...Qualifications :- Bachelor's degree in Computer Science or related field.- 5+ years of experience in data engineering.- Proficiency in Python, Spark, and SQL.- Experience with BigQuery, Kafka, and cloud platforms.- Strong problem-solving and communication skills. (ref:hirist.tech)
Data EngineerMode : Work from HomeExperience : 6+yearShift Timing : 2PM to 10PMMust have : Python, Spark, React, AWSJob Description :- I would like to request a new resource for the data Engineering team who will be aligned with the human capital analytics team. I would like...
...modelling methods
Awareness of latest technologies and trends
Excellent problem solving, analytical and debugging skills Technical and Professional Requirements:
Primary skills:Technology- Big Data - Data Processing- Spark,Technology- Functional Programming- Scala
Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance...
