Search Results: 14,349 vacancies
Job Profile : Spark ( Pyspark ) DeveloperIndustry Type : IT Services Job description :- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources...
...Airflow, Redshift.- Strong experience with SQL and Scala skills using Spark framework.- Experience with enterprise Data warehousing... ...knowledge- Give timely, balanced, honest, and caring feedback to help develop othersPrimary Skill Set :- Hands on experience on AWS and Bigdata...
...in web development frameworks such as Play or Akka - Solid understanding of relational databases, SQL- Experience with designing and developing RESTful APIs and microservices- Familiarity with version control systems (e.g., Git) and collaborative development workflows- Strong...
...and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be...
Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and... ...ingest data from various sources into Kafka topics, and design and develop Spark streaming applications for real-time data processing,...
...you can join:
- Should have 4-8 years Experienced in Java, Spark SQL and worked in Unix/Linux Background.
- Should have Good Knowledge... ...shell scripting.
12. Need to contribute individually for developing the shell scripts.
13. Ability to understand the framework...
...Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.-... ...large-scale data processing systems using Spark and Scala.- Develop and optimize SQL queries to extract and analyze data from various...
Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADFJob Overview :- 7+ years of experience with detailed... ...Python code in Pyspark frame work using Dataframes. - Design and develop SQL Server stored procedures, functions, views and triggers to be...
...to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.The key accountabilities:- Design data solutions to meet business, technical and user...
...Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x- Good Problem-Solving Skills- Detail Oriented- Strong Analytical skills working...
...to easily access to data whenever they need too.- Experiencing developing scalable Big Data applications or solutions on distributed platforms... ...Experience working with distributed technology tools, including Spark, Presto, Scala, Python, Databricks, Airflow- Developed the...
Rs 12 - 16 lakhs p.a.
...Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Microsoft SQL Server,Unix to Linux Migration,Data Warehouse...
Rs 7 - 15 lakhs p.a.
...Role : Application Developer Role Description : Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good To Have Skills : Python Programming Language Job Requirements : Key Responsibilities: a Lead...
Rs 12 - 16 lakhs p.a.
...Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have Skills : Apache Spark Good to Have Skills : Hadoop, Job Requirements : Key Responsibilities : A: Create...
...environment alongside software engineers, and a solid foundation in developing solutions for marketing, and advertising organizations.... ...Data Science and/or Statistical analysis- Expertise in Python, Spark, SQL or other modern programming languages- Experience in using...
...team on behalf of our partner. This team is at the forefront of developing cutting-edge Big Data and Cloud-Based Business Operation Support... ...vast data sets using distributed processing tools such as Akka and Spark.- Evaluate and enhance existing data pipelines in collaboration...
...Description :Roles & Responsibilities :- Must have 4 years of Experience on Python.- Must have 4 years' relevant experience on Apache Spark OR pyspark. - Must have 4 years of experience in SQL [Must be proficient in writing Advanced complex queries]. - Must have 4 years' relevant...
...ob Description Responsibilities:
Configure, fine-tune, and optimize Spark and YARN administration for high performance
and resource efficiency.
Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for
efficient data storage and processing...
...Python, along with proficiency in AWS services and tools such as Spark (MLIB) and ML flow. The candidate should have a proven track record... ...that are secure, scalable, and robust.Responsibilities : - Develop and implement algorithms and machine learning models for production...
Rs 12 - 20 lakhs p.a.
...Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have Skills : Apache Spark Good to Have Skills : No Technology Specialization Job Requirements : Key Responsibilities : 1 Set-up and configure data bricks for an...
