Average salary: Rs72,500 /yearly
More stats ...Offering : Product & Services- Founding Year : 1991- No of Employees : 5001-10000Role : Spark DeveloperExperiences : 6+ yearsLocation : Bangalore , HyderabadPrimary Skills : spark, apache sparkKey Responsibilities :- Design, develop, and maintain Spark applications for data...
...including BigQuery, Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x- Good Problem-Solving Skills- Detail Oriented- Strong Analytical...
Are you passionate about building robust integration solutions using Apache Camel? We're seeking a talented Java Integration Engineer to join our dynamic team and drive innovation in our integration projects.Work Location : Hyderabad/Banglore Work Type (WFO/WFH) : Onsite/WFO...
...Must Have : - 8+ years of experience in software development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Apache Spark with Python- SQL- Good to have AWS and Airflow knowledge.- Good to have Snowflake knowledge.- Good aptitude, strong problem solving...
...IntelliJ IDEA, AutoSys, WinSCP, Putty & GitHub.- Designing, building, installing, configuring and supporting Hadoop.- Transform data using spark & scala- Translate complex functional and technical requirements into detailed design.- Perform analysis of vast data stores and...
Job roles and responsibilities :- 3+ years served as Data Engineer or DataOps role.- 3+ years of experience working with SQL and Spark.- 2+ years of experience with Microsoft Azure Data Lake, Azure Data Factory, Azure Synapse and SQL Database products or equivalent products...
...equivalent designing large data-heavy distributed systems and/or high-traffic web apps.- Must have 4+ experience using big data tools such as Spark / PySpark- Must have experience in Airflow pipeline orchestration.- At least 4 years of hands-on implementation experience working...
...Designing and implementing data pipelines using Azure Data Factory (ADF).- Developing and maintaining data processing scripts using Python, Spark, and Scala.- Building and optimizing data storage solutions using Azure Data Lake Storage (ADLS), Blob Storage, and Synapse.-...
...Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise...
Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.-...
...Consultant-Databricks/Spark Developer - ITO073879
With a startup spirit and 115,000+ curious and courageous minds, we have the expertise... ...data solutions, with a specific focus on Databricks and Apache Spark.
Responsibilities:
- Collaborate with data architects...
...We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for:
Experience- 5+ Yrs
Location- Hyderabad & Indore
Responsibilities:
Implementing the large scale Spark applications and finetune at runtime
Design and implement...
...good experience in programming languages like Java, Python or Scala.- Hands-on experience on the Big Data stack like Hadoop, Mapreduce, Spark, Hbase, and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing,...
...Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts, Java Spark and 3+ years applied experience
Hands-on practical experience in system design, application development, testing, and operational stability...
...designing, implementing, and maintaining data processing systems. You will work with large-scale data sets using technologies such as Apache Spark, Scala, Hadoop, Jenkins CI/CD, and Microservices. This is an excellent opportunity to contribute to the development of cutting-edge...
...Primary Skill – Scala Spark Total Exp – 5.2 Years to 13 Years
Notice Period – ONLY 0 to 60 Days Joiners
Job Location – Pune, Mumbai... ...• Spark + Scala Scala (with a focus on the programming )
• Apache Spark 2.x
• Spark query tuning and performance optimization
•...
...Production environment.Should have good working experience on : - Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet - Spark - Batch Processing - Setting ETL pipelines - Python or Java programming language is mandatory. - Worked in data Lake , Data...
...Drive in Hyderabad, Telangana on 4th May [Saturday], 2024 , and we believe your skills in Databricks, Data Factory, SQL, and Pyspark or Spark align perfectly with what we are seeking.
Experience Level: 3 years to 25 years
Details of the Walk-in Drive:
Date: 4th...
...release plan
2.
Quality & CSAT
On-Time Delivery, Manage software, Troubleshoot queries
Customer experience, completion of assigned certifications for skill upgradation
3.
MIS & Reporting
100% on time MIS & report generation
Apache Spark
...in Java, Scala, Python, or similar languages.
• Experience with NoSQL and SQL databases
• Experience in information retrieval and machine learning
• Experience/Knowledge in big data using Scala spark, ML, Kafka, Elasticsearch will be a plus.
Apache Spark & SQL...
...Level:
SQL: 10+ years
Azure Synapse: 2+ years
Data Warehousing: 5+ years
Pre-Sales / Proposal development: 2+ years
Apache Spark or DataBricks: 2+ years
Overall Experience with database design and development: 15 years
Certifications Preferred : Azure...
...AWS, Python, Spark, Data Bricks Developer with 3 to 5 years of experience:
Must-Have:
* Advanced proficiency in Python for data processing and analytics.
* In-depth experience with Apache Spark and Databricks for big data processing.
* Extensive knowledge of AWS services...
...years of experience in Data Engineering and Databricks
~ Proficiency in Python, SQL, and data analysis tools
~ Strong knowledge of Apache Spark and ETL processes
~ Experience in Machine Learning and working with large datasets
Roles and Responsibilities
Develop...
...scalability, performance, and cost-effectiveness.
Develop and maintain data processing pipelines using AWS services like AWS Lambda, Apache Spark, and Python.
Design and implement data security measures, including encryption, access controls, and compliance with data...
...Science Studio) environment would be a plus
~ Strong experience on Spark with Scala/Python/Java
~ Strong proficiency in building/... ...libraries (pandas, numpy, scikit-learn, etc.)
Experience with Apache Hadoop / Spark (or equivalent cloud-computing/map-reduce framework...
Rs 12 - 35 lakhs p.a.
...to develop chatbots and datasets from Public data.
Build cutting-edge cloud-native infrastructure - real-time streaming engines (Apache Spark or similar), Scraping engines, Databases (BigQuery, Postgres or similar), and Analytics engines on top of Google Cloud Platform...
...Databricks.
Knowledgeable in AI/ML principles, models, tools, and deployment strategies.
Advanced expertise in Apache technologies like Kafka, Airflow, and Spark for creating effective data pipelines.
Capable of designing and implementing data solutions for AI, ML, and...
...~ Containerization and cloud exposure is an added advantage.
~ Exposure to Big Data tech like Hadoop / HDFS / Map Reduce / Apache Spark / Flink / Storm /Druid etc. is added advantage.
~ Hands-on exposure to Application/Data security concepts is a must.
~ Familiar...
...Mongo.
~ Containerization and cloud exposure is an added advantage.
~ Exposure to Big Data tech like Hadoop / HDFS / Map Reduce / Apache Spark / Flink / Storm /Druid etc. is added advantage.
~ Hands-on exposure to Application/Data security concepts is a must.
~ Familiar...
...preferably Postgres, Oracle, MySQL) and No-SQL (Cassandra, DynamoDB, HBase) databases
Design and develop analytics applications using Apache Spark with Scala or Java on Hadoop or similar Ecosystems
Basic Qualifications
~ Bachelor’s degree in Computer Science, IT or an...