Average salary: Rs1,320,689 /yearly
More statsGet new jobs by email
- ...guidance to clients on the current data and analytics landscape. Optimize and manage large-scale data pipelines, particularly using Apache Spark. Collaborate with client ML engineers to define and implement MLOps and LLMOps processes. Assist in productionizing...SuggestedRemote jobItanagar3 days ago
- ...Data Engineer :- Design, build, and optimize robust and scalable data pipelines for both batch and real-time data ingestion using Apache Spark (Streaming + Batch), Apache Nifi, and Apache Kafka.Data Storage and Management :- Manage and maintain data storage solutions on Hadoop...Suggested
- ...solutions. Develop high-performance and low-latency components to run Spark clusters. Interpret functional requirements into design... ...Big Data Technologies: Experience with HDFS, Hive, HBase, Apache Spark, and Kafka. Familiarity with building self-service platform...SuggestedPune27 days ago
- ...across data engineering, advanced analytics, and machine learning workloads.The ideal candidate will have extensive experience with Apache Spark, Delta Lake, PySpark/Scala, and cloud platforms (Azure, AWS, or GCP), along with a proven ability to define best practices for...Suggested
- ...deadlines.Professional & Technical Skills : Must To Have Skills : - Proficiency in Python (Programming Language), AWS Architecture, Apache Spark, PySpark.- Experience with cloud computing platforms and services.- Strong understanding of application development methodologies.-...SuggestedFull timeImmediate start
- ...8+ years of hands-on experience in data engineering, with at least 4 years in a lead or architect-level role. - Deep expertise in Apache Spark, with proven experience developing large-scale distributed data processing pipelines. - Strong experience with Databricks platform...Suggested
- Description :Key Responsibilities :- Design, develop, and deploy end-to-end data engineering solutions using Databricks, Apache Spark, PySpark, Python, and SQL.- Build scalable and efficient ETL/ELT pipelines for data ingestion, transformation, and integration from various sources...Suggested
- ...align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Staff Apache Spark Engineer at BairesDev We are seeking a Staff Apache Spark Engineer to work on distributed data processing systems and real-time...SuggestedLocal areaWorldwideBangalore2 days ago
- ...:- Design, develop, and manage data pipelines using Databricks (Spark, Delta Lake).- Optimize large-scale data processing workflows for... ...engineering or similar roles.- Strong experience with Databricks, Apache Spark, and Delta Lake.- Proficient in SQL, Python, and distributed...Suggested
- ...your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Scala (Apache Spark) Developer at BairesDev We are seeking a Senior Scala (Apache Spark) Developer to lead complex Spark implementations and...SuggestedRemote jobLocal areaWorldwideBangalore2 days ago
- ...ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack.The role involves working on scalable... ...:- Build and manage high-volume data pipelines using Spark/Databricks.- Implement ELT frameworks using Azure Data Factory/Synapse...SuggestedLong term contractFull timeTemporary workLocal areaWorldwideKochi3 days ago
- ...passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Scala (Apache Spark) Engineer at BairesDev We are seeking a Principal Scala (Apache Spark) Engineer to define the technical vision and architecture...SuggestedLocal areaWorldwideBangalore2 days ago
- ...Roles and Responsibilities: Skillset : Apache Spark Designer Education - BE, MCA, MSc or equivalent( valid degree) ~8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent) ~ BFSI domain experience...SuggestedMumbaia month ago
- ...for learning.Build products in the data analytics space.Roles and Responsibilities :- Develop and manage robust ETL pipelines using Apache Spark (Scala).- Understand Spark concepts, performance optimization techniques, and governance tools.- Develop a highly scalable,...Suggested
- ...real-time/batch data processing applications using Scala, Java, and Apache Flink. Build and optimize distributed data pipelines on AWS... ...optimization. Preferred Skills: Exposure to Splunk, Apache Spark, Kafka, Docker, Kubernetes (k8s). Familiarity with GitLab CI/...SuggestedSecunderabad27 days ago
- ...Data experience- 3-4 years' 3 years of hands-on experience supporting Java-based applications Experience working with Apache Flink, Apache Spark , or other distributed data processing frameworks Understanding of production concerns like data consistency, latency, availability...Bangalore4 days ago
- ...exceptional career development and success. Senior Python Developer (Apache Ecosystem) at BairesDev We are seeking a Senior Python... ...popular open source Apache projects with Python integration - Spark, Kafka, and related ecosystem tools. Thus, there is ample scope for...Remote jobLocal areaWorldwideBangalore1 day ago
- ...path to exceptional career development and success. Senior Apache Impala Developer at BairesDev We are seeking a Senior Apache... .... - Core contributions to Apache open source projects (Impala, Spark, Hive, or similar). - Advanced level of English. How we make...Remote jobLocal areaWorldwideBangalore2 days ago
- ...years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.- Strong knowledge of AWS services,... ....- Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.- Familiarity with other data...
- ...experience with complex data workflows.- Strong hands-on expertise in Apache NiFi (must-have).- Advanced experience with PostgreSQL (query... ..., Airflow, etc.- Familiarity with big data ecosystems (Hadoop, Spark, Kafka) is a plus.- Strong knowledge of data modeling, warehousing...
- ...you on a path to exceptional career development and success. Apache Hadoop Developer at BairesDev We are seeking an Apache... ...Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar). - Advanced level of English. How we make your...Remote jobLocal areaWorldwideBangalore1 day ago
- ...for a Senior Software Engineer with strong hands-on experience in Apache Kafka and Apache Flink. The ideal candidate will have a solid... ...Good to Have : - Knowledge of other streaming platforms like Apache Spark Streaming or NiFi.- Experience with monitoring tools like Prometheus...Hybrid workImmediate startRemote job
- Job Description :Key Responsibilities :- Design, develop, and maintain large-scale, real-time data pipelines using Apache Flink, Apache Kafka, and Apache Spark.- Implement robust, fault-tolerant, and scalable distributed systems to handle high-volume streaming and batch data...Remote job
- ...exceptional career development and success. Senior Java Developer (Apache Ecosystem) at BairesDev We are seeking a Senior Java... ...stack includes popular open source Apache projects - Iceberg, Kafka, Spark, Hive, Ozone, Hadoop, Trino, and related ecosystem tools. Thus,...Local areaWorldwideBangalore1 day ago
- ...you on a path to exceptional career development and success. Apache Iceberg Developer at BairesDev We are seeking an Apache... ...'ll contribute to Apache Iceberg and related ecosystem projects (Spark, Flink, Hive), focusing on schema evolution, partitioning, and scalable...Remote jobLocal areaWorldwideBangalore1 day ago
- ...automate processes for scalability- Collaborate with cross-functional teams (Product, Data, Design, ML)- Work with modern tools : Apache Spark, Databricks, SQL, Python/Scala/JavaExperience in Scala is mandatoryWhat were looking for :- Strong expertise in Big Data, Spark & distributed...Permanent employmentFull timeRemote jobShift work
- ...Role :We are looking for a Data Engineer with strong experience in Spark (PySpark), SQL, and data pipeline architecture.You will play a... ...this mentioned skills would be great).- Familiarity with orchestration frameworks such as Apache Airflow or Apache NiFi. (ref:hirist.tech)
- ...Scrapping.- Understanding of databases like No Sql , relational database, In Memory database and technologies like MongoDB, Redis, Apache Spark would be add on..- Knowledge of distributed computing frameworks and big data technologies (e.g., Hadoop, Spark) is a plus.- Excellent...
- ...~ Knowledge in how to develop data-intensive applications using Spark. ~ Knowledge in writing SQL queries to wrangle data from relational... ...Terraform, Data Lake & Lake Formation, Open Table formats like Apache Iceberg. ~ Experience in EMR ~ Experience with CI/CD such as...Full timeFlexible hours
- ...Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, Microservices Good to have:-... ...performance. Collaborate on distributed data processing pipelines using Apache Spark (basic level) and integrate with batch/stream processing...Full timeWorldwide
