Get new jobs by email
- Key Responsibilities- Design, develop, and optimize robust big data pipelines for data ingestion, processing, and transformation using tools like Hadoop, Spark, Scala, Hive etc.- Manage and maintain large-scale distributed data storage and processing systems.- Collaborate with...PythonBig Data
- Job Title: Senior Data Engineer/Developer.Number of Positions: 2.Job Description:- The Senior Data Engineer will be responsible... ...a Senior Data Engineer or similar role.- Experience with big data tools: Hadoop, Spark, Kafka, Ansible, chef, Terraform, Airflow, and Protobuf RPC...PythonBig DataSide job
- ...developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop Platform In depth knowledge of... ...of Protocol Buffers and Geospatial data analytics. Writing Test cases using... ...conflicts, working with branches. Good to have Python programming skills Good to have worked...PythonBig DataBangalore1 day ago
- ...We are Hiring Big Data Engineer/Data Engineer with SCALA & Spark Location: Nagpur NP: 60 days & Less Experience: 5-9 Years Skills: Preferred Skillset: Spark, Scala, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands...Big DataWeekend workNagpur1 day ago
- ...Spark Scala Developer Location : Bengaluru, Mumbai Employment Type : Full-time What Were Looking For Were hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write...Big DataFull timeMumbai8 days ago
- ...solutions that help transform product and businesses Must Haves Spark Scala Postgres(or any SQL DB)s Elasticsearch(or any No-SQL DB) Azure (if not, any other cloud experience) Big data processing Good To Have Golang Databricks Kubernetes Skills...Big DataFlexible hoursBangalore1 day ago
- ...Job Title: Data Engineer – Scala + Spark Location: Bangalore (Hybrid/On-site) Experience: 5 to 8 Years (Minimum 4 Years of Relevant Experience in Scala & Spark) Budget: Up to ₹25 LPA Notice Period: Immediate to 30 Days Max About the Role: We are looking...Big DataHybrid workImmediate startBangalorea month ago
- ...and we have the perfect software engineering opportunity for you. As a... ...troubleshooting Building pipelines in spark, tuning spark queries Writes... ...from large, diverse data sets to identify problems and contribute... ...Learning Frameworks and Big Data technologies such as Hadoop...PythonBig DataSecunderabad1 day ago
- ...Responsibilities: Design, develop, and deliver applications using Scala, Python, and Java. Build, optimize, and manage applications deployed... ...and DevOps practices for automation and efficiency. Exposure to microservices, big data processing, or API-driven development....PythonBig DataSecunderabada month ago
- Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support... ...(HDFS, MapReduce, YARN).- Strong expertise in Apache Spark for large-scale data processing and analytics.- Proficiency in...PythonBig DataBangalore12 days ago
- ...and Consulting, Digital Product Engineering, Digital Workplace Services,... ...:Seeking an experienced Senior Data Engineer to lead data ingestion... ...high-volume data pipelines using Spark/Databricks.- Implement ELT frameworks... ....Technical Stack :- Big Data : Apache Spark, Kafka, Hive...PythonBig DataLong term contractFull timeTemporary workLocal areaWorldwideKochi19 days ago
- ...About The Role We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong... ...Strong expertise in big data technologies such as Hadoop, Spark, Hive, HBase, Kafka, Flume. Proficiency in SQL and at least...PythonBig DataPune5 days ago
- ...Job Title : Engineering (Data Engineering) Location : Gurgaon Experience Required : 1+ Years Employment Type : Full-Time... ...and solutions. The role involves working with big data technologies like Spark, Kafka, and Python/Scala to support data management, analytics...PythonBig DataFull timeGurgaon12 days ago
- ...Join us for an exciting opportunity to advance your data engineering career and drive innovation in cloud automation. Job summary... ...Designs, develops, and maintains scalable data pipelines using Python and Big Data frameworks to support governance initiatives Architects...PythonBig DataSecunderabad2 days ago
- ...highly energetic, passionate, technology enthusiast for Data Engineering team. The successful candidate will work as a... ...Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark) Responsible for the implementation and test of scalable...PythonBig DataHybrid workWork at officeLocal areaBangalore1 day ago
- ...that help people, businesses and governments realize their greatest potential. Title And Summary Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL) Who is Mastercard Mastercard is a global technology company in the payments industry. Our mission is...PythonBig DataWorldwidePune2 days ago
- ...the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Big Data Engineer - Scala About Us 'Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of...PythonBig DataLocal areaPune1 day ago
- ...of new projects and features using Hadoop, Spark/Pyspark, Scala or Java, Hive, SQL, and other open-source tools and design patterns. Python knowledge is a bonus for this role.... ...or similar Must have technologies like Big Data, AWS services like EMR, S3, Lambdas,...PythonBig DataFull timeBangalore7 days ago
- ...an adaptive experience that provides data and ML driven opportunities to our... ...distributed team of Machine Learning engineers and ML Scientists to design and code... ...degree. ~ Must have experience in big data technologies, particularly Spark, Hive, and Databricks. ~ Proficiency...PythonBig DataFull timeLocal areaFlexible hoursGurgaon1 day ago
- ...opportunity for you to take your software engineering career to the next level. As a... ...the consumer and community banking- data technology, you serve as a seasoned member... ..., etc.) Experience with Java, Python & AWS also exposure to Spark and big Data technologies Preferred...PythonBig DataSecunderabad2 days ago
- ...GPTW winner.Position Overview : We are looking for an experienced and driven Data Engineer to join our team. The ideal candidate will have a strong foundation in big data technologies, particularly Spark, and a basic understanding of Scala to design and implement efficient data...PythonBig DataLong term contractIndia13 days ago
- ...Technical Trainer to deliver in-depth training programs aligned with our Data Engineering curriculum. The ideal candidate will have expertise in programming (Python, Java), cloud technologies (AWS), big data frameworks (Apache Spark), and software engineering principles. The...PythonBig DataBangalore18 days ago
- ...Summary Job Profile Summary We’re looking for dynamic data engineers with Databricks or Apache Spark and AWS experience to join the data analytics team at... ...or equivalent ~6+ years of experience working with big data technologies on AWS/Azure/GCP ~4+ years of experience...PythonBig DataLong term contractTemporary workWork at officeRemote jobAfternoon shiftBangalore3 days ago
- ...Responsibilities: Design and implement scalable, fault-tolerant data pipelines using Scala , Kafka , and other Big Data technologies. Build real-time data streaming... ...data processing frameworks such as Apache Spark , Flink , or Kafka Streams . Optimize data...PythonBig DataSecunderabad13 days ago
- Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good... ...domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration...Big Data
- ...:- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform... ...Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver...Big Data
- ...Job Description: Spark Expertise Expert proficiency in Spark... ...design and implement efficient data processing workflows... ...DataFrames Good exposure to Big Data architectures and good understanding... ...Good to have experience with Python APIs and exposure to Kafka...PythonBig DataPune3 days ago
- ...Job Description As a Software Engineer III - Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will be instrumental in designing and implementing the next generation of a cloud-native liquidity risk management platform for JPMC. The Liquidity...Big Data
- ...- Design, develop, and maintain scalable big data systems and pipelines.- Implement data processing... ...datasets using tools such as Hadoop, Spark, and Hive.- Develop and maintain ETL... ...with scripting/programming languages (Java, Scala, Python, or Shell).- Strong problem-solvingPreferred...PythonBig Data
- Description : Data Engineer Analytics & Platform DevelopmentRole Overview :We are seeking a skilled... ...-time data processing solutions using Spark, Kafka, or Hadoop.- Translate business requirements... ...data analysis and develop reports using Python and SQL.- Collaborate with data science...PythonBig Data
