Bigdata Developer
Unison Group
- Big data production support Role :-
- Client - IBM/DBS
- Mode of work - 24/7 Rotational shift (WFO)
- Experience - 4-6 years
- Location - Hyderabad
- N.P - Immediate - 15days
- Required skills:- Spark, Scala, Hive, Hadoop, SQL, Unix
- Mode of interview F2F
- Spark,
- Scala,
- Hive,
- Hadoop,
- SQL,
- Unix
Requirements
Job Summary
We are looking for a Big Data Support Engineer with hands-on experience in Hadoop ecosystem technologies to provide production support, monitoring, troubleshooting, and performance optimization of Big Data platforms. The candidate should possess strong analytical and problem-solving skills and be comfortable working in a support environment.
Key Responsibilities
- Provide L2/L3 support for Big Data applications and Hadoop clusters.
- Monitor platform health, analyze logs, and proactively identify issues.
- Troubleshoot production incidents and perform root cause analysis (RCA).
- Support Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Kafka, Oozie, and Sqoop.
- Manage job failures, performance bottlenecks, and data pipeline issues.
- Work closely with development and infrastructure teams during deployments and releases.
- Perform cluster maintenance, upgrades, patching, and capacity planning.
- Create and maintain operational documentation, runbooks, and SOPs.
- Participate in on-call support and incident management activities.
- Ensure SLA compliance and timely resolution of support tickets.
Required Skills
- Strong experience with Hadoop ecosystem (HDFS, Hive, Spark, YARN).
- Good knowledge of Kafka, Sqoop, Oozie, Flume, or NiFi.
- Hands-on experience with Linux/Unix administration.
- Strong SQL and data analysis skills.
- Shell scripting (Bash) and/or Python scripting.
- Experience with log analysis and monitoring tools.
- Knowledge of Cloudera CDP/CDH or Hortonworks platforms.
- Understanding of incident, problem, and change management processes.
- Excellent troubleshooting and communication skills.
Good to Have
- Experience with Kubernetes/OpenShift.
- Knowledge of Airflow, Data Engineering concepts, and ETL pipelines.
- Exposure to cloud platforms (AWS, Azure, GCP).
- Banking or Financial Services domain experience.
- Git and CI/CD knowledge.
Mandatory Skills
Hadoop, HDFS, Hive, Spark, Kafka, Linux, SQL, Shell Scripting, Python, Production Support, RCA, Cloudera/CDP, Incident Management .
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Bigdata Developer in Hyderabad vacancy
- .... ~ Strong proficiency in SQL, data structures, at least one statistical programming language (R or Python), familiar with Spark bigdata analytics environments, GenAI tools, for data wrangling, analysis, and reproducible research workflows. ~ Strong hands-on problem-solving...Big DataFor contractorsFlexible hours
- ...deploying AI workloads in enterprise environmentsResponsibilities :- Design, build, and enhance AI and Generative AI solutions using Python- Develop and manage agentic workflows for complex task execution- Create effective prompts, system instructions, and agent interaction...Big Data
- Description : MOURI Tech is seeking an innovative AI professional to elevate our enterprise Data Governance program.We are looking for someone who can blend advanced AI/ML expertise with a deep understanding of data governance to drive automation, efficiency, and value across...Big Data
- Design and implement scalable data architectures using databricks lakehouse, ensuring alignment with enterprise data strategy and business objectives Act as the resident databricks subject matter expert, driving best practices across delta lake, spark optimization, and workload...Big DataFull time
- Job Description :We are seeking a GCP Cloud Infra Engineer with expertise in designing and managing cloud infrastructure on Google Cloud Platform (GCP). The ideal candidate will have strong experience with Python programming, as well as proficiency in utilizing GCP services ...Big Data
- Job Role : IBM DataStage DeveloperClient Location : HyderabadShift : 1:30 PM - 10:30 PM ISTJoining : Earlier the bestEmployment : Full-timeExperience : 6+ YearsRequired Skills :- Strong expertise in T-SQL / SQL Server (querying, performance tuning, stored procedures)- Hands-...Big DataFull time
- ...analyze project requirements and deliver high-quality software solutions Leverage expertise in Apache Spark, Python, Azure, and AWS to develop scalable and optimized data systems Improve the performance, security, and scalability of data applications Monitor industry...Big Data
- ...and 1 Managerial round. All rounds are only Face to Face.Note : No virtual interview.Job Description :Key Skills Required : Python Developer, FastAPI/Flask, SQL/Postgre, and PySpark (Good to have).- Strong experience in Python programming- Hands-on experience with Django (...Big DataWork at officeWork from home
- ...GenAI and Agentic AI applications. · Produce reusable, efficient, and scalable programs, and also cost-effective strategies. · Develop AI pipelines and integrate with the data in Databricks and leverage different AWS services, including S3, EC2, API Gateway, Bedrock...Big DataFull time
- LiveRamp is the data collaboration platform of choice for the worlds most innovative companies.A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity...Big Data
- Key Responsibilities:- Design, build, and maintain scalable data pipelines and ETL/ELT workflows on AWS.- Develop and optimize cloud-based data architectures to support analytics and business intelligence.- Integrate data from multiple sources, ensuring data quality, consistency...Big Data
- ...Cloud services and Big Data technologies, ensuring efficient data processing, storage, and analytics.Key Responsibilities : - Design, develop, and maintain scalable data pipelines on Google Cloud Platform.- Work extensively with GCS, Dataproc, BigQuery, and Composer (Airflow...Big Data
- ...candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure and AWS. Develop and execute end-to-end Data solutions for intricate business needs Work alongside cross-functional teams to comprehend project...Big Data
- Skill : GCP Data EngineerExperience : 7 - 10 yearsLocation : Gurgaon / Noida / HyderabadMode : HybridJob Description : Data Pipeline Development : - Design and build robust ETL/ELT pipelines for batch and stream processing using GCP tools.Data Warehousing & Modeling : - Build...Big Data
- Description : We are looking for a skilled Databricks Developer to design, develop, and optimize big data solutions using Apache Spark and Databricks on cloud platforms like Azure. The ideal candidate will have strong experience in data engineering, ETL pipelines, and performance...Big Data
- ...Streaming ingestion methods.- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.- Experience in developing NO SQL solutions using Azure Cosmos DB is essential.- Thorough understanding of Azure and AWS Cloud Infrastructure offerings.-...Big DataImmediate start
- Description : Exp : 6-8.5 YrsSkill : AI ML/Gen AI EngineerLocation - Hyderabad / Bangalore / GurgaonKey Skills - GitHub Copilot and Gemini; AI/ML and Generative AI (GenAI); LLMs and GenAI agents/assistants (e.g., LangChain); cloud integration; and Python/R workflowsKey Qualifications...Big Data
- We are an Artificial Intelligence (AI) focused product engineering company , providing our customers in healthcare, retail & e-commerce, manufacturing, and hospitality sectors with cutting-edge products & solutions, harnessing Big Data Analytics, Vision Analytics, and...Big DataHybrid work
- Job Title : Senior Databricks Engineer.Experience Required : 8+ Years.Role Summary : We are seeking an experienced Senior Databricks Developer with 8+ years of experience in Data Engineering, Big Data, and Cloud Analytics solutions, including extensive hands-on expertise in...Big Data
- ...powers our clients' analytical capabilities. You will work closely with cross-functional teams, including data scientists, software developers, and business stakeholders, to transform raw data into reliable, high-quality assets. This role is pivotal in ensuring that our data...Big Data
- ...on experience with CI/CD systems, repository management, and automation . You will work closely with engineering teams to improve developer productivity while maintaining platform reliability and governance. You will also support adoption of GitHub Copilot and modern...Big Data
- ...- Coordinate across teams to identify, resolve, mitigate and prevent technical issues- Coach and mentor engineers within the team to develop their skills and abilities- Continuously improve the team's practices in code quality, reliability, performance, testing, automation,...Big Data
- ...technical, business, and customer experience goals. To thrive in this role, you must have the ability and willingness to mentor and develop junior software engineers, and act as a thought leader and trusted subject-matter expert in a variety of technical domains. Here’s...Big Data
- Job Overview : Job Title : Data Engineer Java & SparkRole Summary : Were looking for a Java Developer with 5+ years of experience and strong hands-on skills in Core Java and Spring Boot. You should be confident working with multithreading and have strong knowledge of data structures...Big DataFull timeInterim roleWork at officeImmediate start
- ...knowledge exchange. Plus, we offer: Support, coaching and feedback from some of the most engaging colleagues around Opportunities to develop new skills and progress your career The freedom and flexibility to handle your role in a way that’s right for you EY |...Big Data
- ..., and hyper-connected world. Role Overview In this role as a Senior Manager Engineering, you will help in building and developing teams, you will also support a rapidly growing business and ensure we are building highly available, reliable and extendable products...Big DataHybrid workWork at officeWork from home2 days week
- ...Location: Hyderabad Work Timing: 11 am – 8 pm Job Overview: We are seeking a skilled and motivated AI Engineer to design, develop, and deploy AI-driven applications. The role involves full-stack development, integrating AI/ML models, and building scalable, high-...Big Data
- ...insights through an integrated set of futuristic digital technologies.Digital Transformation Services Specialized in Design, Build, Develop, Integrate, and Manage cloud solutions and modernize Data centers, build a Cloud-native application and migrate existing applications...Big DataFull timeHybrid work
- ...engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. You will work closely with our clients to develop and implement data solutions that meet their business needs. This is a hybrid role, meaning that you will primarily work from our...Big DataFull timeHybrid workRemote jobWork from home
- Role Overview : As a PySpark Developer, you will be at the forefront of building scalable data pipelines that transform raw information into actionable business intelligence. You will work closely with cross-functional teams, including data scientists, product managers, and...Big DataHybrid work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Bigdata Developer. Be the first to apply!
