Average salary: Rs1,388,998 /yearly
More statsJob Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data... ...of data from a wide variety of data sources using SQL and AWS big data technologies.- Build analytics tools that utilize the data pipeline...
Job Description :- 10+ years of design & development experience with big data technologies like Azure, AWS or GCP- Preferred is Azure & Databricks, with experience in Azure DevOps- Experience in data visualizing technology in DL, like PowerBI- Proficient in Python, PySpark and...
...active with strong analytical skills, raising clarifications, risks and solution driven- Prior work experience in handling SQL / ETL or Big Data Testing- Proven track record in leading team, Test deliveries for ST, SIT and UAT- Experience in JIRA, Zephyr, Traceability, Test...
...company, home to more than 224,000 people across 60 countries.Role : Data EngineerExp : 5+ years Mode of Work : HybridMode of Hire :... ...languages: Scala, Java, Clojure, and/or Go.- 5+ years experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash...
...Developers proficient in designing, implementing, and maintaining scalable data processing solutions using Apache Spark and Scala.... ...and collaboratively in a fast-paced environment, with a passion for learning and adopting new technologies in big data and analytics....
About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance... ...Spark Core, Spark SQL, and Spark Streaming- Experience with big data technologies such as Hadoop, Hive, and Kafka- Proficiency in...
...We are seeking a seasoned Data Engineer with 4-8 years of experience, proficient in Big Data technologies and PL/SQL development.
The ideal candidate will have a strong background in Hadoop ecosystem, including HDFS, MapReduce, and Hive, along with hands-on experience...
...Responsibilities
Design and architect Big Data solutions to meet business requirements.
Collaborate with stakeholders to understand their data and analytics needs.
Create and maintain data models, data flow diagrams, and data integration strategies.
Develop...
...formation, EMR, AWS S3, AWS.- Experience designing and implementing data pipelines in a onprem/cloud environment is required.- Experience... ...streams using Spark and Experience in Spark.- AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data (ref:hirist.tech)
We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : Bangalore/chennai/puneRoels & Responsibilities... ...Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like Oracle,...
...both functional and technical testing of ETL jobs, utilizing automation tools whenever possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is essential for testing data transformation and querying...
...Responsibilities
Design, develop, and deploy scalable Big Data applications using Apache Spark.
Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.
Write efficient and optimized code...
Job Description:
Meeting with managers to determine the company’s Big Data needs.
Developing Hadoop systems.
Loading disparate data sets and conducting pre-processing services using Hive or Pig.
Finalizing the scope of the system and delivering Big Data solutions.
Managing...
...with test management process
ISTQB or Agile Test Certified
Banking domain knowledge is a plus.
Some understanding of Big Data and warehousing technologies such as Hadoop, Kafka, Teradata
Understanding of continuous integration and deployment processes...
Rs 20 - 28 lakhs p.a.
...Key Responsibilities:
Design, architect, and engineer big data solutions
Develop a modern data analytics lake house
Propose and standardize ELT, BI, AI, governance, and analytics
Publish enterprise ingress, development, transform, egress, consumption guidelines...
...Experience: 5 - 8 years
Key Skills: Pyspark, Python, SQL, Hive, HBase, AWS, Big Data
Location: Chennai
Notice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice period
What are...
Job Description :- Strong hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure... ...in Data factory, Databricks, Functions etc., - 4+ years of technical experience on MS Azure and Big data technologies. (ref:hirist.tech)
...Description
Are you passionate about working with Amazon-scale data, analytics, and data science?
Do you love bringing data together... ..., complex datasets
- Experience in Unix
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience...
...Role : Data Engineer Years of experience : 4-10.
Job Location: Chennai
Job Description :
Position Overview: We are seeking... .... The ideal candidate will have extensive experience with Big Query, Google Cloud Storage (GCS), Data Ingestion, Data Flow, and...
...Experience
*Bachelors degree in computer science
* 6-8 years of data engineering experience
* Writing SQL and schema buildout,... ...snowflake schemas
* Experience with ETL tool, such as SSIS
* Big data technologies like: Spark, Kafka, Hadoop
* Strong CI/CD (Continuous...
...transformation of our Group
As part of the IT Department of BNL, the IT Data Platform is responsible for defining and implementing the... ...Analytics and Reporting technologies (example: Microsoft PowerBI), up to Big Data technologies (Spark, Kafka etc) and Machine Learning/...
...Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark.
Please connect on LinkedIn for a swift profile process.
Role: Data Engineer.
Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark,
Experience: 7+ Yrs Only
Notice...
...A minimum of 10 years of experience in data architecture and analytics.
Databricks: Proficiency in Databricks for data processing machine... ...Airflow for orchestrating and
scheduling ETL workflows.
Big Data Technologies: Familiarity with big data technologies like Spark...
...Lead Data Engineer
Chennai, Tamil Nadu
Work Type: Full Time
Responsibilities:
Designing and implementing data pipelines to collect... ...processes and ways of working is documented.
Collaborate with Big Data Solution Architects to design, prototype, implement, and...
...Data Engineer (Google Cloud Platform) Exp: 5 - 9 Years
Location: Chennai / Bengaluru
Notice Period: Immediate - 30 Days
Requirements... ...data pipelines (e.g. Airflow, Control-M, Autosys)
Experience in big data technologies (Hadoop, Google BigQuery or similar)...
...Key Responsibilities:
# Lead data engineering initiatives, providing technical guidance, and mentorship to the data engineering team.... ...performance.
# Utilize extensive experience with GCP services like Big Query, Data Flow, Pub Sub, Data Stream etc for data storage,...
...of hands-on experience with Databricks- Highly proficient in SQL & Data model (conceptual and logical) concepts - Proficiency with Python... ...Knowledge of Distributed computing and cloud databases like Redshift, Big query etc. - 1+ years of Hands-on experience with one of the top...
...Summary
We’re looking for a dynamic Data engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell... ...architecture or equivalent.
• 5+ years of experience working with big data technologies on AWS/Azure/GCP
• 7+ years of experience in...
...We are innovators, driven by the needs of our customers and deep data insights. Our 5,000 team members based around the world understand... ...integration and deployment
~ Expertise in visualizing and manipulating big datasets
~ Ability to translate business needs to technical...
IDP Education Ltd
Chennai
2 days ago
...Company RNTBCI PL Job Description
~ Assemble large, complex data sets that meet functional / non-functional business requirements.... ...disconnected datasets.
Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
Advanced working...