Average salary: Rs1,450,000 /yearly
More statsSearch Results: 38,511 vacancies
Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data pipelines using Databricks and PySpark.- Implement and manage real-time data processing with Spark Streaming...
...client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with...
...DESCRIPTION :- 6+ years of overall technology experience that includes at least 5+ years of hands-on data engineering utilizing the power of Python and the Apache Spark framework to design, build, and maintain data pipelines and perform large-scale data processing tasks.- Writing...
Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor...
...building efficient data pipelines using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory, Informatica,... ...standards within Databricks notebooks and scripts.- Lead Data Engineering Projects to manage and implement data-driven communication...
...years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from... ..., Looker- Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow- Good Communication skills...
Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and...
Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience... .../Sub.- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)- Experience Developing DAGs in Apache Airflow 1.10.x...
...Strong skills building positive relationships across Product and Engineering.- Able to influence and communicate effectively, both verbally... ...Experience working with distributed technology tools, including Spark, Presto, Scala, Python, Databricks, Airflow- Developed the Pysprk...
Notice Period : Max 30 daysWe are searching for a talented Software Engineer to join our growing team. In this role, you will be responsible... ...large-scale data processing applications using Scala and Spark. You will work closely with data scientists and engineers to develop...
...and cloud.- Demonstrate expertise in PySpark, SQL, Python/Scala, Spark, Hadoop, Hive HDFS for efficient data processing and analysis.-... ...stakeholders.Requirements :- Bachelor's degree in Computer Science/Engineering or MCA- Minimum of 6 years of experience in data engineering...
...maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to... ...stakeholders.Requirements : - Bachelor's degree in Computer Science, Engineering, or a related field.- 3+ years of experience working with Apache...
...Job Title: SPARK L3 Support Engineer Location: Bangalore or Hyderabad
Workspace Type: Hybrid (preferably office – at least 3 days a week)
Experience Required: 3-5 Years
Daily Schedule and OT Estimate: 9 Hours (Candidate should be flexible as it can be NA, EMEA...
Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail-...
Responsibilities: - Work closely with MLEs, MLOps, Data Engineers, and Data Scientists to build and extend our DS/ML platform and use cases... ...to support productionizing their use case. - Use Python, Spark, AWS, Snowflake. - Perform code review and end-to-end testing. -...
...EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for...
Designation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python... ...with Pure/Alloy.4. Working knowledge of open-source tools such as AWS Lambda, Prometheus, Spark, Hadoop, or Snowflake. (ref:hirist.tech)
...EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-SQL/ PY-Spark/ Azure Data Factory/ AWS Glue etc.- Working Experience... ...Data Science.Key Responsibilities :- Independently work as Data Engineer on Big data Projects- Gather and process raw data at scale.-...
Job Description :4 to 6 years of Relevant experience in Data Engineering and delivery.3 to 4 years of relevant work experience in large-scale... ...Glue is mandatory.Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.Good aptitude, strong...
...quality dashboards using industry best practices- Manage team of data engineers (both full-time associates and/or third party resources)- Own... ...:Desired skills for lead data engineer include :- Python- Spark- Java- Hive- SQL- Hadoop architecture- Large scale search applications...
