Average salary: Rs1,450,000 /yearly
More stats ...client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with...
Job Summary:We are seeking an experienced Data Engineer with strong skills in Databricks, Python/PySpark, and Spark Streaming.Key Responsibilities:- Build and maintain data pipelines using Databricks and PySpark.- Implement and manage real-time data processing with Spark Streaming...
...DESCRIPTION :- 6+ years of overall technology experience that includes at least 5+ years of hands-on data engineering utilizing the power of Python and the Apache Spark framework to design, build, and maintain data pipelines and perform large-scale data processing tasks.- Writing...
Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor...
...building efficient data pipelines using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory, Informatica,... ...standards within Databricks notebooks and scripts.- Lead Data Engineering Projects to manage and implement data-driven communication...
...years of overall Data Analytics and BI experience- Experience in Spark, Hive, Scala.- Build data pipelines for ETL that fetch data from... ..., Looker- Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow- Good Communication skills...
Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and...
...and cloud.- Demonstrate expertise in PySpark, SQL, Python/Scala, Spark, Hadoop, Hive HDFS for efficient data processing and analysis.-... ...stakeholders.Requirements :- Bachelor's degree in Computer Science/Engineering or MCA- Minimum of 6 years of experience in data engineering...
Notice Period : Max 30 daysWe are searching for a talented Software Engineer to join our growing team. In this role, you will be responsible... ...large-scale data processing applications using Scala and Spark. You will work closely with data scientists and engineers to develop...
Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience... .../Sub.- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)- Experience Developing DAGs in Apache Airflow 1.10.x...
...maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to... ...stakeholders.Requirements : - Bachelor's degree in Computer Science, Engineering, or a related field.- 3+ years of experience working with Apache...
...Strong skills building positive relationships across Product and Engineering.- Able to influence and communicate effectively, both verbally... ...Experience working with distributed technology tools, including Spark, Presto, Scala, Python, Databricks, Airflow- Developed the Pysprk...
Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail-...
...EMR / Hadoop/ Databricks )- Big data processing experience using Spark Spark-SQL/ PY-Spark/ Azure Data Factory/ AWS Glue etc.- Working Experience... ...Data Science.Key Responsibilities :- Independently work as Data Engineer on Big data Projects- Gather and process raw data at scale.-...
...EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for...
Job Description :4 to 6 years of Relevant experience in Data Engineering and delivery.3 to 4 years of relevant work experience in large-scale... ...Glue is mandatory.Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.Good aptitude, strong...
...Job Title: SPARK L3 Support Engineer Location: Bangalore or Hyderabad
Workspace Type: Hybrid (preferably office – at least 3 days a week)
Experience Required: 3-5 Years
Daily Schedule and OT Estimate: 9 Hours (Candidate should be flexible as it can be NA, EMEA...
Designation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python... ...with Pure/Alloy.4. Working knowledge of open-source tools such as AWS Lambda, Prometheus, Spark, Hadoop, or Snowflake. (ref:hirist.tech)
Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would...
We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in... ...Tech GraduateMust-Have Technical Skills : including 3+ years Spark or Scala,- 2+ years of Hadoop/Big Data using tools like Hive, Spark...
Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Bangalore/Hyderabad/PuneWork Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and...
Responsibilities: - Work closely with MLEs, MLOps, Data Engineers, and Data Scientists to build and extend our DS/ML platform and use cases... ...to support productionizing their use case. - Use Python, Spark, AWS, Snowflake. - Perform code review and end-to-end testing. -...
...evaluating data?- If so, this is the job for you. As a Senior Data Engineer you will be responsible for implementing robust data management... ...platforms.- Distributed compute technologies such as Databricks & Spark plus knowledge of underlying programmatic frameworks.- Modern...
...quality dashboards using industry best practices- Manage team of data engineers (both full-time associates and/or third party resources)- Own... ...:Desired skills for lead data engineer include :- Python- Spark- Java- Hive- SQL- Hadoop architecture- Large scale search applications...
...specific configuration and deployment along with ability to build custom solutions- Have experience in building Data Pipelines using Scala, Spark, Hadoop, HiveQL etc.- Have experience with streaming frameworks such as Kafka.- Have experience with Data Warehousing, Data Modelling...
Role : Senior Data Engineer. Experience : 4-6 years. To be onboarded by : Immediate. Location : Bangalore. Type : Onsite/Full-Time. Responsibilities... ...tools for- developing Batch and Streaming- pipelines using. SQL, Spark, Python, PySpark (4+ years), Airflow (3+ years), Scala (2+ years)...
...Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support- Collaborate with data... ....- Strong experience with big data technologies such as Hadoop, Spark, and Hive- Proficiency in either Scala or Java programming...
...develop real-time data ingestion pipelines using Databricks and Spark Streaming to enable timely processing of large volumes of data.-... ...technologies.- Stay updated with the latest advancements in data engineering, streaming technologies, and best practices to drive continuous...
...Have : - 8+ years of experience in software development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Apache Spark with Python- SQL- Good to have AWS and Airflow knowledge.- Good to have Snowflake knowledge.- Good aptitude, strong problem solving abilities...
...SQL.- Deep knowledge and experience working with Python/Scala and Spark- Experienced in Azure data factory, Azure Data bricks, Azure... ...implementation, responsible for technical delivery and mentoring peer engineers.- Knowledge of Azure DevOps and version control systems, ideally...