Average salary: Rs859,999 /yearly
More statsGet new jobs by email
- ...platforms that improve learning outcomes. To support our growing Data & Analytics capability, we are hiring a Senior Data Engineer - Spark, Data Bricks & AWS who will play a critical role in strengthening McGraw Hill's data platform and enabling high-impact, data-driven decision...SuggestedRemote job
- ...design and maintain scalable data pipelines and analytics systems. The ideal candidate will have 2- 4 years of experience with Apache Spark,Scala/Python, Trino/Presto, Hadoop,kafka and data lake technologies such as Delta Lake. Experience with Elasticsearch, streaming data,...SuggestedHybrid work
- ...- 6+ years of Java/Scala and/or Python programming with good CS fundamentals- 6+ years of Big Data development experience with Hadoop/Spark and writing ETLs- 6+ years' experience of SQL, RDBMS and/or NoSQL database technologies- AWS experience preferred or any other public...Suggested
Rs 5 - 10 lakhs p.a.
...frameworks. Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs. Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations. Data Analysis...SuggestedPermanent employmentFull time- ...their data and make data-driven decisions.Key Responsibilities :- Design and implement scalable and reliable data pipelines using Hadoop, Spark, and other big data technologies to process large volumes of data for various business applications.- Develop and maintain data models...Suggested
- ...About Gap Inc. Our past is full of iconic moments — but our future is going to spark many more. Our brands — Gap, Banana Republic, Old Navy and Athleta — have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more...SuggestedFull time
- ...PyTorch, TensorFlow, Scikit-learn. ~ Hands-on experience with data preparation, feature engineering, model training, and tuning (Pandas, Spark). ~ Experience with NLP, computer vision, LLMs (APIs or fine-tuning), Agentic AI, and MCP-based architectures. ~ Familiarity with...SuggestedFull time
- ...requirements.- Tool and Technology Selection : Evaluate and select appropriate data engineering tools and technologies (e.g., SQL, Python, Spark, Hadoop, cloud platforms).- Documentation : Create and maintain clear and comprehensive documentation for data pipelines,...Suggested
- ...talent, where creativity dances with technology to orchestrate solutions beyond imagination.In this vibrant ecosystem, challenges are sparks igniting the flames of innovation, propelling us towards new horizons.Welcome to Taazaa, where we sculpt the future with passion, purpose...SuggestedFlexible hours
- ...engineering and analytics implementations on cloud platforms (preferably Azure).This role requires strong hands-on expertise in Databricks, Spark, and modern data architecture principles, along with the ability to mentor engineering teams and drive strategic data initiatives.Key...Suggested
- ...and/or Scala- Hands-on experience with data pipeline tools (e.g., Apache Airflow, Luigi)- Experience with big data technologies (e.g., Spark, Hadoop)- Expertise in relational and NoSQL databases- Experience with cloud platforms (AWS, Azure, or GCP) and data services- Solid...SuggestedFull time
- ...similar.- Strong understanding of Docker, Kubernetes, CI/CD, and distributed training.- Experience with data pipeline technologies (Kafka, Spark, Delta Lake, Databricks).- Good understanding of multimodal autonomous driving data (camera, LiDAR, radar).- Proven experience...SuggestedFull time
- ...working on connector or integration framework development- Deep Python expertise including PySpark, pyarrow, and an understanding of Spark's execution model (driver vs executor, serialization constraints, partition fan-out)- Hands-on experience with at least one SaaS ingestion...SuggestedHybrid work
- ...an offer to the client. Capabilities and experience to design complete cycle of 20MLD or Higher Municipal STPs. Do these words spark your interest? Proposals, Process Engineering Do your eyes light up when you read about this great opportunity? Apply now, we look...SuggestedFull timeLocal areaRemote jobWorldwide
- ...processes moving and transforming data for ODS Staging and Data Warehousing Design and development of solutions in Data Bricks Scala Spark SQL to process and analyze large datasets perform data transformations and build data models. Design SQL Schema Database Schema...SuggestedFull time
- ...Experience with one or more scripting language (e.g. Python KornShell) - Experience with big data technologies such as: Hadoop Hive Spark EMR - Experience with any ETL tool like Informatica ODI SSIS BODI Datastage etc. Our inclusive culture empowers Amazonians to deliver...Full time
- ...environments such as: SPSS SAS Matlab KNIME etc. R Python etc. Hadoop Hortonworks Cloudera IBM Big Insights etc. Mapreduce Spark Mahout etc. SQL/noSQL Databases and its manipulation components Additionally the following will be considered a strong asset:...Full time
- ...Professional experience in building distributed software systems, specializing in big data and NoSQL database technologies (Hadoop, Spark, DynamoDB, HBase, Hive, Cassandra, Vertica). Ability to work with relational and NoSQL databases Strong problem-solving skills....
- ...improve efficiency and reduce cost. Must have worked on both Batch and streaming data pipeline. Must have extensive knowledge of Spark and Hive data processing framework. Must have worked on any cloud (Azure AWS GCP) and most common services like ADLS/S3 ADF/Lambda...Full time
- ...experience in building Semantic relationships). Proficiency in SQL Python and PySpark. Demonstrable ability to write & optimize SQL and spark jobs. Some experience in Apache Kafka and Airflow is a prerequisite as well. Hands-on experience on DevOps on hyperscaler platforms...Full timeVisa sponsorshipWork visa
- ...and resilient solutions on Force.com while influencing architectural decisions across complementary technologies like React Native and Spark. You'll work on sophisticated engineering challenges across domains such as telecom and energy, delivering capabilities that directly...Long term contract
Rs 6 - 7.8 lakhs p.a.
...You'll Do (Your Ownership) You will set the tone for how the world sees and feels VibeSquad. You'll build our brand presence , spark conversations, and create content people genuinely want to share. • Create scroll-stopping content marketing : posts, memes, reels...Full time- ...service offering. Your key responsibilities Work Experience 3 to 5 years of hands-on development experience specifically in Scala (Spark). Development experience with RDDs writing code for performing actions transformations using in-memory processing using Scala....Full time
- ...Responsibilities: Design develop and manage data solutions using Microsoft Fabric including Lakehouse Data Engineering Pipelines Spark Notebooks and KQL Database. Implement ETL/ELT processes to ensure efficient data integration and transformation. Create and maintain...Full time
- ...in SQL for data extraction transformation analysis and debugging. ~ Experience with distributed data processing frameworks (e.g. Spark) and understanding of data architectures. ~ Practical experience moving from EDA and insight generation to predictive modeling and...Full timeWorldwide
- ...support each other and our users Become an expert in promote and recruit contributors for Databricks inspired open-source projects (Spark Delta Lake and MLflow) across the developer community. What we look for: ~8 years in a data engineering data science technical...Full time
- ...frameworks) ~ CI/CD pipelines and tools (e.g. Jenkins GitHub Actions GitLab CI) ~ Experience with stream processing engines like Kafka Spark etc. Preferred Qualifications: Bachelors degree in computer science Engineering or equivalent practical experience Domain...Full timeSide jobFlexible hours
- ...Data Governance Tools: Microsoft Purview Collibra. Distributed Systems: Azure ADLS Gen 2 Databricks Hadoop HDFS Kafka MapReduce/Hive Spark Storm Zookeeper Enterprise Architecture Tools: Spark Enterprise Architect Graph Databases: Should have extensive experience...Full timeImmediate startFlexible hours
Rs 7 - 14 lakhs p.a.
...with Databricks Unified Data Analytics Platform. Good to Have Skills: Experience with other big data technologies such as Hadoop, Spark, and Hive. Strong understanding of software development principles and methodologies. Experience with programming languages such...Rs 2 - 5 lakhs p.a.
...Expertise in AWS (Athena, Redshift), GCP (BigQuery), or Snowflake Experience with data governance, lineage tracking, and big data tools (Spark, Kafka) Exposure to machine learning and AI-powered analytics Nice to Have: Experience with graph analytics, geospatial data,...Contract workFreelanceWork at officeRemote job

