Average salary: Rs859,999 /yearly
More statsGet new jobs by email
- ...architecture across ingestion, transformation, storage, and analytics- Design and scale batch and streaming pipelines using Python, Airflow, Spark / PySpark, Kafka, dbt, and Debezium- Architect and optimize data models across MongoDB, ClickHouse, and OpenSearch for high-volume...Suggested
- ...platforms that improve learning outcomes. To support our growing Data & Analytics capability, we are hiring a Senior Data Engineer - Spark, Data Bricks & AWS who will play a critical role in strengthening McGraw Hill's data platform and enabling high-impact, data-driven decision...SuggestedRemote job
- ...architecture across ingestion, transformation, storage, and analytics.- Design and scale batch and streaming pipelines using Python, Airflow, Spark / PySpark, Kafka, dbt, and Debezium.- Architect and optimize data models across MongoDB, ClickHouse, and OpenSearch for high-volume...Suggested
- ...Job Description: We are looking for a skilled Data Engineer with strong expertise in AWS, Scala, and Apache Spark to design, build, and optimize scalable data pipelines and data processing systems. Key Responsibilities: Design and develop scalable data pipelines using...SuggestedImmediate start
Rs 5 - 10 lakhs p.a.
...frameworks. Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs. Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations. Data Analysis...Suggested- ...- 6+ years of Java/Scala and/or Python programming with good CS fundamentals- 6+ years of Big Data development experience with Hadoop/Spark and writing ETLs- 6+ years' experience of SQL, RDBMS and/or NoSQL database technologies- AWS experience preferred or any other public...Suggested
- ...Weaviate, Milvus). • Cloud platforms (AWS, Azure, GCP) and Kubernetes orchestration at enterprise scale. • Data engineering tools (Spark, Airflow, Kafka, Databricks, Snowflake). • Security, compliance, and data governance frameworks (RBAC, encryption, audit logging)...SuggestedLong term contractHybrid workWork at officeRemote jobFlexible hours
- ...talent, where creativity dances with technology to orchestrate solutions beyond imagination. In this vibrant ecosystem, challenges are sparks igniting the flames of innovation, propelling us towards new horizons.Welcome to Taazaa, where we sculpt the future with passion,...SuggestedFlexible hours
- ...requirements. - Tool and Technology Selection : Evaluate and select appropriate data engineering tools and technologies (e.g., SQL, Python, Spark, Hadoop, cloud platforms). - Documentation : Create and maintain clear and comprehensive documentation for data pipelines,...Suggested
- ...practice at pace. Our culture brings together courageous thinking and practical execution, with unexpected teams in the same room to spark new ideas and move them into the clinic. We value persistence alongside ambition, and we equip you with pioneering science, strong partnerships...SuggestedLong term contractFull timeContract workHybrid workWork at officeLocal areaWorldwideFlexible hours3 days week
- ...Surrounded by diverse and talented individuals, you will feel welcomed, respected, and engaged. Enjoy a safe, caring environment where you can spark new ideas, reimagine the future, and lead change. As your career grows, you will benefit from learning opportunities at T.EN...SuggestedFull time
- ...workflows using Adobe Campaign or equivalent enterprise grade tools.- Develop high performance big data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python.- Build and optimize cloud native data pipelines on Azure, including ADF based ingestion,...Suggested
- ...AI platform, slashing SME costs by 50–80% and saving 20–40 hours/month. MVP Buzz: Testing with CAs, retailers, and startups is sparking demand; Unrivaled Edge: Crushes competitors like Vakilsearch or ClearTax with a high-voltage, all-in-one AI solution....Suggested
- ...build lasting relationships with top influencers and media outlets, ensuring their clients always stand out. Whether you're looking to launch a new product, increase brand visibility, or drive conversions, Pyromedia is the spark that will help your business rise to new heights.Suggested
- ...~ Ability to work in a collaborative, fast-paced environment. Preferred Skills Experience with big data technologies (Hadoop, Spark, etc.). Understanding of DevOps practices and microservices architecture. Familiarity with NLP, Computer Vision, or other AI specializations...SuggestedWorldwide
Rs 8 - 9 lakhs p.a.
...SQL queries on MPP systems (Snowflake/Redshift). ~ Experience in Databricks and Delta tables. ~ Data engineering experience with Spark/Scala/Python. ~ Experience in Microsoft Azure stack (Azure Storage Accounts, Data Factory, and Databricks). ~ Experience in Azure...- ...GCP, AWS, or Azure) Familiarity with MLOps frameworks for deployment, monitoring, and automation Exposure to big data tools (e.g., Spark, BigQuery) Understanding of A/B testing, experimentation frameworks, and causal inference techniques We are proud to offer a...Full time
Rs 3.5 - 10 lakhs p.a.
...Enhancement opportunity. Visualization Tools exposure like Power BI, Tableau. AWS Services exposure. Machine Learning Operations Py Spark exposure You may be assessed on key essential skills relevant to succeed in role, such as strong knowledge on Python, SQL, Big Data...Shift work- ...reliable. Key Responsibilities: Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka. Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions...
- ...pipelines at scale. . Strong SQL and data modeling expertise (OLAP, dimensional modeling, lakehouse). . Hands-on experience with: o Spark / PySpark o Airflow or similar orchestration tools o REST APIs and microservices . Experience using GitHub Copilot or similar...Full time
- ...frameworks, tools, and best practices Preferred Technical Expertise Programming & Querying: Python, SQL Big Data Technologies: Spark, PySpark, Scala, Hadoop, Kafka Cloud Data Platforms: Snowflake, Databricks, AWS, Azure, or GCP Databases: NoSQL and distributed...Long term contract
- ...ingestion of large-scale datasets from various sources (transactional systems, APIs, external files). Optimize processing of big data using Spark and integrate legacy Hadoop-based data into our AWS environment. Data Modeling: Develop and maintain data models (conceptual,...Full timeLocal areaRemote jobWorldwideFlexible hours
- ...databases. Knowledge of deep learning frameworks (e.g., TensorFlow , PyTorch). Familiarity with data processing tools (e.g. , Spark ). Familiarity with version control systems like Git. Communication & Ownership Communication Skills: Excellent verbal...Work at office
- ...concentrations in Computer Science, Data Science, Math, Actuarial Science, Engineering, or related field. Experience writing in Python or Spark (ScalaSpark or PySpark) and with popular machine learning libraries such as TensorFlow, Keras, PyTorch, and conversant with JAVA (...Local areaWorldwide
- ...years of experience in ETL and Data Warehousing. The ideal candidate will have strong hands-on expertise in SQL development across Hive, Spark, and Impala, along with a solid understanding of cloud ecosystems. This role requires proficiency in big data technologies and...Worldwide
- ...gain from this intense experience at GydeXP The Silence or The Call If your approach and answers resonate – if they show the spark of a true builder – you'll hear from us. We'll then ask for your resume and schedule a conversation. If not, you won't. And that's...Full timeApprenticeshipInternshipHybrid workWork at officeLocal areaImmediate start
Rs 1 - 4 lakhs p.a.
...learning for vision tasks. Exposure to generative AI models (e.g., Stable Diffusion, GANs) and large-scale image processing (Apache Spark, Dask). Research publications or patents in computer vision and deep learning. What are the next steps Register on our Soul...Contract workFreelanceWork at officeRemote job- ...and schedule high-quality pitch meetings with decision-makers and senior stakeholders. Conduct value-led initial conversations to spark interest and establish credibility with prospects. Build and present use cases tailored to prospect needs, showing potential business...Full timeHybrid workWorldwideFlexible hours
- ...place. The two initiatives you will be working on primarily under GPPL are: TEDxGateway As Asia's largest TEDx program, TEDxGateway sparks global conversations by uniting top minds to share their ideas and innovations. We provide a stage for groundbreaking ideas, inspiring...Local area
Rs 8 - 12 lakhs p.a.
...SQL Server Data Engineering & Cloud Technologies Strong experience with Azure Data Lake Storage Gen2, Azure Databricks, Apache Spark (PySpark), and Logic Apps Exposure to real-time data processing and streaming with Apache Kafka and Azure Event Hubs Hands-on with...

