Average salary: Rs723,085 /yearly
More statsGet new jobs by email
- ...; mentor junior engineers and define engineering best practices for DLT data workloads.Skills & Qualifications :Must-Have :- Python.- Apache Spark.- Apache Kafka.- SQL.- Apache Airflow.- Distributed Ledger Technology.Preferred :- Hyperledger Fabric.- Ethereum.- AWS.Additional...SuggestedContract workRemote jobFlexible hours
- ...programming languages and frameworks. The ideal candidate will have hands-on experience with real-time data processing frameworks (like Apache Flink), NoSQL databases (MongoDB), and the ability to design, build, and scale robust distributed systems.. You will work closely with...Suggested
- ...Tech Skills Details: Expertise in Apache Druid setup, configuration, and cluster management. Strong knowledge of real-time and batch data ingestion using Kafka, HDFS, S3 , etc. Proficiency in Druid SQL and native query optimization for high performance....SuggestedFull time
- ...integration of various systems and applications. Key Responsibilities: Design, develop, and implement integration solutions using Apache Nifi. Develop custom connectors, processors, and components as needed. Collaborate with software engineers and architects to...SuggestedWork from homework from homea month ago
- Description :Responsibilities :- Assemble large, complex data that meet functional/non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing transformation for greater...Suggested
- ...with dbt for data transformations and testing Familiarity with workflow orchestration tools, specifically Dagster Knowledge of Apache Superset for data visualization Understanding of containerization concepts, Kubernetes, and AWS EKS Strong SQL skills for complex...SuggestedRemote jobFull timeContract workLocal areaWork from home
- ..., Postgress or Cassandra) ~ Fluency in Python and Ruby on Rails. ~ Knowledge in Web servers and Web application servers (e.g., Apache, Jetty, Tomcat, IIS) ~ Knowledge in code repository like Git ~ Ability to multi-task and adapt to shifting priorities, demands,...SuggestedRemote jobFull timeFlexible hoursShift work
- ...scripting and GitHub Actions ~ Familiarity with high-performance, high-availability server infrastructure, including Linux, NGINX, Varnish, Apache, and CDN/WAF ~ Familiarity in cross-platform integrations using purpose build APIs, serverless functions or tools like Zapier, Make,...SuggestedFull timeRemote jobWorldwideShift work
- ...Have) :- Experience with a workflow orchestration tool like Airflow.- Experience with a data governance or data catalog tool (e.g., dbt, Apache Atlas).- Familiarity with data governance principles and best practices.- Experience in a B2B SaaS or e-commerce environment.-...Suggested
- ...to deliver high-quality features. 7. Troubleshoot, debug, and enhance application performance and reliability. Skill(s) required Apache Kafka Java Kubernetes Microservices Spring Boot Earn certifications in these skills + 3 more skills Who can apply Only...SuggestedRemote jobLong term contractImmediate startFlexible hours
- ...Git How can you impress us? ● Knowledge of REST APIs ● Any experience with big data technologies like Hadoop, MapReduce, and Apache Iceberg is a plus ● Knowledge of shell scripting. ● Experience with BI tools like Looker. ● Experience with DB maintenance ● Experience...SuggestedRemote jobFull timeWork at officeFlexible hours
- ..., JUnit, Batch Programming, Unix shell scripting and Oracle. Experience in or equivalent experience in tools and technologies like Apache Tomcat, Apache Web Server, Kibana, SOLR, Vagrant, Docker, MySQL. Should be well acquainted with J2EE design patterns like GOF, Composite...SuggestedFull timework from homea month ago
- ...Responsibilities: Design, deploy, and manage containerized applications using Azure Kubernetes Service (AKS). Configure and optimize Apache Kafka for real-time data streaming and messaging. Administer and optimize PostgreSQL databases for high availability and...Suggestedwork from home16 days ago
- ...Java. Experience with data modeling, normalization, and cleansing techniques. Familiarity with ETL tools and frameworks such as Apache Spark, Talend, or Informatica. Excellent communication and collaboration skills. Ability to work effectively in a fast-paced, dynamic...Suggestedwork from home9 days ago
- ...cross-functional teams to build scalable, reliable, and secure services while leveraging modern technologies like Java, Spring Boot, RDS, Apache Kafka/RabbitMQ, and Redis/Memcached. Responsibilities: Design, build, and maintain scalable, secure backend systems using Java...Suggestedwork from homea month ago
- ...predictive models using Python, SQL, and popular ML/DL frameworks (Pandas, Scikit-learn, TensorFlow, PyTorch). Leverage Databricks, Apache Spark, and Hadoop for large-scale data processing and model training. Implement workflows and pipelines using Airflow and AWS EMR...Remote jobFull time
- ...-10 years of proven experience as a Full Stack Developer managing and deploying LAMP stack applications in Linux environments (Linux, Apache, MySQL, PHP) with expertise in AWS services (EC2/ Lambda/ S3/ Route 53) ~ Proficiency in building and consuming REST APIs (SOAP experience...Remote jobLong term contractFull timeHybrid workWork at officeLocal areaWorldwide
- ...Data platform. Requirements Strong programming experience in Scala (preferred), Java, or Python. Hands-on experience with Apache Spark (batch & streaming) for large-scale data processing. Proficiency in Hive, SQL, and data modeling for analytical workloads....Remote jobFull time
- ...Experience with testing AI solutions Azure AI Fundamental Certification Azure Data Fundamentals Certification Expertise with Apache JMeter, Test Harness, Selenium Expertise in python, SQL Server, and vue.js Any data provided as a part of this...Remote jobFull time
- ...ensuring clear lineage, consistency, and scalability.- Automate data modelling and transformation pipelines using tools such as AWS Glue, Apache Spark, AWS Lambda, and Step Functions.- Support GoodData reporting and analytics by providing optimized and reliable data structures.-...Hybrid workImmediate startRemote job
- ...data warehouse solutions such as Redshift, BigQuery, Snowflake, or Delta Lake- Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT- Ensure data governance, lineage, quality, and observability- Collaborate with stakeholders to define...
- ..., and optimizing large-scale data pipelines and data warehouse solutions. This role requires deep expertise in PostgreSQL, Databricks/Apache Spark, Python, and Azure services.Key Responsibilities : - Data Architecture & Design : Design, implement, and manage robust, scalable...
- ...with APIs, SQL databases, graphs, and low-level design (including class design).- Working knowledge of : Java, Spring, Python, Linux, Apache, MySQL, Solr, Memcache, Redis- Familiarity with graph algorithms and their applications.- Experience working on high-performance services...Immediate startRemote job
- ...technologies, including proxies, load balancers, LDAP, Active Directory, SSL. ~ Understanding of application server technologies (e.g. Tomcat, Apache, WebSphere, J Boss,) Experience with SQL databases ~ Experience in escalation handling ~ Experience working with enterprise...Work at officeLocal areaRemote jobWork from homework from home2 days ago
- ...leverage your 10+ years of expertise to develop complex data pipelines, ensure data quality, and drive innovation using Databricks and Apache Spark. Responsibilities: ~ Design and implement scalable and robust data pipelines using Databricks and Apache Spark. ~...work from home29 days ago
- ...Key Responsibilities : Design, develop, and maintain robust Java applications. Work on Apache Beam pipelines and integrate with Google Cloud Platform (GCP). Collaborate with cross-functional teams to define, design, and deliver new features. Write clean, efficient...work from home12 days ago
- ...engineering workflows. Required Skills & Experience: ~5+ years of experience in data engineering with hands-on expertise in Databricks and Apache Spark. ~ Proficient in Unity Catalog for data lineage, security, and governance. ~ Experience building and optimizing ETL...work from home12 days ago
- ...data engineers to build and deploy pipelines using AWS Glue , Kinesis , Lambda , S3 , and Redshift . Implement orchestration using Apache Airflow (open-source and AWS MWAA). Ensure reliability, scalability, and security throughout the data lifecycle. Monitoring, Logging...work from home18 days ago
- ...Integrate, transform, and centralize large-scale data from varied sources- Implement/manage Delta Lake architecture (Databricks Delta or Apache Hudi)- Build end-to-end data workflows with PySpark, Databricks Notebooks, Python- Develop data warehouses/marts (Snowflake, Redshift,...
- ...years of experience in software engineering ~ You’ve 2+ years of experience in architecting big data systems around technologies like Apache Spark and Hive ~ Experience in uplevelling junior engineers via processes and setting a high bar for them to follow ~ You know...Remote jobFull timeLocal areaRelocation
