Apache jobs in work from home

 ...programming languages and frameworks. The ideal candidate will have hands-on experience with real-time data processing frameworks (like Apache Flink), NoSQL databases (MongoDB), and the ability to design, build, and scale robust distributed systems.. You will work closely with... 

Description : Key Responsibilities : - Apache Flink (Advanced - Mandatory)- Design, develop, and optimize large-scale stateful stream-processing applications using Apache Flink.- Implement stream processing semantics including event time, processing time, and ingestion time.... 

 ...; mentor junior engineers and define engineering best practices for DLT data workloads.Skills & Qualifications :Must-Have :- Python.- Apache Spark.- Apache Kafka.- SQL.- Apache Airflow.- Distributed Ledger Technology.Preferred :- Hyperledger Fabric.- Ethereum.- AWS.Additional... 

 ...integration of various systems and applications. Key Responsibilities: Design, develop, and implement integration solutions using Apache Nifi. Develop custom connectors, processors, and components as needed. Collaborate with software engineers and architects to... 

 ...Tech Skills Details:  Expertise in Apache Druid setup, configuration, and cluster management. Strong knowledge of real-time and batch data ingestion using Kafka, HDFS, S3 , etc. Proficiency in Druid SQL and native query optimization for high performance.... 

Description :Responsibilities :- Assemble large, complex data that meet functional/non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing transformation for greater...

 ...with cross-functional teams to design scalable and secure application architectures. Deploy, configure, and manage applications in Apache Tomcat or equivalent servlet containers. Work with AWS cloud services (EC2, S3, Lambda, RDS) to build cloud-ready systems.... 

 ...- Develop async Python services with FastAPI/asyncio to manage Ansible Runner execution and event workflows.- Integrate services with Apache Kafka to coordinate inter-service communication, track job execution, and publish status updates.- Design and manage relational database... 

Description : Looking for a Senior Data Engineer skilled in Azure Databricks, Apache Spark (PySpark), and Unity Catalogue to design, optimise, and govern large-scale data pipelines on Azure.Responsibilities : - Build and optimise ETL/ELT pipelines using Databricks and PySpark... 

 ...databases). ~ Familiarity with cloud computing platforms (AWS, Azure, Google Cloud). ~ Experience with data processing frameworks such as Apache Kafka, Spark, or similar. ~ Programming experience in Python, Java, or Scala. ~ Strong analytical skills and the ability to work... 

 ...architectures, data pipelines, and top-tier datastores (MongoDB, SQL Server, MySQL). ~ Strong understanding of Linux, Docker, Kubernetes, Apache Tomcat, Nginx, and CI/CD tools. ~ Familiarity with security best practices in cloud/distributed systems and infrastructure as code (... 

 ...communication and teamwork skills.Preferred Qualifications (Good to Have)- Experience working with both SQL and NoSQL databases.- Experience with Apache Airflow for workflow management.- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.- Experience or interest in LLM (... 

 ...CA Spectrum, LoadRunner, Splunk, SiteScope, Perfmon, Wireshark, Java profilers Experience administering or troubleshooting WebLogic, Apache, JBoss, or similar containers Experience troubleshooting J2EE and JVM tools (jps, jcmd, jstat, jmap) POSITION RESPONSIBILITIES: Provide... 

 ...tokenizers, filters, and index mappings/schemas tailored to domain-specific search needs. Develop and optimize indexing pipelines using Apache Spark for processing large-scale structured and unstructured datasets. Perform query tuning and search relevance optimization based... 

 ...product development Familiarity with *nix based operating systems. Experience with GitLab CI pipelines. Experience in working with Apache Kafka or Confluent Kafka for message bus integration. Contributions to open-source projects. Exposure to Python and C++... 

 ...and networking • Experience with ML concepts covering Model Tracking, Model Serving and other aspects of productionizing ML pipelines in distributed data processing environments like Apache Spark, using tools like ML flow • Experience with NoSQL and/or graph databases... 

 ...our frontend mainstay, so you would be required to gain proficiency in this as well. - We use a couple of database systems, MySQL and Apache Solr. You would be expected to become comfortable with their use, deployment, and scaling. - Our devs are mini-server admins as well... 

 ...virtualized environments. 4. Create and back up MySQL and PostgreSQL databases. 5. Work with Linux-based web servers such as Nginx and Apache. 6. Host and manage PHP websites. 7. Understand and configure common network protocols such as DNS, DHCP, SSH, and TCP/IP. 8.... 

 ...Large-scale data processing experience on cloud platforms like Azure, AWS or GCP ~ Understanding of distributed computing like Ray, Apache Spark ~ SQL (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Elasticsearch) ~ Understanding of workflow orchestration platforms (Airflow... 

 ...technologies, including proxies, load balancers, LDAP, Active Directory, SSL. ~ Understanding of application server technologies (e.g. Tomcat, Apache, WebSphere, J Boss,) Experience with SQL databases ~ Experience in escalation handling ~ Experience working with enterprise... 

 ...years of experience in software engineering ~ You’ve 4+ years of experience in architecting big data systems around technologies like Apache Spark and Hive ~ Experience in uplevelling junior engineers via processes and setting a high bar for them to follow ~ You know... 

 ...Production: Python API deployed on Amazon EKS (Docker, Kubernetes, Flask) ML: Scikit-Learn, LightGBM, XGBoost, shap ETL: Python, Apache Airflow Cloud: AWS, GCP Database: MySQL DWH: BigQuery, Snowflake BI: Tableau, Metabase, dbt Streaming... 

 ...with dbt for data transformations and testing Familiarity with workflow orchestration tools, specifically Dagster Knowledge of Apache Superset for data visualization Understanding of containerization concepts, Kubernetes, and AWS EKS Strong SQL skills for complex... 

 ..., Postgress or Cassandra) ~ Fluency in Python and Ruby on Rails. ~ Knowledge in Web servers and Web application servers (e.g., Apache, Jetty, Tomcat, IIS) ~ Knowledge in code repository like Git ~ Ability to multi-task and adapt to shifting priorities, demands,... 

 ...scripting and GitHub Actions ~ Familiarity with high-performance, high-availability server infrastructure, including Linux, NGINX, Varnish, Apache, and CDN/WAF ~ Familiarity in cross-platform integrations using purpose build APIs, serverless functions or tools like Zapier, Make,... 

 ...Have) :- Experience with a workflow orchestration tool like Airflow.- Experience with a data governance or data catalog tool (e.g., dbt, Apache Atlas).- Familiarity with data governance principles and best practices.- Experience in a B2B SaaS or e-commerce environment.-... 

 ...Git How can you impress us? ● Knowledge of REST APIs ● Any experience with big data technologies like Hadoop, MapReduce, and Apache Iceberg is a plus ● Knowledge of shell scripting. ● Experience with BI tools like Looker. ● Experience with DB maintenance ● Experience... 

 ..., JUnit, Batch Programming, Unix shell scripting and Oracle. Experience in or equivalent experience in tools and technologies like Apache Tomcat, Apache Web Server, Kibana, SOLR, Vagrant, Docker, MySQL. Should be well acquainted with J2EE design patterns like GOF, Composite... 

 ...Java. Experience with data modeling, normalization, and cleansing techniques. Familiarity with ETL tools and frameworks such as Apache Spark, Talend, or Informatica. Excellent communication and collaboration skills. Ability to work effectively in a fast-paced, dynamic... 

 ...Responsibilities: Design, deploy, and manage containerized applications using Azure Kubernetes Service (AKS). Configure and optimize Apache Kafka for real-time data streaming and messaging. Administer and optimize PostgreSQL databases for high availability and...