...Implement tests within Azure DevOps pipelines ensuring integration and deployment processes are robust and efficient.
Using Azure Databricks to set up data simulations and environments for thorough testing of datadriven applications.
Continuous Integration and...
Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into...
Role : Databricks EngineerYour main responsibilities will be :- Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks- Integrating the end-to-end data pipeline to take data from source systems to target data...
...Proven experience as a Data Engineer, Big Data Architect, or similar role, with a focus on designing and implementing solutions on the Databricks platform.
Strong proficiency in Apache Spark and experience with Databricks Runtime environments.
Hands-on experience with...
Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand...
...Solutions Architect in our Professional Services team, you will work with customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client...
Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing...
...development and testing for enterprise wide data solutions- Azure cloud experience is a must have with familiarity of the services : Azure Databricks, Azure Datafactory, Azure Datalake, Spark SQL, PySpark, Airflow, SQL server and Informatica MDM.- Additional exposure to GCP and AWS...
Job Description :Technical Expertise :- Should have experience of working on Microsoft Azure tools like Spark, Databrick, Synapse (knowledge of these will be an added advantage).- Should be very strong on BI and EDWH concepts.- Must have good experience on working on Microsoft...
...variety of Data Architecture services (SnowPro Advanced Architect, Azure Solutions Architect Expert, AWS Solutions Architect / Database, Databricks Data Engineer / Spark / Platform etc.)- Experience with MLOps and/or developing and maintaining machine learning models and...
...play a crucial role in managing and maintaining cloud infrastructure across multiple platforms, including AWS, Azure, Azure DevOps, Databricks, and Copilot services. Your primary responsibilities will include:1. Service Management :- Hands-on experience in deploying, configuring...
...Visual Studio Code. In addition, you know how to use Bitbucket/ GIT for version control and collaborative coding. Familiarity with Databricks/ Sagemaker would be a plus.
You have a solid understanding of relational databases and the ability to efficiently query large databases...
...technologies including EMR, Glue, Athena, Data Pipeline, Lambda, et
• Knowledge and exposure to Big Data warehouses - RedShift, Snowflake, Databricks etc.
• Proven experience in data modelling, analysis, and profiling
• Experience of working in diverse data domains.
•...
...Graph analysis, Large Language models/Transformers/chatbots is good to have- Experience with cloud computing and cloud based tools like Databricks is good to have- Follow industry best practices for Python coding and model development and deployment- Strong record of achievement...
...Engineering, or related discipline
Familiarity with Oracle, Microsoft SQL Server, SSIS, SSRS data technologies
~ Familiarity with the Databricks Platform and notebook environments
~ Familiarity with reporting and analysis tools such as PowerBI, Tableau, or SAS JMP...
...solution on Azure/On-Prem and sometime in collaboration with business/technical partners.- Manage Datawarehouse solution on Azure like Databricks, Data Lake and Azure Synapse and more- Managing Database solution on Azure/on-prem for SQL Server, Azure SQL Server (Managed/...
...infrastructure, and project services in a cost efficient manner to Corning worldwide.
Responsibilities:
As a DevOps Engineer, Databricks Platform, your primary responsibilities will be to deploy and automate, administer, and monitor the core platform services provided...
...advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. You'll grow as...
...We need Data Engineers with Azure, Databricks, DataStage, SQL, Kafka; Scala/Java/Python/R, etc. (any combination); experience with BI tools (tableau, Cognos, ThoughtSpot) is a plus.
Long-term contract, 2-3 rounds of interviews.
Requirement:
We are looking for an...
..., understand automation requirements and clearly define what success looks like
Create fully automated dashboards using Python, Databricks, and Power Bi
Automation of highly leveraged manual processes/recurring activities/deliverables (e.g., PowerPoint presentation,...
...with popular MLOps tools (e.g., Kubeflow, miflow, AzureML, Domino).
Preferred:
Experience with deep learning platforms (eg: Databricks, Nvidia DGX) and frameworks (e.g.: TensorFlow, Keras, Theano, PyTorch, Caffe, etc.)
Experience working in Data Architecture,...
...robust data integration.
~ Programming expertise in SQL and Python
~ Core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP
~ SQL and the ability to write, debug, and optimize SQL queries
~ Create and deliver detailed presentations.
~...
...tackling complex data challenges by developing innovative solutions using cloud technologies. Proficiency in building a data lakehouse on Databricks or Snowflake is required, as well as experience in data enrichment, database performance management, data caching techniques, data...
Amplifi Capital
Noida
1 day ago
...big data and cloud related technologies including Azure, SOA with API, REST, GraphQL interfaces and distributed systems with Spark/Databricks; knowledge of different databases Postgres, MongoDB or ElasticSearch
~Technical credibility through lengthy software engineering experience...
Role as a Data engineer :- Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake- Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability.- Partner with AI/ML product teams proactively identify the...
...SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations.- Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency.- Conduct code reviews to ensure...
...databases and query languages like SQL.
• Strong understanding of data modelling principles.
• Practical experience with tools such as Databricks, DBT, Dremio, Airflow, Spark, PowerBI, or similar platforms.
• Proven track record in implementing a DWH/Analytical platform.
•...
...Requirements :Proven experience designing and implementing solutions built on Microsoft AzureExperience in core Azure Data skills such as Databricks, Data Lake Gen2, SQL Server PaaS solutions (SQL Database, Hyperscale, Managed instance), Azure Synapse Analytics, Azure pipelines,...
...for organizations.
BluePi works with technology partners – Amazon Web Services (AWS), Snowflake, Google Cloud Platform (GCP), & Databricks.
About the role-
The VP Technology is a senior leadership role that oversees the technical vision, strategy, and delivery...
...different sources.
• Kafka and Flink(Real Time) poc and migration
• Batch, Consumption and Orchestration includes EMR to dataproc, databricks and model framework
• Prism and its related components
GCP DataProc(Spark and Hive), Databricks(Spark), Kafka, Airflow, SQL,...