Azure Databricks Developer - PySpark/Python
Laksh Consultants
Position: Azure Databricks Developer (Pyspark, Databricks)Overall/Total Experience: 8-15 years onlyLocation: Days: 5 Days from OfficeNotice Period Requirement: Immediate Joiners OnlyClient's Company Size: Startup / Small EnterpriseInterview Process: Technical interview (Round 2) will be a face-to-face interview at the end client's officeRoles & Responsibilities:- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.- Build and optimize data engineering workflows using Databricks and PySpark.- Write efficient, high-performance SQL for data transformation and analysis.- Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing, data models, and pipelines.- Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the development lifecycle.- Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production environments with proper change control processes.- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.- Ensure data quality, reliability, and performance across all pipelines and platforms.Candidate Requirements:- Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.- Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.- Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.- Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.- Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.- Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments. (ref:hirist.tech)
- ...solutions Manual and automated testing in python of Networking Software Triage and... ...SRv6 ~ Proficient in the use of IXIA to develop Data Path and Control Plane Test cases ~... ...to have: DevOps experience with AWS, GCP, Azure or other cloud service Bonus ~ Prior...SuggestedFull timeFlexible hours
- ...releases and branching strategies. Strong scripting skills (Python/Java) and problem-solving ability are essential. Join us to build... ..., and automated systems! What You’ll Do: Collaborate with developers, consultants, operational team members in adoption of DevOps/...SuggestedFull timeHybrid workImmediate start
- ...region Perform premium rate and complex data validations using Python, SQL, and formula-driven logic to identify variances and provide... ...data structuring and enhancing end-to-end validation workflows Develop dashboards and insights using Power BI and other visualization...SuggestedHybrid workWork at officeLocal area3 days week
- ...contribute ideas and solutions to process improvement initiatives Support automation and efficiency projects using tools such as Excel, Python, and GenAI Participate in QC reviews, UAT cycles, and project rollouts , documenting key findings and learnings About the Team...SuggestedHybrid workWork at officeWorldwide3 days week
- ...Responsibilities Transform and process data using Python, R, and SQL to support actuarial... ...cloud-based analytics platforms such as Databricks or Palantir Foundry Experience with... ...scale data processing Experience with MS Azure for cloud-based data solutions...SuggestedHybrid workWork at office3 days week
- ...from designs provided by the UX team, using ReactJS and NextJS. Developing and maintaining comprehensive test suites using Jest and... ...services in any modern language (e.g., TypeScript/Node.js, Go, Java, Python, C#) — with the aptitude and willingness to work primarily in TypeScript...Full timeCasual workHybrid workWork at officeWorldwideFlexible hours
- ...Strong grounding in at least one of the three domains, with the ability to teach across all three. Familiarity with analytics tools (Python, R, SQL, Tableau, or Power BI) is a strong plus. A record of, or clear potential for, quality research and publication....Full timeInternshipImmediate start
- ...manufacturing processes. In this role, you will apply your expertise to develop, review, and optimize machining strategies, toolpaths, and CNC... ...-processor development. ~ Mill-turn / Swiss-type exposure. ~ Python or tool-specific scripting/macros; CMM programming....Full timeImmediate start
- ...and identifying and implementing continuous improvement plans Develops strong working relationships with peers across Development &... ...debugging solutions Advanced knowledge of one or more of: C#/Java or Python Bachelor’s degree in computer science, Engineering, IT,...Full timeImmediate startFlexible hours
- ...working world for all. Career Family-Azure Full Stack Architect The opportunity... ...professional development. That’s how we develop outstanding leaders who team to deliver on... ...development experience using .Net Core / Python Good knowledge and Understanding of MACH...
- ...experience, mobile technology, infrastructure, Microsoft technologies and open innovation. The Opportunity: Senior Cloud Native Developer (AWS) In today’s rapidly evolving digital landscape, cloud-native architectures are at the core of scalable, resilient, and secure...Local areaWorldwide
- ...cloud architectures and embed security into CI/CD pipelines. Develop and enforce policies for secure cloud-native deployments. Drive... ...Vulnerability management tool, preferably Qualys. ~2+ years of Python development for automation. ~2+ years of Terraform experience for...Local areaImmediate startWorldwideFlexible hours
- ...analytics and business intelligence (Power BI, Python, and Power Query), Transaction Advisory... ...this role, you will support clients in developing, reviewing, and enhancing complex... ...automated corporate strategy solutions using Databricks, Python, or Agentic AI Knowledge of PPP...Long term contractWorldwide
- About Us: Abstrabit is a private AI company based in Bengaluru. We help businesses run AI entirely on their own infrastructure: self-hosted LLMs, secure enterprise RAG, fine-tuned models, and AI agents that never send data outside the network. We serve clients across the...Full timeInternshipHybrid work
- ...Time | Core Team LAT Aerospace | Civil LAT Aerospace is developing next-generation aerospace systems from first principles. This includes... ...in low fidelity and high fidelity simulations ~ Strong Python/MATLAB skills for CFD automation, data processing, and engineering...Full timeHybrid work
Rs 4 - 5 lakhs p.a.
...experiences. As an AI Engineer, you will be responsible for designing, developing, integrating, testing, and continuously improving the AI systems... ...Other requirements Core Engineering Strong Python programming skills. Experience with REST APIs...Full timeHybrid workImmediate startRemote job- ...systems for real-time generative applications. You will collaborate to develop and maintain platform software, generative AI models, and high-... ...including LLMs, NLP, or multi-modal models. ~ Proficiency in Python and experience with GenAI libraries (e.g., Transformers, PyTorch,...Full timeHybrid work
- ...experience — can define a problem, not just execute a known one Has trained models before (not just fine-tuned APIs) and is fluent in Python Bachelor's in computer science and related fields. Energized by open-ended problems and ambiguity Wants to publish, not just...Full time
- ...Deliverables Responsibilities & Key Deliverables Design and develop advanced control algorithms for Vehicle Control Units (VCU) in... ...tools. Peer to Peer review of source codes using embedded C, C ++/python/M-Script. Perform requirement analysis and maintain...
- ...footprint, we have an exciting opportunity for a highly skilled Databricks Architect to join our innovative and dynamic team. Databricks... ...within Databricks. Lead cloud‑based implementations across AWS, Azure, or GCP, including networking, security, and access controls....Long term contractFull timeWorldwide
- ...centric roles, such as Senior Software Development Engineer, Solution Developer, Solution Architect and Delivery. For those who are interested... ...or field-service management systems. Knowledge of Java, Python, or JEE frameworks. ITIL V3/V4 certification or equivalent foundation...Long term contractFull timeHybrid workShift workNight shift
- ...footprint, we have an exciting opportunity for a highly skilled Azure AI Co-Pilot Engineer to join our innovative and dynamic team.... ...Copilot Studio, and Azure AI services. ~ Solid programming skills in Python and familiarity with SQL. ~ Experience with ML libraries and UI...Full timeWorldwide2 days week
- ...scalable test automation frameworks from scratch. Script Creation: Develop and execute automated functional, regression, UI, and API tests.... ...Qualifications: Programming: Proficiency in Java , Python , Golang , or JavaScript . Automation Tools: Hands-on experience...Full time
- ...Engineer | Day-to-Day Architect and develop AI-powered services, tools, and products that... .... Build and integrate AI models using Azure OpenAI and other Azure AI Services,... ...fields. ~ Strong programming skills in Python and SQL, with hands-on experience in ML libraries...Full timeWorldwide
- ...analysis for complex technical issues. Develop, test, and deliver fixes, patches, hotfixes... ...VM-based cloud environments (AWS, Azure, Tata, NTT, or equivalent). Monitor and... ...fundamentals Experience with scripting (Shell, Python, or similar) Understanding of HA, DR,...Full timeHybrid work
- ...container orchestration platforms (such as Kubernetes, OpenShift, or VMware Tanzu) and major public cloud ecosystems (such as AWS or Azure). Proficiency with modern Infrastructure-as-Code and DevOps tools (such as Terraform, Ansible, Chef, or Puppet) and Linux to troubleshoot...Shift work
- ...build solutions or breakdown technical problems Develops secure and high-quality production code, and reviews... ...qualifications, capabilities, and skills Basic/Intermediate knowledge of Python Experience with either Snowflake or DataBricks About Us About the Team...
- ...Home Lending Consumer Revenue Management team is responsible for developing, managing and implementing Chase Home Lending’s pricing strategy... ...BI and data tools (Power BI/Tableau); basic SQL and/or Alteryx/Python a plus (not required). ~ Proficiency with data mining/gathering...
- ...products. Unlock career growth by leveraging advanced AI, Java, and Python full-stack development skills. Job summary As a... ...culture of innovation. Job responsibilities Design, develop, test, and deliver Java- or Python-based backend services and...Full time
- ...distributed systems Core Technical Skills Key skills: C++, Java, Python, Scala, JavaScript or any other Programming language. Solid... ..., Kubernetes. Experience in architecting, designing and developing large-scale, multi-tiered, distributed software systems, storage...Full timeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Developer - PySpark/Python. Be the first to apply!
