Senior Data Engineer - Azure Databricks
US TECHNOLOGY INTERNATIONAL PRIVATE LIMITED
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based environment.The ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation in data warehousing, ELT/ETL processes, and dimensional modeling (Kimball/star schema) is essential for this role.Key Requirements : - Strong proficiency in PySpark and SQL for data transformation and pipeline development.- Experience working in Azure Databricks or equivalent Spark-based cloud platforms.- Practical knowledge of cloud data environments - Azure, AWS, or GCP.- Solid understanding of data warehousing concepts, including Kimball methodology and star/snowflake schema design.- Proven experience designing and maintaining ETL/ELT pipelines in production.- Familiarity with version control (e.g., Git), CI/CD practices, and data pipeline orchestration tools (e.g., Airflow, Azure Data Factory).- Experience in the financial domain or understanding of investment banking workflows.Total Experience : 7 to 9 years. (ref:hirist.tech)
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Azure Databricks in Hyderabad vacancy
- ...Accounting Analyst within our Account to Report, you’ll be working in line to Increase automation, Optimize process, Centralize master data & Build a robust Governance. We are an innovative global healthcare company with one purpose: to chase the miracles of science to improve...SuggestedLocal area
- ...instrumental in maintaining the integrity of ESM Medical Service’s core operational model while providing essential technical support and data administration services. The specialist will be responsible for ensuring the ESM platform operates efficiently, enabling Medical...SuggestedFull timeFlexible hours
- ...understanding of various database technology capabilities and enterprise data and application patterns and principles. You must be comfortable... ...-on experience with cloud-based database services (e.g., AWS, Azure SQL/MySQL Databases). Required Skills • Languages :...Suggested
- ...years Industry Preference: Forging / Aerospace & Defence / Heavy Engineering / Precision Manufacturing / Metallurgical Manufacturing Role... ...and manufacturing quality controls. Ability to analyse quality data and convert findings into measurable improvement actions. Strong...SuggestedFull time
- ...Reporting to: Head – Corporate HR, Administration & Compliance Experience: 8+ years Industry Preference: Manufacturing / Engineering / Aerospace & Defence / Automotive / Industrial organisations Role Purpose The Manager – HR & Administration will be responsible...SuggestedFull time
- ...understanding of real manufacturing processes, preferably from engineering, forging, foundry, machining, automotive, aerospace, heavy engineering... ...preparation and UAT. Understanding of manufacturing master data including item masters, BOMs, routings, work centres and process...Full timeContract work
- ...and respective contact setup as part of Private Equity fund launches and subsequent fund closes. Maintain and update investor static data , including bank/wire instructions, contact information and accounting-related data across applicable systems. Process requests for...
- ...you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within Deposits 2.0, you are an integral part of... ...of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and...
- ...needed to grow within your role and advance your career — and we have the perfect software engineering opportunity for you As a Software Engineer III at JPMorgan Chase as a part of the Data Product team within Consumer & Community Banking, you will contribute to a suite of...
- ...exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at... ..., and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications...
- ...received through various communication channels. Ensure accurate and timely entry of client information, case details, and relevant data into internal systems. Assign case owners and preparers to ensure seamless workflow across teams and regions. Document Management...Permanent employmentFull time
- ...Arcesium is a global financial technology firm that solves complex data-driven challenges faced by some of the world’s most sophisticated... ...address issues and solve problems. • Experience in engaging senior internal and external stakeholders including auditors, statutory...Local area
- ...Senior Installation Package Development & Validation Engineer (Contract role) Focus Areas : MSI InstallShield (Windows) & Linux... ...Pluggable Databases (PDB) , Azure SQL , and PostgreSQL . # Build... ...Redwood will comply with all local data protection laws, including GDPR...SeniorContract workFor contractorsLocal areaImmediate start
- ...simultaneously improving customer retention and spending. Our platform is engineered for reliability and scale and harnesses the power of enterprise-... ...India Duration: 6 months (Contractual) Job Description – Data Entry Operator What will I be doing? Extract data from...Contract workWork at officeLocal area
- ...supports developers and enterprises from data and model training through to production deployment... ...-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU... ...asset status and potential issues to senior management and relevant teams effectively....
- ...AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the... ...complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference...For contractors
- ...Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their data and AI are fully understood, secured,... ...framework, HTML, CSS What You’ll Bring ~ Full stack or front-end engineer with solid understanding of modern single-page web apps ~...Contract workLocal areaWorldwideFlexible hours
- ...pipelines leveraging vector databases, embeddings, and enterprise data sources. Create multi-step reasoning workflows combining... ...hybrid, and on-premises environments. Collaborate with product, engineering, and domain experts to translate business requirements into scalable...Long term contractHybrid work
- ...Qualcomm is hiring for the role of Software Engineer! Responsibilities of the Candidate: Applies Software knowledge to assist and support the design, development, creation, modification, and validation of embedded and cloud edge software, applications, and/or specialized...
- ...management: Manage the full lifecycle each month, pitching, negotiation, activation, and ongoing support to the restaurant partner Data-driven problem solving: Track adoption metrics, identify why restaurants aren't growing, troubleshoot issues, and course-correct Revenue...Full time
- ...) when required Out-of-Office alternative contact: Supporting the movement of client emails during periods of absence and leave of Senior Directors Building strong relationships with key client EAs Establishing a rapport with key stakeholders, partners, directors, and...Work at office
- ...Take responsibility for keeping up to date on Deloitte policy and process developments. Always ensure compliance with appropriate Data Protection legislation. Contribute to wider projects and initiatives in the Practice Support Services as required. Requirements:...Work at officeWeekend work
Rs 18 - 22 lakhs p.a.
...environments. Drive innovation and identify opportunities for high-impact AI/ML solutions. Mentor and provide technical guidance to engineering and AI/ML teams. Required Skills ~10–15 years of experience in AI/ML implementation and enterprise technology environments....Hybrid workRs 8 - 15 lakhs p.a.
...Hiring: Senior Interior Designer | Hyderabad We are looking for an experienced Senior Interior Designer to join a creative design team working on high-end residential, commercial, and hospitality projects . Location: Financial District, Hyderabad CTC: ₹6–1...SeniorImmediate startRs 9 - 15 lakhs p.a.
...Hiring: Senior Architect | Hyderabad We are looking for an experienced Senior Architect to join a design-focused team working on high-end residential, commercial, and hospitality projects . Location: Financial District, Hyderabad CTC: ₹6–15 LPA (depending...SeniorFor contractorsImmediate startRs 65 lakh p.a.
...Job Title: Director – Site Reliability Engineering (SRE) Industry: B2B SaaS / Cloud Product... ...Leadership: 5+ Years at Director / Senior Engineering Leadership Level Notice Period... ...Establish engineering metrics and use data/KPIs to identify and resolve operational...Immediate startRs 15 - 20 lakhs p.a.
...Senior Marketing Manager – Rehabilitation Healthcare Location: Hyderabad Industry: Rehabilitation Healthcare Experience: Relevant experience in rehabilitation / healthcare marketing is mandatory Compensation: Competitive package based on experience and current...SeniorRs 10 - 26 lakhs p.a.
...Java, Spring Boot and REST APIs . Design and manage CI/CD pipelines for automated build, testing and deployment. Work with AWS/Azure/GCP , containers and Kubernetes environments. Implement monitoring, logging, alerting and application performance improvements....Rs 15 - 20 lakhs p.a.
...Azure DevOps Enginee Experience: 6–8 Years Employment Type: Full-Time Location:... ...looking for an experienced Azure DevOps Engineer with strong hands-on expertise in Microsoft... ...Collaborate with Development, QA, Security, Data, and Infrastructure teams. Required...Full timeHybrid workRs 30 - 40 lakhs p.a.
...administration, and enterprise data analytics . The ideal... ...availability. Work closely with Data Engineering, Database, ERP, and business... .... Collaborate with senior stakeholders and convert business... ...platforms such as Snowflake, Databricks, Azure, or AWS . Exposure...Full timeHybrid work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Azure Databricks. Be the first to apply!
