Data Engineer - Azure Databricks/Python

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL.As a Data Engineer you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs.Essential Job Functions : - Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks- Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.- Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.- Optimize database performance by designing scalable and cost-effective solutions.Qualifications : - 5+ years of experience in data engineering or a similar role.- Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization- Exposure to Azure.- Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)- Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).- Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R programming).- Familiarity with workload automation and job scheduling tools such as Control M.- Familiar with data governance frameworks and security protocols.- Excellent problem-solving skills and attention to detail.- Strong communication and collaboration skills.- Bachelor's degree in computer science, IT, or a related discipline. (ref:hirist.tech)