Cognizant - Azure Data Engineer

Job Description : - Design, develop, and maintain scalable data pipelines using Microsoft Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.- Build and optimize ETL/ELT workflows for structured and unstructured data processing across multiple business systems.- Develop high-performance data transformation logic using SQL, Python, and PySpark to support analytics and reporting requirements.- Implement and manage large-scale data ingestion frameworks from various sources including APIs, databases, flat files, and cloud platforms.- Work extensively with relational databases (RDBMS) to design schemas, write optimized queries, and improve database performance.- Create scalable and reusable data models for enterprise data warehousing and business intelligence solutions.- Monitor, troubleshoot, and enhance existing Azure-based data engineering solutions to ensure reliability, scalability, and performance.- Collaborate with business stakeholders, data analysts, architects, and cross-functional teams to gather requirements and deliver data-driven solutions.- Ensure data quality, governance, security, and compliance standards are maintained across all data platforms.- Automate data workflows and deployment processes using CI/CD and DevOps best practices within Azure environments.- Optimize PySpark jobs and distributed processing workloads for handling large datasets efficiently.- Support cloud migration and modernization initiatives involving on-premise to Azure data platform transitions.- Prepare technical documentation, data flow diagrams, and operational runbooks for developed solutions.- Mentor junior engineers and contribute to best practices in data engineering and cloud data architecture. (ref:hirist.tech)