Senior Data Engineer - AI & Data

Job Description : About PrimeSoft Solutions, Inc. : PrimeSoft is an outsourced product development and software services provider. We offer Product Development, Enterprise Applications, Mobile Applications, Quality Assurance and DevOps Support Services to clients from venture funded startups to publicly traded companies in Networking, Telecom, Healthcare and Banking.Designation : Senior Data EngineerExperience : 6 - 10 yearsQualification : BE/B tech, ME/M tech, Bsc, Msc.Location : Hyderabad, Bangalore and MumbaiRole Overview : As a Senior Data Engineer, you will own the end-to-end data platform, from raw data ingestion through transformation to trusted, business-ready datasets. You will be responsible for designing, building, and maintaining scalable, reliable, and high-quality data pipelines that power analytics and decision-making across the organization.Key Responsibilities : - Design, build, and maintain end-to-end data pipelines from ingestion to curated, trusted data models.- Develop scalable and maintainable data transformation layers using modern transformation frameworks.- Design and optimize data warehouse schemas and data models to support reporting and analytics.- Write highly efficient, production-grade SQL and optimize complex queries for performance.- Build, maintain, and monitor orchestration workflows, ensuring proper dependency management and data lineage.- Implement data quality, validation, monitoring, and reliability practices to ensure trusted datasets.- Make architecture and design decisions while balancing scalability, maintainability, and delivery speed.- Collaborate closely with analysts, engineers, and business stakeholders to understand requirements and translate them into robust data solutions.- Proactively identify improvements in data architecture, pipeline performance, and engineering practices.- Leverage Large Language Models (LLMs) and AI-assisted development tools to improve engineering productivity and accelerate delivery.- Build solutions that are production-ready, scalable, and resilient while maintaining high development velocity.Must-Have Technical Skills : - Expert-level proficiency in SQL, including complex query optimization, performance tuning, and advanced data modeling.- Strong expertise in data warehousing concepts, dimensional modeling, and analytical database design.- Hands-on experience with modern data transformation frameworks such as dbt and SQLMesh.- Strong understanding of workflow orchestration, DAG design, dependency management, and data lineage.- Experience designing and maintaining reliable, production-grade data pipelines.- Strong knowledge of data quality frameworks, testing, validation, and monitoring.AI & LLM Skills (Mandatory) : - Demonstrated hands-on experience using Large Language Models (LLMs) as a core part of the software development lifecycle, including prompt engineering, context engineering, RAG, vector embeddings, LLM evaluations, and hallucination mitigation. (ref:hirist.tech)