Data Engineer - ETL Pipeline

Job Description : Designation : Data Engineer (Snowflake, DBT)Location : HyderabadDepartment : Information TechnologyEmployment Type : Full TimeExperience : 3 to 5 yearsWork Model : 5 days work from office (relocation not open)About the Role : We are looking for an experienced, results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt or Matillion, and able to work effectively in a consulting setup. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making across the client's organization.Key Responsibilities : - Design and implement scalable ELT pipelines using dbt on Snowflake, following industry best practices- Build ingestion pipelines from various sources including relational databases, APIs, cloud storage, and flat files into Snowflake- Implement data modelling and transformation logic to support layered architecture (staging, intermediate, mart layers or medallion architecture)- Leverage orchestration tools (Airflow, dbt Cloud, or Azure Data Factory) to schedule and monitor data workflows- Apply dbt best practices : modular SQL development, testing, documentation, and version control- Perform performance optimizations in dbt/Snowflake through clustering, query profiling, materialization, partitioning, and efficient SQL design- Apply CI/CD and Git-based workflows for version-controlled deployments- Contribute to the internal knowledge base of dbt macros, conventions, and testing frameworks- Collaborate with data analysts, data scientists, and data architects to deliver clean, validated datasets- Participate in Agile ceremonies (sprint planning, stand-ups, retrospectives)- Support consulting engagements through clear documentation, demos, and delivery of client-ready solutionsRequired Qualifications : - 3 to 5 years in data engineering roles, with 2+ years hands-on experience in Snowflake and DBT or Matillion (Matillion-DPC highly preferred, not mandatory)- Experience building and deploying DBT models in a production environment- Expert-level SQL and strong understanding of ELT principles, ELT patterns, and data modelling (Kimball / Dimensional preferred)- Familiarity with data quality and validation techniques (dbt tests, dbt docs)- Experience with Git, CI/CD, and deployment workflows in a team setting- Familiarity with orchestrating workflows using dbt Cloud, Airflow, or Azure Data FactoryCore Competencies : 1. Data Engineering & ELT Development : - Building robust, modular data pipelines using dbt- Writing efficient SQL for transformation and performance tuning in Snowflake- Managing environments, sources, and deployment pipelines in dbt2. Cloud Data Platform Expertise : - Strong Snowflake proficiency : warehouse sizing, query profiling, data loading, performance optimization- Experience with cloud storage (Azure Data Lake, AWS S3, or GCS) for ingestion and external stages3. Technical Toolset : - Python : for data transformation, notebook development, automation- SQL : strong grasp for querying and performance tuning4. Best Practices & Standards : - Knowledge of modern data architecture, including layered architecture (staging - intermediate - marts, Matillion architecture)- Familiarity with data quality, unit testing (dbt tests), and documentation (dbt docs)5. Security & Governance : - Understanding of access control within Snowflake (RBAC), role hierarchies, secure data handling- Familiarity with data privacy policies (GDPR basics), encryption at rest/in transit6. Deployment & Monitoring : - Version control using Git, CI/CD practices in a data context- Monitoring and logging of pipeline executions, alerting on failures7. Soft Skills : - Ability to present solutions and handle client demos and discussions- Work closely with onshore and offshore teams of analysts, data scientists, architects- Clear documentation of pipelines and transformations- Basic Agile/Scrum familiarity; comfort with ambiguity and a fast-changing client environmentMandatory / Most Preferred Skill Set : - Must have experience in Snowflake- Must have experience in DBT or Matillion (Matillion-DPC highly preferred)- Must have experience in SSIS- Other mandatory skills listed : Azure Cloud, Data Factory, Databricks, Data Warehousing, SQL, ETL/ELT, Cloud Storage. Additional : Kimball, Dimensional modelling.Education : - Bachelor's or master's degree in Computer Science, Data Engineering, or a related field. Certifications such as Snowflake SnowPro or dbt Certified Developer are a plus. (ref:hirist.tech)