Wissen Technology - GCP Data Engineer

We are looking for a GCP Data Engineer with 6-8 years of experience to design, build, and scale our enterprise data infrastructure. In this role, you will lead the development of robust data pipelines, optimize large-scale analytical storage, and leverage modern AI-assisted engineering practices to drive efficiency. You will play a pivotal role in ensuring our data ecosystem on Google Cloud Platform is secure, highly performant, and resilient.Key Responsibilities : - Design, build, and automate robust data pipeline and transformation logic using Python.- Author, schedule, and manage complex workflows in Cloud Composer (Apache Airflow), implementing strict dependency management, SLA alerting, and retry logic.- Develop large-scale analytical queries and optimize storage performance in BigQuery utilizing partitioning, clustering, and materialized views.- Process high-volume batch data and incremental updates using Dataproc (Apache Spark) and Delta Lake merge operations.- Integrate data from external vendors by consuming REST APIs and building seamless service-layer integrations.- Apply DevOps and Git workflows to enforce pipeline-as-code practices, clean branching strategies, and rigorous code reviews.- Leverage AI-assisted development tools to accelerate code generation, optimize development velocity, and maintain high standards of productivity.Technical Skills & Qualifications : - 6-8 years of professional experience in data engineering.- Proficiency in Python programming for data pipeline development, transformation logic, and automation scripts.- Strong hands-on experience in SQL and Google BigQuery, focusing on partitioning, clustering, materialized views, and time-series query patterns at scale.- Hands-on experience building and scheduling pipelines using Cloud Composer (Apache Airflow), including DAG authoring and operational management.- Working knowledge of Dataproc (Apache Spark) for batch ingestion, Delta Lake merge operations, and incremental data processing.- Proficiency in AI-assisted development tools such as GitHub Copilot, Cursor, or similar tools for accelerating code generation.- Strong code versioning and collaboration skills using Git, including branching strategies and pull request workflows.- Familiarity with consuming external data vendor REST APIs and building service-layer integrations.- Practical familiarity with core GCP technologies, including Cloud Storage, Pub/Sub, Datastream, Cloud Monitoring, IAM, and VPC Service Controls. (ref:hirist.tech)