Senior GCP Data Engineer
Diligent Tec Inc
Senior Data Engineer - GCP Native Platform
Fully Remote (Pan - India)
Seeking an experienced Senior Data Engineer to design and build scalable data pipelines on Google Cloud Platform. You will implement data solutions using BigQuery Dataflow Cloud Composer and modern engineering practices while mentoring junior team members and driving technical excellence.
Build and optimize batch and streaming data pipelines usingDataflow (Apache Beam).
Implement ELT processes usingDataform(SQLX) for transformations testing and documentation.
Design and maintainBigQuerydatasets following medallion architecture (Bronze/Silver/Gold).
Data Platform Implementation
BigQuery:Optimized schemas partitioning strategies clustering materialized views and performance tuning.
Build Apache Beam pipelines inPythonand/orJavafor complex transformations.
Cloud Composer:Manage Airflow workflows with dependency management and scheduling.
Dataform:Author SQLX transformations tests and documentation.
Cloud Storage (GCS):Architect data lake structures access patterns and lifecycle policies.
Troubleshoot and optimize pipeline performance and cost.
Implement data quality checks monitoring and observability.
Support production deployments and incident resolution.
Mentor junior engineers on GCP best practices and data engineering patterns.
Collaborate with analysts data scientists and cross-functional teams to enable data consumption.
Participate in agile ceremonies and coordinate with onshore/offshore teams.
Experience
5 years of Data Engineering experience; Hands-on experience withBigQueryat enterprise scale and production pipelines.
Strong background in building production-grade batch and streaming pipelines.
Development experience inPythonand/orJava.
Proven track record of delivering complex data solutions.
BigQuery (SQL optimization scripting stored procedures partitioning).
Airflow / Cloud Composer (DAG development).
SQL and Python programming proficiency.
Git CI/CD pipelines and basic DevOps familiarity.
Dataform or dbt experience.
Data modeling and schema design.
Cloud Monitoring logging and data quality frameworks.
GCP Professional Data Engineercertification.
Experience withVertex AIfor ML pipeline integration.
Cloud Functionsfor serverless processing.
Familiarity with data governance tools (Atlan Collibra Dataplex).
Experience with legacy system migrations.
BI tools experience (Power BI Looker).
Containerization (Docker) and orchestration (Kubernetes).
Self-motivated and able to work independently in a remote environment.
Passion for data engineering continuous learning and mentoring others.
- Description : We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust...Senior
- ...We are looking for a GCP Data Engineer to design build and maintain scalable data platforms on Google Cloud. The ideal candidate will have strong experience in automated data ingestion analytics engineering and MLOps with the ability to support marketing analytics use cases...SuggestedFull timeRemote job
- ...A technology-driven company focused on delivering modern data engineering and cloud solutions. We believe in real-world problem-solving hands... ...theoretical credentials. About the Role We are looking for a GCP Data Engineer who can design build and deploy end-to-end data...SuggestedFull time
- ...JOB INFORMATION Job Title Name: Data Engineer HCA India Grade/Level: Level II... ...Build and maintain scalable data pipelines using GCP services like Dataflow Composer and Dataproc . Automate...SuggestedFull time
- ...Responsibilities: Design and implement real-time data ingestion pipelines using Pub/Sub and... ...Skills: ~5 years of experience with GCP services (Cloud Storage Pub/Sub Dataflow... ...Qualifications: GCP Professional Data Engineer certification Experience with Confluent...SuggestedFull timeRemote job
- ...Data Engineering and Infrastructure: - 6+ years of experience in a Data Engineering role, designing, building, and managing scalable and reliable data systems. - Proficient with big data and stream-processing technologies such as Spark and Kafka. - Hands-on experience...SeniorFull time
- ...About the Role We are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python,...SeniorFull time
- Description : Senior Data Protection Engineer - Enterprise Backup & RecoveryLocation : HyderabadExperience : 7 - 10 Years (strong 5 - 7 yrs profiles may be considered)Work Mode : Onsite / HybridRole Snapshot :We are hiring a Senior Data Protection Engineer to own and support...Senior
- ...~ Bachelors or Masters in Computer Science Engineering or a related field ~5 years of total experience in data engineering or similar roles ~ Proven ability to connect technical solutions with business objectives ~ Strong communication and stakeholder management...SeniorFull time
- ...Amazon and been amazed at how fast it gets to you? Every day Amazon engineers are relentlessly working to decrease the time between Click to... ...-class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated...SeniorFull timeImmediate start
- ...creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel... ...visit Job Description We’re looking for a skilled Senior Data Engineers with strong experience in distributed systems, Python/Scala,...SeniorFull time
- Job Title : Senior Software Engineer Data EngineeringExp : 8-12 yearsClient : Global Investment BankLocation : Hyderabad (Near Hitech City)Work Model... ...Experience working in cloud-based environments (AWS preferred; GCP acceptable)- Solid understanding of distributed systems,...SeniorHybrid workWork at office
- ...Our Company We’re Hitachi Vantara, the data foundation trusted by the world’s innovators. Our resilient, high-performance data infrastructure... ...Skills: Proven work experience of 5–8 years as a Data Engineer or in a related role. Proficiency in SQL, Reporting,...SeniorFlexible hours
- ...technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others... ...and experience in Data & AI, ML engineering, and solution delivery # Technical... ...Who We're Looking For We’re seeking senior Data Engineering professionals (6+ years)...SeniorContract workFlexible hours
- ...difference, come grow with us. About the Role We are hiring a Senior Data Engineer to design, build, and maintain cloud-based data pipelines... ...Azure: Databricks, PySpark, Data Lake, ADF ~ Or equivalent GCP stack: BigQuery, Dataflow, Composer, etc. ~ Proficiency in...SeniorFull time
- ...Unison Group is looking for a highly skilled and motivated Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure that facilitate data analytics and support business...SeniorFull time
- ...TSX (GIB.A) and the NYSE (GIB). Learn more at . Job Title: Senior Data Engineer Position: Senior Data Engineer Experience: 6 to 10 yrs Years... ...use cases from our on premises Data Lake to Databricks on GCP. . Collaborate with Product Management and business partners...SeniorFull timeLocal areaShift work
- ...Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to... ...patterns and debugging Java or Scala Design and Implement Data Engineering Frameworks on HDFS, Spark and EMR Implement and manage Kafka...SeniorFull time
- ...Design, develop and implement scalable batch/real time data pipelines (ETLs) to integrate data from a variety of sources into... ...3+ years Microsoft ETL experience with SSIS. ~3+ Years data engineering experience to include data analysis. ~3+ years programming SQL...SeniorHybrid work
- Description :Position Name : Senior Data Engineer Databricks.Location : Pune / Hyderabad / Bengaluru.Experience : Min 6 to 10 years.About Jade Global... ....- Hands-on experience with cloud platforms: Azure, AWS, or GCP (Azure Databricks preferred).- Experience working with...SeniorHybrid work
- ...Position: Azure Data Engineer (Offshore - Remote) Experience: 6- 8 years Engagement Type: Full-Time This role requires 6 to 8 years... ...tasks. Join Smartbridge and be part of an innovative team driving cloud data solutions ! Required Experience: Senior IC...SeniorFull timeRemote jobAfternoon shift
- Senior Software Engineer – Data Engineer Position Description Company Profile: We’re Hiring at CGI for our GCC - Right Here in Hyderabad! Join us at the intersection of technology, finance, and innovation. You will be working to support the one of the top-tier financial...SeniorFull timeShift work
- ...into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development... ...we serve. Job Description: ProArch is seeking a Senior Data Engineer with 3–5 years of experience to join our Data & Analytics practice...SeniorFull timeFlexible hours
- ...in deterministic identity and AI-powered data solutions. Leveraging our 35-year... ...Position Overview: We are seeking a Senior Data Engineer with a robust background in data engineering... ...Experience with cloud platforms (e.g. AWS Azure GCP) and containerization technologies (e.g....SeniorFull time
- Description :About the Role : A Senior Data Engineer is a mid-level professional leading the design, build, and evolution of the in-house data platforms. You lead the construction of datasets requested by various stakeholders, the build and maintenance of the resulting data...SeniorHybrid workWork at officeRemote jobWorking Monday to FridayMonday to Wednesday3 days week
- ...Postman. About the Team The Data team enables all functions... ...decisions with confidence. The Data Engineering team is responsible for... ...are looking for a passionate Senior Data Engineer to join the Data... ...operates seamlessly across AWS GCP and Azure with strong automation...SeniorLong term contractFull timeHybrid workWork at officeFlexible hours3 days week
- ...Senior Data Engineer Statistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing...SeniorContract workHybrid workFlexible hours
- Description : Join DAZN Hyderabad and help shape the future of sports streaming! Were looking for passionate Analytics Engineer with strong Data Build Tool experience.Required Skills & Experience :- 4 - 7 years of professional experience as a Analytics Engineer.- Strong SQL...Senior
- ...Were looking for a talented and driven senior NLP practitioner to contribute to... ...strategies.- Mentor and lead a team of data scientists and AI engineers, fostering a culture of innovation, collaboration... ...Experience with cloud platforms (AWS, GCP, Azure) for large-scale AI deployments...SeniorFull time
- ...Job Title: Senior ETL Developer Overview This role is centered on designing developing... ...robust ETL solutions that support our data integration and transformation needs. The... ...experience. ~8 years of experience in data engineering or ETL development. ~ Proven experience...SeniorFull timeRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GCP Data Engineer. Be the first to apply!
