Lead Data Engineer - Google Cloud Platform
Deqode
Job Requirement :- Have Implemented and Architected solutions on Google Cloud Platform using the components of GCP- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines.- Experience in some of the following : Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.- Experience programming in Hadoop, python, SQL- Expertise in at least two of these technologies: Relational Databases, Analytical Databases, NoSQL databases.- Certified in Google Professional Data Engineer/ Solution Architect is a major AdvantageSkills Required :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- Design, develop, and deploy scalable ETL/ELT pipelines using PySpark on GCP.- Utilize GCP services extensively, including BigQuery (data warehousing), Cloud Storage, Dataproc, and Dataflow.- Optimize PySpark jobs for performance and reliability, and fine-tune BigQuery queries.- Implement complex transformations and process large volumes of structured/unstructured data using Spark SQL and PySpark- Build and manage automated workflows using Apache Airflow or Cloud Composer.- Strong proficiency in Python and SQL is essential- Proven experience with Google Cloud Platform (GCP) services.- Relevant certifications on google cloud is an added advantage. (ref:hirist.tech)
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Google Cloud Platform in Pune vacancy
- About the job :Role : DevOps Engineer GCPExperience : 6+ YearsEmployment Type : Full TimeWork Mode : HybridLocations : Hyderabad, Chennai... ...a highly skilled DevOps Engineer with strong expertise in Google Cloud Platform (GCP) to support and enhance cloud infrastructure, CI/CD...Google CloudFull timeImmediate start
- ...build, and maintain scalable data pipelines and data processing... ...extensively on GCP services for data engineering solutions- Implement and... ...scalable data solutions- Work on cloud-native and microservices-based... ...) :- Core Data Engineering- Google Cloud Platform (GCP)- Data Pipeline...Google Cloud
- Job Description:Key Responsibilities:- Design and implement scalable data architectures on Google Cloud Platform- Build and optimize high-performance data pipelines using BigQuery- Develop robust ETL/ELT frameworks and reusable components- Optimize BigQuery performance (partitioning...Google Cloud
- Job Description :The Cloud Provisioning Engineer :- Builds the various opinionated cloud environments and platforms while aligning them with business and security strategies and requirements... ...into public cloud infrastructure (AWS, Google Cloud Platform, Azure, etc.)- Experience...Google CloudFull time
- Job Title : Data Engineer (GCP)Location : Pune, Mumbai, Bangalore, Gurgaon, Panchkula, MohaliExperience : 3+ yearsNotice period : Immediate... ...passionate Data Engineer with hands-on experience working on Google Cloud Platform (GCP). The ideal candidate will have expertise in building...Google CloudImmediate start
- ...opportunity with our MNC client for an experienced GCP + Big Data Engineer.Role : GCP + Big Data EngineerExperience : 5+ YearsLocation :... ...Pacific ITKey Skills Required : Strong hands-on experience with Google Cloud Platform (GCP) services : - BigQuery- Google Cloud Storage (GCS...Google CloudContract workHybrid workWork at officeImmediate start
- Role : GCP Data EngineerRole Overview :We are seeking a talented and experienced GCP Data Engineer to join our dynamic team. In this role, you will be responsible for designing... ...scalable and reliable data pipelines on Google Cloud Platform (GCP). You will collaborate closely...Google Cloud
- ...Role : GCP Solution Architect- A Seasoned lead architect with a minimum of 12+ years experience... ...application migration & modernization to Google cloud leveraging Cloud Native architecture. -... ...of event-driven architecture, data integration, event streaming architecture,...Google CloudPermanent employmentHybrid work
- ...management through our OpenBlue Platform. By leveraging cutting-edge... ...controls. We are looking for a Staff Engineer to join our team and focus on... ...our edge computing and cloud-based systems. Job Overview... ...platforms like AWS, Azure, or Google Cloud. Knowledge of event-...Google Cloud
- ...Description THE POSITION: Reporting to the Manager, Public Cloud Platform Engineering, the Public Cloud Platform Engineer helps build and support... ...who share a passion for improving the lives of patients and leading innovation within the healthcare industry. Diversity not...Google CloudFull timeHybrid work
- ...for yourself, and a better working world for all. The opportunity Your role will be a Technology Lead or Senior Technology Lead in the Cloud Data Engineering team. You will be responsible for designing and delivering scalable data platforms across Azure and GCP for...Google CloudHybrid work
Rs 15 - 25 lakhs p.a.
...Location: Chennai, Coimbatore, Bangalore, Pune Jobtype: full-time We are looking for a highly skilled Lead Data Engineer to design, build, and optimize scalable cloud-based data platforms and processing pipelines for enterprise-grade applications. This role is ideal for...Google CloudLong term contractFull timeWeekday work- ...and strong expertise in Master Data Management (MDM) solutions,... ...particularly the Reltio Connected Data Platform. The ideal candidate will be... ..., Information Technology, Engineering, or a related field.- 6+ years... ..., Informatica Intelligent Cloud Services, MuleSoft Anypoint Platform...Google Cloud
- Description : Job Title : GCP Data EngineerLocation : Hyderabad / Bangalore / Chennai /... ...highly skilled and experienced GCP Data Engineer to join our growing data and analytics team... ...scalable data engineering solutions on Google Cloud Platform (GCP), developing robust ETL/ELT...Google CloudFull time
- ...Description :Site Reliability Engineer (SRE) to build and maintain highly... ..., reliable, and secure cloud infrastructure. The ideal candidate... ...in automation, cloud platforms, monitoring, incident management... ...- Expertise in AWS, Azure, or Google Cloud Platform (GCP).- Hands-on...Google Cloud
- We are seeking an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) technologies to join our growing data engineering team. The ideal candidate should have at least 8 years of experience in data engineering, data processing, and cloud-based data...Google Cloud
- ...We are looking for a highly skilled Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate... ...experience in creating scalable data solutions across cloud platforms. Requirements Key Responsibilities Design and...Google CloudFull timeWeekday work
- ...infrastructure and deployment models Lead implementation of Splunk... ...deployment servers Develop data onboarding strategies and... ...visualizations Integrate Splunk with cloud, SIEM, DevOps, and third-party... ...incident analysis Ensure platform availability, scalability, backup...Google CloudFull time
- Senior Software Cloud EngineerLocation : Hyderabad/Pune, HybridOur company :At Teradata,... ...built the most complete cloud analytics and data platform for AI. By delivering harmonized data,... ...Azure and/or Amazon AWS Platform and/or Google Cloud Platform.- Develop, debug code, and...Google CloudFull time
- Senior Software Engineer- GCP Data Engineer Position Description Founded in 1976, CGI is among the largest independent IT and business... ..., and optimize our next-generation data architecture on Google Cloud Platform. You will be responsible for the "heavy lifting" of...Google CloudFull timeHybrid workWork at officeLocal areaShift work
- ...Description :We are Looking for DevOps engineers who can build, test and maintain the infrastructure... ..., test, deploy frameworks on multiple cloud platforms.- Ability to learn existing... ...alerting, logging, tools for analyzing the data.- Write tools to maintain the storage needs...Long term contractTemporary work
- ...global OEM brands, our vehicle and cloud software solutions are at the... ...Staff Cloud Backend Engineer to join our cloud engineering... ...applications for automotive cloud platforms. This role requires deep expertise... ...Role and Responsibilities: Lead the design, development, and...Google CloudRemote job
- ...runbooks so support work can be automated and not depend on direct messaging.Must-Have :- 8+ years in DevOps / DevSecOps / SRE / Platform Engineering.- Strong Azure DevOps Pipelines (YAML, agents, releases).- Deploying and operating Spring Boot (Java) microservices.- Strong...
- ...and LLM-specific metrics (latency, token usage, and cost) Cloud Governance: Optimise GCP costs and manage resource quotas,... ...Relevant experience of 6+ years and above Expert-level Google Cloud Platform (GCP) administration skills: GKE, Cloud Run, Vertex AI, GCS,...Google CloudFull time
- ...to a region with no downtime. Build a cloud infrastructure that’ll be easy to move... ...Terraform. Experience with Cloud Computing platforms like Amazon AWS, Google Cloud Platform, Heroku. Experience... ...systems (Kafka, RabbitMQ) and Big data platforms (Hadoop) Good programming...Google CloudFull time
- ...Job title: Software Engineering II - Developer Productivity Location - Pune... ...engineering build tools and platforms for a variety of codebase languages... ...and logging. ~ Experience with Cloud Computing platforms like Amazon AWS, Google Cloud Platform, Heroku. ~ Experience...Google CloudFull timeHybrid work
- ...Job Title : DevOps Engineer II Location - Pune (Hybrid) About the Team:... ...to a region with no downtime. Build a cloud infrastructure that’ll be easy to move... .... Experience with cloud computing platforms like Amazon AWS, Google Cloud Platform, and Heroku. Experience...Google CloudHybrid work
- ...world. Job description - Manager – Cloud (Risk Consulting – Digital Risk) Requisition... ...and Security, this role focuses on leading engagements that assess, test, and... ...and risk controls across AWS, Azure, and Google Cloud Platform environments. The role involves working...Google CloudFull time
- ...forefront of AI and high-performance data storage innovation for over two... ..., VP, Solutions Architecture & Engineering | NVIDIADDN is the global leader in AI and multi-cloud data management at scale.Our cutting-edge data intelligence platform is designed to accelerate AI workloads...Google CloudHybrid workLocal area
- ...the world! Job Description: We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Unified Asset Inventory. This... ...a team building Qualys next generation Micro-Services based platform processing over a 100 million transactions and terabytes of...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Google Cloud Platform. Be the first to apply!
