Search Results: 2,180 vacancies
As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble... ..., dependency and workload management- Big data tools like Hadoop, Spark, Kafka, etc.- Message queuing, stream processing, and highly...
Job Description :- 4-7 years of experience in DE development.- Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)- Python programming language is mandatory.- PySpark - Excellent with SQL- Excellent with Airflow is a plus.- Good to Have Airflow- Good aptitude...
Responsibilities : - Design and implement scalable data pipelines and engineering infrastructure to support machine learning systems at scale.-... ...Azure, AWS, GCP).- 2 years of experience in Python, Databricks/Hadoop.- 2 years of experience in MLOps.Good to have :- Curiosity,...
...: Skills :- 8+ years of proven experience as a Lead in Big Data Engineering. - Mandatory Technical Proficiency - Hands-on experience with Python... ...computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark. - Proficient in Data Modelling that can...
...for reuse of data models in new environments.- Perform reverse engineering of physical data models from databases and SQL scripts.- Evaluate... ...Collibra, Alteryx and Solidatus- Experience in Data Vault Modeling.- Knowledge of Hadoop, Google Big Query is a plus. (ref:hirist.tech)
Job Description :1. Technologies should be Hive, PIG, Sqoop, Zookeeper,Cloudera - these are Hadoop Ecosystem tools2. Candidate should have worked in at least one Production project, not only understanding or theoretical knowledge3. Should have basic of Spark and Kafka -- at...
...Exciting Opportunity for the role of Data Engineer with one of the Largest Travel Domain Expert(Immediate joiners preferred) Exp:7+ Years... ...mart creation.
Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
Strong problem-solving skills and attention...
...Cloud Function.
~ Strong experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark including DevOPs.
~ Good hands on expertise... ...of GCP core services like Google cloud storage, Google compute engine, Cloud SQL, Cloud IAM.
~ Good to have knowledge on GCP services...
...experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.
~ Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.
~ Exposure to enterprise application development is a must.
Roles...
...Title: Data Engineering Analyst Location: Gurugram
Skills:-Scala, Airflow, Spark, Hive, Hadoop, Data engineering concepts
Our mission is to partner with our Machine Learning Science counterparts to use AI/ML to collaboratively transform data assets into intelligent...
...LPAExcellent Communication Skills :Skillsets : - Snowflake Data Engineer. Candidates should have hands on exp on snowflake features and all... ...- Good knowledge of data base management and SQL, Good to have- Hadoop/Spark, HIVE- Superior analytical and problem solving skills -...
...Senior Data Engineer
Join our tooling division, focused on uplifting data management, regulatory reporting, and record management capabilities... ..., Good SQL experience
~Experience and knowledge of major Hadoop distribution such as Cloudera, MapR, Hortonworks HDP would be beneficial...
...Principal Consultant, AIML Engineer - CPG050555
Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes... ...Qualifications/ Skills
• Data platforms – Big Data (Hadoop, Spark, Hive, Kafka etc.) and Data Warehouse (Teradata, Redshift...
...BigQuery.- Experience with data processing frameworks and tools (e.g., Hadoop, Spark, Apache Airflow) which includes ETL pipelines.- Strong... ..., NoSQL databases.- Collaborating with product design and engineering teams to understand product requirements- Collaborating with product...
...strategies, customer-centric experience design, and world-class product engineering.The future of business is disruptive, transformative and... ...data Wrangling, Computation, Analytics pipelines and exposure to Hadoop ecosystem components. You are also required to have hands-on...
...Job Title: Lead- Data Engineering Department: CET
Location: Corporate Office, Gurgaon
Exp Range: 8 to 10 Years
Educational Qualification... ...role.
~ Fundamentals of distributed systems like Apache Hadoop, Apache Spark.
~ Should be experienced in data structures,...
...biggest digital revolution! About the role.
Job Title: Data Engineer
Location: Gurgaon
Experience: 3 to 8 years of... ...Technologies : Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including...
...About Us:
Persistent Systems is a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and... ...: Java, Big Data, Spark, PySpark, Spark SQL, Scala, Hadoop, HDFS, YARN, Hive, GCP Cloud, Google Cloud Dataflow, Big Query,...
...Experience with version control technologies like GIT.- Excellent communication skills.Good to Have : - Some familiarity with Pyspark/Hadoop. - Some familiarity with data science concepts. - Understanding of Agile Development methodologies. - Understanding of UI frameworks such...
.... He/ She will work with different stakeholders as SME for data engineering- Engages in technical problem solving across multiple technologies... ...on model evolution- Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise).- Superior analytical and...
