Data Engineer - Scala
Capco
Job Title: Senior Data Engineer - Scala
Job Description:
The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
Responsibilities:
- Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline.
- Ensure systems meet business requirements and industry practices.
- Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
- Research opportunities for data acquisition and new uses for existing data.
- Develop data set processes for data modeling, mining and production.
- Integrate new data management technologies and software engineering tools into existing structures.
- Create custom software components and analytics applications.
- Install and update disaster recovery procedures.
- Collaborate with data architects, modelers, and IT team members on project goals.
- Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.
Qualifications:
- Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
- Proven 5-8 years of experience as a Senior Data Engineer or similar role.
- Experience with big data tools: Python, Hadoop, Spark, Pyspark & Scala
- Expert level SQL skills for data manipulation (DML) and validation (DB2).
- Experience with data pipeline and workflow management tools.
- Experience with object-oriented/object function scripting languages: Python, Java, Go lang etc.
- Strong problem solving and analytical skills.
- Excellent verbal communication skills.
- Good interpersonal skills.
- Ability to provide technical leadership for the team.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Engineer - Scala in Bangalore vacancy
- ...Skills : Scala + Big Data + GCP Looking for a strong Data Engineer with experience in Scala, Big Data, and GCP to build scalable data pipelines and processing systems. Hands-on expertise in Scala (OOP/FP concepts), Spark (Core/SQL), Hadoop, and MapReduce is required...SuggestedFull time
- Role Overview :As a Data Engineer at Rayosys, you will be responsible for designing, building, and maintaining the data infrastructure that... ...expertise in designing complex data architectures using Python, Scala, and advanced SQL for high-performance data processing.- Proven...Suggested
- Job Description :We are looking for a Data Engineer with strong hands-on experience in building scalable data pipelines and distributed data processing systems using PySpark and Scala. The role involves working on large datasets, developing ETL/ELT workflows, and optimizing...Suggested
- Job Summary :We are looking for a Data Engineer with strong experience in Scala, Hadoop, and Data Structures. You will build data pipelines, work with big data technologies, migrate data from on-premises systems to the cloud, and support real-time data processing. You will...Suggested
- Job Title : AWS Spark Scala Data EngineerJob Summary : We are seeking a highly skilled AWS Spark Scala Data Engineer to design, develop, and optimize scalable data processing solutions on AWS. The ideal candidate will have strong expertise in Scala, Apache Spark, AWS cloud services...SuggestedFull timeImmediate start
- ...We’re Hiring: Spark-Scala Developer (Big Data Engineer) Location: Bangalore (Day 1 Onsite) ⏳ Notice Period: Immediate to 2–3 Weeks Experience: 5+ Years ❗ Note: Candidates with only PySpark experience will not be considered Share your profiles: ****@*****.***...Immediate start
- ...help to build a better working world. Scala Developer (Senior) EY’s GDS Tax Technology... ...knowledge and outstanding database, data analytics and programming skills. Ever... ...agile methodologies. Degree in software engineering, computer science or similar. Good communication...Full time
- ...address complex problems.- 8+ years exp on ML/Python (predictive modelling).- Design, implement, test, deploy and maintain innovative data and machine learning solutions to accelerate our business.- Create experiments and prototype implementations of new learning algorithms...
- Job Description : Senior Data Scientist & Machine Learning EngineerRole Overview : We are seeking a highly experienced, versatile Senior Data Scientist & Machine Learning Engineer to bridge the gap between advanced data science, full-stack software engineering, and production...
- ...customers from what’s now to what’s next by unlocking the value of their data and applications to solve their challenges, achieving outcomes... ...good, we’d love to hear from you. Job Description – Data Engineer About the Role We are looking for a candidate who is passionate...Flexible hours
- ...us a competitive advantage. MAKE AN IMPACT Job Title: Data Engineer Position: Data Engineer Location: (Pune & Bengaluru preferred... ..., and optimize large-scale data processing applications using Scala, Apache Spark, and Java . Build and maintain high-...Hybrid workWork at officeLocal area
- ...Role Overview We are looking for a Data Engineer to support and enhance the CS-AT platform, which processes large-scale machine log data (15–20 years) to enable predictive and proactive maintenance solutions. The role involves building and optimizing data pipelines, log...
- ...Job Title: Senior Data Engineer (5+ Years Experience) Location: Bangalore/Hyderabad/Gurgaon/Indore/Raipur Experience: 5+ Years Employment Type: Full-time Job Summary: We are looking for a highly skilled Data Engineer with 5+ years of experience in building...Full time
- Job Details : - Job Title : Senior Data Engineer - Microsoft Fabric- Experience : 8+ Years- Location : Bengaluru- Employment Type : Full-TimeJob Summary : - We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Azure Data Factory (ADF...Full time
- Senior Software Engineer -Data Engineer Position Description Founded in 1976, CGI is among the largest independent IT and business consulting... ...role Must Have Skills: . Strong proficiency in Python or Scala and advanced SQL (complex joins, window functions, optimization...Full timeLocal areaShift work
- ...platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly... ...industry. This role goes beyond traditional data engineering and offers the opportunity to shape the... .... Proficiency in Python and/or Scala for data engineering applications. Experience...
- Job Title : Data Engineer (DBT & Snowflake)Experience : 7-12 YearsLocation : BangaloreEmployment Type : Full-timeJob Description : We are looking for an experienced Data Engineer with strong expertise in DBT, Snowflake, SQL, and Python to build and optimize scalable data pipelines...Full time
- ...hands-on experience in at least one of the following areas : - Workday Architecture- Workday Integrations- Workday ReportingRole : Data Engineer IILocation : BengaluruWhat youll do : Were MiQ, a global programmatic media partner for marketers and agencies. Our people are at...Hybrid workWork at officeAfternoon shift
- ...uncover, take action, and rapidly recover from cyberattacks – keeping data safe and businesses resilient. The company’s unique AI-powered... ..., improve governance, and do more with data. Data Protection Engineer The Opportunity We have an outstanding opportunity for a...Remote job
- ...perspectives, turn inputs into actions, and uphold trust through integrity. Skills and Competencies ~6–9 years of experience in data engineering with a strong focus on scalable data platforms ~ Strong proficiency in Python including pandas, SQLAlchemy, and PySpark ~...
- ...product team responsible for developing and delivering Snowflake data models. What you will do Design and implement robust,... ...Systems, or related field. ~5-7 years of experience in data engineering, with at least 3 years working with Snowflake. ~ Strong...Full timeLocal areaRelocation
- ...authentic selves. About the Job We are building a Customer Data Platform (CDP) designed to unlock the full potential of customer... ...personalization, and engagement. As a key member of the data engineering team, you will architect and implement the pipelines, storage...Full timeWorldwide
- ...around the world while gaining meaningful experience across a variety of disciplines. About the team The mission of Roku’s Data Engineering team is to develop a world-class big data platform that empowers both internal and external partners to leverage data and drive...Hybrid workWork at officeLocal areaRemote jobWorldwideMonday to ThursdayFlexible hours
Rs 40 - Rs 45 per hour
...Responsibility Key Responsibilities: Building and optimizing big data pipelines, architectures, and datasets to handle large-scale data.... ...& Workflow: Airflow, EMR, Glue, Athena Programming: Java, Scala, Python Cloud & Storage: AWS Databases: SQL, NoSQL (ScyllaDB...- ...back our most valuable asset, time. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping both... .... Our Stack Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited) Datastores: MySQL, PostgreSQL,...Local areaAfternoon shift
- ...JOB TITLE Reference Data Engineer A Career with point72’s Cubist TEAM Cubist Systematic Strategies, an affiliate of Point72, deploys systematic, computer-driven trading strategies across multiple liquid asset classes, including equities, futures and foreign exchange...Long term contract
- ...What You'll Do: Design, build, and maintain robust, scalable data pipelines and infrastructure Develop ETL/ELT processes to collect... ..., Spark) Document systems and contribute to internal data engineering standards and playbooks What We're Looking For: ~3+ years of...Flexible hours
- Responsibilities :- Develop, maintain, and optimize data pipelines and workflows and Feature Store to ensure seamless data ingestion... ...data solution.- Design, develop, implement, and architect Data Engineering pipelines, considering performance & scalability including data...
- ...have opportunity to work with a great technology team, diverse across globe. What you will do: Workplace Options (WPO) seeks a Data Engineer to design, develop, and maintain scalable data pipelines and platforms that deliver high‑quality data for analytics, reporting,...WorldwideFlexible hours
- ...and non-human access to all of an organization's applications, data, and business processes. Customers trust Saviynt to safeguard... ...information, please visit . We are seeking a motivated Sr. Data Engineer with 5-8 years of experience in snowflake to join our growing...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Scala. Be the first to apply!
