Sr Data Engineer Job Description Template
Our company is looking for a Sr Data Engineer to join our team.
Responsibilities:
- Establish DataOps best practices and processes;
- Work with geographically distributed teams while maintaining highest standards in collaboration and communication;
- Serve as technical expert and mentor for core technologies in AWS/Azure data stacks;
- Assemble large, complex data sets that meet functional / non-functional business requirements;
- Support on-boarding new customers with your expertise in organizational or data-intensive tasks;
- A good team player who has to work together with our machine learning experts, engineers and project managers to advance our data science products;
- You will work cross-functionally with various teams, creating solutions that deal with large volumes of data;
- Identify, document and promote best practices;
- Work in an agile team with emphasis on quality, testability, and automation;
- Product vision: a customer-centric mindset and the capacity to ruthlessly prioritize the development of new features;
- You will be a keen advocate of quality and continuous improvement;
- Design and develop data-intensive distributed systems in Python with a focus on data engineering;
- You will constantly evolve data models & schema design of our data warehouse to support our business self-service needs;
- Design, implement and build pipelines that deliver data with measurable quality under the SLA;
- Own and document data pipelines and data lineage.
Requirements:
- Assemble large, complex data sets that meet functional / non-functional business requirements,
- Demonstrated experience in designing and developing reusable code frameworks, libraries, and components;
- Serve as technical expert and mentor for core technologies in AWS/Azure data stacks;
- Strong object-oriented programming experience in Java, Python, Ruby or similar;
- 3+ years of experience in creating reports and dashboards in Tableau/PowerBI or similar frameworks;
- 2+ years of experience in working with marketing data engineering in an enterprise;
- Contributes to project success by providing technical leadership on assigned projects;
- Completes all administration in a timely and quality manner;
- Understands interrelationships and impacts of systems and applications upon the Target technical environment;
- Writes technical architecture and solutions;
- Passionate about various technologies including but not limited to SQL/No SQL/MPP databases etc;
- BS degree in Computer Science or Engineering discipline;
- Translates technical solutions based on client s needs and feasibility;
- Ability to work on multiple areas like Data pipeline ETL, Data modeling & design, writing complex SQL queries etc;
- Proficiency in Airflow is a big plus.