Data Engineering - AWS/Spark/Python

Job Description :This is a senior-level engineering role where the candidate would be a part of the Data Engineering team distributed in the US and India. They are expected to provide technical leadership, be fully hands-on, and lead by example. They are expected to architect complete end-to-end solutions/data pipelines; data ingestion, ETL, reporting, and APIs.You Will :- Work with various Big Data technologies on AWS.- Deploy data pipelines in production based on CI/CD practices using Docker and Airflow- Contribute to software implementation specs, test plans, participate actively in code reviews and adhere to very high-quality coding practices with good test coverage.- Mentor and lead other data engineers.You have :- B.Tech./B.E./M.Tech./MCA or equivalent, in computer science or relevant area- 6+ years of computer systems design/software architecture experience- 6+ years of Java/Scala and/or Python programming with good CS fundamentals- 6+ years of Big Data development experience with Hadoop/Spark and writing ETLs- 6+ years' experience of SQL, RDBMS and/or NoSQL database technologies- AWS experience preferred or any other public cloud- A big plus and way to standout - Experience building Machine Learning pipelines, MLOps, knowledge of fundamental ML/statistical models (ref:hirist.tech)