Senior Software Engineering Lead - Python/Golang

Role Overview:The role requires a strong technical leader who can drive architecture and engineering decisions while remaining hands-on with critical components of the platform. You will work closely with product, engineering, data, and infrastructure teams to design and deliver high-performance systems capable of processing large volumes of data.Key Responsibilities:- Lead the architecture, design, development, and delivery of scalable backend and data-intensive applications.- Design and build robust data ingestion frameworks capable of processing high-volume, high-velocity, and heterogeneous data from multiple sources.- Develop reliable and scalable data pipelines for batch and real-time data processing.- Build backend services and data-processing components using Python and Golang.- Design APIs, microservices, and distributed services that support data ingestion and processing workflows.- Design mechanisms for data validation, transformation, enrichment, deduplication, and error handling within ingestion pipelines.- Work on real-time and near-real-time data processing using event-driven architectures and streaming technologies.- Design fault-tolerant and highly available data processing systems with appropriate retry, recovery, checkpointing, and monitoring mechanisms.- Optimize existing data pipelines and backend services for performance, scalability, reliability, and cost efficiency.- Establish engineering best practices around code quality, testing, documentation, deployment, observability, and production readiness.- Lead technical discussions, architecture reviews, design reviews, and code reviews.- Mentor senior engineers and technical teams while establishing strong engineering standards.- Collaborate with Product, Data Engineering, DevOps, SRE, and other technology teams to deliver end-to-end solutions.Technical Skills:- Strong hands-on programming experience in Python and/or Golang.- Extensive experience in backend software development and distributed systems.- Strong understanding of data ingestion architectures and large-scale data pipelines.- Experience designing batch and real-time data processing pipelines.- Strong experience with relational and NoSQL databases, SQL, and database performance optimization.- Hands-on experience with messaging and streaming technologies such as Kafka.- Strong understanding of containerization, CI/CD, monitoring, logging, and production deployment practices.System Design & Architecture:- Strong expertise in designing distributed, highly available, and scalable systems.- Ability to translate business requirements into scalable technical architectures.- Strong understanding of horizontal scaling, caching, partitioning, replication, load balancing, and fault tolerance.Leadership & Collaboration:- Lead a team of experienced software engineers and provide technical mentorship.- Drive engineering excellence and promote clean, maintainable, and scalable code.- Define technical standards and development practices across engineering teams.- Partner with engineering leadership to define technical roadmaps and modernization initiatives.Qualifications:- 15 to 20 years of overall software engineering experience.- Proven experience building large-scale backend systems and data platforms.- Strong background in data ingestion, data pipelines, distributed systems, and scalable architectures.- Experience leading technical teams and complex engineering initiatives.- Excellent communication and stakeholder-management abilities. (ref:hirist.tech)