Lead Pyspark Developer
Luxoft
Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market abuse. The Bank met its commitment to FCA (Financial Conduct Authority, FCA) to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017. Following that, subsequent projects were initiated to further enhance, expand and complement the current coverage of the automated surveillance platform. This project will focus on Alerts enhancements, Strategic data sourcing from FM order and trade lakes, UI / workflow enhancements to meet regulatory obligations (i.e. Market Abuse Regulation, Dodd Frank). This also includes Control Room & Suitability Monitoring related data, UI and scenario enhancements.
Responsibilities
Develop software applications based on business requirements
Maintain software applications and make enhancements according to project specifications
Participate in requirement analysis, design, development, testing, and implementation activities
Propose new techniques and technologies for software development.
Perform unit testing and user acceptance testing to evaluate application functionality
Ensure to complete the assigned development tasks within the deadlines
Work in compliance with coding standards and best practices
Provide assistance to Junior Developers when needed.
Perform code reviews and recommend improvements.
Review business requirements and recommend changes to develop reliable applications.
Develop coding documentation and other technical specifications for assigned projects.
Act as primary contact for development queries and concerns.
Analyze and resolve development issues accurately.
Skills
Must have
10+ years of experience in data intensive Pyspark development
Must have experience in leading a Development Team
Proven experience as a Core Python developer
Good understanding of Gen AI
Experience developing Classes, OOPS, exception handling, parallel processing
Strong knowledge of DB connectivity, data loading , transformation, calculation
Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
Lambda Functions, Decorators
Vector operations on Pandas dataframes /series
Application of applymap, apply, map functions
Concurrency and error handling data pipeline batch of size [1-10 gb]
Ability to understand business requirements and translate them into technical requirements
Ability to design architecture of data pipeline for concurrent data processing
Familiar with creating/designing RESTful services and APIs
Familiar with application unit tests
Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services
Debugging application
Nice to have
Knowledge of web backend technology
Django, Python, PostgreSQL.
Apache Airflow
Atlassian Jira
Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Other
Languages
English: C2 Proficient
Seniority
Lead
- We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team. Responsibilities Develop software applications based on business requirements Maintain software applications and...Suggested
- Role Overview : As a PySpark Developer, you will be at the forefront of building scalable data pipelines that transform raw information into actionable business intelligence. You will work closely with cross-functional teams, including data scientists, product managers, and...SuggestedHybrid work
- Role Overview :We are looking for a skilled PySpark Developer to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have strong experience in PySpark, distributed data processing, and ETL development, with the ability to build scalable...Suggested
- Job Title : PySpark DeveloperExperience : 5+ YearsLocation : Bangalore / Pune / ChennaiEmployment Type : Full-Time, PermanentIndustry :... ...Software & QAAbout the Role : We are seeking a highly skilled PySpark Developer with 5+ years of experience in building and optimizing large-...SuggestedPermanent employmentFull time
- Role Overview :As a PySpark Developer, you will serve as a critical architect within our data engineering team, responsible for designing, developing, and maintaining high-performance data pipelines that process massive datasets. You will collaborate closely with data scientists...SuggestedHybrid work
- ...transformation journey and is continuously innovating to ensure their success. Role Summary Sapiens is seeking a Lead Gen AI (Fullstack) Developer to join our growing engineering team focused on building a next-generation Generative AI platform. This is a high-ownership...
- Role : OLS Software Lead EngineerLocation : BangaloreExperience : 8 to 13 yearsAbout the Role :We are looking for a seasoned OLS Software... ...the direction of the Software Architect, leading a team of developers while hands-on contributing to design, development, and integration...
- ...Lead Developers act as the primary point of contact for our clients, ensuring that teams are successful in their delivery. In this role, you will bring a strategic mindset to projects and spend time collaborating and negotiating with clients to bring a technical vision to...Work at officeShift work
- ...Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the...
- ...Sapiens is on the lookout for a Lead Developer to become a key player in our Bangalore team. If you're a Backend developer and ready to take your career to new heights with an established, globally successful company, this role could be the perfect fit. Location: Bangalore...Work at officeRemote jobFlexible hours
- ...and advancement abound. About TRG Screen TRG Screen is the leading provider of market data and subscription management technology... ...and most respected private equity firms. The Role The Lead Developer will provide technical leadership for the Research Monitor team,...Long term contractFull timeWorldwide
- Role : Duck Creek Policy Lead DeveloperWork Location : Chennai, Bangalore, HyderabadWork Preference : HybridExperience : 5- 10 YearsJob... ...) for reporting.- Integration Engineering : Proven track record developing and managing data pipelines connecting Duck Creek Policy to...
- ...biopharma contract development and manufacturing. It also has a rapidly developing presence in highly specialised and molecular clinical diagnostic... ...20 years. Job Description POSITION TITLE: Module Lead REPORTING TO: Manager LOCATION: Bangalore POSITION &...Full timeContract work
- Perform embedded system software design and implementation for leading high-performance data networking products as a member of a highly... ...Responsibilities . Architect/Design and Develop embedded platform software for high-end networking solutions...Full time
- ...Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity... ...hear from you. Job Description The Technical Lead Developer is a practitioner-leader, someone who guides their team to deliver...Long term contractFull timeWork at officeImmediate startRemote jobWork from homeFlexible hours3 days week
- ...Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity... ...hear from you. Job Description The Technical Lead Developer is a practitioner-leader, someone who guides their team to deliver...Long term contractFull timeWork at officeImmediate startRemote jobWork from homeFlexible hours3 days week
Rs 30 - 45 lakhs p.a.
Engineering Manager / Lead Developer - StackPro Technologies CTC : 30L - 45 LPA - No equityAbout StackPro Technologies : StackPro Technologies is a boutique product development company based in Bangalore, focused on building high-quality, scalable software products for startups...Flexible hours- Role Overview:As a Lead Python Developer, you will spearhead the design, development, and maintenance of high-performance backend systems that serve as the backbone of our digital infrastructure. You will work in close collaboration with cross-functional product managers, frontend...Hybrid work
- Were Hiring : Lead SAP MDK DeveloperLocation : Bangalore | Hyderabad | Kochi | Kolkata | Noida | Pune | TrivandrumWork Type : HybridSalary... ...: 7+ YearsWe are looking for an experienced Lead SAP MDK Developer to join a leading global technology and digital transformation organization...
- Role : Lead Full stack DeveloperRelevant experience : 9+ yearsLocation : Bangalore/CoimbatoreWork mode : WFONotice period : Max 30 daysAbout... ...expectations from start to finish - architecting, designing, developing, hosting, deploying, maintaining, and supporting our clients...Full time
- Job Title : Lead Full Stack DeveloperPosition type : Full TimeWork Location : BangaloreWorking style : HybridShift Time : 12PM to 9PMPeople... ...and clients succeed.What will your day look like :- Design and develop end-to-end web applications using Angular (front end) and .NET...Full time
- ...backbone that allows businesses to scale their operations and derive actionable insights from massive datasets.Role Overview : As a Lead Database Developer, you will serve as the primary architect for our core data platforms, overseeing the design, optimization, and maintenance of...Long term contractHybrid work
- ...Working with other D365 developers (including lead developer and junior developer), you will develop D365 changes in X++ to help drive value to the business. You will also need to use your experience to advise on the technical design of any changes alongside the functional...
- ...JIRA Nice to have Exposure to microservices architecture Other Languages English: B2 Upper Intermediate Seniority Lead...
- ...candidates will go through a fast-track interview process with closure targeted within a week.Position Details : Job Title : Lead Backend Developer Event Driven Logistics ServicesPosition : Lead AnalystExperience : 10 to 12 YearsOpen Positions : 7Category : Software Development...Full time
- ...tools to the software life cycle phases. • Low-level device driver development expertise. • Experience with TI microcontrollers • Lead a team of software engineers in Design and Verification • Consistently estimate effort and specify schedules for software development...Permanent employment
- ...presence with offices in China, India, Europe, and North America. Position Overview: We are seeking an experienced Dynamics CRM Lead Developer to join our team and drive the development, customization, and optimization of our Microsoft Dynamics 365 CRM solutions. This role...
- We are seeking a an experienced Salesforce Senior Lead, particularity in Salesforce CPQ to drive the design, development, and delivery... ...with leadership responsibilities, including managing a team of developers, collaborating with stakeholders, and ensuring best practices across...Full timeShift work
- Sr Java Full Stack Lead Developer :Experience : 7+ Years.Location : Hyderabad, Bangalore, NCR (Hybrid).Notice Period : 30 Days.Job Summary :We are seeking a highly skilled Senior Full Stack Developer with strong hands-on experience in Java, Spring Boot, Microservices, Angular...Hybrid work
- ...Job Overview: The Lead Salesforce Developer within the BTT (Business Technology and Transformation) team will collaborate with other developers, architects, admins, QA and release and Engineering managers to deliver new innovative solutions on the Salesforce platform. Toast...Hybrid workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Pyspark Developer. Be the first to apply!
