Discovered 23d ago

Lead Pyspark Developer Lambda / Pandas / Python (Chennai)

Luxoft India•Shine

Apply via Jobspiq

LocationChennai

Work Modeonsite

Experience10+ yrs

CompensationNot disclosed

Explore Related Opportunities & Hubs

Python Developer Jobs →Tech Jobs in Chennai →Apache Spark jobs →Python jobs →Generative AI jobs →Apache Airflow jobs →Django jobs →Browse All Tech Jobs →Python Developer in Chennai →

Required Skills & Technology Stack

Performance OptimizationPySparkWindow FunctionsSpark ArchitectureSaltingColumn PruningPythonGenerative AIDB ConnectivityPandasAWS LambdaNumPyJIRAUnit TestingUser Acceptance TestingSparkAirflowOOPDjangoPostgreSQLGit

About the Role

- Project Description: - Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market abuse. The Bank met its commitment to FCA (Financial Conduct Authority, FCA) to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017.…

This role in context

Apache Spark is one of the skills this role asks for. It appears in 6,344 active tech jobs in India (5.4% of those we track). This posting asks for 10+ years. 17% of Apache Spark jobs that state experience ask for 9+ years. Chennai accounts for 11% of Apache Spark jobs. 11% of Apache Spark jobs are remote; this one is onsite.

Based on active listings from the last 30 days. See the full Apache Spark job data →