Discovered 2d ago

Pyspark Engineer

Citi•Linkedin

Apply via Jobspiq

LocationChennai, Tamil Nadu, India

Work Modeonsite

Experience4+ yrs

CompensationNot disclosed

Explore Related Opportunities & Hubs

Python Developer Jobs →Tech Jobs in Chennai →CI/CD jobs →REST APIs jobs →Apache Kafka jobs →Scala jobs →DevOps jobs →Browse All Tech Jobs →Python Developer in Chennai →

Required Skills & Technology Stack

CI/CDREST APIKafkascaladevopshadoopdistributed systemscloudwatchmlflowdelta lakeOracleGCPkinesispytestGitHub ActionsglueSparkprefectAirflowTerraformavroGitbigqueryapacheSnowflakeamazon redshiftquery optimizationSQLLinuxPySparkKubernetesvaultGitLab CIAWSJenkinsRedshiftdata lakedagsterdata scienceJavaPythonluigiPrometheuscloudformationGrafanaemrDatabricksAzureAWS S3

About the Role

We are seeking an experienced and results-driven PySpark / Big Data Engineer to design, develop, and maintain large-scale batch and real-time data pipelines. In this role, you will be responsible for transforming complex raw data into actionable analytical data models, optimizing distributed computing workloads, and ensuring data integrity, scalability, and security across enterprise data…

This role in context

CI/CD is one of the skills this role asks for. It appears in 29,504 active tech jobs in India (25.2% of those we track). This posting asks for 4+ years. 25% of CI/CD jobs that state experience ask for 2–4 years. Chennai accounts for 9% of CI/CD jobs. 12% of CI/CD jobs are remote; this one is onsite.

Based on active listings from the last 30 days. See the full CI/CD job data →