Back to all opportunities
Discovered 2mo ago
Merit Group - Technical Lead - Web Scraping & Data Engineering
Merit Data and Technology•Hirist
LocationAnywhere in India/Multiple Locations
Work Moderemote
Experience10+ yrs
CompensationNot disclosed
Explore Related Opportunities & Hubs
Required Skills & Technology Stack
ScrapyWeb ScrapingData EngineeringWeb CrawlingPuppeteerData PipelineAirflowData ModelingAWSSnowflake DBCI/CDavroPrometheusSparkaws gluecloudformationcloudflarePythonPySparkDockerecsGCPMongoDBGraphQLapache flinkopentelemetryceleryKafkaDynamoDBJenkinsSQLdevopsjsondatadogiamPostgreSQLeksGitLab CIDesign PatternsvaultdbtprefectTerraformdataflowCSSgkegRPCAzureopensearchCassandraSnowflakeKubernetesAWS S3pulumiAzure Data FactoryNoSQLElasticsearchSeleniumRedshiftRedisNLPPlaywrightemrrabbitmqGrafanaJavaScripttlspub/subDatabricksdagsterdelta lakeapacheaksGitHub ActionsNode.jsbigquerysqsLLMMySQLserverlesshttp
About the Role
Experience :
12 - 18 Years
Location :
PAN INDIA
Work Mode :
Permanent Remote
Job Type :
Full Time Employment
Notice :
Immediate Joiners
Job Description :
Primary (70%) : Web scraping architecture anti-bot, distributed crawling, proxy/CAPTCHA strategy, compliance.
Secondary (30%) : Data engineering pipelines, lakehouse, orchestration, dbt.
Mandatory ownership of the technical solution and effort…
This role in context
Apache Airflow is one of the skills this role asks for. It appears in 2,833 active tech jobs in India (2.4% of those we track). This posting asks for 10+ years. 16% of Apache Airflow jobs that state experience ask for 9+ years. 11% of Apache Airflow jobs are remote; this one is remote.
Based on active listings from the last 30 days. See the full Apache Airflow job data →
Related Tech Roles in India
Hirist 2mo ago
Merit Group - Solution Architect - Web Scraping & Data Engineering
Merit Data and Technology
Anywhere in India/Multiple Locations, Remote·remote·9+ yrs exp
Web ScrapingSolution ArchitectTechnical ArchitectData Engineering+78
CTCNot disclosed