Discovered 26d ago

Senior Software Engineer - AI Gateway & Agentic AI Solutions

EXL Talent Acquisition Team•Shine

Apply via Jobspiq

LocationGurugram

Work Modeonsite

Experience0+ yrs

CompensationNot disclosed

Explore Related Opportunities & Hubs

Software Engineer Jobs →Tech Jobs in Gurugram →Microsoft Azure jobs →C# jobs →RAG (Retrieval-Augmented Generation) jobs →LLMs (Large Language Models) jobs →Browse All Tech Jobs →Software Engineer in Gurugram →

Required Skills & Technology Stack

CAzureGovernanceClient engagementLLM gatewayAPI managementObservabilityAI frameworksAgentic AIPoC developmentC#RAGOpenTelemetryLLMAzure AIAzure OpenAI

About the Role

Top 5 Responsibilities Architect and implement the AI Gateway. Design and build an Azure-native LLM gateway in C# providing unified ingress across multiple model providers (Azure OpenAI, Azure AI Foundry models, and others) - covering intelligent routing, fallback/load balancing, rate limiting and token-quota enforcement, semantic caching, and centralized API key/secret management. Reference…

This role in context

Microsoft Azure is one of the skills this role asks for. It appears in 24,833 active tech jobs in India (21.2% of those we track). This posting asks for 0+ years. 5% of Microsoft Azure jobs that state experience ask for 0–1 years. Gurugram accounts for 6% of Microsoft Azure jobs. 12% of Microsoft Azure jobs are remote; this one is onsite.

Based on active listings from the last 30 days. See the full Microsoft Azure job data →