Senior GenAI Governance Engineer (Kubernetes, API ...

Senior GenAI Governance Engineer (Kubernetes, API Security)Our banking client is investing heavily in enterprise-scale Generative AI and is seeking a Senior GenAI Governance Engineer to lead the security, governance, and operational reliability of mission-critical AI platforms. This is a highly technical role focused on AI runtime governance, inference security, and large-scale LLM platform operations.What You'll DoOwn and enhance enterprise AI security guardrails across GenAI platforms.Design and manage secure inference flows from API gateway through Model Armor to runtime telemetry and observability platforms.Lead advanced API lifecycle tracing, troubleshooting rate limiting, token throughput, gateway bottlenecks, and GPU saturation issues.Drive AI observability and runtime monitoring using Arize AI and enterprise telemetry tooling.Support distributed inference operations, token queueing, and complex upstream/downstream API traffic flows.Maintain and optimize Kubernetes platforms, Terraform deployments, and cloud landing zones across GCP and Azure.Ensure enterprise-safe inference, prompt filtering, and data leakage prevention in regulated environments.ExperienceStrong expertise in GenAI platform engineering and LLM runtime governance.Advanced experience with API tracing, rate limiting, and distributed inference troubleshooting.Hands-on experience with AI security tooling, particularly Model Armor.Deep knowledge of AI observability platforms including Arize AI.Strong Kubernetes, cloud networking, and infrastructure engineering experience across GCP and Azure.Proven ability to operate secure, scalable AI platforms in enterprise environments.

Created: 2026-05-14