Skip to content
View kumarpraveendev's full-sized avatar

Block or report kumarpraveendev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
kumarpraveendev/README.md

Praveen Kumar

Engineering leader · agentic systems · LLM inference & cost engineering · production AI

20 years in engineering leadership — the last four-plus building production generative AI at Amazon (Berlin), and a decade before that as a customer-embedded technical lead delivering for UK enterprise clients. I work on the unglamorous parts that decide whether AI products survive contact with production: cost, reliability, evaluation, and safe autonomy.

The repositories below are reference designs — distilled from production work and written as the decisions an engineering leader actually owns, not as tutorials. Each one is runnable.


Selected work

LLMInferenceRouter — cascaded multi-provider routing Try the cheapest model first; escalate only when quality demands it. This is where the unit economics of an AI product are won or lost — so it ships with a reproducible cost-vs-quality benchmark rather than an asserted number.

AgenticAI-OncallAgent — safe autonomy under pressure An on-call agent is the highest-stakes place to put autonomy: it acts during incidents, on production, where a wrong move makes a bad night worse. Built around action gating (auto / approval-required / forbidden), RAG over runbooks, and per-action evaluation.

CustomerSupportAgent — A Decision Record — the decisions, not the diagram A production-grade customer-facing support agent written as the architecture and policy decisions a Head of Engineering owns — the tradeoffs and their rationale, not a tour of the boxes.

AIAgent-eval-harness — evaluation as a first-class artifact A small, runnable test bench for tool-using agents: adversarial scenarios — a hidden instruction in a search result, a refund over the policy limit, an ambiguous request — each with explicit pass/fail invariants.

shortlink — cloud-native, hands-on A compact Node.js + Redis URL shortener deployed to Kubernetes — a small, end-to-end cloud-native deployment.


Focus areas

Agentic systems (LangGraph · MCP · tool-calling · human-in-the-loop) · LLM inference & cost engineering · RAG · evaluation & guardrails · responsible AI & the EU AI Act · AWS · production reliability / SRE

Background

At Amazon: a cascaded multi-provider inference platform adopted as an org-wide reference standard (~70% serving-cost reduction), a production LangGraph multi-agent system that removed ~50% of manual on-call effort, and a multi-tenant LLM inference platform. Earlier, nearly a decade embedded directly with UK enterprise customers at British Telecom.

Certifications

Agentic AI — DeepLearning.AI (course). NVIDIA Certified Professional: Agentic AI (NCP-AAI) and Anthropic Claude Certified Associate, Foundations — in progress.


Website · LinkedIn · praveen.git@gmail.com

Pinned Loading

  1. LLMInferenceRouter LLMInferenceRouter Public

    Cascaded multi-provider LLM routing with a reproducible cost-vs-quality benchmark — where AI unit economics are won.

    Python 1

  2. AgenticAI-OncallAgent AgenticAI-OncallAgent Public

    A gated agentic on-call assistant: safe-action gating (auto/approve/forbid), runbook RAG, per-action evaluation.

    Python 1

  3. CustomerSupportAgent-A-Decision-Record CustomerSupportAgent-A-Decision-Record Public

    A production support-agent reference design, written as the architecture and policy decisions an eng leader owns.

    Python 1

  4. shortlink shortlink Public

    Node.js + Redis URL shortener on Kubernetes — a compact, end-to-end cloud-native deployment.

    JavaScript 1