Skip to content
Diagnosis · Data

ai-llm-inference

LLM inference patterns for latency, batching, caching, quantization, routing, and serving stacks.

Sorting a stream of records into a picture

Works with
ClaudeChatGPTGeminiClaude CodeCodexCursorCopilotGemini CLI
Setup
One command
Best in a coding tool, where its scripts can run.
Contains
Instructions + 1 script
Python.
Maintained
Last change 23 Sept 2026
On the repository’s main branch.

What it does

Operational guidance for choosing and tuning modern inference stacks. Focus on runtime fit, routing, output guarantees, adapter loading, multimodal serving, and measured performance under load.

When your AI uses it

Use when optimizing throughput, tail latency, or serving cost

You don’t need to name it. Ask for the job in your own words — your AI loads the skill when the request matches.

What it can touch

  • Includes 1 script

    Your AI can run these when the skill is used — on your computer in a coding tool (which asks first unless you have told it not to), or in the AI’s own sandbox in Claude and ChatGPT.

    How we know

    Found in the skill’s folder: scripts/latency_benchmark.py.

  • Its code sends data over the internet

    A script in it uploads or posts data. That is normal for a skill that talks to a service — check that the address is the service you expect.

    How we know

    references/profiling-and-capacity-planning.md line 144: “async with session.post(url, json=payload) as response:”. Read 2026-10-05, commit 8dc5de4.

    references/profiling-and-capacity-planning.md, line 144 ↗
  • No known risk pattern found

    Launch7’s automated check read all 42 text files in this skill and matched none of its risk patterns. This is not a guarantee: a check like this can miss new or disguised tricks, and the author can change the files after the check.

    How we know

    Read 2026-10-05, commit 8dc5de4 by pipeline/trust/analyze.py — 40+ patterns for hidden text, prompt injection, downloads that run, credential access and more. It reads; it never runs the skill.

  • Recently maintained

    Its repository has had changes recently.

    How we know

    Last push to vasilyu1983/AI-Agents-public: 2026-09-23 (12 days before the scan).

Read automatically from the skill’s own files on GitHub on 5 Oct 2026. Launch7 does not run or manually review skills: this lists what the check saw, and nothing here means “safe”. How we check

Add it to your AI

Partly. Upload it in Claude’s settings — the instructions work; the scripts need the full folder.

  1. Built in your browser from the SKILL.md on GitHub — nothing passes through Launch7.

  2. In Claude, open Customize → Skills, press +, then Create skill → Upload a skill, and choose the .zip.

  3. Make sure code execution is switched on (Settings → Capabilities). Skills need it.

  4. Start a new chat and ask for the job in your own words — Claude picks the skill up when it fits.

This skill ships 1 script beside its instructions. The download here is the SKILL.md alone — enough for the instructions, not for the parts that run code. Use the command route, or take the full folder from the repository.

How Claude does this: support.claude.com · checked 28 Sep 2026 · “Supported” means documented by the vendor; Launch7 has not run it end to end

More from vasilyu1983

All from this publisher →
  • agents-skills

    Creates and audits agent skills with SKILL.md, references, scripts, and platform-scoped metadata.

    vasilyu1983Includes 7 scripts
  • ai-agents

    AI agent architecture, graph and loop composition, protocol choice, evaluation, and observability.

    vasilyu1983Includes 5 scripts
  • ai-coding-agents

    Creates coding agents on Claude Code, Codex, and Agent SDK.

    vasilyu1983Review before installing
  • ai-ml-timeseries

    Time-series forecasting with temporal validation, panel models, probabilistic forecasts, and TS foundation models.

    vasilyu1983Includes 1 script
  • ai-mlops

    Operates production MLOps for ML, LLM, and agent systems.

    vasilyu1983Review before installing