SKILL

inference-serving-vllm

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

Target: Learning & research. Automatically collected · unverified.

Use with Codex

A guide for this combination is not available yet, and compatibility has not been verified.

Requirements

Only the author’s Skill metadata is included. Read the full instructions to check dependencies, licensing and conditions of use.

Choose an AI tool with documented instructions, or save the resource and request a guide after the page loads.

Read the author’s documentation ↗