serving-llms-vllm 91/100

vLLM: high-throughput LLM serving, OpenAI API, quantization.

no risky patterns detected

Type: Agent skill (SKILL.md) · Category: LLM & Model APIs · Source: https://github.com/dabit3/sonic-agent/tree/HEAD/skills/mlops/inference/vllm

Score breakdown

Why this score

• Docs include setup/install commands (one-time setup, not penalised)
• Instructions only: no bundled scripts
• Last updated 2 days ago +15
• 0 GitHub stars +1
• 513 contributors +5
• License: MIT +5
• Description and source link present +15

Always review files before installing. How scores work. Request a correction