Stateful streaming transformer inference methodology with persistent KV cache, Flash Queries prefetching, and multi-tenant continuous-batching for efficient streaming workloads.
no risky patterns detected
Type: Agent skill (SKILL.md) · Category: LLM & Model APIs · Source: https://github.com/hiyenwong/ai_collection/tree/HEAD/collection/skills/ai-ml/sta
| Capabilities (fewer powerful permissions = higher) | 50/50 |
| Maintenance | 21/35 |
| Documentation | 15/15 |
Always review files before installing. How scores work. Request a correction