vllm-plugins

Here are 4 public repositories matching this topic...

Prefix-Aware Attention for LLM Decoding

kernel attention llm llm-inference vllm-plugins prefix-aware

A curated list of plugins built on top of vLLM

plugins vllm vllm-operator vllm-serve vllm-integration vllm-plugins

vLLM Plugins for additional features like decoding strategies, monitoring, models etc

vllm vllm-plugins

A manager to load vllm plugins without rebuilding image for each new plugin.

vllm vllm-plugins

Add a description, image, and links to the vllm-plugins topic page so that developers can more easily learn about it.

To associate your repository with the vllm-plugins topic, visit your repo's landing page and select "manage topics."