ai/kimi-k2

Docker

Kimi K2 Thinking: open-source agent with deep reasoning, stable tool use, fast INT4, 256k context.

ai/qwq

Docker

Experimental Qwen variant—lean, fast, and a bit mysterious

ai/devstral-small

Docker

Agentic coding LLM (24B) fine-tuned from Mistral-Small-3.1 with a 128K context window

ai/qwen3-reranker-vllm

Docker

Multilingual reranking model for text retrieval, scoring document relevance across 119 languages.

ai/qwen3-vllm

Docker

Qwen3 is the latest Qwen LLM, built for top-tier coding, math, reasoning, and language tasks.

ai/gpt-oss-vllm

Docker

OpenAI’s open-weight models designed for powerful reasoning, agentic tasks

ai/moondream2

Docker

An open-source visual language model that interprets images via text prompts, fast and powerful.

ai/granite-4.0-h-tiny

Docker

7B long-context instruct model with RL alignment, IF, tool use, and enterprise optimization.

ai/granite-4.0-nano

Docker

Granite-4.0-nano: lightweight instruct model trained via SFT, RL, and merging on diverse data.

ai/deepseek-v3.2-vllm

Docker

DeepSeek-V3.2 boosts efficiency and reasoning with DSA, scalable RL, agentic data—IMO/IOI wins.

ai/granite-embedding-multilingual

Docker

Granite Embedding Multilingual is a 278 million parameter, encoder‑only XLM‑RoBERTa‑style

ai/ministral3-vllm

Docker

Ministral 3: compact vision-enabled model with near-24B performance, optimized for local edge use

ai/granite-4.0-h-small

Docker

32B long-context instruct model with RL alignment, IF, tool use, and enterprise optimization.

ai/smollm2-vllm

Docker

SmolVLM: lightweight multimodal model for video, image, and text analysis, optimized for devices

ai/granite-4.0-h-micro

Docker

3B long-context instruct model with RL alignment, IF, tool calling, and enterprise readiness.

ai/kimi-k2-vllm

Docker

Kimi K2 Thinking: open-source agent with deep reasoning, stable tool use, fast INT4, 256k context.

ai/snowflake-arctic-embed-l-v2-vllm

Docker

Snowflake’s Arctic-Embed v2.0 boosts multilingual retrieval and efficiency

ai/qwen3-reranker

Docker

Multilingual reranking model for text retrieval, scoring document relevance across 119 languages.

ai/granite-4.0-h-nano

Docker

Granite-4.0-h-nano: lightweight instruct model trained via SFT, RL, and merging on diverse data.

ai/granite-4.0-micro

Docker

3B long-context instruct model with RL alignment, IF, tool use, and enterprise optimization.

ai/embeddinggemma-vllm

Docker

Embedding Gemma is a state-of-the-art text embedding model from Google DeepMind

ai/all-minilm-l6-v2-vllm

Docker

all-MiniLM-L6-v2 is a sentence-transformers, maps sentences & paragraphs to a 384 dimensional vector