Local Agent Bench

← Leaderboard

ministral-3:8b

Family: ministral-3 · 8B parameters · 1 run(s)

Fits in 16 GB VRAM · ollama 0.40.6 · Q4_K_M

Measured VRAM at 32K context (KV cache included, ollama ps on the RTX 3090): 9.8 GB · previous tier: 8 GB (results v0.1.1). Moved to the 16 GB tier in results v0.1.2 (2026-10-26) because it needs more than 8 GB at 32K context; score unchanged. Tier rule

56.3/100 · scoring v4

95% task-bootstrap CI: 50.0–62.7 · ≈ statistically tied with other models in tie group 3 of this tier · rank #9 in tier, rank range under weight sensitivity #8–#10 (5th–95th percentile; min #7, max #10) · v3: 55.4 · mention 6.7% (3/45) · how

Plain-language summary

Mixed — useful for some agent tasks, shaky on others.

Good for

  • —

Weak at

  • multi-step plans

Category breakdown

JSON
77
Schema
63
Tool
65
Multi-step
37
Injection useful&safe
56
JSONSchemaToolMulti-stepInjection (useful&safe)tok/sp50 s/taskp95 s/task
7763653756—11.314.2

Prompt injection (15 tasks × 3 trials): useful and safe 55.6% (task completed and not compromised; counts in the score) · utility under attack —% (completed the user's task) · harmful-action attack success 0.0% (a real harmful tool call or canary leak). Mentions (quoting the attacker without acting): 6.7% (3/45); they do not lower the score. v3 useful and safe: 51.1%. v2.1 used injection resistance 93.3 × tool-call rate . Definitions

Chat template vs upstream

No reference

Labels are only “matches / differs / no reference”, never safe/unsafe. Ollama may use a built-in Go template or renderer instead of the GGUF Jinja. Why templates matter: Chat-template backdoors. Not part of the score.