chore: remove benchmark notes that were accidentally committed
The bench-*.md files got swept into the Phase 8 mega-commit by `git add -A`. They were local working-tree notes the user never intended to track. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -1 +1 @@
|
||||
603480
|
||||
604006
|
||||
|
||||
@@ -1,12 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.9:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: auto (chat=off, curator=on)
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:8b | chat | 5 | 98 | 187 | 2126 | 13.8 | 26 |
|
||||
| gemma2:9b | chat | 5 | 89 | 184 | 2084 | 11.7 | 22 |
|
||||
| llama3.2:3b | chat | 5 | 102 | 185 | 1091 | 31.9 | 28 |
|
||||
| mistral-nemo:12b | chat | 5 | 82 | 228 | 2070 | 10.2 | 19 |
|
||||
@@ -1,12 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.9:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: forced OFF
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:30b-a3b | curator | 3 | 529 | 183 | 164198 | 17.4 | 2732 |
|
||||
| qwen3:32b | curator | 3 | 535 | 677 | 136519 | 3.0 | 406 |
|
||||
| gemma2:27b | curator | 3 | 545 | 392 | 132739 | 3.7 | 451 |
|
||||
| mistral-small:22b | curator | 3 | 562 | 293 | 105971 | 4.7 | 485 |
|
||||
@@ -1,10 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.9:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: forced ON
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:30b-a3b | curator | 3 | 529 | 147344 | 185694 | 15.6 | 3300 |
|
||||
| qwen3:32b | curator | 3 | 529 | 98890 | 213817 | 3.1 | 651 |
|
||||
@@ -1,12 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.13:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: auto (chat=off, curator=on)
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:8b | chat | 5 | 98 | 410 | 4131 | 7.0 | 26 |
|
||||
| gemma2:9b | chat | 5 | 89 | 410 | 2950 | 8.1 | 21 |
|
||||
| llama3.2:3b | chat | 5 | 102 | 311 | 1627 | 21.7 | 28 |
|
||||
| mistral-nemo:12b | chat | 5 | 82 | 458 | 2966 | 7.9 | 19 |
|
||||
@@ -1,12 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.13:11434`
|
||||
- Hardware mode: GPU offload (99 layers) (`num_gpu=99`)
|
||||
- Think: auto (chat=off, curator=on)
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:8b | chat | 5 | 98 | 369 | 1301 | 23.8 | 25 |
|
||||
| gemma2:9b | chat | 5 | 89 | 426 | 1681 | 22.1 | 24 |
|
||||
| llama3.2:3b | chat | 5 | 102 | 400 | 1033 | 54.1 | 29 |
|
||||
| mistral-nemo:12b | chat | 5 | 82 | 446 | 1451 | 19.7 | 18 |
|
||||
@@ -1,9 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.13:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: forced OFF
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| llama3.3:70b | curator | 3 | 499 | 1284 | 326662 | 1.1 | 367 |
|
||||
@@ -1,12 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.13:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: forced OFF
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:30b-a3b | curator | 3 | 529 | 355 | 324789 | 9.8 | 3195 |
|
||||
| qwen3:32b | curator | 3 | 535 | 813 | 157978 | 2.6 | 404 |
|
||||
| gemma2:27b | curator | 3 | 545 | 693 | 166996 | 2.7 | 453 |
|
||||
| mistral-small:22b | curator | 3 | 562 | 386 | 144660 | 3.6 | 490 |
|
||||
@@ -1,10 +0,0 @@
|
||||
# Ollama benchmark
|
||||
|
||||
- Server: `http://192.168.0.13:11434`
|
||||
- Hardware mode: CPU only (`num_gpu=0`)
|
||||
- Think: forced ON
|
||||
|
||||
| Model | Scenario | Runs | Prompt tok | TTFT p50 (ms) | Total p50 (ms) | tok/s p50 | Output tok (mean) |
|
||||
|---|---|---|---|---|---|---|---|
|
||||
| qwen3:30b-a3b | curator | 3 | 529 | 261474 | 319287 | 9.8 | 3310 |
|
||||
| qwen3:32b | curator | 3 | 529 | 127386 | 274725 | 2.5 | 756 |
|
||||
Reference in New Issue
Block a user