{"type": "meta", "benchmark_run_id": "8d63125e-6074-4143-befd-1139add7a797", "harness_version": "codetwig-vllm-coldwarm-1", "started_at_utc": "2026-10-20T22:19:51Z", "host": "codetwig-box (driver; requests via ssh -L to vllm-test)", "node": "vllm-test", "engine": "vllm", "target_url": "http://127.0.0.1:18080 (ssh -L 18080:localhost:8080 vllm-test)", "git_sha": "64c3b48e0642cd5ab5aa0cf53dae7bd78aaaf186", "load_avg": [0.0458984375, 0.20654296875, 0.2685546875], "served_model": "Qwen3.8-MXFP4", "temperature": 0.1, "n_warm": 5, "max_tokens_per_prompt": {"hello": 64, "P-MEDIUM": 512, "P-HARD": 1024}, "prompt_map": {"hello": "P-EASY", "P-MEDIUM": "P-MEDIUM", "P-HARD": "P-HARD"}, "cells": [{"key": "think", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "enable_thinking": true}, {"key": "nothink", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "enable_thinking": false}]}
{"type": "vram_snapshot", "model_key": "think", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "ts_utc": "2026-10-20T22:19:51Z", "raw": "renderD128 33876262912 34208743424 17000000 210000000\nrenderD129 33876434944 34208743424 16000000 210000000", "format": "card vram_used_bytes vram_total_bytes power_avg_uW power_cap_uW"}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 109, "first_chunk_ms": 109, "total_duration_ms": 268, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 245.2830188679245, "tokens_per_sec_incl_prefill": 145.52238805970148, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.2, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:52Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 100, "first_chunk_ms": 99, "total_duration_ms": 259, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 245.2830188679245, "tokens_per_sec_incl_prefill": 150.57915057915056, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:52Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 110, "first_chunk_ms": 110, "total_duration_ms": 264, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 253.24675324675326, "tokens_per_sec_incl_prefill": 147.72727272727272, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:53Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 104, "first_chunk_ms": 104, "total_duration_ms": 258, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 253.24675324675326, "tokens_per_sec_incl_prefill": 151.1627906976744, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:53Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 109, "first_chunk_ms": 109, "total_duration_ms": 263, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 253.24675324675326, "tokens_per_sec_incl_prefill": 148.2889733840304, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:54Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 99, "first_chunk_ms": 99, "total_duration_ms": 252, "prompt_tokens": 11, "completion_tokens": 39, "tokens_per_sec": 254.90196078431373, "tokens_per_sec_incl_prefill": 154.76190476190476, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 121, "content_chars": 37, "response_preview": "\n\nHi there! How can I help you today?", "spec_draft_tokens": 49.0, "spec_accepted_tokens": 32.0, "spec_acceptance_rate": 0.6530612244897959, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 11.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:54Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 105, "first_chunk_ms": 105, "total_duration_ms": 3177, "prompt_tokens": 24, "completion_tokens": 512, "tokens_per_sec": 166.66666666666666, "tokens_per_sec_incl_prefill": 161.15832546427447, "finish_reason": "length", "max_tokens": 512, "reasoning_chars": 2367, "content_chars": 13, "response_preview": "\n\nSunlight is", "spec_draft_tokens": 952.0, "spec_accepted_tokens": 376.0, "spec_acceptance_rate": 0.3949579831932773, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:19:58Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 98, "first_chunk_ms": 98, "total_duration_ms": 2769, "prompt_tokens": 24, "completion_tokens": 480, "tokens_per_sec": 179.70797454137028, "tokens_per_sec_incl_prefill": 173.3477789815818, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 1368, "content_chars": 861, "response_preview": "\n\nSunlight is composed of all visible wavelengths, but when it enters Earth's atmosphere, it collides with gas molecules and undergoes Rayleigh scattering, in which shorter wavelengths scatter far more strongly than longer ones (roughly pro", "spec_draft_tokens": 826.0, "spec_accepted_tokens": 362.0, "spec_acceptance_rate": 0.43825665859564167, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:01Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 98, "first_chunk_ms": 98, "total_duration_ms": 2517, "prompt_tokens": 24, "completion_tokens": 459, "tokens_per_sec": 189.74782968168665, "tokens_per_sec_incl_prefill": 182.3599523241955, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 1368, "content_chars": 770, "response_preview": "\n\nSunlight is white light that contains all visible wavelengths, from red to violet. As it enters Earth's atmosphere, it scatters off nitrogen and oxygen molecules through a process called Rayleigh scattering, in which shorter wavelengths s", "spec_draft_tokens": 749.0, "spec_accepted_tokens": 352.0, "spec_acceptance_rate": 0.4699599465954606, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:04Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 98, "first_chunk_ms": 98, "total_duration_ms": 2654, "prompt_tokens": 24, "completion_tokens": 434, "tokens_per_sec": 169.79655712050078, "tokens_per_sec_incl_prefill": 163.52675207234364, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 1371, "content_chars": 650, "response_preview": "\n\nSunlight is white light that contains all visible wavelengths, from red to violet. As it enters the atmosphere, it undergoes Rayleigh scattering off gas molecules, a process in which shorter wavelengths scatter far more strongly than long", "spec_draft_tokens": 791.0, "spec_accepted_tokens": 321.0, "spec_acceptance_rate": 0.40581542351453853, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.2, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:07Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 118, "first_chunk_ms": 118, "total_duration_ms": 2441, "prompt_tokens": 24, "completion_tokens": 428, "tokens_per_sec": 184.24451140766251, "tokens_per_sec_incl_prefill": 175.33797623924622, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 1238, "content_chars": 720, "response_preview": "\n\nSunlight is white light that contains all visible wavelengths, from red to violet. As it enters the atmosphere, it scatters off nitrogen and oxygen molecules, and shorter wavelengths scatter far more strongly than longer ones (a process c", "spec_draft_tokens": 721.0, "spec_accepted_tokens": 325.0, "spec_acceptance_rate": 0.4507628294036061, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.3, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:09Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 102, "first_chunk_ms": 102, "total_duration_ms": 2776, "prompt_tokens": 24, "completion_tokens": 463, "tokens_per_sec": 173.1488406881077, "tokens_per_sec_incl_prefill": 166.78674351585016, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 1345, "content_chars": 810, "response_preview": "\n\nSunlight is actually a mixture of all visible wavelengths, but when it enters Earth's atmosphere it collides with nitrogen and oxygen molecules, a process called Rayleigh scattering. Because the amount of scattering is inversely proportio", "spec_draft_tokens": 826.0, "spec_accepted_tokens": 345.0, "spec_acceptance_rate": 0.41767554479418884, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 24.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:12Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 110, "first_chunk_ms": 110, "total_duration_ms": 4996, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 209.57838722881704, "tokens_per_sec_incl_prefill": 204.96397117694153, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2699, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1498.0, "spec_accepted_tokens": 813.0, "spec_acceptance_rate": 0.5427236315086782, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:18Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 102, "first_chunk_ms": 102, "total_duration_ms": 4747, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 220.4520990312164, "tokens_per_sec_incl_prefill": 215.7151885401306, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2661, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1421.0, "spec_accepted_tokens": 827.0, "spec_acceptance_rate": 0.5819845179451091, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:23Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 115, "first_chunk_ms": 115, "total_duration_ms": 5123, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 204.47284345047925, "tokens_per_sec_incl_prefill": 199.8828811243412, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2624, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1533.0, "spec_accepted_tokens": 805.0, "spec_acceptance_rate": 0.5251141552511416, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.2, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:28Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 102, "first_chunk_ms": 102, "total_duration_ms": 5415, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 192.73480143045362, "tokens_per_sec_incl_prefill": 189.10433979686056, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2828, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1624.0, "spec_accepted_tokens": 798.0, "spec_acceptance_rate": 0.49137931034482757, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:34Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 100, "first_chunk_ms": 100, "total_duration_ms": 4992, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 209.32134096484054, "tokens_per_sec_incl_prefill": 205.12820512820514, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2609, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1491.0, "spec_accepted_tokens": 812.0, "spec_acceptance_rate": 0.5446009389671361, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:39Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "model_key": "think", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 108, "first_chunk_ms": 108, "total_duration_ms": 5384, "prompt_tokens": 32, "completion_tokens": 1024, "tokens_per_sec": 194.08642911296437, "tokens_per_sec_incl_prefill": 190.1931649331352, "finish_reason": "length", "max_tokens": 1024, "reasoning_chars": 2698, "content_chars": 0, "response_preview": "", "spec_draft_tokens": 1610.0, "spec_accepted_tokens": 797.0, "spec_acceptance_rate": 0.49503105590062113, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 32.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:44Z", "error": null}
{"type": "vram_snapshot", "model_key": "think", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-think", "ts_utc": "2026-10-20T22:20:45Z", "raw": "renderD128 33876262912 34208743424 181000000 210000000\nrenderD129 33876434944 34208743424 180000000 210000000", "format": "card vram_used_bytes vram_total_bytes power_avg_uW power_cap_uW", "when": "post"}
{"type": "vram_snapshot", "model_key": "nothink", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "ts_utc": "2026-10-20T22:20:45Z", "raw": "renderD128 33876262912 34208743424 36000000 210000000\nrenderD129 33876434944 34208743424 35000000 210000000", "format": "card vram_used_bytes vram_total_bytes power_avg_uW power_cap_uW"}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 97, "first_chunk_ms": 97, "total_duration_ms": 142, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 244.44444444444446, "tokens_per_sec_incl_prefill": 77.46478873239437, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:45Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 94, "first_chunk_ms": 94, "total_duration_ms": 136, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 261.90476190476187, "tokens_per_sec_incl_prefill": 80.88235294117646, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:45Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 95, "first_chunk_ms": 95, "total_duration_ms": 140, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 244.44444444444446, "tokens_per_sec_incl_prefill": 78.57142857142857, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:46Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 93, "first_chunk_ms": 93, "total_duration_ms": 141, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 229.16666666666666, "tokens_per_sec_incl_prefill": 78.01418439716313, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:46Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 102, "first_chunk_ms": 102, "total_duration_ms": 144, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 261.90476190476187, "tokens_per_sec_incl_prefill": 76.3888888888889, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:46Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "hello", "frozen_prompt_id": "P-EASY", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 92, "first_chunk_ms": 92, "total_duration_ms": 138, "prompt_tokens": 13, "completion_tokens": 11, "tokens_per_sec": 239.1304347826087, "tokens_per_sec_incl_prefill": 79.71014492753622, "finish_reason": "stop", "max_tokens": 64, "reasoning_chars": 0, "content_chars": 35, "response_preview": "Hi there! How can I help you today?", "spec_draft_tokens": 14.0, "spec_accepted_tokens": 9.0, "spec_acceptance_rate": 0.6428571428571429, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 13.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:47Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 101, "first_chunk_ms": 101, "total_duration_ms": 890, "prompt_tokens": 26, "completion_tokens": 113, "tokens_per_sec": 143.21926489226868, "tokens_per_sec_incl_prefill": 126.96629213483146, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 588, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters the Earth's atmosphere, it interacts with gas molecules. Shorter wavelengths, such as blue and violet, are scattered much more effectively by these molecules than long", "spec_draft_tokens": 245.0, "spec_accepted_tokens": 78.0, "spec_acceptance_rate": 0.3183673469387755, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:48Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 103, "first_chunk_ms": 102, "total_duration_ms": 1028, "prompt_tokens": 26, "completion_tokens": 135, "tokens_per_sec": 145.94594594594594, "tokens_per_sec_incl_prefill": 131.3229571984436, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 713, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters the Earth's atmosphere, it interacts with gas molecules. Shorter wavelengths of light, such as blue and violet, are scattered much more effectively by these molecules ", "spec_draft_tokens": 287.0, "spec_accepted_tokens": 94.0, "spec_acceptance_rate": 0.32752613240418116, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:49Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 105, "first_chunk_ms": 104, "total_duration_ms": 1072, "prompt_tokens": 26, "completion_tokens": 128, "tokens_per_sec": 132.36814891416753, "tokens_per_sec_incl_prefill": 119.40298507462686, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 720, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters the Earth's atmosphere, it interacts with gas molecules through a process called Rayleigh scattering. This scattering is inversely proportional to the wavelength of li", "spec_draft_tokens": 301.0, "spec_accepted_tokens": 85.0, "spec_acceptance_rate": 0.2823920265780731, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:50Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 99, "first_chunk_ms": 99, "total_duration_ms": 795, "prompt_tokens": 26, "completion_tokens": 111, "tokens_per_sec": 159.48275862068968, "tokens_per_sec_incl_prefill": 139.62264150943395, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 593, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters Earth's atmosphere, it interacts with gas molecules. These molecules scatter shorter wavelengths of light, such as blue and violet, much more effectively than longer w", "spec_draft_tokens": 217.0, "spec_accepted_tokens": 80.0, "spec_acceptance_rate": 0.3686635944700461, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:51Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 97, "first_chunk_ms": 97, "total_duration_ms": 750, "prompt_tokens": 26, "completion_tokens": 110, "tokens_per_sec": 168.4532924961715, "tokens_per_sec_incl_prefill": 146.66666666666666, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 579, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters Earth's atmosphere, it interacts with gas molecules. These molecules scatter shorter wavelengths of light, such as blue and violet, much more effectively than longer w", "spec_draft_tokens": 203.0, "spec_accepted_tokens": 81.0, "spec_acceptance_rate": 0.39901477832512317, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:52Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-MEDIUM", "frozen_prompt_id": "P-MEDIUM", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 101, "first_chunk_ms": 101, "total_duration_ms": 912, "prompt_tokens": 26, "completion_tokens": 123, "tokens_per_sec": 151.66461159062885, "tokens_per_sec_incl_prefill": 134.86842105263156, "finish_reason": "stop", "max_tokens": 512, "reasoning_chars": 0, "content_chars": 631, "response_preview": "Sunlight contains all colors of the visible spectrum, but when it enters the Earth's atmosphere, it interacts with gas molecules. Shorter wavelengths of light, such as blue and violet, scatter much more strongly than longer wavelengths like", "spec_draft_tokens": 252.0, "spec_accepted_tokens": 87.0, "spec_acceptance_rate": 0.34523809523809523, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 26.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:53Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "cold_kind": "process_warm", "first_delta_ms": 106, "first_chunk_ms": 106, "total_duration_ms": 3180, "prompt_tokens": 34, "completion_tokens": 371, "tokens_per_sec": 120.6896551724138, "tokens_per_sec_incl_prefill": 116.66666666666666, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1532, "response_preview": "The mist clung to the harbor like a wet shroud, dampening Elias’s wool sweater as he hauled the last of the day’s catch. The net was heavy, not with fish, but with the weight of the deep. As he untangled the kelp, his fingers brushed agains", "spec_draft_tokens": 945.0, "spec_accepted_tokens": 236.0, "spec_acceptance_rate": 0.24973544973544973, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:20:57Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "cold_kind": null, "first_delta_ms": 111, "first_chunk_ms": 111, "total_duration_ms": 3521, "prompt_tokens": 34, "completion_tokens": 370, "tokens_per_sec": 108.50439882697947, "tokens_per_sec_incl_prefill": 105.08378301618859, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1621, "response_preview": "The mist clung to the harbor like a wet shroud, dampening Elias’s wool sweater as he hauled in the morning’s catch. His nets were usually heavy with silver-scaled herring, but today, the weight felt different—dense, unnatural. He pulled the", "spec_draft_tokens": 1050.0, "spec_accepted_tokens": 220.0, "spec_acceptance_rate": 0.20952380952380953, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:21:00Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "cold_kind": null, "first_delta_ms": 108, "first_chunk_ms": 108, "total_duration_ms": 3445, "prompt_tokens": 34, "completion_tokens": 347, "tokens_per_sec": 103.98561582259514, "tokens_per_sec_incl_prefill": 100.7256894049347, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1489, "response_preview": "Elias pulled the net through the churning water, the weight of the catch heavy against his back. The sea had been uncharacteristically calm, a deceptive stillness that made the old man uneasy. As he hauled the last of the silver-scaled fish", "spec_draft_tokens": 1029.0, "spec_accepted_tokens": 199.0, "spec_acceptance_rate": 0.1933916423712342, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:21:04Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "cold_kind": null, "first_delta_ms": 103, "first_chunk_ms": 103, "total_duration_ms": 3270, "prompt_tokens": 34, "completion_tokens": 348, "tokens_per_sec": 109.88317019261132, "tokens_per_sec_incl_prefill": 106.42201834862385, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1475, "response_preview": "The mist clung to the harbor like a wet shroud, dampening Elias’s wool sweater as he hauled the last of the day’s catch. The net was heavy, not with fish, but with the weight of the deep. As he untangled the kelp, his fingers brushed agains", "spec_draft_tokens": 973.0, "spec_accepted_tokens": 209.0, "spec_acceptance_rate": 0.2147995889003083, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:21:08Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 4, "phase": "warm", "cold_kind": null, "first_delta_ms": 116, "first_chunk_ms": 116, "total_duration_ms": 3390, "prompt_tokens": 34, "completion_tokens": 368, "tokens_per_sec": 112.40073304825901, "tokens_per_sec_incl_prefill": 108.55457227138643, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1551, "response_preview": "Elias pulled the net through the grey, churning water, his hands raw and red from the cold. The morning fog clung to the harbor, obscuring the distant lighthouse. As he hauled the heavy mesh onto the deck, something clinked against the wood", "spec_draft_tokens": 1008.0, "spec_accepted_tokens": 224.0, "spec_acceptance_rate": 0.2222222222222222, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.2, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:21:11Z", "error": null}
{"type": "call", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "model_key": "nothink", "prompt_id": "P-HARD", "frozen_prompt_id": "P-HARD", "run_idx": 5, "phase": "warm", "cold_kind": null, "first_delta_ms": 101, "first_chunk_ms": 101, "total_duration_ms": 3630, "prompt_tokens": 34, "completion_tokens": 363, "tokens_per_sec": 102.86200056673279, "tokens_per_sec_incl_prefill": 100.0, "finish_reason": "stop", "max_tokens": 1024, "reasoning_chars": 0, "content_chars": 1531, "response_preview": "The mist clung to the harbor like a wet shroud, dampening Elias’s wool sweater as he hauled the last of the day’s catch. The net was heavy, not with fish, but with the silt of the deep. As he shook the water from the mesh, a dull, metallic ", "spec_draft_tokens": 1085.0, "spec_accepted_tokens": 208.0, "spec_acceptance_rate": 0.19170506912442398, "prefix_cache_hit_tokens": 0.0, "prefix_cache_query_tokens": 34.0, "idle_wait_s": 0.1, "other_requests_completed_during_call": 0.0, "ts_utc": "2026-10-20T22:21:15Z", "error": null}
{"type": "vram_snapshot", "model_key": "nothink", "cell_id": "r9700x2:vllm:qwen3.8-27b-mxfp4-dflash2-nothink", "ts_utc": "2026-10-20T22:21:15Z", "raw": "renderD128 33876262912 34208743424 128000000 210000000\nrenderD129 33876434944 34208743424 126000000 210000000", "format": "card vram_used_bytes vram_total_bytes power_avg_uW power_cap_uW", "when": "post"}
{"type": "footer", "finished_at_utc": "2026-10-20T22:21:15Z", "load_avg_end": [0.0673828125, 0.17041015625, 0.2509765625]}