{
  "_published": {
    "source": "docs/measurements/dgx-spark-review-spark2-2026-11-02.json",
    "published": "2026-11-05",
    "publisher": "J4SGON S.L., vorluxai.com",
    "index": "https://vorluxai.com/data/",
    "cleaned": "Copied from our internal repository by scripts/publish_measurements.py. Every number is unchanged. Redacted: private IP addresses -> <prime> / <second-box> / <private-ip> (1). Hostnames (spark-43d5, spark-7180) and the PRIME / spark2 labels are kept: the posts use them.",
    "redactions": {
      "private_ip": 1
    }
  },
  "measured_at": "2026-11-01T23:20:28+00:00",
  "finished_at": "2026-11-01T23:21:07+00:00",
  "host": "spark2 (spark-7180) via http://<second-box>:11434 from spark-43d5",
  "machine": "NVIDIA DGX Spark, GB10, 128 GB unified memory (spark2, spark-7180)",
  "kernel": "7.0.0-1019-nvidia (spark2; the script recorded the client host, corrected by hand from ssh spark2 uname -r)",
  "gpu_driver": "NVIDIA GB10, 580.178.04 (spark2; corrected by hand from ssh spark2 nvidia-smi)",
  "ollama_version": "0.34.0",
  "command": "python3 scripts/bench/local_model_benchmark.py --models qwen3.6:35b,gemma4:26b --runs 3 --max-tokens 200 --think false --out docs/measurements/dgx-spark-review-spark2-2026-11-02.json",
  "method": "same prompt for every model, temperature 0, seed fixed, num_predict = max tokens; model unloaded before run 1 (cold, discarded), run 2 reported; a per-run first line defeats Ollama's prompt cache; think=false for thinking-capable models; generation and prompt tok/s from Ollama's eval_count/eval_duration and prompt_eval_count/prompt_eval_duration; time to first token and wall time measured client-side on the stream; loaded size from /api/ps; one model resident at a time, keep_alive 0 after each",
  "memory_rule": "MemAvailable >= 40 GB and PSI full avg10 < 2 before each load; no model file over 25.0 GB",
  "prompt": "Read the following note from a small accounting firm and answer in English. First list the key entities (people, organisations, dates, amounts). Then summarise the main decision in one sentence. Finally, write a short paragraph with the three risks you see and what the firm should check before the end of the quarter.\n\nNote from the Monday team meeting, 5 October. Present: Ana (director), Javier (accounts), Lucia (payroll) and Pablo (client service). Ana opened by reminding everyone that the third-quarter close ends on 20 October and that this year 48 clients file a quarterly VAT return, six more than last year. Javier said that 11 clients have still not sent their September invoices and proposed calling them this week instead of waiting for the last day. The team agreed that Pablo will make those calls on Tuesday and Wednesday. Lucia reported that two client companies hired new staff in October and that their social security registrations must be filed before the new employees start work; one is done and the other is waiting for the employee's identity document. The team also discussed the AI assistant the firm has been testing since September to draft routine emails. Pablo said it saves time on simple replies but gets dates and amounts wrong, so the team agreed that no email containing an amount goes out without a human check. Ana asked everyone to note in a shared sheet which tasks they use the assistant for, to prepare the register of AI uses that the European rules require. The next meeting was set for Monday 19 October at 9:00, and Javier will bring a list of the clients who still owe documents.",
  "prompt_words": 278,
  "prompt_note": "each run prepends 'Request <n> of <runs>.' so the prompt cache cannot serve run 2",
  "max_tokens": 200,
  "results": [
    {
      "model": "qwen3.6:35b",
      "digest": "616a741b1383c7c68aa8b43711ea4173fb4008fcd2ba308bc3bd3b0c80ffc1fd",
      "details": {
        "parent_model": "qwen3.6:35b",
        "format": "gguf",
        "family": "qwen35moe",
        "families": [
          "qwen35moe"
        ],
        "parameter_size": "36.0B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "vision",
        "tools",
        "thinking"
      ],
      "think": false,
      "file_size_gb": 23.94,
      "loaded_size_gb": 23.1,
      "loaded_size_vram_gb": 23.1,
      "context_length": 16384,
      "memory_before_load": "remote host, see top-level note",
      "memory_after_runs": null,
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 75.8,
        "prompt_tok_s": 1658.2,
        "time_to_first_token_s": 0.243,
        "wall_s": 2.883,
        "eval_count": 200,
        "prompt_eval_count": 349
      },
      "runs": [
        {
          "time_to_first_token_s": 4.991,
          "wall_s": 7.652,
          "eval_count": 200,
          "eval_duration_s": 2.659,
          "generation_tok_s": 75.2,
          "prompt_eval_count": 349,
          "prompt_eval_duration_s": 0.375,
          "prompt_tok_s": 931.3,
          "load_duration_s": 4.608,
          "total_duration_s": 7.646,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service)\n*   **Organizations:** The accounting firm (referred to as \"the Monday team\"), European regulatory bodies (implied by \"European rules\")\n*   **Dates:** 5 October (meeting date), 20 October (Q3 close deadline), 19 October (next meeting date), September (start of AI testing), October (current month for new hires)\n*   **Amounts/Numbers:** 48 clients (filing quarterly VAT returns), six more than last year, 11 clients (missing invoices), two client companies (with new staff), 9:00 (time of next meeting)\n\n**Main Decision Summary**\n\nThe team agreed that Pablo will contact the 11 clients missing September invoices this week and established a strict protocol requiring human verification for any AI-generated email containing financial amounts to",
          "run": 1
        },
        {
          "time_to_first_token_s": 0.243,
          "wall_s": 2.883,
          "eval_count": 200,
          "eval_duration_s": 2.638,
          "generation_tok_s": 75.8,
          "prompt_eval_count": 349,
          "prompt_eval_duration_s": 0.21,
          "prompt_tok_s": 1658.2,
          "load_duration_s": 0.001,
          "total_duration_s": 2.879,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service)\n*   **Organizations:** The accounting firm (implied entity subject to European regulations)\n*   **Dates:** 5 October (Meeting date), 20 October (Q3 close deadline), 19 October (Next meeting date), September (Start of AI testing), October (Month of new hires)\n*   **Amounts/Numbers:** 48 clients (filing quarterly VAT returns), 6 more than last year, 11 clients (missing invoices), 2 client companies (with new staff), 9:00 (Next meeting time)\n\n**Main Decision Summary**\n\nThe team agreed that Pablo will contact the 11 clients with missing September invoices this week and established a strict protocol requiring human verification for any AI-generated email containing financial amounts to ensure accuracy and regulatory compliance.\n\n**Risks and",
          "run": 2
        },
        {
          "time_to_first_token_s": 0.239,
          "wall_s": 2.896,
          "eval_count": 200,
          "eval_duration_s": 2.654,
          "generation_tok_s": 75.4,
          "prompt_eval_count": 349,
          "prompt_eval_duration_s": 0.208,
          "prompt_tok_s": 1675.9,
          "load_duration_s": 0.001,
          "total_duration_s": 2.892,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service)\n*   **Organisations:** The accounting firm (implied entity subject to European rules)\n*   **Dates:** 5 October (Meeting date), 20 October (Q3 close deadline), 19 October (Next meeting date), September (Start of AI testing), October (Month of new hires)\n*   **Amounts/Numbers:** 48 clients (filing quarterly VAT returns), six more than last year, 11 clients (missing invoices), Tuesday and Wednesday (days for calls), 9:00 (time of next meeting)\n\n**Main Decision Summary**\n\nThe team agreed that Pablo will contact the 11 clients with missing September invoices on Tuesday and Wednesday to ensure timely data collection before the third-quarter close.\n\n**Risks and Pre-Q3 Close Checks**\n\nThere are three primary",
          "run": 3
        }
      ]
    },
    {
      "model": "gemma4:26b",
      "digest": "9bffc8b7c5cbfcd165d29c6e257267d2b7d4ef5c4277ae2e454a137e107d0850",
      "details": {
        "parent_model": "gemma4:26b",
        "format": "gguf",
        "family": "gemma4",
        "families": [
          "gemma4"
        ],
        "parameter_size": "25.8B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "vision",
        "tools",
        "thinking"
      ],
      "think": false,
      "file_size_gb": 17.99,
      "loaded_size_gb": 22.64,
      "loaded_size_vram_gb": 22.64,
      "context_length": 16384,
      "memory_before_load": "remote host, see top-level note",
      "memory_after_runs": null,
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 68.2,
        "prompt_tok_s": 2095.5,
        "time_to_first_token_s": 0.212,
        "wall_s": 3.149,
        "eval_count": 200,
        "prompt_eval_count": 350
      },
      "runs": [
        {
          "time_to_first_token_s": 6.289,
          "wall_s": 9.242,
          "eval_count": 200,
          "eval_duration_s": 2.95,
          "generation_tok_s": 67.8,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 0.354,
          "prompt_tok_s": 988.9,
          "load_duration_s": 5.927,
          "total_duration_s": 9.237,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm (unnamed), unnamed clients (48 total for VAT).\n*   **Dates:** 5 October (meeting date), 20 October (Q3 close deadline), September (month of invoices/AI testing), Tuesday and Wednesday (scheduled calls), October (month of new hires), 19 October at 9:00 (next meeting).\n*   **Amounts:** 48 clients (VAT), 6 additional clients compared to last year, 11 clients (missing invoices).\n\n**Main Decision**\nThe team decided that Pablo will proactively call clients with missing September invoices this week and that all AI-generated emails containing financial figures must undergo a manual human review.\n\n**Risk Assessment**\nThe firm faces three primary risks: operational delays due to the high volume of VAT",
          "run": 1
        },
        {
          "time_to_first_token_s": 0.212,
          "wall_s": 3.149,
          "eval_count": 200,
          "eval_duration_s": 2.933,
          "generation_tok_s": 68.2,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 0.167,
          "prompt_tok_s": 2095.5,
          "load_duration_s": 0.002,
          "total_duration_s": 3.143,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm, unnamed clients (48 total for VAT returns, 11 with missing invoices, 2 with new staff).\n*   **Dates:** 5 October (meeting date), 2/3 October (Tuesday/Wednesday for calls), 20 October (Q3 close deadline), October (month of new hires), 19 October at 9:00 (next meeting), September (start of AI testing).\n*   **Amounts:** 48 clients (VAT), 6 more clients than last year, 11 missing invoices, 2 new staff registrations.\n\n**Main Decision**\nThe team decided that Pablo will proactively call clients with missing September invoices this week and that all AI-generated emails containing financial figures must undergo a manual human review.\n\n**Risk Assessment**",
          "run": 2
        },
        {
          "time_to_first_token_s": 0.212,
          "wall_s": 3.206,
          "eval_count": 200,
          "eval_duration_s": 2.992,
          "generation_tok_s": 66.9,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 0.168,
          "prompt_tok_s": 2082.0,
          "load_duration_s": 0.001,
          "total_duration_s": 3.202,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm (unnamed), unnamed clients (48 total for VAT).\n*   **Dates:** 5 October (meeting date), 20 October (Q3 close deadline), September (start of AI testing), Tuesday and Wednesday (scheduled calls), October (new staff hiring), 19 October at 9:00 (next meeting).\n*   **Amounts:** 48 clients (VAT returns), 6 additional clients compared to last year, 11 clients (missing invoices).\n\n**Main Decision**\n\nThe team decided that Pablo will proactively call clients with missing September invoices this week and that all AI-generated emails containing financial figures must undergo a manual human review.\n\n**Risks and Recommendations**\n\nThe firm faces three primary risks: operational delays due to missing client documentation, potential",
          "run": 3
        }
      ]
    }
  ],
  "provenance_note": "Run from PRIME against spark2 Ollama 0.34.0. kernel/gpu_driver/memory_* fields were read on the client (PRIME); kernel and driver corrected above, memory_before_load/after_runs describe PRIME, not spark2. spark2 had gemma4-32k resident (about 21 GB) throughout; MemAvailable on spark2 about 38 GB before the run (free -g)."
}