{
  "_published": {
    "source": "docs/measurements/dgx-spark-review-prime-2026-11-02.json",
    "published": "2026-11-05",
    "publisher": "J4SGON S.L., vorluxai.com",
    "index": "https://vorluxai.com/data/",
    "cleaned": "Copied from our internal repository by scripts/publish_measurements.py. Every number is unchanged. Redacted: nothing. Hostnames (spark-43d5, spark-7180) and the PRIME / spark2 labels are kept: the posts use them.",
    "redactions": {}
  },
  "measured_at": "2026-11-01T23:13:31+00:00",
  "finished_at": "2026-11-01T23:16:48+00:00",
  "host": "spark-43d5",
  "machine": "NVIDIA DGX Spark, GB10, 128 GB unified memory (PRIME, spark-43d5)",
  "kernel": "6.17.0-1032-nvidia",
  "gpu_driver": "NVIDIA GB10, 580.173.02",
  "ollama_version": "0.30.10",
  "command": "python3 scripts/bench/local_model_benchmark.py --models llama3.1:8b,qwen2.5-coder:7b,deepseek-r1:14b,qwen2.5vl:7b,gemma4:26b --runs 3 --max-tokens 200 --think false --out docs/measurements/dgx-spark-review-prime-2026-11-02.json",
  "method": "same prompt for every model, temperature 0, seed fixed, num_predict = max tokens; model unloaded before run 1 (cold, discarded), run 2 reported; a per-run first line defeats Ollama's prompt cache; think=false for thinking-capable models; generation and prompt tok/s from Ollama's eval_count/eval_duration and prompt_eval_count/prompt_eval_duration; time to first token and wall time measured client-side on the stream; loaded size from /api/ps; one model resident at a time, keep_alive 0 after each",
  "memory_rule": "MemAvailable >= 40 GB and PSI full avg10 < 2 before each load; no model file over 20 GB",
  "prompt": "Read the following note from a small accounting firm and answer in English. First list the key entities (people, organisations, dates, amounts). Then summarise the main decision in one sentence. Finally, write a short paragraph with the three risks you see and what the firm should check before the end of the quarter.\n\nNote from the Monday team meeting, 5 October. Present: Ana (director), Javier (accounts), Lucia (payroll) and Pablo (client service). Ana opened by reminding everyone that the third-quarter close ends on 20 October and that this year 48 clients file a quarterly VAT return, six more than last year. Javier said that 11 clients have still not sent their September invoices and proposed calling them this week instead of waiting for the last day. The team agreed that Pablo will make those calls on Tuesday and Wednesday. Lucia reported that two client companies hired new staff in October and that their social security registrations must be filed before the new employees start work; one is done and the other is waiting for the employee's identity document. The team also discussed the AI assistant the firm has been testing since September to draft routine emails. Pablo said it saves time on simple replies but gets dates and amounts wrong, so the team agreed that no email containing an amount goes out without a human check. Ana asked everyone to note in a shared sheet which tasks they use the assistant for, to prepare the register of AI uses that the European rules require. The next meeting was set for Monday 19 October at 9:00, and Javier will bring a list of the clients who still owe documents.",
  "prompt_words": 278,
  "prompt_note": "each run prepends 'Request <n> of <runs>.' so the prompt cache cannot serve run 2",
  "max_tokens": 200,
  "results": [
    {
      "model": "llama3.1:8b",
      "digest": "4fc21a39517b00ec4e30ed847340ac2f683891cfe94f8e42b882f02f1c363cc7",
      "details": {
        "parent_model": "llama3.1:8b",
        "format": "gguf",
        "family": "llama",
        "families": [
          "llama"
        ],
        "parameter_size": "8.0B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "tools"
      ],
      "think": null,
      "file_size_gb": 4.92,
      "loaded_size_gb": 9.21,
      "loaded_size_vram_gb": 9.21,
      "context_length": 32768,
      "memory_before_load": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 15.1,
        "mem_available_gb": 72.1,
        "psi_full_avg10": 0.0
      },
      "memory_after_runs": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 15.8,
        "mem_available_gb": 72.9,
        "psi_full_avg10": 0.0
      },
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 43.7,
        "prompt_tok_s": 3403.4,
        "time_to_first_token_s": 0.385,
        "wall_s": 4.963,
        "eval_count": 200,
        "prompt_eval_count": 340
      },
      "runs": [
        {
          "time_to_first_token_s": 4.019,
          "wall_s": 8.599,
          "eval_count": 200,
          "eval_duration_s": 4.579,
          "generation_tok_s": 43.7,
          "prompt_eval_count": 340,
          "prompt_eval_duration_s": 0.227,
          "prompt_tok_s": 1500.5,
          "load_duration_s": 3.789,
          "total_duration_s": 8.597,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key entities:**\n\n* People:\n\t+ Ana (director)\n\t+ Javier (accounts)\n\t+ Lucia (payroll)\n\t+ Pablo (client service)\n* Organisations:\n\t+ The small accounting firm\n\t+ 48 client companies\n* Dates:\n\t+ Monday, 5 October\n\t+ Tuesday and Wednesday\n\t+ Monday, 19 October\n\t+ 20 October (end of third-quarter close)\n\t+ September\n* Amounts: None mentioned\n\n**Main decision:** The team agreed that Pablo will make calls to 11 clients who have not sent their September invoices this week instead of waiting for the last day.\n\n**Risks and recommendations:**\n\nThe firm should be aware of the following risks:\n\n1. **Inaccurate invoicing**: If the AI assistant continues to get dates and amounts wrong, it may lead to incorrect invoices being sent to clients, which could damage the firm's reputation and relationships with clients.\n2. **Late social security",
          "run": 1,
          "psi_full_avg10_after": 0.0
        },
        {
          "time_to_first_token_s": 0.385,
          "wall_s": 4.963,
          "eval_count": 200,
          "eval_duration_s": 4.578,
          "generation_tok_s": 43.7,
          "prompt_eval_count": 340,
          "prompt_eval_duration_s": 0.1,
          "prompt_tok_s": 3403.4,
          "load_duration_s": 0.257,
          "total_duration_s": 4.961,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key entities:**\n\n* People:\n\t+ Ana (director)\n\t+ Javier (accounts)\n\t+ Lucia (payroll)\n\t+ Pablo (client service)\n* Organisations:\n\t+ The small accounting firm\n\t+ 48 client companies\n* Dates:\n\t+ Monday, 5 October\n\t+ Tuesday and Wednesday\n\t+ Monday, 19 October\n\t+ 20 October (end of third-quarter close)\n\t+ September\n* Amounts: None mentioned\n\n**Main decision:** The team agreed that Pablo will make calls to 11 clients who have not sent their September invoices this week instead of waiting for the last day.\n\n**Risks and checks needed before the end of the quarter:**\n\nThe firm should be aware of three potential risks:\n\n1. **Inaccurate VAT returns**: With six more clients filing a quarterly VAT return than last year, there is a risk that some errors may occur in the calculations or submissions.\n2. **Late social security",
          "run": 2,
          "psi_full_avg10_after": 0.0
        },
        {
          "time_to_first_token_s": 0.332,
          "wall_s": 4.903,
          "eval_count": 200,
          "eval_duration_s": 4.571,
          "generation_tok_s": 43.8,
          "prompt_eval_count": 340,
          "prompt_eval_duration_s": 0.101,
          "prompt_tok_s": 3374.7,
          "load_duration_s": 0.201,
          "total_duration_s": 4.902,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key entities:**\n\n* People:\n\t+ Ana (director)\n\t+ Javier (accounts)\n\t+ Lucia (payroll)\n\t+ Pablo (client service)\n* Organisations:\n\t+ The small accounting firm\n\t+ 48 client companies\n* Dates:\n\t+ Monday, 5 October\n\t+ Tuesday and Wednesday\n\t+ Monday, 19 October\n\t+ 20 October (end of third-quarter close)\n\t+ September\n* Amounts: None mentioned\n\n**Main decision:** The team agreed that Pablo will make calls to 11 clients who have not sent their September invoices this week instead of waiting for the last day.\n\n**Risks and recommendations:**\n\nThe firm should be aware of three potential risks:\n\n1. **Inaccurate invoicing**: If the AI assistant continues to get dates and amounts wrong, it may lead to incorrect invoices being sent to clients, which could damage the firm's reputation and relationships with clients.\n2. **Late social security",
          "run": 3,
          "psi_full_avg10_after": 0.0
        }
      ]
    },
    {
      "model": "qwen2.5-coder:7b",
      "digest": "dae161e27b0e90dd1856c8bb3209201fd6736d8eb66298e75ed87571486f4364",
      "details": {
        "parent_model": "",
        "format": "gguf",
        "family": "qwen2",
        "families": [
          "qwen2"
        ],
        "parameter_size": "7.6B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "tools",
        "insert"
      ],
      "think": null,
      "file_size_gb": 4.68,
      "loaded_size_gb": 6.59,
      "loaded_size_vram_gb": 6.59,
      "context_length": 32768,
      "memory_before_load": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 15.8,
        "mem_available_gb": 72.9,
        "psi_full_avg10": 0.0
      },
      "memory_after_runs": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 16.2,
        "mem_available_gb": 73.3,
        "psi_full_avg10": 0.0
      },
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 46.6,
        "prompt_tok_s": 3220.9,
        "time_to_first_token_s": 0.313,
        "wall_s": 4.611,
        "eval_count": 200,
        "prompt_eval_count": 364
      },
      "runs": [
        {
          "time_to_first_token_s": 3.953,
          "wall_s": 8.316,
          "eval_count": 200,
          "eval_duration_s": 4.361,
          "generation_tok_s": 45.9,
          "prompt_eval_count": 364,
          "prompt_eval_duration_s": 0.175,
          "prompt_tok_s": 2076.8,
          "load_duration_s": 3.772,
          "total_duration_s": 8.313,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- Ana (director)\n- Javier (accounts)\n- Lucia (payroll)\n- Pablo (client service)\n- Third-quarter close date: 20 October\n- Number of clients filing quarterly VAT returns this year: 48 (6 more than last year)\n- Clients who have not sent September invoices: 11\n- New staff hired by client companies in October: 2\n- AI assistant for drafting routine emails\n\n### Main Decision:\nThe team decided to call the 11 clients who have not sent their September invoices this week instead of waiting until the last day.\n\n### Risks and Checks Before End of Quarter:\n1. **Client Invoices**: The firm should ensure that all outstanding invoices are collected by the end of the quarter to avoid penalties or delays in VAT returns.\n2. **Social Security Registrations**: They need to verify that both client companies have completed their social security registrations for the new employees before they start work, as non-compliance",
          "run": 1,
          "psi_full_avg10_after": 0.0
        },
        {
          "time_to_first_token_s": 0.313,
          "wall_s": 4.611,
          "eval_count": 200,
          "eval_duration_s": 4.296,
          "generation_tok_s": 46.6,
          "prompt_eval_count": 364,
          "prompt_eval_duration_s": 0.113,
          "prompt_tok_s": 3220.9,
          "load_duration_s": 0.183,
          "total_duration_s": 4.608,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- Ana (director)\n- Javier (accounts)\n- Lucia (payroll)\n- Pablo (client service)\n- Third-quarter close date: 20 October\n- Number of clients filing VAT returns this year: 48 (6 more than last year)\n- Clients who have not sent September invoices: 11\n- Client companies hired new staff in October\n- Social security registrations for new employees\n- AI assistant for drafting routine emails\n\n### Main Decision:\nThe team decided to call the clients who have not sent their September invoices this week instead of waiting until the last day.\n\n### Risks and Checks Before End of Quarter:\n1. **Client Invoices**: The firm should ensure that all outstanding invoices are collected by the end of the quarter to avoid penalties or delays in VAT returns.\n2. **Social Security Registrations**: They need to verify that all social security registrations for new employees are completed before their start dates, as non-compliance can lead to fines",
          "run": 2,
          "psi_full_avg10_after": 0.0
        },
        {
          "time_to_first_token_s": 0.319,
          "wall_s": 4.643,
          "eval_count": 200,
          "eval_duration_s": 4.323,
          "generation_tok_s": 46.3,
          "prompt_eval_count": 364,
          "prompt_eval_duration_s": 0.113,
          "prompt_tok_s": 3207.4,
          "load_duration_s": 0.189,
          "total_duration_s": 4.64,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- People: Ana (director), Javier (accounts), Lucia (payroll), Pablo (client service)\n- Organizations: Small accounting firm\n- Dates: 5 October (meeting date), 20 October (third-quarter close), 19 October (next meeting date)\n- Amounts: Not specified in the note\n\n### Main Decision:\nThe team decided to call clients who have not sent their September invoices by the end of the week instead of waiting until the last day.\n\n### Risks and Checks Before End of Quarter:\n1. **Client Invoices**: The firm should ensure that all outstanding invoices are collected before the third-quarter close on 20 October. This includes following up with clients who have not sent their September invoices.\n   \n2. **Social Security Registrations**: The firm needs to verify that social security registrations for new employees hired by two client companies are completed and submitted before they start work. This is crucial to avoid any delays in payroll processing.\n\n3",
          "run": 3,
          "psi_full_avg10_after": 0.0
        }
      ]
    },
    {
      "model": "deepseek-r1:14b",
      "digest": "c333b7232bdb521236694ffbb5f5a6b11cc45d98e9142c73123b670fca400b09",
      "details": {
        "parent_model": "",
        "format": "gguf",
        "family": "qwen2",
        "families": [
          "qwen2"
        ],
        "parameter_size": "14.8B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "tools",
        "thinking",
        "completion"
      ],
      "think": false,
      "file_size_gb": 8.99,
      "loaded_size_gb": 15.29,
      "loaded_size_vram_gb": 15.29,
      "context_length": 32768,
      "memory_before_load": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 16.2,
        "mem_available_gb": 73.3,
        "psi_full_avg10": 0.0
      },
      "memory_after_runs": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 30.4,
        "mem_available_gb": 67.9,
        "psi_full_avg10": 1.07
      },
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 22.4,
        "prompt_tok_s": 1570.9,
        "time_to_first_token_s": 0.431,
        "wall_s": 9.372,
        "eval_count": 200,
        "prompt_eval_count": 342
      },
      "runs": [
        {
          "time_to_first_token_s": 20.332,
          "wall_s": 29.443,
          "eval_count": 200,
          "eval_duration_s": 9.109,
          "generation_tok_s": 22.0,
          "prompt_eval_count": 342,
          "prompt_eval_duration_s": 0.26,
          "prompt_tok_s": 1316.8,
          "load_duration_s": 20.067,
          "total_duration_s": 29.44,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- **People**: Ana (director), Javier (accounts), Lucia (payroll), Pablo (client service)\n- **Organizations**: The accounting firm\n- **Dates**:\n  - Monday team meeting: 5 October\n  - Third-quarter close ends: 20 October\n  - New employees hired in October\n  - Next meeting: Monday 19 October at 9:00\n- **Amounts**: None explicitly mentioned\n\n### Main Decision:\nThe team agreed to have Pablo call clients who haven't sent their September invoices by the end of this week and to ensure all emails containing amounts are manually checked before being sent.\n\n### Risks Identified and Checks Needed:\n1. **Late Invoices**: Some clients may delay sending invoices, risking missed deadlines. The firm should follow up with calls as planned and track responses.\n2. **Incomplete Registrations**: One client's new employee registration is pending an identity document, which could lead to delays in compliance",
          "run": 1,
          "psi_full_avg10_after": 7.91
        },
        {
          "time_to_first_token_s": 0.431,
          "wall_s": 9.372,
          "eval_count": 200,
          "eval_duration_s": 8.939,
          "generation_tok_s": 22.4,
          "prompt_eval_count": 342,
          "prompt_eval_duration_s": 0.218,
          "prompt_tok_s": 1570.9,
          "load_duration_s": 0.172,
          "total_duration_s": 9.369,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- **People**: Ana (director), Javier (accounts), Lucia (payroll), Pablo (client service)\n- **Organizations**: The accounting firm\n- **Dates**:\n  - Monday team meeting: 5 October\n  - Third-quarter close ends: 20 October\n  - New employees hired in October\n  - AI assistant testing since September\n- **Amounts**: None explicitly mentioned\n\n### Main Decision:\nThe team agreed to implement additional checks for emails generated by the AI assistant, ensuring that no email containing amounts is sent without human verification.\n\n### Risks and Checks Needed Before the End of the Quarter:\n1. **Invoices Not Sent**: Some clients have not submitted their September invoices. The firm should verify if Pablo successfully contacted them and ensure all outstanding invoices are followed up before the quarter close.\n2. **Late Social Security Registrations**: Two companies hired new staff, but one registration is pending due to missing identity documents. The firm needs to",
          "run": 2,
          "psi_full_avg10_after": 2.91
        },
        {
          "time_to_first_token_s": 0.434,
          "wall_s": 9.198,
          "eval_count": 200,
          "eval_duration_s": 8.762,
          "generation_tok_s": 22.8,
          "prompt_eval_count": 342,
          "prompt_eval_duration_s": 0.22,
          "prompt_tok_s": 1554.3,
          "load_duration_s": 0.175,
          "total_duration_s": 9.195,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- **People**: Ana (director), Javier (accounts), Lucia (payroll), Pablo (client service)\n- **Organizations**: The accounting firm\n- **Dates**:\n  - Monday team meeting: 5 October\n  - Third-quarter close ends: 20 October\n  - New employees hired in October\n  - Next meeting: Monday 19 October at 9:00\n- **Amounts**: None explicitly mentioned\n\n### Main Decision:\nThe team agreed to implement additional checks for emails generated by the AI assistant, ensuring that no email containing amounts is sent without human verification.\n\n### Risks and Checks Before the End of the Quarter:\n1. **Missed Deadlines for Client Invoices**:\n   - **Risk**: Clients who haven't submitted their September invoices might delay payment beyond the quarter close.\n   - **Check**: Ensure Pablo follows up with all clients as planned, and track responses to avoid missing any deadlines.\n\n2. **",
          "run": 3,
          "psi_full_avg10_after": 1.31
        }
      ]
    },
    {
      "model": "qwen2.5vl:7b",
      "digest": "5ced39dfa4bac325dc183dd1e4febaa1c46b3ea28bce48896c8e69c1e79611cc",
      "details": {
        "parent_model": "",
        "format": "gguf",
        "family": "qwen25vl",
        "families": [
          "qwen25vl"
        ],
        "parameter_size": "8.3B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "vision"
      ],
      "think": null,
      "file_size_gb": 5.97,
      "loaded_size_gb": 6.59,
      "loaded_size_vram_gb": 6.59,
      "context_length": 32768,
      "memory_before_load": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 30.4,
        "mem_available_gb": 67.9,
        "psi_full_avg10": 1.07
      },
      "memory_after_runs": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 25.5,
        "mem_available_gb": 75.1,
        "psi_full_avg10": 0.15
      },
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 43.3,
        "prompt_tok_s": 3122.1,
        "time_to_first_token_s": 0.307,
        "wall_s": 4.93,
        "eval_count": 200,
        "prompt_eval_count": 354
      },
      "runs": [
        {
          "time_to_first_token_s": 15.999,
          "wall_s": 20.595,
          "eval_count": 200,
          "eval_duration_s": 4.594,
          "generation_tok_s": 43.5,
          "prompt_eval_count": 354,
          "prompt_eval_duration_s": 0.147,
          "prompt_tok_s": 2409.5,
          "load_duration_s": 15.846,
          "total_duration_s": 20.592,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- Ana (director)\n- Javier (accounts)\n- Lucia (payroll)\n- Pablo (client service)\n- Clients filing quarterly VAT returns (48 this year, up from 42 last year)\n\n### Main Decision:\nThe team agreed that Pablo will make calls to clients who have not sent their September invoices by the end of the week.\n\n### Risks and Checks:\n1. **Non-payment Risk**: The failure to collect outstanding invoices could lead to financial losses for the firm. Before the quarter ends, the firm should ensure all outstanding invoices are paid or have a clear plan in place for follow-up actions.\n2. **Compliance Risk**: There is a risk of non-compliance with social security registration requirements if new employees start work without proper registrations. The firm must verify that all new hires' social security registrations are completed and filed before the quarter ends to avoid penalties.\n3. **Accuracy Risk**: The AI assistant, while saving time on simple replies, has been",
          "run": 1,
          "psi_full_avg10_after": 0.5
        },
        {
          "time_to_first_token_s": 0.307,
          "wall_s": 4.93,
          "eval_count": 200,
          "eval_duration_s": 4.621,
          "generation_tok_s": 43.3,
          "prompt_eval_count": 354,
          "prompt_eval_duration_s": 0.113,
          "prompt_tok_s": 3122.1,
          "load_duration_s": 0.176,
          "total_duration_s": 4.926,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- Ana (director)\n- Javier (accounts)\n- Lucia (payroll)\n- Pablo (client service)\n- Clients: 48 (this year), 42 (last year)\n- New hires in October: Two client companies\n\n### Main Decision:\nThe team agreed that Pablo will make calls to clients who have not sent their September invoices by Tuesday and Wednesday.\n\n### Risks and Checks:\n1. **Non-payment Risk**: The firm should ensure all outstanding invoices are collected before the quarter closes on 20 October, as late payments can impact cash flow and profitability.\n   - **Check**: Review the list of clients who still owe documents provided by Javier at the next meeting to prioritize collections.\n\n2. **New Employee Registration Risk**: Two client companies need their new employees' social security registrations filed before they start work; one registration is complete, while the other requires an identity document.\n   - **Check**: Confirm that all necessary paperwork for both new hires has been",
          "run": 2,
          "psi_full_avg10_after": 0.27
        },
        {
          "time_to_first_token_s": 0.36,
          "wall_s": 4.97,
          "eval_count": 200,
          "eval_duration_s": 4.609,
          "generation_tok_s": 43.4,
          "prompt_eval_count": 354,
          "prompt_eval_duration_s": 0.113,
          "prompt_tok_s": 3122.1,
          "load_duration_s": 0.23,
          "total_duration_s": 4.968,
          "done_reason": "length",
          "thinking": "",
          "output": "### Key Entities:\n- Ana (director)\n- Javier (accounts)\n- Lucia (payroll)\n- Pablo (client service)\n- Clients: 48 this year (6 more than last year)\n\n### Main Decision:\nThe team agreed that Pablo will make calls to clients who have not sent their September invoices by Tuesday and Wednesday.\n\n### Risks and Checks:\n1. **Non-payment Risk**: The firm should ensure all outstanding invoices are collected before the quarter closes on 20 October, as late payments can impact cash flow and financial statements.\n   - **Check**: Review the list of clients who still owe documents provided by Javier at the next meeting.\n\n2. **Social Security Compliance Risk**: There is a risk that new employees may start work without proper social security registrations, which could lead to legal penalties or employee dissatisfaction.\n   - **Check**: Verify all new hires have their social security registrations completed and filed before they begin working.\n\n3. **AI Assistant Accuracy Risk**: The AI assistant might",
          "run": 3,
          "psi_full_avg10_after": 0.18
        }
      ]
    },
    {
      "model": "gemma4:26b",
      "digest": "5571076f3d70050487b26b341705799e0ab29b808164f90d20d4cf84f699d251",
      "details": {
        "parent_model": "",
        "format": "gguf",
        "family": "gemma4",
        "families": [
          "gemma4"
        ],
        "parameter_size": "25.8B",
        "quantization_level": "Q4_K_M"
      },
      "capabilities": [
        "completion",
        "vision",
        "tools",
        "thinking"
      ],
      "think": false,
      "file_size_gb": 17.99,
      "loaded_size_gb": 17.47,
      "loaded_size_vram_gb": 17.47,
      "context_length": 32768,
      "memory_before_load": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 25.5,
        "mem_available_gb": 75.1,
        "psi_full_avg10": 0.15
      },
      "memory_after_runs": {
        "mem_total_gb": 121.7,
        "mem_free_gb": 30.9,
        "mem_available_gb": 77.8,
        "psi_full_avg10": 4.58
      },
      "reported_run": 2,
      "reported": {
        "generation_tok_s": 61.1,
        "prompt_tok_s": 1860.4,
        "time_to_first_token_s": 0.693,
        "wall_s": 3.971,
        "eval_count": 200,
        "prompt_eval_count": 350
      },
      "runs": [
        {
          "time_to_first_token_s": 63.025,
          "wall_s": 66.493,
          "eval_count": 200,
          "eval_duration_s": 3.465,
          "generation_tok_s": 57.7,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 1.103,
          "prompt_tok_s": 317.3,
          "load_duration_s": 61.915,
          "total_duration_s": 66.489,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm (unnamed), unnamed clients (48 total for VAT returns, 11 with missing invoices, 2 with new staff).\n*   **Dates:** 5 October (meeting date), 20 October (Q3 close deadline), Tuesday and Wednesday (scheduled calls), October (new hires), September (start of AI testing), Monday 19 October at 9:00 (next meeting).\n*   **Amounts:** 48 clients (VAT returns), six more than last year, 11 clients (missing invoices), two client companies (hiring staff).\n\n**Main Decision**\nThe team decided that Pablo will proactively call clients with missing September invoices this week and that all AI-generated emails containing financial figures must undergo a manual human review.\n\n**Risk Assessment**",
          "run": 1,
          "psi_full_avg10_after": 5.44
        },
        {
          "time_to_first_token_s": 0.693,
          "wall_s": 3.971,
          "eval_count": 200,
          "eval_duration_s": 3.274,
          "generation_tok_s": 61.1,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 0.188,
          "prompt_tok_s": 1860.4,
          "load_duration_s": 0.431,
          "total_duration_s": 3.966,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm (unnamed), unnamed clients (48 total for VAT returns, 2 with new staff).\n*   **Dates:** 5 October (meeting date), 20 October (Q3 close deadline), September (start of AI testing), Tuesday and Wednesday (scheduled calls), October (new staff hiring month), 19 October at 9:00 (next meeting).\n*   **Amounts:** 48 clients (VAT returns), 6 more clients than last year, 11 clients (missing invoices).\n\n**Main Decision**\n\nThe team decided that Pablo will proactively call the eleven clients with missing September invoices this Tuesday and Wednesday, and all AI-generated emails containing financial figures must undergo a manual human review.\n\n**Risks and Recommendations**\n\nThe firm faces three primary",
          "run": 2,
          "psi_full_avg10_after": 7.03
        },
        {
          "time_to_first_token_s": 0.727,
          "wall_s": 3.991,
          "eval_count": 200,
          "eval_duration_s": 3.26,
          "generation_tok_s": 61.3,
          "prompt_eval_count": 350,
          "prompt_eval_duration_s": 0.204,
          "prompt_tok_s": 1718.6,
          "load_duration_s": 0.447,
          "total_duration_s": 3.986,
          "done_reason": "length",
          "thinking": "",
          "output": "**Key Entities**\n\n*   **People:** Ana (Director), Javier (Accounts), Lucia (Payroll), Pablo (Client Service).\n*   **Organisations:** The accounting firm (unnamed), unnamed clients (48 total for VAT, 11 with missing invoices, 2 with new staff).\n*   **Dates:** 5 October (meeting date), 2/3 October (Tuesday/Wednesday for calls), 20 October (Q3 close deadline), September (start of AI testing), October (new staff hiring), 19 October at 9:00 (next meeting).\n*   **Amounts:** 48 clients (VAT returns), 6 more clients than last year, 11 missing invoices.\n\n**Main Decision**\n\nThe team decided that Pablo will proactively call clients with missing September invoices this week and that all AI-generated emails containing financial figures must undergo a manual human review to ensure accuracy.\n\n**Risk Assessment**\n\n",
          "run": 3,
          "psi_full_avg10_after": 4.71
        }
      ]
    }
  ]
}
