tool                              pass   rate   $/run  calls  wall s   tok in  capped
Cua MCP                        49/58      84%   0.196   17.8    51.5   678742       0
Ours: computer mcp 0.1.12      51/58      88%   0.165   14.3    52.8   499428       0

per task (passes out of runs scored, mean calls):
  libreoffice_calc-1954cced          Cua MCP 3/3  22.0c   Ours 3/3  14.3c
  libreoffice_calc-4e6fcf72          Cua MCP 3/3   5.0c   Ours 3/3   5.3c
  libreoffice_calc-6e99a1ad          Cua MCP 3/3  10.0c   Ours 3/3   8.7c
  libreoffice_calc-d681960f          Cua MCP 3/3   5.7c   Ours 3/3   5.0c
  libreoffice_calc-eb03d19a          Cua MCP 3/3   7.0c   Ours 3/3  11.7c
  libreoffice_impress-05dd4c1d       Cua MCP 1/3  20.0c   Ours 3/3  11.3c
  libreoffice_impress-73c99fb9       Cua MCP 2/3   7.7c   Ours 3/3   5.7c
  libreoffice_impress-a097acff       Cua MCP 3/3   9.0c   Ours 3/3  10.0c
  libreoffice_impress-f23acfd2       Cua MCP 1/3  10.0c   Ours 1/3   6.3c
  libreoffice_writer-0e763496        Cua MCP 3/3   8.3c   Ours 3/3   5.7c
  multi_apps-4c26e3f3                Cua MCP 3/3  22.3c   Ours 3/3  13.3c
  multi_apps-69acbb55                Cua MCP 1/1  96.0c   Ours 0/1  26.0c
  multi_apps-91190194                Cua MCP 3/3  19.7c   Ours 3/3  13.3c
  multi_apps-a82b78bb                Cua MCP 2/3  33.7c   Ours 2/3  25.3c
  multi_apps-c2751594                Cua MCP 3/3  42.0c   Ours 3/3  23.3c
  multi_apps-da52d699                Cua MCP 3/3  14.7c   Ours 3/3  10.7c
  multi_apps-df67aebb                Cua MCP 0/3  20.3c   Ours 0/3  37.0c
  multi_apps-e2392362                Cua MCP 3/3  22.0c   Ours 3/3  38.7c
  thunderbird-7b1e1ff9               Cua MCP 3/3  25.0c   Ours 3/3  16.3c
  thunderbird-dd84e895               Cua MCP 3/3   7.0c   Ours 3/3   5.0c

unscored:
  multi_apps-69acbb55 cua-mcp t1: hit the 100-turn cap, 138.6 s, 100 calls, $1.364
  multi_apps-69acbb55 cua-mcp t3: hit the 100-turn cap, 129.6 s, 100 calls, $1.366
  multi_apps-69acbb55 computer-mcp-0112 t2: hit the 100-turn cap, 328.8 s, 100 calls, $1.049
  multi_apps-69acbb55 computer-mcp-0112 t3: hit the 100-turn cap, 330.0 s, 100 calls, $1.063