Harness
pi
| rider | scenario | harness | model | workflow | quality | cost | time | result |
|---|---|---|---|---|---|---|---|---|
| house | js-commander-negative-exp-E | [email protected] | grok-4.5 | baseline | 1.00 | — | 23.4s | completed |
| house | js-commander-negative-exp-E | [email protected] | grok-4.5 | baseline | 1.00 | $0.056 | 17.8s | completed |
| house | go-chi-tee-bytes-double-count | [email protected] | grok-4.5 | baseline | 1.00 | $0.077 | 28.0s | completed |
| house | js-commander-negative-exp-E | [email protected] | grok-4.5 | baseline | 1.00 | $0.190 | 20.2s | completed |
| house | js-commander-negative-exp-E | [email protected] | grok-4.5 | baseline | 1.00 | $0.251 | 21.8s | completed |
| house | go-chi-tee-bytes-double-count | [email protected] | grok-4.5 | baseline | 1.00 | $0.261 | 1.1m | completed |
| house | python-fastapi-stream-router-schema | [email protected] | grok-4.5 | baseline | 1.00 | $0.628 | 3.7m | completed |
| house | python-fastapi-stream-router-incomplete | [email protected] | grok-4.5 | baseline | 1.00 | $0.756 | 3.1m | completed |
| house | python-fastapi-stream-router-schema | [email protected] | grok-4.5 | baseline | 1.00 | $1.162 | 5.5m | completed |