Cost per correct answer: V4 Flash, V4.1 Flash, V4 Pro
11 exhaustive-validation tasks, 3 runs each, at each model's peak list card (V4 Flash at its last card; off-peak is half). Total spend divided by correct answers.
effort low
V4 Flash 0731: $0.00131, 33/33 correct
V4.1 Flash: $0.00097, 33/33 correct
V4 Pro 0813: $0.00286, 33/33 correct
effort high (default)
V4 Flash 0731: $0.00163, 33/33 correct
V4.1 Flash: $0.00149, 33/33 correct
V4 Pro 0813: $0.00768, 33/33 correct
effort max
V4 Flash 0731: $0.00343, 33/33 correct
V4.1 Flash: $0.00129, 33/33 correct
V4 Pro 0813: $0.00825, 33/33 correct
thinking off
V4 Flash 0731: $0.00083, 21/33 correct
V4.1 Flash: $0.00050, 21/33 correct
V4 Pro 0813: $0.00232, 21/33 correct
Red bars: thinking off, where every model loses answers; the low price buys wrong ones.