log fails during the run
Following on from !9, log unexpected results and flakes as they happen with pointers to the QPA files involved so you can go debug them. This may reduce the desire for !10 and will be very useful in CI (you can see what's going on in your branch as the CI is still running, and we'll be able to parse that output to speed up the nasty QPA extraction loop)