Have better internal error types

What we do at the minute is mainly use `fmt.Errof` to add a bit of context to our errors. We could be a bit better about that, and add our own error types.

Likely we could use those to print better error messages, but the main benefit would be in the testsuite we could check the error returned to see if the condition we wanted has happened - currently we check it in a pretty naive way.