If I try to write an enum as e.g. \xbf\x67variant\x65hello\xff there's a somewhat confusing error: "invalid type: map, expected variant identifier"

This is probably not common (I was just writing a test with manually written cbor bytes) but theoretically some implementation in another language could always rewrite maps into indeterminate length maps..