Sounds like a problem with the conformance suite then?

A number of the CMA9 were given a deadline extension, so there is no reason for them to be compliant yet.