I imagine pluginval is attempting to get the plugin under test to instantiate its GUI, and that there is an issue with WindowServer not allowing the app to launch, perhaps because, as you’re running headless, the Mac booted to the LoginWindow and there aren’t any real users logged in?
See this StackOverflow answer for more details:
The answer might be to have your system automatically log in to your test user - i.e. bypass the LoginWindow - which may work even if you don’t have a monitor physically connected.
The reason this wasn’t caught is because the AU validation action has continue-on-error: true — probably leftover when we were debugging and releasing 1.0!