Do you have the ‘randomise tests’ feature enabled in pluginval? There may be a bug in pluginval that could cause this, as discussed in this thread: