This sounds similar to an issue reported here:
Perhaps it’s worth trying out the Xcode 15.1 beta to see whether things are fixed there.