We’ve been trying hard to work out a way around this, but have been unable to find any good solutions.
We cannot remove the dependency on CoreAudioKit without breaking AU, AUv3 and Bluetooth MIDI, and, whilst avoiding linking the framework for other plug-in formats is possible, it introduces too much complexity into the build system and doesn’t actually do anything the address the underlying problem.
The way we would suggest working around this is to export the project twice. First build everything apart from macOS ARM against the 10.12 SDK, then build just the ARM versions using a more recent SDK. Finally, use lipo to join the x86_64 and ARM versions.