Make samplerSound refer to pre-allocated audio buffer

Is there a simple way to get a SamplerSound object to refer to a specific audio buffer without using the audioformat manager?

I’d like to set up a midi-based audition system through which I can set the sampler sound to various different buffers containing audio. I’m aware there are probably better ways to do this, but I’m curious as to how it might be done via the sampler sound object.