Latency compensation for audio but not for midi?

I know this is a long-shot - but is there a way to ask the host to apply delay compensation on the audio only and NOT the MIDI? ie - midi notes and controllers have to arrive on time, but the audio has to be fed early.

i have a midi effect - that the audio needs some pre-processing but the midi notes must be played live
would be grateful for any idea.