Something that helps is to set input device to “none”. And I noticed that this bug doesn’t appears with pipewire.