I use hungarian keyboard with AltGr button and I have this line in my settings file:
use_altgr_substitute=0
If I want to switch to vi mode with Ctrl-Alt-j an í will be written in the console (like in any other editor e.g. notepad) and the editing mode doesn't change.