I don't know a way to do it directly, but if you have a preset saved you can use the Screenmode prefs without opening the GUI. I think the syntax is something like (assuming SYS:Prefs is in your command path):
Screenmode SYS:Prefs/Presets/myscreenmode.preset USE
