The pointer really needs changing. It's a hang over from testing the "hardware sprite" bounds with the screen.
The Middle mouse button thing is actually the way to breakout the focus from amiberry, essential if you accidentally click away from the pause menu and restore focus to a paused game / app.