Had an Acer A100 tablet for about a year, a Galaxy Nexus for several months, and just got a Samsung SII for my wife a couple of days ago. We both have used iPhones and iPods as well for several years.
The thing that drove me a bit nuts was how I could hardly figure out how to use my Wife's SII. Both the Nexus and it are running Ice Cream Sandwich. Yet the UI, behaviour, and features are quite different. This is insane. And the Acer tablet also on ICS is a bit different too. I bought the Nexus because I heard it was the raw Android experience without some other UI crap put on it. Now I understand why that was important. That TouchWiz stuff is just useless ugly annoying crap. I think manufacturers need a reality check here that the stuff they are adding to tick of feature boxes is just dragging them down.
And yes, it can be very annoying waiting for updates. I bought the Nexus with the understanding that the latest Android would most likely be available for it. It's still stuck on 4.0.1 while the SII I could updated to 4.0.3. I wouldn't normally mind this but the Nexus has been very unstable, it's lucky to go a couple of days without spontaneously rebooting, I'm hoping an update might fix this.
And hearing that Flash is not going to be supported in Android 4.1 is disappointing. Half of my time using Android is watching local TV stream presented in flash. I have no love for flash and wish the world would move on from it but if there is no way to do this going forward I will not be pleased, and I'll just try to stick on 4.0.x.
Now with all that griping I'll still take Android over iOS any day. Couldn't stand being told what I was allowed to do and not do with my iOS device. My iPod apps crap out even more than my Android apps, and the iOS app store never wants to work.
I have no problem at all with the usability of Android other than the fact every device seems to make it look different.