We've just finished the episode "Amy's Choice" in season 5, and you were all correct—Matt Smith has grown on me.
His mannerisms and whatnot are completely not what I expected of him simply based on looks. I'm finding his take on the Doctor very interesting; so far, I keep seeing behaviors that lead me to think he's playing him in an almost autistic fashion (and before anybody gets their knickers in a twist, I worked for years with the autistic population, so that's based on personal experience, not anecdotal evidence). It's quite intriguing so far.
And Amy and Rory are just lovely. She reminds me so much of Megan Follows, who so memorably played Anne of Green Gables back in the 80's (still one of my favourite book adaptations of all time).
So yeah. I'm relieved, to say the least. And really looking forward to the episodes coming up, especially the Neil Gaiman ones.