I got one the day they came out and love it. We've an iPad3 as well and I prefer the Nexus - we've a desktop pc, two laptops and the iPad but I was using the Nexus to browse CC when I saw this thread anyway.
It's around half the size and weight of the iPad, easier to carry, easier to read, better functionality, easier to type etc, The iPad might win if I'm at home for the day but, as a travelling tool, the Nexus wins out totally, even in a straight contest without considering the 3x price difference. The iPad hasn't been out of the house since we bought it, the Nexus comes with me everywhere.
Oh, and I think the lack of sim is a bonus. My phone, and many other smart phones, can be used to create a wireless access point and I can position that where the signal is strongest and connect to the world through it. There's no need for another device on contract, another number and another monthly charge and I can set up the phone then piggy back off that with Nexus, iPad, laptop and whatever else I want, rather than having to sort out access for every device. If I want wireless access, BT connect points are pretty prevalent, I can see three from where I'm sitting now, and many cafés have free wireless access but, tbh, I just use the phone's hardware as I like to control access rather than using other people's network points with other people's ideas of security. So, I definitely see the lack of SIM as a bonus.
But, back to the Nexus, love it, would replace in a flash and, given my phone contract is up soon, buying the Nexus and sticking with the current phone will actually work it cheaper than switching some something like the Samsung SIII which is smaller and less convenient than the Nexus but, at the same time, larger and less convenient than just taking the current phone, if space is an issue.
Downsides... none for me. Some don't like that it has a single low-quality camera, compared to the two cameras on the iPad, but I use a DSLR for images. Also, the battery life in the iPad seems to be better, but the difference is pretty marginal and I have some fairly juicy apps running 24/7 on this. In terms of the battery life, it's telling me that it has been unplugged for 44 hours and I still have 25% battery remaining.