You don't rotate them. There are generally two of each object, one pointing right and the other one pointing down.
To rotate things like chairs or critters, right click on the item. This brings up a menu where you can choose rotate. Keep in mind, not all items can be rotated, mostly just the critters and chairs. The rest just shift positions within the square it was placed.