You're not crazy. I change my oil every 3000 miles (used to do it every 2500 for a while). This month I'm changing it even though I've only driven 1300 miles in the past 3 months. I let my car warm up for 10 minutes in the winter and don't drive it until the temp is about 140-150*. I don't even want to drive it cold at 2000rpms.
I don't want to risk anything. Summer time is a bit different, but I've decided to baby it more because I want it to last until I can buy my dream car. If something goes wrong before I have the money for my dream car, I'll be very unhappy.