Honestly? I find myself liking them (go figure). However, there is a fine line between going to the gym and going on a date, so let's review, shall we?
1. Keep it tailored. Juuuust like the easy pant, there needs to be some structure to this look. A blazer with strong shoulders, a cinched in jacket-- anything with obvious lines and some fitted aspects will do.
(Rag and Bone, Fall '10-- they got it down!)
2. Play off the opposites. To make it fun, pair the casual pants with a dressy top. Lace, velvet, brocade, even fur! (all very cold-weather appropriate) would be a great contrast to the relaxed nature of the pants.
(Photo from Mint Velvet)