I towel dry too. I guess, I colored my hair too much in the past that it's beyond repair regardless of what I do. To me, blow drying makes the hair look shiny and healthier.
let it dryout, I shower every morning and goes to work w/ hair un-comb ,tangle, fuzzy , soaking my t-shirt, at the end of day it's like a bird nest. my lazy style lol