Well actually, I've washed my car several times, even the inside edges of the wheel wells, and when drying, the absorber still picks up tiny dirt particles and other decent sized flakes of whatever, that can scratch the paint. Whether it'* crap from the air that falls on the car after it'* washed, or small stuff I missed with the wash mitt, it'* possible for any towel or drying cloth you use to scratch the paint. Microfiber would be worse IMO since the fibers attract that stuff easier.
That'* why I rinse the absorber after drying a section of the car. Even the tiniest particles can scratch the paint. It'* impossible to avoid even putting one tiny scratch on your car by accident (and most of these scratches we're talking about are very fine scratches), but there are ways to be more careful. The absorber is one of the safest things to use if you rinse it often.
Andrew asked a good question though, and that actually had crossed my mind too. What'* more risky, a leaf blower or a clean absorber? I'd probably say a leaf blower.