I have even cleaned car with waterless wash dirtied in rain. But it takes more time and more waterless wash.
Just spray and mist. I use only one towel and roll it after every wipe. Here is a video explaining how to do it.
Well you cannot avoid swirls, but by this method you will have lesser.