Although the Nazis used the inverted swastika (facing right instead of left), the Buddhists have used it facing left and right.
I've encountered the swastikas often at Buddhist temples in several countries and the temples were places of calm and serenity. No jack boots on the monks, not even Doc Martins or Nike's. More like barefooted.
Note: Headline links to source.