First of all, the cactus does not look like a swastika-- it's arms and legs go the wrong ways.
Second, a swastika has a lot of history to it aside from the Nazi aspect. Hell, Girl Scouts in America used it as a symbol prior to WWII
http://en.wikipedia.org/wiki/Swastika
People see what they want to see. It's kind of like an ink blot test. What you make of a symbol says more about yourself than anything else.