The way to prevent violence is to stand back and watch as others call for and commit violence?

Inaction to help a persecuted group is siding with the persecutors. You aren’t more intelligent, peaceful or high minded by sitting by, just more tolerant of assholes. Tolerance for others intolerance makes you their ally.