Misogyny and antisemitism are attempt to silence people trying to bring about change, conference hears