Actor Jeremy Piven has sworn off soy milk after complaining about side effects.