Not a good solution, but you could add a front derailleur and fix it in place. It won't rub if the chain isn't falling off, and should prevent it from trying. You could also try something like NGear JumpStop.
Try getting a trainer and riding your bike to see if you can make it happen while...