Stephen Yaxley-Lennon’s former producer explains how the hard-right has chosen a fight it cannot win and why Boris Johnson cannot cut it completely loose