Silence is only frightening to people who are compulsively verbalizing.
After one of the lectures in Philadelphia, a woman asked Chesterton what made women talk so much, to which he replied, briefly, 'God, Madam'.