With improv, it's a combination of listening and not trying to be funny.
The current Babe Ruth of improv? Sacha Baron Cohen. He's pretty amazing.