Fiercer weather and worsening wildfires drove more than 20 million people from their homes over the last decade - a problem set to worsen unless leaders act swiftly to head off surging climate threats, anti-poverty charity Oxfam said today.