I've had a peripheral interest in virtual sets and real-time compositing by way of a colleague from grad school.

A quick visual summary of this tech: http://www.lightcrafttech.com/portfolio/beauty-beast/

This video was from a pilot several years ago, and it didn't make it to air, but it was visually wonderful.