Achieve 2D in 3D Fez effect

Hello everyone!

I really admire the 2D in a 3D world effect that Fez has. But I’ve got no idea on how I could implement something like it. Any ideas?