Another idea for a project

I had another idea for a project you could do using a PC and webcam - a pseudo 3d display. Basically the camera would be used to track (or estimate) the position of a person in the room and the display would show a 3d scene where the camera would change orientation depending on where the person is standing. Basically the person would be able to walk around in the room and it would look like they are looking out of a window into a 3d scene. You could have the person wear a bright colored hat or something like that to make tracking easier (or you could use RFID instead of a the camera). The idea is a variation on some other projects I've seen where an on screen character turns his head to follow you.