Well… Just take a look, please…
Its people already did this. What im thinking of is a raycast engine, not a full on 3d renderer like you mentioned. Since hardware is very slow with actual 3d rendering i think raycast engines are the way to making good-looking 3d scenes.