Need to deactivate NVIDIA driver from recovery mode or using Ubuntu 12.04 install disk

Need to deactivate NVIDIA driver from recovery mode or using Ubuntu 12.04
install disk

I tried switching graphics drivers from 317 to 304(post-release) because
it kept crashing when I wanted to move my monitor's display to the other
side of the laptop display (using NVIDIA Settings)
Now Ubuntu won't boot at all. It just crashes and leaves a blinking cursor
but I can't type anything.
I want to switch the graphics driver back to the old one using recovery
mode or the Ubuntu install disk so I can boot again. How can I do this?