Sounds like you might have a short, and the issues have the ignition in common. Could be a relay for the fuel pump went bad and the key gives power to the relay that's stuck closed, or the harness the ignition runs on is at fault. There is a buzzer for key in ignition so you don't forget to take the key when you turn the engine off.
Bookmarks