Hey, MrPaco ~ Paint thinner should work on the duct tape stuff.

As for the liner...I'd vote to take it off and see what the bed looks like. If you can live with that, then leave the liner off.