Oracle's newly released Java 7 runtime is relatively painless to install and uninstall.

When you install Java on a Windows PC for the first time, the installer includes this step, which I’ve previously documented: Notice how the check box for that Ask toolbar is selected already.