If you run firefox on a flashdrive then all of your internet temp files/cache/history is already on the flashdrive and only the flashdrive. You dont need any additional software.
Only difference is the password protection software on flashdrive. Which can be found for free within a minute or two on google... thunderbird and roboform are free as well
And im sure everyones familiar with hushmail?