I have a 2Gb USB drive with linux that I use for that purpose. It 'just works' on more or less any PC, and unlike windows it has no problem with differing hardware. In practice I don't use it that often as I usualy have access to more normal PCs, but it is still good to have on my keyring just in case.
Head over to
PenDriveLinux.com for instructions.