Originally Posted by AntonMG

Brings us back to option one, buy a 8Go USB stick, install Ubuntu live on it with persistent space to allow updates.
Add a firewall of some kind.
A virtual keyboard (random positions) for the passcode

That's as safe as you are going to be.