Have you reviewed
Distrowatch for CD based distros?
Some of the business card distros include compiling capabilities....
Try looking into
Damn Small Linux,
LNX-BBC, and
DemoLinux - all offer gcc 2.95.3 or better in their live CD, but DemoLinux is possibly dead project.
Then, just mount your local hard disc and save your work, no install needed.