If you want to do it in DOS, you can boot to a floppy and use "cd" to get into your desktop directory ("c:\WINDOWS\DESKTOP" on a Win98/ME machine). Then just use "del <filename>" to delete it.
It is easier to remove in safe mode, but booting from the hard drive may still cause you problems.
BTW, Welcome to TechIMO!!