My laptop battery is dead. Is it safe to use my laptop?

No issue what so ever. Infact you can take your battery out of the tray if your worried. The computer will still work without it being inside. But then dust would get into the tray. If you want you can buy a new battery from what ever dealer is your laptop. [HP, Sony, Dell]