Many workers only have their retirement savings for emergencies