When fountains are empty they disappear from the map, but don't worry! They will come back after some time. The time depend on their refill speed (keep reading).