Deteriorating. Something of use or beauty has become useless or ugly. ‘Dogs’ references the fact that humans would not be in the condition that only dogs could live in.(Compare to Go from bad to worse or Go downhill.)

“That old house use to be the nicest in town, but after years of neglect it has gone to the dogs.”