Not a DNS issue. We could ping google, but HTTP/HTTPS connections were not going through. Checked with third party monitoring systems and they also reported the same state
________________________________ From: observium [observium-bounces@observium.org] on behalf of Joseph L. Brunner [joe@affirmedsystems.com] Sent: Monday, December 01, 2014 10:30 PM To: Observium Network Observation System Subject: Re: [Observium] Observium and Google downtime
What is your dns server?
Sure its good?
We use google’s own 8.8.8.8
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Milton Ngan Sent: Tuesday, December 02, 2014 01:27 AM To: observium@observium.org Subject: [Observium] Observium and Google downtime
We use the Google Map API, and it appeared that Google was unreachable here for several minutes. In that time, our Observium box ground to a halt due to all the PHP processes hanging on what I can only guess were map API calls. Once Google came back the machine became responsive again after all the processes finally cleared out.