Adam,<br><br><div class="gmail_quote">On Wed, Nov 7, 2012 at 11:03 AM, Adam Armstrong <span dir="ltr">&lt;<a href="mailto:adama@memetic.org" target="_blank">adama@memetic.org</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

  
    
  
  <div bgcolor="#FFFFFF" text="#000000"><div class="im">
    <div>On 07/11/2012 11:39, Chris Stone wrote:<br>
    </div>
    <blockquote type="cite">On a few occasions graphs would have no data for some
      devices. Nuking all of the RRD files and starting that device over
      for data would &#39;fix&#39; it, but I loose all historical data. Now I
      have a dozen or so Linux servers that I am getting blank graphs
      for. Running poller.php for the devices manually shows data being
      received and I note no errors. Nuking the RRD files does not fix
      it though. Might be able to dig in and, maybe, but I have just
      don&#39;t have the time to f*@!k with it - need something I can rely
      on - used to use Cacti and it was great but a pain setting up new
      devices. Observium is great and very easy to setup new devices,
      but this problem that keeps popping up causing historical data
      loss to fix - or as now, that does not even fix, is not something
      I can mess with anymore. I do like Observium overall and don&#39;t
      like having to switch away from it, but need the data and
      something reliable for ourselves and our clients....<br>
      <br>
    </blockquote></div>
    I&#39;ve never seen anything like this happen, and I&#39;ve seen some pretty
    fucked up installations!<br>
    <br>
    What exactly happens? Do devices spontaneously lose all of the
    existing data, do they stop recording data after a while? Is it
    /every/ graph, or just some?<br></div></blockquote><div><br>It appears to pull data - &#39;poller.php -d&#39; shows data - lots of valid counters - see no problem there - e.g.:<br><br>RRD[update /opt/observium/rrd/<a href="http://hydra.mydomain.com/ucd_load.rrd">hydra.mydomain.com/ucd_load.rrd</a> N:5:2:0] including: includes/polling/ipSystemStats.inc.php<br>
Polling IP-MIB ipSystemStats DEBUG: SNMP Auth options =  -v2c -c k3fJzJAFeAtCyYKVFNxX<br>/usr/bin/snmpbulkwalk -v2c -c k3fJzJAFeAtCyYKVFNxX -OQUs  -m IP-MIB -M /opt/observium/mibs udp:<a href="http://hydra.mydomain.com:161">hydra.mydomain.com:161</a> ipSystemStats<br>
ipSystemStatsInReceives.ipv4 = 2124263890<br>ipSystemStatsInReceives.ipv6 = 19818236<br>ipSystemStatsHCInReceives.ipv4 = 6419231186<br>ipSystemStatsHCInReceives.ipv6 = 19818236<br>ipSystemStatsInOctets.ipv6 = 3931117553<br>
ipSystemStatsHCInOctets.ipv6 = 3931117553<br>ipSystemStatsInHdrErrors.ipv4 = 0<br>ipSystemStatsInHdrErrors.ipv6 = 0<br>ipSystemStatsInNoRoutes.ipv4 = 0<br>ipSystemStatsInNoRoutes.ipv6 = 0<br>ipSystemStatsInAddrErrors.ipv4 = 99390<br>
ipSystemStatsInAddrErrors.ipv6 = 0<br>ipSystemStatsInUnknownProtos.ipv4 = 0<br>ipSystemStatsInUnknownProtos.ipv6 = 0<br>ipSystemStatsInTruncatedPkts.ipv4 = 0<br>ipSystemStatsInTruncatedPkts.ipv6 = 0<br>ipSystemStatsInForwDatagrams.ipv4 = 0<br>
ipSystemStatsInForwDatagrams.ipv6 = 0<br>ipSystemStatsHCInForwDatagrams.ipv4 = 0<br>ipSystemStatsHCInForwDatagrams.ipv6 = 0<br>....<br><br>and the rrd file appears to get updated:<br><br>-rw-r--r-- 1 root root 371152 Oct 17 16:31 /opt/observium/rrd/<a href="http://hydra.mydomain.com/ucd_load.rrd">hydra.mydomain.com/ucd_load.rrd</a><br>
<br>But the graphs show no data. They used to and then not. Some systems still show data, it&#39;s only a few and seems to be only some Linux servers - differing versions of CentOS.<br><br>And I am not even seeing any of my historical data - all graphs show &#39;nan&#39; for the data including old data that it was showing at one point....<br>
<br>Note too that it seems to be just something with the RRD&#39;s since on the device overview page, the graph is blank, but the &#39;bars&#39; on the right (Processors, Memory Pools and Storage) do so information correctly.<br>
<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000">
    <br>
    The only thing I can think of immediately to cause this would be if
    Observium somehow got a broken date far into the future, which
    caused rrd to refuse to accept any new data until that point. That
    would only break code which sends a specific date though, like the
    ports code.<span class="HOEnZb"><font color="#888888"></font></span><br></div><br></blockquote><div><br>Don&#39;t know - how would I check that and/or how would I recover from it without loosing historical data and keep it from happening again? <br>
<br>I&#39;d really prefer to stay with Observium, but my time for this is very limited and .....<br> </div></div><br><br>Chris<br><br clear="all"><br>-- <br>Chris Stone<br>AxisInternet, Inc.<br><a href="http://www.axint.net" target="_blank">www.axint.net</a><br>