Hi guys,

Hope someone here can shed some light on my issue with rrdcached and observium. I am using a distributed setup with web/sql/poller on separate machines. Followed the guide here http://blog.best-practice.se/2017/10/scaling-observium-horizontally.html and currently using two pollers with great success overall

What I can’t seem to figure out is why some rrd files won’t get created. It doesn’t matter what poller I am using or what devices, it is always the following rrd-files

ping.rrd

ping_snmp.rrd

status.rrd

Some information regarding my system

Observium        18.7.9354 (30th July 2018)

OS                      Linux 4.4.0-130-generic [amd64] (Ubuntu 16.04)

Apache              2.4.18 (Ubuntu)

PHP                    7.0.30-0ubuntu0.16.04.1 (OPcache: ENABLED)

Python               2.7.12

MySQL               5.7.23-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev)

SNMP                NET-SNMP 5.7.3

RRDtool            1.5.5 (rrdcached 1.5.5: unix:/var/run/rrdcached.sock)

Fping                  3.13 (IPv4 and IPv6)

rrdcached settings

$config['rrdcached'] = 'ip address';

$config['rrd']['no_local'] = TRUE;

root@server:/home/user# ps aux | grep rrdcached

observi+ 13596  1.6  0.5 1727784 45980 ?       Ssl  Aug01  15:07 /usr/bin/rrdcached -B, -F, -O, -R -L -w 1800 -z 1800 -t 8 -b /opt/observium/rrd/ -j /var/lib/rrdcached/journal/ -G www-data -U observium -p /var/run/rrdcached.pid -s www-data -m 0660 -l unix:/var/run/rrdcached.sock

rrdcached journal file show no trace of the files

Syslog errors on rrdcached server

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/status.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/ping.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/status.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/ping_snmp.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/ping.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/ping_snmp.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/status.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/ping.rrd) failed.

Aug  2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/ping_snmp.rrd) failed.

I can manually create a rrd file from the poller with success

rrdtool create device/status.rrd --daemon ip-address RRA:AVERAGE:0.5:1:2016 DS:status:GAUGE:600:-20000:U

Best regards

Christian Eriksson