Hi all,

 

In an attempt to improve the performance (previous email thread with subject Performance Issue - High CPU with 'mysqld'?), I'm trying to use 'rrdcached' on a new setup (version 18.9.9428 (9th September 2018) with the following configuration:

 

===

 

sjc-observium-1:/etc/init.d# cat rrdcached

<...snipped...>

# Path to the apachectl script, server binary, and short-form for messages.

rrdcached=/usr/sbin/rrdcached

prog=rrdcached

pidfile=/var/run/rrdcached/rrdcached.pid

sockfile=/var/run/rrdcached/rrdcached.sock

lockfile=/var/lock/subsys/rrdcached

RETVAL=0

<...snipped...>

 

-

 

sjc-observium-1:/etc/sysconfig# cat rrdcached

<...snipped...>

RRDCACHED_USER="apache"

OPTIONS="-w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B"

SOCKPERMS=0660

<...snipped...>

 

-

 

sjc-observium-1:/usr/lib/tmpfiles.d# cat rrdcached.conf

d       /run/rrdcached          -       apache  apache

sjc-observium-1:/usr/lib/tmpfiles.d#

 

-

 

sjc-observium-1:/opt/observium# grep rrd config.php

//rrdcached

#$config['rrdcached']    = "unix:/var/run/rrdcached/rrdcached.sock"; <<<====== will un-comment once rrdcached is configured and running

sjc-observium-1:/opt/observium#

 

-

 

sjc-observium-1:/root# service rrdcached stop

Stopping rrdcached (via systemctl):                        [  OK  ]

sjc-observium-1:/root# service rrdcached start

Starting rrdcached (via systemctl):

 

Job for rrdcached.service failed because a timeout was exceeded. See "systemctl status rrdcached.service" and "journalctl -xe" for details.

                                                           [FAILED]

sjc-observium-1:/root#

 

-

 

sjc-observium-1:/opt/observium# systemctl status rrdcached.service -l

● rrdcached.service - SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file

   Loaded: loaded (/etc/rc.d/init.d/rrdcached; bad; vendor preset: disabled)

   Active: failed (Result: timeout) since Wed 2018-10-31 16:39:48 PDT; 11min ago

     Docs: man:systemd-sysv-generator(8)

  Process: 2449 ExecStart=/etc/rc.d/init.d/rrdcached start (code=exited, status=0/SUCCESS)

   CGroup: /system.slice/rrdcached.service

           └─2453 /usr/sbin/rrdcached -w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B -p /var/run/rrdcached/rrdcached.pid -l /var/run/rrdcached/rrdcached.sock

 

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd: illegal attempt to update using time 1541024231 when last update time is 1541028534 (minimum one second step))

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd: illegal attempt to update using time 1541024224 when last update time is 1541028525 (minimum one second step))

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd: illegal attempt to update using time 1541024165 when last update time is 1541028466 (minimum one second step))

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd: illegal attempt to update using time 1541024166 when last update time is 1541028467 (minimum one second step))

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd: illegal attempt to update using time 1541024223 when last update time is 1541028524 (minimum one second step))

Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd: illegal attempt to update using time 1541024147 when last update time is 1541028719 (minimum one second step))

Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service start operation timed out. Terminating.

Oct 31 16:39:48 sjc-observium-1 systemd[1]: Failed to start SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file.

Oct 31 16:39:48 sjc-observium-1 systemd[1]: Unit rrdcached.service entered failed state.

Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service failed.

sjc-observium-1:/opt/observium#

 

===

 

Any suggestions or docs/links showing how it can be resolved?

 

Thanks.

 

- Gordon