Some devices takes very long to complete /opt/observium/poller.php process.
/opt/observium/poller-wrapper.py --host hk2net01a -d
/opt/observium/poller-wrapper.py:568: Warning: Data truncated for column 'process_name' at row 1
cursor.execute(p_query, (pid,ppid,processname,uid,command,s_time))
INFO: starting the poller at 2017/11/02 17:10:50 with 16 threads
WARNING: DEBUG enabled, each device poller store output to /tmp/observium_poller_id.debug (where id is device_id)
/usr/bin/env php /opt/observium/poller.php -d -h 320 >> /tmp/observium_poller_320.debug 2>&1
INFO: starting alerter.php for 320
INFO: finished alerter.php for 320
WARNING: worker Thread-1 finished device 320 in 405 seconds
INFO: poller-wrapper.py poller --host hk2net01a processed 1 devices in 405.53 seconds with 16 threads, load average (5min) 1.67
WARNING: the process took more than 5 minutes to finish, you need faster hardware or more threads
INFO: in sequential style processing the elapsed time would have been: 405 seconds
WARNING: device 320 is taking too long: 405 seconds
ERROR: Some devices are taking more than 300 seconds, the script cannot recommend you what to do.
Number of rows updated: 1
DEBUG: /usr/bin/rrdtool update /opt/observium/rrd/poller-wrapper.rrd N:1:405.531:16
DEBUG: /usr/bin/rrdtool update /opt/observium/rrd/poller-wrapper_count.rrd N:1
o Caching Oids Used full table ifEntry/ifXEntry snmpwalk.
CMD[/usr/bin/snmpbulkwalk -v2c -c *** -Pu -OQUs -m IF-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'hk2net01a':'161' ifEntry]
and almost after 5mins it resumes. What could be the reason ?
Thanks.