- observium - lists.observium.org

OBS-2744: wrapper broke :(
by Stef Renders 03 Aug '18

03 Aug '18

Mike Please fix ☹ /opt/observium/observium-wrapper poller Traceback (most recent call last): File "/opt/observium/observium-wrapper", line 285, in <module> remote_rrd = false NameError: name 'false' is not defined Kind regards

1 0

rrdcached
by Christian Eriksson 02 Aug '18

02 Aug '18

Hi guys, Hope someone here can shed some light on my issue with rrdcached and observium. I am using a distributed setup with web/sql/poller on separate machines. Followed the guide here http://blog.best-practice.se/2017/10/scaling-observium-horizontally.html and currently using two pollers with great success overall What I can't seem to figure out is why some rrd files won't get created. It doesn't matter what poller I am using or what devices, it is always the following rrd-files ping.rrd ping_snmp.rrd status.rrd [cid:image002.png@01D42A5F.99A20960] [cid:image005.png@01D42A5F.99A20960] Some information regarding my system Observium 18.7.9354 (30th July 2018) OS Linux 4.4.0-130-generic [amd64] (Ubuntu 16.04) Apache 2.4.18 (Ubuntu) PHP 7.0.30-0ubuntu0.16.04.1 (OPcache: ENABLED) Python 2.7.12 MySQL 5.7.23-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.5.5 (rrdcached 1.5.5: unix:/var/run/rrdcached.sock) Fping 3.13 (IPv4 and IPv6) rrdcached settings $config['rrdcached'] = 'ip address'; $config['rrd']['no_local'] = TRUE; root@server:/home/user# ps aux | grep rrdcached observi+ 13596 1.6 0.5 1727784 45980 ? Ssl Aug01 15:07 /usr/bin/rrdcached -B, -F, -O, -R -L -w 1800 -z 1800 -t 8 -b /opt/observium/rrd/ -j /var/lib/rrdcached/journal/ -G www-data -U observium -p /var/run/rrdcached.pid -s www-data -m 0660 -l unix:/var/run/rrdcached.sock rrdcached journal file show no trace of the files Syslog errors on rrdcached server Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/status.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/ping.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/status.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device1.net.ad.handels.se/ping_snmp.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/ping.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device2/ping_snmp.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/status.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/ping.rrd) failed. Aug 2 13:01:01 server rrdcached[13596]: handle_request_update: stat (/opt/observium/rrd/device3/ping_snmp.rrd) failed. I can manually create a rrd file from the poller with success rrdtool create device/status.rrd --daemon ip-address RRA:AVERAGE:0.5:1:2016 DS:status:GAUGE:600:-20000:U Best regards Christian Eriksson

3 5

Performance issue with a Cisco C6807-XL
by Richard Kuhns 02 Aug '18

02 Aug '18

1 1

Re: [Observium] ifAlias Description notmatches multiple wildcard issue
by Adam Armstrong 31 Jul '18

31 Jul '18

Use attributes as attributes. You probably don't want to create permanent alert table entries just for this, and it's not time critical. Using attributes to match these non-valid descriptions, an alert table entry would only be created when it's necessary, and then you can just use an unrealistic metric condition to make it always trigger. adam. ------ Original Message ------ From: "Klimek, Denis" <DKlimek(a)Stadtwerke-Norderstedt.de> To: "'observium(a)observium.org'" <observium(a)observium.org> Sent: 2018-07-26 15:01:55 Subject: [Observium] ifAlias Description notmatches multiple wildcard issue >Hi all, > > > >I would like to setup a alert checker which checks configured Ethernet >ports if there is a “valid” Observium port description configured. I >tried it with following conditions “ifAlias notmatches >*:*[*Gbit]*{*}*(*)*:*:” but it’s reporting any port as “OK”. The “::” >got added by us for internal purposes. > > > >B: POP102-TBA [20Gbit] {} () ::-> get’s reported as “OK” which is >correct > >CERRZ2R_C_X670-> get’s reported also as “OK” but this is wrong > > > >Attached a screenshot of the complete rule set. > > > >Any ideas are welcome how to solve this J > > > >Mit freundlichem Gruß > >Stadtwerke Norderstedt > > > >Denis Klimek > > > >Professional Network Engineer > >IP-Systemtechnik > > > >Tel: 040 / 521 04 – 1049 > >Mobil: 0151 / 652 219 06 > > > >dklimek(a)stadtwerke-norderstedt.de > >www.stadtwerke-norderstedt.de > > >

3 2

Re: [Observium] ifAlias Description notmatches multiple wildcard issue
by Adam Armstrong 31 Jul '18

31 Jul '18

You are trying to use attributes as metrics, don't do that. adam. ------ Original Message ------ From: "Klimek, Denis" <DKlimek(a)Stadtwerke-Norderstedt.de> To: "'Observium'" <observium(a)observium.org> Sent: 2018-07-31 15:21:15 Subject: Re: [Observium] ifAlias Description notmatches multiple wildcard issue >Hi, > >would it be possible to add ifAlias too or the feature to support other >type of category description aswell to fill the port_descr_type, >port_descr_descr and the other ports_descr_* fields >We are using some custom types additional to "Core, Peering, >Server".... to separate those links better. > >Mit freundlichem Gruß >Stadtwerke Norderstedt > >Denis Klimek > >Professional Network Engineer >IP-Systemtechnik > >Tel: 040 / 521 04 – 1049 >Mobil: 0151 / 652 219 06 > >dklimek(a)stadtwerke-norderstedt.de >www.stadtwerke-norderstedt.de > >-----Ursprüngliche Nachricht----- >Von: observium [mailto:observium-bounces@observium.org] Im Auftrag von >Adam Armstrong >Gesendet: Freitag, 27. Juli 2018 14:04 >An: Observium >Betreff: Re: [Observium] ifAlias Description notmatches multiple >wildcard issue > >ifAlias can't (currently) be used as an alerting metric. > >we could add it, but its perhaps better to just use the attribute in >the >association. > >adam. > >On 2018-07-26 08:01, Klimek, Denis wrote: >>Hi all, >> >>I would like to setup a alert checker which checks configured Ethernet >>ports if there is a "valid" Observium port description configured. I >>tried it with following conditions "ifAlias notmatches >>*:*[*Gbit]*{*}*(*)*:*:" but it's reporting any port as "OK". The "::" >>got added by us for internal purposes. >> >>B: POP102-TBA [20Gbit] {} () ::-> get's reported as "OK" which is >>correct >> >>CERRZ2R_C_X670-> get's reported also as "OK" but this is wrong >> >>Attached a screenshot of the complete rule set. >> >>Any ideas are welcome how to solve this J >> >>Mit freundlichem Gruß >> >>Stadtwerke Norderstedt >> >>DENIS KLIMEK >> >>Professional Network Engineer >> >>IP-Systemtechnik >> >>Tel: 040 / 521 04 - 1049 >> >>Mobil: 0151 / 652 219 06 >> >>dklimek(a)stadtwerke-norderstedt.de >> >>www.stadtwerke-norderstedt.de [1] >> >> >> >>Links: >>------ >>[1] http://www.stadtwerke-norderstedt.de/ >>_______________________________________________ >>observium mailing list >>observium(a)observium.org >>http://postman.memetic.org/cgi-bin/mailman/listinfo/observium >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

3 3

ifAlias Description notmatches multiple wildcard issue
by Klimek, Denis 31 Jul '18

31 Jul '18

Hi all, I would like to setup a alert checker which checks configured Ethernet ports if there is a "valid" Observium port description configured. I tried it with following conditions "ifAlias notmatches *:*[*Gbit]*{*}*(*)*:*:" but it's reporting any port as "OK". The "::" got added by us for internal purposes. B: POP102-TBA [20Gbit] {} () ::-> get's reported as "OK" which is correct CERRZ2R_C_X670-> get's reported also as "OK" but this is wrong Attached a screenshot of the complete rule set. Any ideas are welcome how to solve this :) Mit freundlichem Gruß Stadtwerke Norderstedt Denis Klimek Professional Network Engineer IP-Systemtechnik Tel: 040 / 521 04 - 1049 Mobil: 0151 / 652 219 06 dklimek(a)stadtwerke-norderstedt.de<mailto:dklimek@stadtwerke-norderstedt.de> www.stadtwerke-norderstedt.de<http://www.stadtwerke-norderstedt.de/>

2 2

Re: [Observium] VLANs and fdb-table on Cisco devices
by Mike Stupalov 30 Jul '18

30 Jul '18

http://docs.observium.org/faq/#all-my-hosts-seem-down-to-observium-snmp-doe… > todevnull(a)free.fr <mailto:todevnull@free.fr> > 28 July 2018 at 13:42 > Hi, > > Please find it in attached file. > With this debug on vlans module, i think there is my error : > > STDERR[ > add_mibdir: strings scanned in from > /var/www/observium/mibs/cisco/.index are too large. count = 703 > MIB search path: > /var/www/observium/mibs/rfc:/var/www/observium/mibs/net-snmp:/var/www/observium/mibs/cisco > Cannot find module (CISCO-VTP-MIB): At line 0 in (none) > vtpVersion.0: Unknown Object Identifier (Sub-id not found: (top) -> > vtpVersion) > ] > SNMP STATUS[FALSE] > SNMP ERROR[#997 - Wrong .index in mibs dir] > > > Don't really know how to solve this.... > > Thanks in advance for your help. > > Rds, > > Tarik. > > > 28 juillet 2018 07:51 "Mike Stupalov" <mike(a)stupalov.ru > <mailto:%22Mike%20Stupalov%22%20%3Cmike@stupalov.ru%3E>> a écrit: > > > Mike Stupalov <mailto:mike@stupalov.ru> > 28 July 2018 at 08:51 > Hi, > > please attach debug for discovery: > > ./discovery.php -d -m ports,vlans -h <device> > > -- Mike Stupalov Observium Limited, http://observium.org

2 1

Re: [Observium] Port groups unusable in alerts checks ?
by Thibault Richard 30 Jul '18

30 Jul '18

No feedback on this one ? De : Thibault Richard <thibs(a)thibs.com> Envoyé : mercredi 25 juillet 2018 15:50 À : 'observium(a)observium.org' <observium(a)observium.org> Objet : Port groups unusable in alerts checks ? Hello, Ive defined several port groups as you can see below : 1° First question I would like to add a condition equivalent to ifOperStatus equals up but this kind of condition doesnt exist in the pre-defined list. Am I missing something ? 2° Second question I would like to use this group in an Alert Checks but in the entity association ruleset, I can use a Device Group but not a Port Group No « Port Group » and if I try to use Device Group I see only groups related to devices Bug of misunderstanding from me ? Best Regards Thibault

1 0

Re: [Observium] VLANs and fdb-table on Cisco devices
by todevnull＠free.fr 28 Jul '18

28 Jul '18

Hi, Please find it in attached file. With this debug on vlans module, i think there is my error : STDERR[ add_mibdir: strings scanned in from /var/www/observium/mibs/cisco/.index are too large. count = 703 MIB search path: /var/www/observium/mibs/rfc:/var/www/observium/mibs/net-snmp:/var/www/observium/mibs/cisco Cannot find module (CISCO-VTP-MIB): At line 0 in (none) vtpVersion.0: Unknown Object Identifier (Sub-id not found: (top) -> vtpVersion) ] SNMP STATUS[FALSE] SNMP ERROR[#997 - Wrong .index in mibs dir] Don't really know how to solve this.... Thanks in advance for your help. Rds, Tarik. 28 juillet 2018 07:51 "Mike Stupalov" <mike(a)stupalov.ru (mailto:%22Mike%20Stupalov%22%20<mike(a)stupalov.ru>)> a écrit: Hi, please attach debug for discovery: ./discovery.php -d -m ports,vlans -h <device> todevnull(a)free.fr (mailto:todevnull@free.fr) 27 July 2018 at 15:13 Hello, Since the last svn update 9352 i loose the VLANs button and fdb-table content on every of my Cisco Catalyst switches :-/ More of that, the Dot1q tag disappear on switch ports :( Version Information Observium 18.7.9337 (18th July 2018) OS Linux 4.9.0-6-amd64 [amd64] (Debian 9.5) Apache 2.4.25 (Debian) PHP 7.0.30-0+deb9u1 (OPcache: ENABLED) Python 2.7.13 MySQL 10.1.26-MariaDB-0+deb9u1 (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.6.0 Fping 3.15 (IPv4 and IPv6) See below some debug lines : ##### Cisco configuration ages ##### o sysUptime 2017-10-19 16:29:18 | 280 days, 21h 41m 24s o Running 2018-05-03 15:24:42 | 84 days, 22h 46m o Saved 2018-07-25 09:02:04 | 2 days, 5h 8m 38s o Startup 2018-05-03 14:43:02 | 84 days, 23h 27m 40s o Module time 0.0446s including: includes/polling/fdb-table.inc.php ##### Module Start: fdb-table ##### SQL[SELECT `ifIndex`,`port_id`,`port_label_short` FROM `ports` WHERE `device_id` = '174'] SQL RUNTIME[0.00056696s] SQL[SELECT * FROM `vlans_fdb` WHERE `device_id` = '174'] SQL RUNTIME[0.00038600s] CMD[/usr/bin/snmpbulkwalk -Cr'100' -t '3' -r '3' -v2c -c *** -Pu -OQUs -m BRIDGE-MIB -M /var/www/observium/mibs/rfc:/var/www/observium/mibs/net-snmp 'udp':'2.100.79.11':'161' dot1dBasePortIfIndex] CMD EXITCODE[0] CMD RUNTIME[0.0906s] STDOUT[ dot1dBasePortIfIndex.1 = 10001 dot1dBasePortIfIndex.2 = 10002 dot1dBasePortIfIndex.3 = 10003 dot1dBasePortIfIndex.4 = 10004 dot1dBasePortIfIndex.5 = 10005 dot1dBasePortIfIndex.6 = 10006 dot1dBasePortIfIndex.7 = 10007 dot1dBasePortIfIndex.8 = 10008 dot1dBasePortIfIndex.9 = 10009 dot1dBasePortIfIndex.10 = 10010 dot1dBasePortIfIndex.11 = 10011 dot1dBasePortIfIndex.12 = 10012 dot1dBasePortIfIndex.13 = 10013 dot1dBasePortIfIndex.14 = 10014 dot1dBasePortIfIndex.15 = 10015 dot1dBasePortIfIndex.16 = 10016 dot1dBasePortIfIndex.17 = 10017 dot1dBasePortIfIndex.18 = 10018 dot1dBasePortIfIndex.19 = 10019 dot1dBasePortIfIndex.20 = 10020 dot1dBasePortIfIndex.21 = 10021 dot1dBasePortIfIndex.22 = 10022 dot1dBasePortIfIndex.25 = 10101 dot1dBasePortIfIndex.26 = 10102 ] SNMP STATUS[TRUE] SQL[SELECT `vlan_vlan` FROM `vlans` WHERE (`vlan_status` = 'active' OR `vlan_status` = 'operational') AND `device_id` = '174'] SQL RUNTIME[0.00066495s] o Module time 0.0955s ##### 2.100.79.11 [174] completed poller modules at 2018-07-27 14:10:43 ##### o Graphs [checked] availability, ping, ping_snmp, uptime, fdb_count o Poller time 0.3765 seconds Updating 2.100.79.11 - > $update_array /var/www/observium/includes/polling/functions.inc.php:792 array( [uptime] => int(110170029) [last_polled] => array( [0] => string(5) "NOW()" ) [last_polled_timetaken] => double(0.3765) ) SQL[UPDATE `devices` set `uptime` ='110170029',`last_polled` =NOW(),`last_polled_timetaken` ='0.3765' WHERE `device_id` = '174'] SQL RUNTIME[0.00097919s] o Updated Data uptime, last_polled, last_polled_timetaken SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '10969' AND `process_name` = 'poller.php' AND `device_id` = '174'] SQL RUNTIME[0.00824499s] ./poller.php: 2.100.79.11 - 1 devices polled in 0.557 secs ##### Completed polling run at 2018-07-27 14:10:43 ##### NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 1 o Poller Time 0.557 secs o Memory usage 14MB (peak: 14MB) o MySQL Usage Insert[1/0.001s] Update[1/0.001s] Delete[1/0.009s] Cell[4/0.002s] Row[8/0.005s] Rows[13/0.008s] Col[0/0s] (0.025s 4.512%) o RRDTool Usage update[4/0.005s] (0.005s 0.891%) o SNMP Usage snmpget[7/0.209s] snmpwalk[1/0.091s] (0.3s 53.803%) _______________________________________________ observium mailing list observium(a)observium.org (mailto:observium@observium.org) http://postman.memetic.org/cgi-bin/mailman/listinfo/observium (http://postman.memetic.org/cgi-bin/mailman/listinfo/observium) -- Mike Stupalov https://stupalov.com (https://stupalov.com)

1 0

Re: [Observium] VLANs and fdb-table on Cisco devices
by Mike Stupalov 28 Jul '18

28 Jul '18

Hi, please attach debug for discovery: ./discovery.php -d -m ports,vlans -h <device> > todevnull(a)free.fr <mailto:todevnull@free.fr> > 27 July 2018 at 15:13 > Hello, > > Since the last svn update 9352 i loose the VLANs button and fdb-table > content on every of my Cisco Catalyst switches :-/ > More of that, the Dot1q tag disappear on switch ports :( > > > Version Information > > *Observium* 18.7.9337 (18th July 2018) > *OS* Linux 4.9.0-6-amd64 [amd64] (Debian 9.5) > *Apache* 2.4.25 (Debian) > *PHP* 7.0.30-0+deb9u1 (OPcache: ENABLED) > *Python* 2.7.13 > *MySQL* 10.1.26-MariaDB-0+deb9u1 (extension: mysqli 5.0.12-dev) > *SNMP* NET-SNMP 5.7.3 > *RRDtool* 1.6.0 > *Fping* 3.15 (IPv4 and IPv6) > > > > > See below some debug lines : > > ##### Cisco configuration ages ##### > > o sysUptime 2017-10-19 16:29:18 | 280 days, 21h 41m 24s > o Running 2018-05-03 15:24:42 | 84 days, 22h 46m > o Saved 2018-07-25 09:02:04 | 2 days, 5h 8m 38s > o Startup 2018-05-03 14:43:02 | 84 days, 23h 27m 40s > > o Module time 0.0446s > > > including: includes/polling/fdb-table.inc.php > ##### Module Start: fdb-table ##### > > > SQL[SELECT `ifIndex`,`port_id`,`port_label_short` FROM `ports` WHERE > `device_id` = '174'] > SQL RUNTIME[0.00056696s] > > SQL[SELECT * FROM `vlans_fdb` WHERE `device_id` = '174'] > SQL RUNTIME[0.00038600s] > > CMD[/usr/bin/snmpbulkwalk -Cr'100' -t '3' -r '3' -v2c -c *** -Pu -OQUs > -m BRIDGE-MIB -M > /var/www/observium/mibs/rfc:/var/www/observium/mibs/net-snmp > 'udp':'2.100.79.11':'161' dot1dBasePortIfIndex] > > CMD EXITCODE[0] > CMD RUNTIME[0.0906s] > STDOUT[ > dot1dBasePortIfIndex.1 = 10001 > dot1dBasePortIfIndex.2 = 10002 > dot1dBasePortIfIndex.3 = 10003 > dot1dBasePortIfIndex.4 = 10004 > dot1dBasePortIfIndex.5 = 10005 > dot1dBasePortIfIndex.6 = 10006 > dot1dBasePortIfIndex.7 = 10007 > dot1dBasePortIfIndex.8 = 10008 > dot1dBasePortIfIndex.9 = 10009 > dot1dBasePortIfIndex.10 = 10010 > dot1dBasePortIfIndex.11 = 10011 > dot1dBasePortIfIndex.12 = 10012 > dot1dBasePortIfIndex.13 = 10013 > dot1dBasePortIfIndex.14 = 10014 > dot1dBasePortIfIndex.15 = 10015 > dot1dBasePortIfIndex.16 = 10016 > dot1dBasePortIfIndex.17 = 10017 > dot1dBasePortIfIndex.18 = 10018 > dot1dBasePortIfIndex.19 = 10019 > dot1dBasePortIfIndex.20 = 10020 > dot1dBasePortIfIndex.21 = 10021 > dot1dBasePortIfIndex.22 = 10022 > dot1dBasePortIfIndex.25 = 10101 > dot1dBasePortIfIndex.26 = 10102 > ] > SNMP STATUS[TRUE] > > SQL[SELECT `vlan_vlan` FROM `vlans` WHERE (`vlan_status` = 'active' OR > `vlan_status` = 'operational') AND `device_id` = '174'] > SQL RUNTIME[0.00066495s] > > o Module time 0.0955s > > ##### 2.100.79.11 [174] completed poller modules at 2018-07-27 > 14:10:43 ##### > > o Graphs [checked] availability, ping, ping_snmp, uptime, fdb_count > o Poller time 0.3765 seconds > Updating 2.100.79.11 - > > > $update_array /var/www/observium/includes/polling/functions.inc.php:792 > array( > [uptime] => int(110170029) > [last_polled] => array( > [0] => string(5) "NOW()" > ) > [last_polled_timetaken] => double(0.3765) > ) > > > SQL[UPDATE `devices` set `uptime` ='110170029',`last_polled` > =NOW(),`last_polled_timetaken` ='0.3765' WHERE `device_id` = '174'] > SQL RUNTIME[0.00097919s] > o Updated Data uptime, last_polled, last_polled_timetaken > > > SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '10969' > AND `process_name` = 'poller.php' AND `device_id` = '174'] > SQL RUNTIME[0.00824499s] > ./poller.php: 2.100.79.11 - 1 devices polled in 0.557 secs > ##### Completed polling run at 2018-07-27 14:10:43 ##### > > NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and > snmp v3 auth hidden from debug output. > o Devices Polled 1 > o Poller Time 0.557 secs > o Memory usage 14MB (peak: 14MB) > o MySQL Usage Insert[1/0.001s] Update[1/0.001s] Delete[1/0.009s] > Cell[4/0.002s] Row[8/0.005s] Rows[13/0.008s] Col[0/0s] (0.025s > 4.512%) > o RRDTool Usage update[4/0.005s] (0.005s 0.891%) > o SNMP Usage snmpget[7/0.209s] snmpwalk[1/0.091s] (0.3s 53.803%) > > > > _______________________________________________ > observium mailing list > observium(a)observium.org > http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- Mike Stupalov Observium Limited, http://observium.org

1 0