- observium - lists.observium.org

DB and Polling issues after upgrading to r9505
by Christopher Smith 25 Oct '18

25 Oct '18

We had many devices not set to the correct location due to https://jira.observium.org/browse/OBS-2767 Updated to r9505 and after doing so we reset the geo location via web interface (device properties -> Geolocation -> Reset GEO location) On any device that this was done to it seems like they do not exist to the poller any longer, none have been polled since the above action was taken. I based this info from the Per Device stats in the Pollerlog section (all of the devices that had their geo location reset were last polled 5+ hours ago, everything else that was not touched are being polled as expected every 5 minutes) I see these errors in the db.log file, they appear to have shown up when the Reset GEO location operation was done on each device: [2018/10/24 14:48:43 -0400] index.php(4115): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:49:44 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:23 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:57 -0400] index.php(44932): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:51:28 -0400] index.php(25685): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:52:29 -0400] index.php(25888): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? Observium system info: Observium 18.10.9505 (24th October 2018) OS Linux 3.10.0-862.3.3.el7.x86_64 [amd64] (CentOS 7) Apache 2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.0.31 PHP 7.0.31 (OPcache: ENABLED) Python 2.7.5 MySQL 5.5.56-MariaDB (extension: mysqli 5.5.56-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.6.0 Fping 3.10 (IPv4 only)

2 2

Update - Port descripton changed ( possible bug or ... )
by Sigurður Hannesson 23 Oct '18

23 Oct '18

Hi, just updated Version Information Observium 18.10.9472 (16th October 2018) OS Linux 4.9.0-3-amd64 [amd64] (Debian 9.1) Apache 2.4.25 (Debian) PHP 7.0.19-1 (OPcache: ENABLED) Python 2.7.13 MySQL 10.1.23-MariaDB-9+deb9u1 (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.6.0 Fping 3.15 (IPv4 and IPv6) . Noticed that most of my port groups had 0 ports in them. Looking at the port description they had changed deviceA 1/1/3<http://172.24.41.34/device/device=31/tab=port/port=5230/> \AKRA-3 No1\ instead of AKRA-3 No1 this of course means that all my port groups are not matching the criteria. br., SH

1 0

Redundancy Mode (C2900)
by Robert Williams 22 Oct '18

22 Oct '18

Hi, We've had a few customer devices generate alerts overnight for 'Operational Redundancy Mode' = nonRedundant Example below: It appears to be a newly detected element during a discovery run - but in all (of our) scenarios it is now in alarm as the customers do not have them operating in redundancy mode. As far as I can tell it's not configured at all on them. Obviously I can filter them out from the alert ("Customer - Status Alert") but it would be nice if I could hide them from the main pages (or stop it from being polled at all). Alternatively, does anyone know what element in our device config may be triggering this to show up, so that I can modify the configs to remove it? Thanks! Robert Williams Custodian Data Centres https://www.CustodianDC.com

3 3

Alert Checker for Printer Toner
by Walter Onda 19 Oct '18

19 Oct '18

Hello I spent a long time to make a toner alert when it arrive lower than 2 %, it doesn't matter which color. Is this condition correct? Because some of this printer has just 1% but it shown as "ok". Has maybe somebody an suggestion? Regards and have a nice weekend Walter

2 3

Discovering storage again - every time discovery is run
by Niklas Larsson 18 Oct '18

18 Oct '18

Hi, after r9479 (ish) we get this in the log every time discovery is running: Attached log from: ./discovery.php -d -h gluster02.example.com -m storage storage module is creating the logging. /niklas

3 10

Distinct alerting when several custom OID on the same device
by Thibault Richard 17 Oct '18

17 Oct '18

Hello, I've finally succeed to create alerting on custom OID Unfortunately, I'm now facing another issue I've one device with 2 custom OIDs * The device called "depanne" have 2 custom OID named "mailnotsent" and "checkdbconnection" I 've created one alert with this basic condition Currently if one of the 2 OID got a different value than 0, I receive the alert message "checkdbconnections fails" which correspond to the message I've defined It's OK when "checkdbconnections" fails but not when "mailnotsent' fails In other words, if the OID value for "mailnotsent" is not 0, I'm receiving a non-related message. I would like to create one alert related to one OID As checker condition for a custom OID I can only use a metric and the only available metric is the OID value. I know I cannot filter on the condition So I'm trying to filter thanks to the "association" In the previous version (which is still the documented one) it was possible to specify a device and an entity But as the current version no longer propose us a free field for this, I've tried to filter with several solution like this one It unfortunately doesn't work. How could I specify an alert is only linked to one OID ? Best Regards Thibault

2 7

MIB for FS.COM switches
by Pieter Meyer 16 Oct '18

16 Oct '18

Hi guys How can we add better support for switches from FS.COM Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 <https://goo.gl/maps/WHe3soT1fHm> map | <http://www.convergedgroup.net/> website | <http://www.convergedgroup.net/blog/> company blog | <http://www.linkedin.com/company/converged-telecoms> linkedin CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

2 1

Stormshield firewalls log
by Luca Sasdelli 16 Oct '18

16 Oct '18

Hello all, we've several Stormshield firewall (FreeBSD-based) to monitor with Observium; most of them send their syslog properly, but with three of them, the syslogs are correctly received on observium server (seen with tcpdump), but not displayed within the respective entries. The hostnames does match the ones used with the device names. The Syslog setup allows unknown host. The syslog messages filters doesn't match any possible string in the incoming logs on mentioned devices. By enabling syslog debug, the observium log writes the correspondent files successfully. What else should I check for this issue? Rev. 18.10.9470 Thanks! Luca

3 4

Citrix Netscaler 12.x
by Adam Armstrong 15 Oct '18

15 Oct '18

Hi Guys, Citrix seem to have broken SNMP in Netscaler 12.x. Best not to try those versions for now if you value your data collection. Adam. ⁣Sent from BlueMail

3 3

RANCiD version labels
by Eric W. Bates 14 Oct '18

14 Oct '18

Just finished adding RANCiD configs to observium and it's quite slick. Thanks for doing that. When displaying config versions, observium uses the git'ish 7-char truncations of the full hash to label those versions. While the time stamps are viewable when hovering the mouse over those links, most of my network team are non-coders and are put off by hex strings (never heard of git). Is there a knob I can tweak in config.php to just change those labels to the time stamp instead? Thanks for your time. -- Clark 159a, MS 46 508/289-3112

1 0

pdf.php
by David Jesus Maturano Sanchez 13 Oct '18

13 Oct '18

Testing this file, I see this message: /opt/observium/html# php pdf.php PHP Fatal error: require_once(): Failed opening required 'includes/tcpdf/config/lang/eng.php' (include_path='/opt/observium/libs/pear:/opt/observium/libs:.:/usr/share/php') in /opt/observium/html/pdf.php on line 27 What do I need to run this? Rergards David.

2 1

Change e-mail address at jira.observium.org
by xomka686 13 Oct '18

13 Oct '18

Hi, I want to change an e-mail used in my account at jira.observium.org, but User Profile page in Jira doesn't allow to do that (in fact, account Summary page is just empty). Can you advice me the right button for e-mail change? -- Best, Sergey

1 0

Observium in LXC Container
by mal＠platinumnetworks.com.au 13 Oct '18

13 Oct '18

Can I run a production Observium install inside a LXC container? Any known issues I should be aware of? Cheers Mal

3 3

n00b question: Implementing a new application but I get no graphs (rrd files)
by Jonas Karlsson 11 Oct '18

11 Oct '18

Hi, I am trying to develop a new application (monroe) by following the instructions here: https://docs.observium.org/developing/add_app/ and are probably doing something stupid but I cannot see where the problem is. In my, updated and working, installation of observium I cannot find the file "includes/definitions/rrdtypes.inc.php" referenced above (I have searched the entire folder tree but with no luck). All the default applications work (ie vmwaretools) so as a "alternative approach" I tried to copy the code of the vmwaretools application and also search for where the vmwaretools have its definition but no luck. My application show up in the WEB UI and the agent works but I get no graphs. When I run ./poller.php manually I get : <snip> ##### Module Start: applications ##### o Applications ioping ...monroe .Cannot create RRD for type monroe - not found in definitions! nginx . nginx statistics vmwaretools . o Module time 0.0247s <snip> So it is missing the definitions but where do I add those ??? I have found a reference for rrdtypes.inc.php in includes/definitions.inc.php but in /includes/definitions/ I only have three files: $ls includes/definitions/ definitions.dat version.inc.php wui.inc.php -- Jonas Karlsson Senior Research Engineer Karlstad University SE-651 88 Karlstad, Sweden 📞 +46 54 700 15 64 📞 +46 70 672 06 20 💬 karlsson.karl.jonas 🗝 0x88765911B284F3A6

3 4

Use ifName instead of IfDescr
by Simon Mousey Smith 10 Oct '18

10 Oct '18

Hi All Im trying to find out if its possible to use IfName instead of ifDescr? TP-Link TL-SG3109 switch For some DUMB reason, all the ifDescr are being discovered as ‘Ethernet Interface’ ifDescr.1 = Ethernet Interface ifDescr.2 = Ethernet Interface ifDescr.3 = Ethernet Interface ifDescr.4 = Ethernet Interface ifDescr.5 = Ethernet Interface ifDescr.6 = Ethernet Interface ifDescr.7 = Ethernet Interface ifDescr.8 = Ethernet Interface ifDescr.9 = Ethernet Interface So when you look down the list on Observium, I have 9 Ethernet Interface (not helpful) I can put descriptions on each port and they get discovered by observium and show underneath the Ethernet Interface (but still not very helpful) I have noticed however tho in the debug output of the poller, ifName are being found as the port numbers as listed on the web interface of the switch! ifName.1 = g1 ifName.2 = g2 ifName.3 = g3 ifName.4 = g4 ifName.5 = g5 ifName.6 = g6 ifName.7 = g7 ifName.8 = g8 ifName.9 = g9 So is it possible to switch them round? Attached is the debug output from the switch if its helpful to anyone :) Regards Simon

3 8

Limited write permissions
by Tom Funken 10 Oct '18

10 Oct '18

Hey Guys, I currently looking for a way to give an employee just "some" access to the system. The main goal is, that he can manage traffic bills but only can see an selected devices group. However, it seems like I'm to stupid for that :D When I create an normal user, I can assign an group to the user, but he just can look and don't edit bills. The only way I can see to give him rights, to create and edits bills is to give him a full admin level.... :( -- Best Regards, Tom Funken Managing Director ------------------------- Srizbi Limited 83 Ducie Street Manchester M1 2JQ United Kingdom Tel.: +44 56-0305 5120 E-Mail.: t.funken(a)srizbi.com

2 1

Submitting MIB's for including into Observium?
by Pieter De Wit 10 Oct '18

10 Oct '18

Hey Guys, What is the process for getting MIBs added to Observium ? (I know adding them to /mibs/ won't work :) ) Thanks ! Pieter

3 4

Re: [Observium] Alerting on custom OID
by Thibault Richard 09 Oct '18

09 Oct '18

Hello Chris, Thanks for your reply. Unfortunately I’ve no success with your proposal I’ve defined my custom OID like this I know it works because if the state change , I see it’s taken into account into Observium I’ve defined my Alert check like this : But it’s still doesn’t work ;-( Adam any tip to help me ? Best Regards Thibault De : Chris Tomkins <christ(a)brandwatch.com> Envoyé : mardi 9 octobre 2018 15:18 À : thibs(a)thibs.com Cc : Observium <observium(a)observium.org> Objet : Re: [Observium] Alerting on custom OID Hi Thibault, See attached, maybe it helps? This is a working setup. Chris On Tue, 9 Oct 2018 at 14:10, Thibault Richard via observium <observium(a)observium.org <mailto:observium@observium.org> > wrote: Hello, Could you please help me to achieve the alert checks I need I ‘ve defined the following custom OID The result ca only be O (means OK) or 1 (means KO) I want to be alerted when the value is 1 I’ve tried a lot of combination including the following : I know the solution is in the condition checker but I don’t know how to define the condition “if the OID value is XX” I’m completely lost Could you please help me ? Best Regards Thibault _______________________________________________ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- Chris Tomkins Brandwatch | Senior Network Engineer (Linux/Network) christ(a)brandwatch.com <mailto:christ@brandwatch.com> | (+44) 01273 448 949 @Brandwatch New York | San Francisco | Brighton | Singapore | Berlin | Stuttgart <https://www.brandwatch.com/customer-success/> Discover how organizations are using Brandwatch to create their own success <http://www.brandwatch.com/email-disclaimer/> Email disclaimer <https://lh6.googleusercontent.com/hYprrBP_3HGBddLOgdQ20pgDf_F_7WTho_ILiPxoO…>

2 1

Alerting on custom OID
by Thibault Richard 09 Oct '18

09 Oct '18

Hello, Could you please help me to achieve the alert checks I need I ‘ve defined the following custom OID The result ca only be O (means OK) or 1 (means KO) I want to be alerted when the value is 1 I’ve tried a lot of combination including the following : I know the solution is in the condition checker but I don’t know how to define the condition “if the OID value is XX” I’m completely lost Could you please help me ? Best Regards Thibault

1 0

Stack Switch Alerts
by Zafar Pravaiz 08 Oct '18

08 Oct '18

Dear All, We have many Cisco Stacks, sometimes one of the switch in stack dies and we don’t get any alert. How can I set an alert if any of the stack member stop working or status change. I would highly appreciate your help. Thanks Zafar Pravaiz Senior Network Architect Information Technology Department Tel +971 6 515 2164 Fax +971 6 515 2112 American University of Sharjah PO Box 26666, Sharjah United Arab Emirates http://www.aus.edu <http://www.aus.edu/> zpravaiz(a)aus.edu <mailto:youremail@aus.edu>

3 5

Custom Dashboards
by John Morris 08 Oct '18

08 Oct '18

Hi All, I was wondering if any of you have managed to use the data from Observium to create a nice dashboard? Thanks John Morris Cloud Specialist

2 2

FW: FW: FW: Can't add Devices/Not polling
by mal＠platinumnetworks.com.au 08 Oct '18

08 Oct '18

From: Mal Evans Sent: Monday, 8 October 2018 12:12 PM To: 'Observium' <observium(a)observium.org> Subject: RE: [Observium] FW: FW: Can't add Devices/Not polling Cancel that – I restarted the snmpd service and everything started to work again… That’s for your help! From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Mal via observium Sent: Monday, 8 October 2018 12:05 PM To: 'Observium' <observium(a)observium.org <mailto:observium@observium.org> > Cc: mal(a)platinumnetworks.com.au <mailto:mal@platinumnetworks.com.au> Subject: Re: [Observium] FW: FW: Can't add Devices/Not polling Thanks Adam – that will be the problem. Is snmpget install as part of the snmpd installation? Or from Observium? I had a problem with SNMP so I uninstalled and reinstalled last week but snmpget wasn’t installed as part of that process. Do I need to reinstall Observium perhaps? Mal From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Adam Armstrong via observium Sent: Monday, 8 October 2018 8:58 AM To: Pieter De Wit via observium <observium(a)observium.org <mailto:observium@observium.org> > Cc: Adam Armstrong <adama(a)memetic.org <mailto:adama@memetic.org> > Subject: Re: [Observium] FW: FW: Can't add Devices/Not polling sh: 1: exec: /usr/bin/snmpget: not found You might need to fix this... 😅 Adam. Sent from BlueMail <http://www.bluemail.me/r?b=13688> On 7 Oct 2018, at 23:44, Mal via observium <observium(a)observium.org <mailto:observium@observium.org> > wrote: From: Mal Evans Sent: Monday, 8 October 2018 8:42 AM To: Observium <observium(a)observium.org> Subject: RE: [Observium] FW: Can't add Devices/Not polling Thanks Adam – output below mal@mon:/opt/observium$ sudo ./poller.php -h rtr-slf.qld.pnet.net.au -dd [sudo] password for mal: DEBUG! Load class 'Console_Color2' from '/opt/observium/libs/pear/Console/Color2.php': OK CMD[/usr/bin/svn info /opt/observium] CMD EXITCODE[0] CMD RUNTIME[0.0109s] STDOUT[ Path: . Working Copy Root Path: /opt/observium URL: http://svn.observium.org/svn/observium/trunk Relative URL: ^/observium/trunk Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 9449 Node Kind: directory Schedule: normal Last Changed Author: mike Last Changed Rev: 9449 Last Changed Date: 2018-09-30 19:05:07 +1000 (Sun, 30 Sep 2018) ] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] ROWS[1] SQL RUNTIME[0.00045204s] SQL[SELECT @@SESSION.sql_mode;] ROWS[1] SQL RUNTIME[0.00022888s] SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] ROWS[0] SQL RUNTIME[0.00021482s] DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] ROWS[1] SQL RUNTIME[0.00024605s] SQL[SELECT * FROM `config`] ROWS[15] SQL RUNTIME[0.00034213s] Load class 'Net_IPv6' from '/opt/observium/libs/pear/Net/IPv6.php': OK ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 18.9.9449 http://www.observium.org SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] ROWS[1] SQL RUNTIME[0.00054002s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] ROWS[1] SQL RUNTIME[0.00022697s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] ROWS[1] SQL RUNTIME[0.00023413s] There is a newer revision of Observium available! CMD[date "+%:z"] Wrong process status! Issue in proc_get_status(), see: https://bugs.php.net/bug.php?id=69014 CMD EXITCODE[0] CMD RUNTIME[0.0025s] STDOUT[ +10:00 ] SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] ROWS[1] SQL RUNTIME[0.00035596s] UNIXTIME from DATETIME "time()": LOCAL (2018-10-08 09:40:55), GMT (2018-10-07 22:40:55), TZ (+11:00) Version 18.10.9452 (8th October 2018) is 3 revisions ahead. CMD[/opt/observium/scripts/distro] CMD EXITCODE[0] CMD RUNTIME[0.0139s] STDOUT[ Linux|4.4.0-137-generic|amd64|Ubuntu|16.04|vmware| ] CMD[/usr/bin/env python --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0026s] STDOUT[ Python 2.7.12 ] SQL[SELECT version();] ROWS[1] SQL RUNTIME[0.00035000s] CMD[/usr/bin/rrdtool --version | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0083s] STDOUT[ RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi(a)oetiker.ch <mailto:tobi@oetiker.ch> > ] CMD[/usr/bin/fping -v 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0019s] STDOUT[ /usr/bin/fping: Version 3.13 /usr/bin/fping: comments to david(a)schweikert.ch <mailto:david@schweikert.ch> ] CMD[/usr/sbin/apache2 -v | awk '/Server version:/ {print $3}'] CMD EXITCODE[0] CMD RUNTIME[0.0503s] STDOUT[ Apache/2.4.18 ] SQL[SELECT @@SESSION.sql_mode;] ROWS[1] SQL RUNTIME[0.00060105s] SQL[SHOW VARIABLES LIKE 'character_set_connection'] ROWS[1] SQL RUNTIME[0.01740503s] ##### Software versions ##### o OS Linux 4.4.0-137-generic [amd64] (Ubuntu 16.04) o Apache 2.4.18 o PHP 7.0.32-0ubuntu0.16.04.1 (OPcache: DISABLED) o Python 2.7.12 o MySQL 5.7.23-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev) o SNMP not found o RRDtool 1.5.5 o Fping 3.13 (IPv4 and IPv6) ##### Memory Limit ##### o PHP Unlimited ##### MySQL mode ##### o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION ##### Charset info ##### o PHP UTF-8 o MySQL utf8 ##### Timezones info ##### o Date Monday, 08-Oct-18 09:40:55 AEDT o PHP +11:00 o MySQL +10:00 SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1538952055' AND `maint_end` > '1538952055'] ROWS[0] SQL RUNTIME[0.00051713s] RRD PIPE OPEN[TRUE] ##### Starting polling run at 2018-10-08 09:40:55 ##### SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'rtr-slf.qld.pnet.net.au' ORDER BY `device_id` ASC] ROWS[1] SQL RUNTIME[0.00057888s] SQL[SELECT * FROM `devices` WHERE `device_id` = '27'] ROWS[1] SQL RUNTIME[0.00041914s] SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '27'] ROWS[1] SQL RUNTIME[0.00042796s] > $device /opt/observium/includes/polling/functions.inc.php:483 array( [device_id] => string(2) "27" [hostname] => string(23) "rtr-slf.qld.pnet.net.au" [sysName] => string(11) "rtr-slf.qld" [snmp_community] => string(12) "PlatinumSNMP" [snmp_authlevel] => null [snmp_authname] => null [snmp_authpass] => null [snmp_authalgo] => null [snmp_cryptopass] => null [snmp_cryptoalgo] => null [snmp_version] => string(3) "v2c" [snmp_port] => string(5) "11164" [snmp_timeout] => null [snmp_retries] => null [snmp_maxrep] => null [ssh_port] => string(2) "22" [agent_version] => null [snmp_transport] => string(3) "udp" [bgpLocalAs] => null [snmpEngineID] => string(22) "800007DB03883FD32FDB21" [sysObjectID] => string(27) ".1.3.6.1.4.1.2011.2.224.133" [sysDescr] => string(176) "Huawei AR169FGW-L Huawei Versatile Routing Platform Software VRP (R) software,Version 5.160 (AR169FGW-L V200R007C00SPCb00) Copyright (C) 2011-2016 Huawei Technologies Co., Ltd" [sysContact] => string(17) "Platinum Networks" [version] => string(5) "5.160" [hardware] => string(0) "" [features] => string(17) "V200R007C00SPCb00" [location] => string(35) "Level 2, 217 George Street Brisbane" [os] => string(3) "vrp" [status] => string(1) "0" [ignore] => string(1) "0" [ignore_until] => null [asset_tag] => null [disabled] => string(1) "0" [uptime] => string(7) "6797935" [last_rebooted] => string(10) "1531299027" [force_discovery] => string(1) "0" [last_polled] => string(19) "2018-09-28 11:08:06" [last_discovered] => string(19) "2018-09-28 06:38:41" [last_alerter] => string(19) "2018-10-08 08:40:22" [last_polled_timetaken] => string(4) "3.23" [last_discovered_timetaken] => string(4) "7.75" [purpose] => null [type] => string(7) "network" [serial] => null [icon] => null [device_state] => string(13597) "a:4:{s:15:"poller_mod_perf";a:27:{s:6:"system";d:0.1202;s:2:"os";d:0.032599999999999997;s:7:"sensors";d:0.025700000000000001;s:6:"status";d:0.00080000000000000004;s:10:"processors";d:0.53269999999999995;s:8:"mempools";d:0.1133;s:7:"storage";d:0.00080000000000000004;s:8:"netstats";d:0.47199999999999998;s:6:"hr-mib";d:0.021999999999999999;s:7:"ucd-mib";d:0.050200000000000002;s:13:"ipSystemStats";d:0.090499999999999997;s:5:"ports";d:1.1046;s:9:"bgp-peers";d:0.021700000000000001;s:15:"printersupplies";d:0.00059999999999999995;s:10:"ucd-diskio";d:0.00059999999999999995;s:4:"wifi";d:0.0016000000000000001;s:10:"p2p-radios";d:0.0011000000000000001;s:4:"ospf";d:0.34749999999999998;s:3:"sla";d:0.0012999999999999999;s:11:"pseudowires";d:0.00080000000000000004;s:14:"mac-accounting";d:0.001;s:12:"loadbalancer";d:0.00069999999999999999;s:15:"entity-physical";d:0.00020000000000000001;s:12:"applications";d:0.00089999999999999998;s:9:"fdb-table";d:0.1444;s:6:"graphs";d:0.00089999999999999998;s:4:"oids";d:0.00089999999999999998;}s:17:"poller_ports_perf";a:1:{s:4:"vlan";d:0.1332399845123291;}s:14:"poller_history";a:288:{i:1538096883;d:3.2341000000000002;i:1538096606;d:6.7492000000000001;i:1538096310;d:3.9961000000000002;i:1538095996;d:3.0249999999999999;i:1538095685;d:3.5903999999999998;i:1538095413;d:3.5851999999999999;i:1538095143;d:3.3856999999999999;i:1538094834;d:3.5752000000000002;i:1538094527;d:3.0781000000000001;i:1538094164;d:3.1539999999999999;i:1538093911;d:4.3428000000000004;i:1538093642;d:3.6230000000000002;i:1538093386;d:3.0167999999999999;i:1538093108;d:4.5301999999999998;i:1538092703;d:2.9601000000000002;i:1538092374;d:3.3117999999999999;i:1538092107;d:3.7368999999999999;i:1538091750;d:2.9855;i:1538091527;d:4.3973000000000004;i:1538091201;d:3.0099999999999998;i:1538090865;d:3.0404;i:1538090624;d:3.4723999999999999;i:1538090317;d:2.9470999999999998;i:1538090040;d:3.1560000000000001;i:1538089693;d:3.6059000000000001;i:1538089357;d:4.6970999999999998;i:1538089111;d:4.0666000000000002;i:1538088809;d:2.9973000000000001;i:1538088453;d:2.9653;i:1538088212;d:3.7945000000000002;i:1538087929;d:3.1436999999999999;i:1538087611;d:3.0897999999999999;i:1538087314;d:3.3374999999999999;i:1538087020;d:2.9289999999999998;i:1538086665;d:2.9698000000000002;i:1538086356;d:3.8460000000000001;i:1538086091;d:4.3402000000000003;i:1538085783;d:4.4097;i:1538085495;d:3.8618999999999999;i:1538085118;d:3.0468000000000002;i:1538084881;d:4.6494999999999997;i:1538084540;d:3.2532000000000001;i:1538084291;d:4.0883000000000003;i:1538083954;d:4.2942;i:1538083707;d:4.2523;i:1538083342;d:2.9864999999999999;i:1538083078;d:3.9192999999999998;i:1538082761;d:3.2778;i:1538082483;d:3.7212999999999998;i:1538082237;d:4.2850999999999999;i:1538081883;d:2.9203000000000001;i:1538081573;d:3.2700999999999998;i:1538081310;d:3.4830000000000001;i:1538080940;d:2.9014000000000002;i:1538080726;d:4.0275999999999996;i:1538080333;d:2.9708999999999999;i:1538080081;d:4.9927000000000001;i:1538079773;d:3.4756;i:1538079454;d:3.5095999999999998;i:1538079143;d:3.6776;i:1538078914;d:3.7774999999999999;i:1538078587;d:4.0484999999999998;i:1538078215;d:3.8601000000000001;i:1538077961;d:4.6565000000000003;i:1538077645;d:3.7262;i:1538077339;d:3.8149000000000002;i:1538077130;d:4.0946999999999996;i:1538076783;d:2.9457;i:1538076499;d:3.6440000000000001;i:1538076176;d:2.9975999999999998;i:1538075873;d:3.4704999999999999;i:1538075515;d:3.3658999999999999;i:1538075299;d:3.8454000000000002;i:1538074988;d:3.0110000000000001;i:1538074668;d:3.5687000000000002;i:1538074343;d:3.6577000000000002;i:1538074043;d:3.9218000000000002;i:1538073762;d:3.9792999999999998;i:1538073522;d:3.5383;i:1538073171;d:3.6278000000000001;i:1538072836;d:3.6461000000000001;i:1538072583;d:4.0179;i:1538072220;d:3.1810999999999998;i:1538071957;d:4.7098000000000004;i:1538071675;d:3.4262000000000001;i:1538071445;d:4.7660999999999998;i:1538071077;d:3.0270000000000001;i:1538070751;d:3.3416999999999999;i:1538070424;d:3.6038999999999999;i:1538070136;d:4.0270999999999999;i:1538069867;d:4.1707999999999998;i:1538069633;d:4.6867999999999999;i:1538069229;d:2.9845000000000002;i:1538068985;d:4.1532999999999998;i:1538068673;d:3.1450999999999998;i:1538068387;d:3.6192000000000002;i:1538068066;d:3.3205;i:1538067737;d:5.0822000000000003;i:1538067474;d:3.9601999999999999;i:1538067121;d:3.0867;i:1538066864;d:4.3624000000000001;i:1538066538;d:3.3744000000000001;i:1538066280;d:4.2998000000000003;i:1538065956;d:4.5049999999999999;i:1538065620;d:4.4577;i:1538065367;d:5.4419000000000004;i:1538065086;d:3.5419999999999998;i:1538064789;d:3.3999999999999999;i:1538064514;d:3.9824000000000002;i:1538064183;d:4.5289999999999999;i:1538063877;d:3.8613;i:1538063551;d:3.3601999999999999;i:1538063274;d:3.4397000000000002;i:1538063006;d:3.194;i:1538062653;d:2.9878;i:1538062370;d:5.0301;i:1538062055;d:3.7035999999999998;i:1538061802;d:3.7561;i:1538061441;d:2.9472999999999998;i:1538061176;d:3.875;i:1538060917;d:3.5076999999999998;i:1538060615;d:3.6699999999999999;i:1538060222;d:3.5133999999999999;i:1538059976;d:4.4635999999999996;i:1538059647;d:3.7187999999999999;i:1538059364;d:4.0709;i:1538059050;d:3.6208999999999998;i:1538058753;d:4.5639000000000003;i:1538058450;d:3.7237;i:1538058178;d:3.6589;i:1538057838;d:3.3045;i:1538057555;d:4.1040000000000001;i:1538057334;d:3.5853000000000002;i:1538056972;d:2.9386999999999999;i:1538056653;d:3.7282999999999999;i:1538056371;d:3.8065000000000002;i:1538056114;d:3.5325000000000002;i:1538055780;d:3.0958000000000001;i:1538055450;d:3.3837000000000002;i:1538055232;d:5.6223999999999998;i:1538054868;d:3.1514000000000002;i:1538054534;d:3.9215;i:1538054284;d:4.5631000000000004;i:1538053995;d:3.4510999999999998;i:1538053662;d:3.2890000000000001;i:1538053379;d:4.8674999999999997;i:1538053080;d:3.8666999999999998;i:1538052750;d:2.9807000000000001;i:1538052479;d:3.6278999999999999;i:1538052131;d:3.1842000000000001;i:1538051868;d:4.3533999999999997;i:1538051588;d:4.8170000000000002;i:1538051267;d:3.5983999999999998;i:1538050956;d:3.4679000000000002;i:1538050679;d:3.7153999999999998;i:1538050374;d:3.6473;i:1538050134;d:3.5888;i:1538049629;d:2.9708000000000001;i:1538049460;d:8.1469000000000005;i:1538049168;d:3.5356999999999998;i:1538048845;d:3.3631000000000002;i:1538048538;d:3.7006999999999999;i:1538048337;d:4.4008000000000003;i:1538048044;d:2.9864000000000002;i:1538047702;d:2.9557000000000002;i:1538047347;d:2.9910000000000001;i:1538047108;d:3.9708999999999999;i:1538046789;d:3.0678000000000001;i:1538046496;d:3.403;i:1538046206;d:4.0400999999999998;i:1538045851;d:3.4628000000000001;i:1538045625;d:4.0418000000000003;i:1538045239;d:2.9009;i:1538044977;d:4.0365000000000002;i:1538044723;d:3.5535000000000001;i:1538044339;d:3.4213;i:1538044062;d:4.3501000000000003;i:1538043803;d:3.8041999999999998;i:1538043510;d:3.0160999999999998;i:1538043150;d:3.0059;i:1538042898;d:3.8214999999999999;i:1538042637;d:4.0918999999999999;i:1538042235;d:2.9893999999999998;i:1538041975;d:4.2956000000000003;i:1538041625;d:3.6320999999999999;i:1538041358;d:4.6371000000000002;i:1538041101;d:4.0105000000000004;i:1538040728;d:4.0038999999999998;i:1538040462;d:4.2099000000000002;i:1538040172;d:3.5746000000000002;i:1538039896;d:3.8418999999999999;i:1538039585;d:3.0783;i:1538039305;d:3.5063;i:1538039039;d:4.0595999999999997;i:1538038639;d:3.1524000000000001;i:1538038355;d:3.8142999999999998;i:1538038083;d:3.8182;i:1538037803;d:3.3988;i:1538037458;d:3.2178;i:1538037175;d:5.2276999999999996;i:1538036910;d:3.9146000000000001;i:1538036585;d:3.056;i:1538036291;d:3.4742000000000002;i:1538035934;d:3.1968999999999999;i:1538035692;d:4.5255999999999998;i:1538035415;d:4.7695999999999996;i:1538035042;d:3.5865999999999998;i:1538034727;d:4.1601999999999997;i:1538034391;d:4.0175999999999998;i:1538034179;d:5.5098000000000003;i:1538033873;d:3.5552999999999999;i:1538033619;d:4.6352000000000002;i:1538033311;d:3.0676999999999999;i:1538032925;d:2.9419;i:1538032673;d:5.1768000000000001;i:1538032408;d:3.3380000000000001;i:1538032066;d:3.0813999999999999;i:1538031831;d:5.1436999999999999;i:1538031518;d:3.1482000000000001;i:1538031214;d:2.9502999999999999;i:1538030925;d:3.1301999999999999;i:1538030587;d:3.1027999999999998;i:1538030254;d:3.6613000000000002;i:1538030088;d:5.9353999999999996;i:1538029651;d:2.9712999999999998;i:1538029430;d:4.0724;i:1538029073;d:3.0114000000000001;i:1538028819;d:4.0864000000000003;i:1538028468;d:3.4072;i:1538028258;d:5.2679999999999998;i:1538027875;d:3.3982999999999999;i:1538027627;d:3.9584999999999999;i:1538027296;d:3.0360999999999998;i:1538027016;d:3.4028999999999998;i:1538026754;d:3.391;i:1538026401;d:3.1278000000000001;i:1538026105;d:3.7959999999999998;i:1538025813;d:3.3414999999999999;i:1538025500;d:3.3069999999999999;i:1538025155;d:3.6038000000000001;i:1538024913;d:4.1936999999999998;i:1538024597;d:4.3296999999999999;i:1538024315;d:3.8589000000000002;i:1538024042;d:3.1970000000000001;i:1538023720;d:2.9822000000000002;i:1538023352;d:3.0276999999999998;i:1538023091;d:4.4111000000000002;i:1538022808;d:5.0712000000000002;i:1538022521;d:3.5150999999999999;i:1538022167;d:3.1518999999999999;i:1538021889;d:3.9045000000000001;i:1538021656;d:3.9718;i:1538021344;d:2.9900000000000002;i:1538021075;d:3.0324;i:1538020728;d:2.9912000000000001;i:1538020414;d:3.0663999999999998;i:1538020108;d:3.4420999999999999;i:1538019840;d:3.4765999999999999;i:1538019573;d:3.0379999999999998;i:1538019168;d:3.0318999999999998;i:1538018911;d:4.5292000000000003;i:1538018588;d:3.0362;i:1538018341;d:4.3705999999999996;i:1538018050;d:3.5909;i:1538017791;d:3.3767999999999998;i:1538017469;d:3.1556000000000002;i:1538017132;d:3.6358000000000001;i:1538016726;d:3.0318999999999998;i:1538016476;d:5.6369999999999996;i:1538016179;d:4.0448000000000004;i:1538015854;d:4.3811999999999998;i:1538015659;d:5.8514999999999997;i:1538015337;d:3.2549000000000001;i:1538014985;d:3.2122000000000002;i:1538014676;d:4.0532000000000004;i:1538014510;d:3.1556999999999999;i:1538014204;d:4.3333000000000004;i:1538013922;d:3.1497000000000002;i:1538013497;d:3.0994999999999999;i:1538013181;d:3.8603999999999998;i:1538012934;d:3.9632999999999998;i:1538012655;d:3.1371000000000002;i:1538012311;d:3.3313000000000001;i:1538011999;d:4.8042999999999996;i:1538011743;d:4.4160000000000004;i:1538011403;d:3.0274000000000001;i:1538011100;d:3.7353000000000001;i:1538010818;d:3.4683999999999999;}s:17:"discovery_history";a:100:{i:1538080714;d:7.7544000000000004;i:1538058954;d:11.8148;i:1538037386;d:7.1657000000000002;i:1538015811;d:7.5838000000000001;i:1537994199;d:7.1746999999999996;i:1537972672;d:7.6186999999999996;i:1537951026;d:9.1906999999999996;i:1537929401;d:8.9390999999999998;i:1537907760;d:6.9756;i:1537886184;d:7.3825000000000003;i:1537864597;d:7.3075000000000001;i:1537843033;d:7.3891;i:1537821394;d:7.5202;i:1537799799;d:7.7005999999999997;i:1537778194;d:8.4852000000000007;i:1537756660;d:8.7713999999999999;i:1537735006;d:7.5862999999999996;i:1537713387;d:8.0109999999999992;i:1537691787;d:7.3535000000000004;i:1537670226;d:7.6965000000000003;i:1537648609;d:8.2081;i:1537626998;d:7.4366000000000003;i:1537605387;d:7.7065999999999999;i:1537583780;d:7.5105000000000004;i:1537562202;d:7.5899000000000001;i:1537540589;d:7.6036000000000001;i:1537518999;d:7.3528000000000002;i:1537497396;d:7.9557000000000002;i:1537475839;d:7.3705999999999996;i:1537454188;d:8.5061999999999998;i:1537432601;d:7.3613;i:1537411004;d:8.2899999999999991;i:1537389392;d:7.4923999999999999;i:1537367772;d:7.7808999999999999;i:1537346241;d:6.9629000000000003;i:1537324683;d:9.3427000000000007;i:1537303013;d:8.5792999999999999;i:1537281409;d:7.9107000000000003;i:1537259778;d:7.6986999999999997;i:1537238203;d:7.5811999999999999;i:1537216594;d:7.4325000000000001;i:1537194987;d:7.5598999999999998;i:1537173376;d:7.1814999999999998;i:1537151822;d:7.3376000000000001;i:1537130177;d:7.5002000000000004;i:1537108585;d:7.2328000000000001;i:1537086974;d:7.5750000000000002;i:1537065377;d:7.2988;i:1537043762;d:7.2800000000000002;i:1537022166;d:7.0979999999999999;i:1537000580;d:7.3391000000000002;i:1536978980;d:7.3795999999999999;i:1536957427;d:7.5382999999999996;i:1536935803;d:8.4991000000000003;i:1536914176;d:7.6386000000000003;i:1536892643;d:7.4509999999999996;i:1536870967;d:7.2976999999999999;i:1536849371;d:7.3731999999999998;i:1536827784;d:7.5589000000000004;i:1536806192;d:7.3960999999999997;i:1536784576;d:7.2220000000000004;i:1536762955;d:7.2169999999999996;i:1536741335;d:6.8833000000000002;i:1536719833;d:7.1026999999999996;i:1536698172;d:7.4108000000000001;i:1536676570;d:7.4114000000000004;i:1536654965;d:7.3682999999999996;i:1536633387;d:7.3731999999999998;i:1536611750;d:7.024;i:1536590174;d:6.8372999999999999;i:1536568541;d:6.9978999999999996;i:1536546983;d:7.0103999999999997;i:1536525376;d:6.8952;i:1536503781;d:7.1639999999999997;i:1536482166;d:7.2619999999999996;i:1536460579;d:6.9081000000000001;i:1536438996;d:7.0580999999999996;i:1536417384;d:7.3914;i:1536395788;d:7.3792;i:1536374186;d:7.5015000000000001;i:1536352570;d:7.0444000000000004;i:1536330988;d:7.1060999999999996;i:1536309359;d:7.4617000000000004;i:1536287808;d:6.9250999999999996;i:1536266167;d:6.8148;i:1536244568;d:6.7591999999999999;i:1536222980;d:7.0377000000000001;i:1536201409;d:6.9621000000000004;i:1536179768;d:7.9686000000000003;i:1536158170;d:7.3461999999999996;i:1536136573;d:7.5946999999999996;i:1536115020;d:7.0101000000000004;i:1536093371;d:7.4097999999999997;i:1536071785;d:7.4455;i:1536050175;d:7.4588999999999999;i:1536028587;d:7.5102000000000002;i:1536006980;d:7.3712999999999997;i:1535985388;d:6.9196;i:1535963759;d:7.6353;i:1535942219;d:7.0571000000000002;}}" [distro] => null [distro_ver] => null [kernel] => null [arch] => null ) > $attribs /opt/observium/includes/polling/functions.inc.php:484 array( [ports_ignored_count] => string(1) "2" ) SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '27'] ROWS[0] SQL RUNTIME[0.00035882s] SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('25849','poller.php','25848','0','php ./poller.php -h rtr-slf.qld.pnet.net.au -dd','1538952055','27')] ROWS[1] SQL RUNTIME[0.00412297s] SQL[SELECT * FROM `alert_tests` WHERE 1] ROWS[1] SQL RUNTIME[0.00033402s] Cached 1 alert rules. SQL[SELECT * FROM `alert_table` WHERE `device_id` = '27'] ROWS[0] SQL RUNTIME[0.00038695s] > $alert_rules /opt/observium/includes/polling/functions.inc.php:492 array( [2] => array( [alert_test_id] => string(1) "2" [entity_type] => string(4) "port" [alert_name] => string(17) "AAPT Transit High" [alert_message] => string(29) "The AAPT Transit is over 100M" [alert_assoc] => null [conditions] => array( [0] => array( [metric] => string(15) "ifInOctets_rate" [condition] => string(2) "ge" [value] => string(9) "100000000" ) ) [conditions_warn] => null [and] => string(1) "1" [severity] => string(4) "crit" [delay] => string(1) "0" [alerter] => string(7) "default" [enable] => string(1) "1" [show_frontpage] => string(1) "1" [suppress_recovery] => string(1) "1" [ignore_until] => null ) ) > $alert_table /opt/observium/includes/polling/functions.inc.php:493 array() ##### rtr-slf.qld.pnet.net.au [27] ##### o OS vrp o OS Group huawei o Last poll duration 3.23 seconds o Last Polled 2018-09-28 11:08:06 o SNMP Version v2c CMD[/usr/bin/fping -t 500 -c 1 -q 103.225.70.102 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0027s] STDOUT[ 103.225.70.102 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.53/0.53/0.53 ] CMD[/usr/bin/snmpget -v2c -c 'PlatinumSNMP' -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'rtr-slf.qld.pnet.net.au':'11164' sysObjectID.0 sysUpTime.0] CMD EXITCODE[127] CMD RUNTIME[0.0009s] STDOUT[ ] STDERR[ sh: 1: exec: /usr/bin/snmpget: not found ] SNMP ERROR - device: 27, cmd: snmpget, options: -OQUs, mib: 'SNMPv2-MIB', oid: 'sysObjectID.0 sysUpTime.0', cmd exitcode: 127, snmp error code: #900, reason: 'isSNMPable', runtime: 0.00094199180603027 SNMP ERROR - device: 27, cmd: snmpget, options: -OQUs, mib: 'SNMPv2-MIB', oid: 'sysObjectID.0 sysUpTime.0', cmd exitcode: 127, snmp error code: #900, reason: 'isSNMPable', runtime: 0.00094199180603027 SNMP STATUS[FALSE] o Device status Device is not responding to SNMP requests RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/status.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/status.rrd N:0] RRD RUNTIME[0.0014s] RRD STDOUT[OK u:0.00 s:0.00 r:0.01] RRD_STATUS[TRUE] RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping.rrd N:0.53] RRD RUNTIME[0.0012s] RRD STDOUT[OK u:0.00 s:0.00 r:0.01] RRD_STATUS[TRUE] RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping_snmp.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping_snmp.rrd N:U] RRD RUNTIME[0.0012s] RRD STDOUT[OK u:0.01 s:0.00 r:0.01] RRD_STATUS[TRUE] SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '25849' AND `process_name` = 'poller.php' AND `device_id` = '27'] ROWS[1] SQL RUNTIME[0.00302505s] ./poller.php: rtr-slf.qld.pnet.net.au - 1 devices polled in 0.155 secs ##### Completed polling run at 2018-10-08 09:40:55 ##### > $db_stats /opt/observium/poller.php:217 array( [insert] => int(1) [insert_sec] => double(0.00457406) [update] => int(0) [update_sec] => int(0) [delete] => int(1) [delete_sec] => double(0.00324702) [fetchcell] => int(4) [fetchcell_sec] => double(0.0025918483734131) [fetchrow] => int(6) [fetchrow_sec] => double(0.0036671161651611) [fetchrows] => int(8) [fetchrows_sec] => double(0.022239685058594) [fetchcol] => int(0) [fetchcol_sec] => int(0) [total] => int(20) [total_sec] => double(0.036319729597168) ) NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 1 o Poller Time 0.155 secs o Memory usage 12MB (peak: 14MB) o MySQL Usage Insert[1/0.005s] Update[0/0s] Delete[1/0.003s] Cell[4/0.003s] Row[6/0.004s] Rows[8/0.022s] Col[0/0s] (0.036s 23.432%) o RRDTool Usage update[3/0.004s] (0.004s 2.475%) o SNMP Usage snmpget[1/0.001s] (0.001s 0.608%) RRD PIPE CLOSE[TRUE] > $snmp_stats /opt/observium/poller.php:279 array( [snmpget] => array( [count] => int(1) [time] => double(0.00094199180603027) ) ) From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Adam Armstrong via observium Sent: Monday, 8 October 2018 8:38 AM To: Mal via observium <observium(a)observium.org <mailto:observium@observium.org> > Cc: Adam Armstrong <adama(a)memetic.org <mailto:adama@memetic.org> > Subject: Re: [Observium] FW: Can't add Devices/Not polling Do: ./poller.php -h <hostname> -dd And show the output. Adam. Sent from BlueMail <http://www.bluemail.me/r?b=13688> On 7 Oct 2018, at 23:33, Mal via observium <observium(a)observium.org <mailto:observium@observium.org> > wrote: From: mal(a)platinumnetworks.com.au <mailto:mal@platinumnetworks.com.au> <mal(a)platinumnetworks.com.au <mailto:mal@platinumnetworks.com.au> > Sent: Thursday, 4 October 2018 8:39 PM To: 'Observium' <observium(a)observium.org <mailto:observium@observium.org> > Subject: Can't add Devices/Not polling Hi all – my Observium installed has just decided to stop polling and reports all devices as down. I also can’t add new devices. I thought it may have been a lack of disk space so today I have updated to the current subscription version, ran the housekeeping script and cleared out as much off the machine as I can but there has been no change. My RRD directory is only about 5 G and I have around 4G free on that drive so it is not obvious to me that there is a lack of available space. I’ve been having trouble with the firewall config on that host so I also disabled the firewall in case it was blocking traffic. I can ping all the devices I am monitoring from this host and I have another SNMP tool monitoring some of the same devices successfully. So I am pretty certain it is the Observium host that is the location of the problem – I’m just not certain about what could be the problem… Below is the error I receive when I try to add a device I have checked the event logs but there are not even any entries in there to reflect that I have even tried to add a device let alone anything that will give me an indication as to what the problem is. Needless to say, after several hours trying to troubleshoot this I would really appreciate any feedback or direction! Thanks in advance Mal _____ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _____ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

FW: FW: Can't add Devices/Not polling
by mal＠platinumnetworks.com.au 08 Oct '18

08 Oct '18

From: Mal Evans Sent: Monday, 8 October 2018 8:42 AM To: Observium <observium(a)observium.org> Subject: RE: [Observium] FW: Can't add Devices/Not polling Thanks Adam – output below mal@mon:/opt/observium$ sudo ./poller.php -h rtr-slf.qld.pnet.net.au -dd [sudo] password for mal: DEBUG! Load class 'Console_Color2' from '/opt/observium/libs/pear/Console/Color2.php': OK CMD[/usr/bin/svn info /opt/observium] CMD EXITCODE[0] CMD RUNTIME[0.0109s] STDOUT[ Path: . Working Copy Root Path: /opt/observium URL: http://svn.observium.org/svn/observium/trunk Relative URL: ^/observium/trunk Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 9449 Node Kind: directory Schedule: normal Last Changed Author: mike Last Changed Rev: 9449 Last Changed Date: 2018-09-30 19:05:07 +1000 (Sun, 30 Sep 2018) ] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] ROWS[1] SQL RUNTIME[0.00045204s] SQL[SELECT @@SESSION.sql_mode;] ROWS[1] SQL RUNTIME[0.00022888s] SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] ROWS[0] SQL RUNTIME[0.00021482s] DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] ROWS[1] SQL RUNTIME[0.00024605s] SQL[SELECT * FROM `config`] ROWS[15] SQL RUNTIME[0.00034213s] Load class 'Net_IPv6' from '/opt/observium/libs/pear/Net/IPv6.php': OK ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 18.9.9449 http://www.observium.org SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] ROWS[1] SQL RUNTIME[0.00054002s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] ROWS[1] SQL RUNTIME[0.00022697s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] ROWS[1] SQL RUNTIME[0.00023413s] There is a newer revision of Observium available! CMD[date "+%:z"] Wrong process status! Issue in proc_get_status(), see: https://bugs.php.net/bug.php?id=69014 CMD EXITCODE[0] CMD RUNTIME[0.0025s] STDOUT[ +10:00 ] SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] ROWS[1] SQL RUNTIME[0.00035596s] UNIXTIME from DATETIME "time()": LOCAL (2018-10-08 09:40:55), GMT (2018-10-07 22:40:55), TZ (+11:00) Version 18.10.9452 (8th October 2018) is 3 revisions ahead. CMD[/opt/observium/scripts/distro] CMD EXITCODE[0] CMD RUNTIME[0.0139s] STDOUT[ Linux|4.4.0-137-generic|amd64|Ubuntu|16.04|vmware| ] CMD[/usr/bin/env python --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0026s] STDOUT[ Python 2.7.12 ] SQL[SELECT version();] ROWS[1] SQL RUNTIME[0.00035000s] CMD[/usr/bin/rrdtool --version | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0083s] STDOUT[ RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi(a)oetiker.ch <mailto:tobi@oetiker.ch> > ] CMD[/usr/bin/fping -v 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0019s] STDOUT[ /usr/bin/fping: Version 3.13 /usr/bin/fping: comments to david(a)schweikert.ch <mailto:david@schweikert.ch> ] CMD[/usr/sbin/apache2 -v | awk '/Server version:/ {print $3}'] CMD EXITCODE[0] CMD RUNTIME[0.0503s] STDOUT[ Apache/2.4.18 ] SQL[SELECT @@SESSION.sql_mode;] ROWS[1] SQL RUNTIME[0.00060105s] SQL[SHOW VARIABLES LIKE 'character_set_connection'] ROWS[1] SQL RUNTIME[0.01740503s] ##### Software versions ##### o OS Linux 4.4.0-137-generic [amd64] (Ubuntu 16.04) o Apache 2.4.18 o PHP 7.0.32-0ubuntu0.16.04.1 (OPcache: DISABLED) o Python 2.7.12 o MySQL 5.7.23-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev) o SNMP not found o RRDtool 1.5.5 o Fping 3.13 (IPv4 and IPv6) ##### Memory Limit ##### o PHP Unlimited ##### MySQL mode ##### o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION ##### Charset info ##### o PHP UTF-8 o MySQL utf8 ##### Timezones info ##### o Date Monday, 08-Oct-18 09:40:55 AEDT o PHP +11:00 o MySQL +10:00 SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1538952055' AND `maint_end` > '1538952055'] ROWS[0] SQL RUNTIME[0.00051713s] RRD PIPE OPEN[TRUE] ##### Starting polling run at 2018-10-08 09:40:55 ##### SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'rtr-slf.qld.pnet.net.au' ORDER BY `device_id` ASC] ROWS[1] SQL RUNTIME[0.00057888s] SQL[SELECT * FROM `devices` WHERE `device_id` = '27'] ROWS[1] SQL RUNTIME[0.00041914s] SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '27'] ROWS[1] SQL RUNTIME[0.00042796s] > $device /opt/observium/includes/polling/functions.inc.php:483 array( [device_id] => string(2) "27" [hostname] => string(23) "rtr-slf.qld.pnet.net.au" [sysName] => string(11) "rtr-slf.qld" [snmp_community] => string(12) "PlatinumSNMP" [snmp_authlevel] => null [snmp_authname] => null [snmp_authpass] => null [snmp_authalgo] => null [snmp_cryptopass] => null [snmp_cryptoalgo] => null [snmp_version] => string(3) "v2c" [snmp_port] => string(5) "11164" [snmp_timeout] => null [snmp_retries] => null [snmp_maxrep] => null [ssh_port] => string(2) "22" [agent_version] => null [snmp_transport] => string(3) "udp" [bgpLocalAs] => null [snmpEngineID] => string(22) "800007DB03883FD32FDB21" [sysObjectID] => string(27) ".1.3.6.1.4.1.2011.2.224.133" [sysDescr] => string(176) "Huawei AR169FGW-L Huawei Versatile Routing Platform Software VRP (R) software,Version 5.160 (AR169FGW-L V200R007C00SPCb00) Copyright (C) 2011-2016 Huawei Technologies Co., Ltd" [sysContact] => string(17) "Platinum Networks" [version] => string(5) "5.160" [hardware] => string(0) "" [features] => string(17) "V200R007C00SPCb00" [location] => string(35) "Level 2, 217 George Street Brisbane" [os] => string(3) "vrp" [status] => string(1) "0" [ignore] => string(1) "0" [ignore_until] => null [asset_tag] => null [disabled] => string(1) "0" [uptime] => string(7) "6797935" [last_rebooted] => string(10) "1531299027" [force_discovery] => string(1) "0" [last_polled] => string(19) "2018-09-28 11:08:06" [last_discovered] => string(19) "2018-09-28 06:38:41" [last_alerter] => string(19) "2018-10-08 08:40:22" [last_polled_timetaken] => string(4) "3.23" [last_discovered_timetaken] => string(4) "7.75" [purpose] => null [type] => string(7) "network" [serial] => null [icon] => null [device_state] => string(13597) "a:4:{s:15:"poller_mod_perf";a:27:{s:6:"system";d:0.1202;s:2:"os";d:0.032599999999999997;s:7:"sensors";d:0.025700000000000001;s:6:"status";d:0.00080000000000000004;s:10:"processors";d:0.53269999999999995;s:8:"mempools";d:0.1133;s:7:"storage";d:0.00080000000000000004;s:8:"netstats";d:0.47199999999999998;s:6:"hr-mib";d:0.021999999999999999;s:7:"ucd-mib";d:0.050200000000000002;s:13:"ipSystemStats";d:0.090499999999999997;s:5:"ports";d:1.1046;s:9:"bgp-peers";d:0.021700000000000001;s:15:"printersupplies";d:0.00059999999999999995;s:10:"ucd-diskio";d:0.00059999999999999995;s:4:"wifi";d:0.0016000000000000001;s:10:"p2p-radios";d:0.0011000000000000001;s:4:"ospf";d:0.34749999999999998;s:3:"sla";d:0.0012999999999999999;s:11:"pseudowires";d:0.00080000000000000004;s:14:"mac-accounting";d:0.001;s:12:"loadbalancer";d:0.00069999999999999999;s:15:"entity-physical";d:0.00020000000000000001;s:12:"applications";d:0.00089999999999999998;s:9:"fdb-table";d:0.1444;s:6:"graphs";d:0.00089999999999999998;s:4:"oids";d:0.00089999999999999998;}s:17:"poller_ports_perf";a:1:{s:4:"vlan";d:0.1332399845123291;}s:14:"poller_history";a:288:{i:1538096883;d:3.2341000000000002;i:1538096606;d:6.7492000000000001;i:1538096310;d:3.9961000000000002;i:1538095996;d:3.0249999999999999;i:1538095685;d:3.5903999999999998;i:1538095413;d:3.5851999999999999;i:1538095143;d:3.3856999999999999;i:1538094834;d:3.5752000000000002;i:1538094527;d:3.0781000000000001;i:1538094164;d:3.1539999999999999;i:1538093911;d:4.3428000000000004;i:1538093642;d:3.6230000000000002;i:1538093386;d:3.0167999999999999;i:1538093108;d:4.5301999999999998;i:1538092703;d:2.9601000000000002;i:1538092374;d:3.3117999999999999;i:1538092107;d:3.7368999999999999;i:1538091750;d:2.9855;i:1538091527;d:4.3973000000000004;i:1538091201;d:3.0099999999999998;i:1538090865;d:3.0404;i:1538090624;d:3.4723999999999999;i:1538090317;d:2.9470999999999998;i:1538090040;d:3.1560000000000001;i:1538089693;d:3.6059000000000001;i:1538089357;d:4.6970999999999998;i:1538089111;d:4.0666000000000002;i:1538088809;d:2.9973000000000001;i:1538088453;d:2.9653;i:1538088212;d:3.7945000000000002;i:1538087929;d:3.1436999999999999;i:1538087611;d:3.0897999999999999;i:1538087314;d:3.3374999999999999;i:1538087020;d:2.9289999999999998;i:1538086665;d:2.9698000000000002;i:1538086356;d:3.8460000000000001;i:1538086091;d:4.3402000000000003;i:1538085783;d:4.4097;i:1538085495;d:3.8618999999999999;i:1538085118;d:3.0468000000000002;i:1538084881;d:4.6494999999999997;i:1538084540;d:3.2532000000000001;i:1538084291;d:4.0883000000000003;i:1538083954;d:4.2942;i:1538083707;d:4.2523;i:1538083342;d:2.9864999999999999;i:1538083078;d:3.9192999999999998;i:1538082761;d:3.2778;i:1538082483;d:3.7212999999999998;i:1538082237;d:4.2850999999999999;i:1538081883;d:2.9203000000000001;i:1538081573;d:3.2700999999999998;i:1538081310;d:3.4830000000000001;i:1538080940;d:2.9014000000000002;i:1538080726;d:4.0275999999999996;i:1538080333;d:2.9708999999999999;i:1538080081;d:4.9927000000000001;i:1538079773;d:3.4756;i:1538079454;d:3.5095999999999998;i:1538079143;d:3.6776;i:1538078914;d:3.7774999999999999;i:1538078587;d:4.0484999999999998;i:1538078215;d:3.8601000000000001;i:1538077961;d:4.6565000000000003;i:1538077645;d:3.7262;i:1538077339;d:3.8149000000000002;i:1538077130;d:4.0946999999999996;i:1538076783;d:2.9457;i:1538076499;d:3.6440000000000001;i:1538076176;d:2.9975999999999998;i:1538075873;d:3.4704999999999999;i:1538075515;d:3.3658999999999999;i:1538075299;d:3.8454000000000002;i:1538074988;d:3.0110000000000001;i:1538074668;d:3.5687000000000002;i:1538074343;d:3.6577000000000002;i:1538074043;d:3.9218000000000002;i:1538073762;d:3.9792999999999998;i:1538073522;d:3.5383;i:1538073171;d:3.6278000000000001;i:1538072836;d:3.6461000000000001;i:1538072583;d:4.0179;i:1538072220;d:3.1810999999999998;i:1538071957;d:4.7098000000000004;i:1538071675;d:3.4262000000000001;i:1538071445;d:4.7660999999999998;i:1538071077;d:3.0270000000000001;i:1538070751;d:3.3416999999999999;i:1538070424;d:3.6038999999999999;i:1538070136;d:4.0270999999999999;i:1538069867;d:4.1707999999999998;i:1538069633;d:4.6867999999999999;i:1538069229;d:2.9845000000000002;i:1538068985;d:4.1532999999999998;i:1538068673;d:3.1450999999999998;i:1538068387;d:3.6192000000000002;i:1538068066;d:3.3205;i:1538067737;d:5.0822000000000003;i:1538067474;d:3.9601999999999999;i:1538067121;d:3.0867;i:1538066864;d:4.3624000000000001;i:1538066538;d:3.3744000000000001;i:1538066280;d:4.2998000000000003;i:1538065956;d:4.5049999999999999;i:1538065620;d:4.4577;i:1538065367;d:5.4419000000000004;i:1538065086;d:3.5419999999999998;i:1538064789;d:3.3999999999999999;i:1538064514;d:3.9824000000000002;i:1538064183;d:4.5289999999999999;i:1538063877;d:3.8613;i:1538063551;d:3.3601999999999999;i:1538063274;d:3.4397000000000002;i:1538063006;d:3.194;i:1538062653;d:2.9878;i:1538062370;d:5.0301;i:1538062055;d:3.7035999999999998;i:1538061802;d:3.7561;i:1538061441;d:2.9472999999999998;i:1538061176;d:3.875;i:1538060917;d:3.5076999999999998;i:1538060615;d:3.6699999999999999;i:1538060222;d:3.5133999999999999;i:1538059976;d:4.4635999999999996;i:1538059647;d:3.7187999999999999;i:1538059364;d:4.0709;i:1538059050;d:3.6208999999999998;i:1538058753;d:4.5639000000000003;i:1538058450;d:3.7237;i:1538058178;d:3.6589;i:1538057838;d:3.3045;i:1538057555;d:4.1040000000000001;i:1538057334;d:3.5853000000000002;i:1538056972;d:2.9386999999999999;i:1538056653;d:3.7282999999999999;i:1538056371;d:3.8065000000000002;i:1538056114;d:3.5325000000000002;i:1538055780;d:3.0958000000000001;i:1538055450;d:3.3837000000000002;i:1538055232;d:5.6223999999999998;i:1538054868;d:3.1514000000000002;i:1538054534;d:3.9215;i:1538054284;d:4.5631000000000004;i:1538053995;d:3.4510999999999998;i:1538053662;d:3.2890000000000001;i:1538053379;d:4.8674999999999997;i:1538053080;d:3.8666999999999998;i:1538052750;d:2.9807000000000001;i:1538052479;d:3.6278999999999999;i:1538052131;d:3.1842000000000001;i:1538051868;d:4.3533999999999997;i:1538051588;d:4.8170000000000002;i:1538051267;d:3.5983999999999998;i:1538050956;d:3.4679000000000002;i:1538050679;d:3.7153999999999998;i:1538050374;d:3.6473;i:1538050134;d:3.5888;i:1538049629;d:2.9708000000000001;i:1538049460;d:8.1469000000000005;i:1538049168;d:3.5356999999999998;i:1538048845;d:3.3631000000000002;i:1538048538;d:3.7006999999999999;i:1538048337;d:4.4008000000000003;i:1538048044;d:2.9864000000000002;i:1538047702;d:2.9557000000000002;i:1538047347;d:2.9910000000000001;i:1538047108;d:3.9708999999999999;i:1538046789;d:3.0678000000000001;i:1538046496;d:3.403;i:1538046206;d:4.0400999999999998;i:1538045851;d:3.4628000000000001;i:1538045625;d:4.0418000000000003;i:1538045239;d:2.9009;i:1538044977;d:4.0365000000000002;i:1538044723;d:3.5535000000000001;i:1538044339;d:3.4213;i:1538044062;d:4.3501000000000003;i:1538043803;d:3.8041999999999998;i:1538043510;d:3.0160999999999998;i:1538043150;d:3.0059;i:1538042898;d:3.8214999999999999;i:1538042637;d:4.0918999999999999;i:1538042235;d:2.9893999999999998;i:1538041975;d:4.2956000000000003;i:1538041625;d:3.6320999999999999;i:1538041358;d:4.6371000000000002;i:1538041101;d:4.0105000000000004;i:1538040728;d:4.0038999999999998;i:1538040462;d:4.2099000000000002;i:1538040172;d:3.5746000000000002;i:1538039896;d:3.8418999999999999;i:1538039585;d:3.0783;i:1538039305;d:3.5063;i:1538039039;d:4.0595999999999997;i:1538038639;d:3.1524000000000001;i:1538038355;d:3.8142999999999998;i:1538038083;d:3.8182;i:1538037803;d:3.3988;i:1538037458;d:3.2178;i:1538037175;d:5.2276999999999996;i:1538036910;d:3.9146000000000001;i:1538036585;d:3.056;i:1538036291;d:3.4742000000000002;i:1538035934;d:3.1968999999999999;i:1538035692;d:4.5255999999999998;i:1538035415;d:4.7695999999999996;i:1538035042;d:3.5865999999999998;i:1538034727;d:4.1601999999999997;i:1538034391;d:4.0175999999999998;i:1538034179;d:5.5098000000000003;i:1538033873;d:3.5552999999999999;i:1538033619;d:4.6352000000000002;i:1538033311;d:3.0676999999999999;i:1538032925;d:2.9419;i:1538032673;d:5.1768000000000001;i:1538032408;d:3.3380000000000001;i:1538032066;d:3.0813999999999999;i:1538031831;d:5.1436999999999999;i:1538031518;d:3.1482000000000001;i:1538031214;d:2.9502999999999999;i:1538030925;d:3.1301999999999999;i:1538030587;d:3.1027999999999998;i:1538030254;d:3.6613000000000002;i:1538030088;d:5.9353999999999996;i:1538029651;d:2.9712999999999998;i:1538029430;d:4.0724;i:1538029073;d:3.0114000000000001;i:1538028819;d:4.0864000000000003;i:1538028468;d:3.4072;i:1538028258;d:5.2679999999999998;i:1538027875;d:3.3982999999999999;i:1538027627;d:3.9584999999999999;i:1538027296;d:3.0360999999999998;i:1538027016;d:3.4028999999999998;i:1538026754;d:3.391;i:1538026401;d:3.1278000000000001;i:1538026105;d:3.7959999999999998;i:1538025813;d:3.3414999999999999;i:1538025500;d:3.3069999999999999;i:1538025155;d:3.6038000000000001;i:1538024913;d:4.1936999999999998;i:1538024597;d:4.3296999999999999;i:1538024315;d:3.8589000000000002;i:1538024042;d:3.1970000000000001;i:1538023720;d:2.9822000000000002;i:1538023352;d:3.0276999999999998;i:1538023091;d:4.4111000000000002;i:1538022808;d:5.0712000000000002;i:1538022521;d:3.5150999999999999;i:1538022167;d:3.1518999999999999;i:1538021889;d:3.9045000000000001;i:1538021656;d:3.9718;i:1538021344;d:2.9900000000000002;i:1538021075;d:3.0324;i:1538020728;d:2.9912000000000001;i:1538020414;d:3.0663999999999998;i:1538020108;d:3.4420999999999999;i:1538019840;d:3.4765999999999999;i:1538019573;d:3.0379999999999998;i:1538019168;d:3.0318999999999998;i:1538018911;d:4.5292000000000003;i:1538018588;d:3.0362;i:1538018341;d:4.3705999999999996;i:1538018050;d:3.5909;i:1538017791;d:3.3767999999999998;i:1538017469;d:3.1556000000000002;i:1538017132;d:3.6358000000000001;i:1538016726;d:3.0318999999999998;i:1538016476;d:5.6369999999999996;i:1538016179;d:4.0448000000000004;i:1538015854;d:4.3811999999999998;i:1538015659;d:5.8514999999999997;i:1538015337;d:3.2549000000000001;i:1538014985;d:3.2122000000000002;i:1538014676;d:4.0532000000000004;i:1538014510;d:3.1556999999999999;i:1538014204;d:4.3333000000000004;i:1538013922;d:3.1497000000000002;i:1538013497;d:3.0994999999999999;i:1538013181;d:3.8603999999999998;i:1538012934;d:3.9632999999999998;i:1538012655;d:3.1371000000000002;i:1538012311;d:3.3313000000000001;i:1538011999;d:4.8042999999999996;i:1538011743;d:4.4160000000000004;i:1538011403;d:3.0274000000000001;i:1538011100;d:3.7353000000000001;i:1538010818;d:3.4683999999999999;}s:17:"discovery_history";a:100:{i:1538080714;d:7.7544000000000004;i:1538058954;d:11.8148;i:1538037386;d:7.1657000000000002;i:1538015811;d:7.5838000000000001;i:1537994199;d:7.1746999999999996;i:1537972672;d:7.6186999999999996;i:1537951026;d:9.1906999999999996;i:1537929401;d:8.9390999999999998;i:1537907760;d:6.9756;i:1537886184;d:7.3825000000000003;i:1537864597;d:7.3075000000000001;i:1537843033;d:7.3891;i:1537821394;d:7.5202;i:1537799799;d:7.7005999999999997;i:1537778194;d:8.4852000000000007;i:1537756660;d:8.7713999999999999;i:1537735006;d:7.5862999999999996;i:1537713387;d:8.0109999999999992;i:1537691787;d:7.3535000000000004;i:1537670226;d:7.6965000000000003;i:1537648609;d:8.2081;i:1537626998;d:7.4366000000000003;i:1537605387;d:7.7065999999999999;i:1537583780;d:7.5105000000000004;i:1537562202;d:7.5899000000000001;i:1537540589;d:7.6036000000000001;i:1537518999;d:7.3528000000000002;i:1537497396;d:7.9557000000000002;i:1537475839;d:7.3705999999999996;i:1537454188;d:8.5061999999999998;i:1537432601;d:7.3613;i:1537411004;d:8.2899999999999991;i:1537389392;d:7.4923999999999999;i:1537367772;d:7.7808999999999999;i:1537346241;d:6.9629000000000003;i:1537324683;d:9.3427000000000007;i:1537303013;d:8.5792999999999999;i:1537281409;d:7.9107000000000003;i:1537259778;d:7.6986999999999997;i:1537238203;d:7.5811999999999999;i:1537216594;d:7.4325000000000001;i:1537194987;d:7.5598999999999998;i:1537173376;d:7.1814999999999998;i:1537151822;d:7.3376000000000001;i:1537130177;d:7.5002000000000004;i:1537108585;d:7.2328000000000001;i:1537086974;d:7.5750000000000002;i:1537065377;d:7.2988;i:1537043762;d:7.2800000000000002;i:1537022166;d:7.0979999999999999;i:1537000580;d:7.3391000000000002;i:1536978980;d:7.3795999999999999;i:1536957427;d:7.5382999999999996;i:1536935803;d:8.4991000000000003;i:1536914176;d:7.6386000000000003;i:1536892643;d:7.4509999999999996;i:1536870967;d:7.2976999999999999;i:1536849371;d:7.3731999999999998;i:1536827784;d:7.5589000000000004;i:1536806192;d:7.3960999999999997;i:1536784576;d:7.2220000000000004;i:1536762955;d:7.2169999999999996;i:1536741335;d:6.8833000000000002;i:1536719833;d:7.1026999999999996;i:1536698172;d:7.4108000000000001;i:1536676570;d:7.4114000000000004;i:1536654965;d:7.3682999999999996;i:1536633387;d:7.3731999999999998;i:1536611750;d:7.024;i:1536590174;d:6.8372999999999999;i:1536568541;d:6.9978999999999996;i:1536546983;d:7.0103999999999997;i:1536525376;d:6.8952;i:1536503781;d:7.1639999999999997;i:1536482166;d:7.2619999999999996;i:1536460579;d:6.9081000000000001;i:1536438996;d:7.0580999999999996;i:1536417384;d:7.3914;i:1536395788;d:7.3792;i:1536374186;d:7.5015000000000001;i:1536352570;d:7.0444000000000004;i:1536330988;d:7.1060999999999996;i:1536309359;d:7.4617000000000004;i:1536287808;d:6.9250999999999996;i:1536266167;d:6.8148;i:1536244568;d:6.7591999999999999;i:1536222980;d:7.0377000000000001;i:1536201409;d:6.9621000000000004;i:1536179768;d:7.9686000000000003;i:1536158170;d:7.3461999999999996;i:1536136573;d:7.5946999999999996;i:1536115020;d:7.0101000000000004;i:1536093371;d:7.4097999999999997;i:1536071785;d:7.4455;i:1536050175;d:7.4588999999999999;i:1536028587;d:7.5102000000000002;i:1536006980;d:7.3712999999999997;i:1535985388;d:6.9196;i:1535963759;d:7.6353;i:1535942219;d:7.0571000000000002;}}" [distro] => null [distro_ver] => null [kernel] => null [arch] => null ) > $attribs /opt/observium/includes/polling/functions.inc.php:484 array( [ports_ignored_count] => string(1) "2" ) SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '27'] ROWS[0] SQL RUNTIME[0.00035882s] SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('25849','poller.php','25848','0','php ./poller.php -h rtr-slf.qld.pnet.net.au -dd','1538952055','27')] ROWS[1] SQL RUNTIME[0.00412297s] SQL[SELECT * FROM `alert_tests` WHERE 1] ROWS[1] SQL RUNTIME[0.00033402s] Cached 1 alert rules. SQL[SELECT * FROM `alert_table` WHERE `device_id` = '27'] ROWS[0] SQL RUNTIME[0.00038695s] > $alert_rules /opt/observium/includes/polling/functions.inc.php:492 array( [2] => array( [alert_test_id] => string(1) "2" [entity_type] => string(4) "port" [alert_name] => string(17) "AAPT Transit High" [alert_message] => string(29) "The AAPT Transit is over 100M" [alert_assoc] => null [conditions] => array( [0] => array( [metric] => string(15) "ifInOctets_rate" [condition] => string(2) "ge" [value] => string(9) "100000000" ) ) [conditions_warn] => null [and] => string(1) "1" [severity] => string(4) "crit" [delay] => string(1) "0" [alerter] => string(7) "default" [enable] => string(1) "1" [show_frontpage] => string(1) "1" [suppress_recovery] => string(1) "1" [ignore_until] => null ) ) > $alert_table /opt/observium/includes/polling/functions.inc.php:493 array() ##### rtr-slf.qld.pnet.net.au [27] ##### o OS vrp o OS Group huawei o Last poll duration 3.23 seconds o Last Polled 2018-09-28 11:08:06 o SNMP Version v2c CMD[/usr/bin/fping -t 500 -c 1 -q 103.225.70.102 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0027s] STDOUT[ 103.225.70.102 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.53/0.53/0.53 ] CMD[/usr/bin/snmpget -v2c -c 'PlatinumSNMP' -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'rtr-slf.qld.pnet.net.au':'11164' sysObjectID.0 sysUpTime.0] CMD EXITCODE[127] CMD RUNTIME[0.0009s] STDOUT[ ] STDERR[ sh: 1: exec: /usr/bin/snmpget: not found ] SNMP ERROR - device: 27, cmd: snmpget, options: -OQUs, mib: 'SNMPv2-MIB', oid: 'sysObjectID.0 sysUpTime.0', cmd exitcode: 127, snmp error code: #900, reason: 'isSNMPable', runtime: 0.00094199180603027 SNMP ERROR - device: 27, cmd: snmpget, options: -OQUs, mib: 'SNMPv2-MIB', oid: 'sysObjectID.0 sysUpTime.0', cmd exitcode: 127, snmp error code: #900, reason: 'isSNMPable', runtime: 0.00094199180603027 SNMP STATUS[FALSE] o Device status Device is not responding to SNMP requests RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/status.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/status.rrd N:0] RRD RUNTIME[0.0014s] RRD STDOUT[OK u:0.00 s:0.00 r:0.01] RRD_STATUS[TRUE] RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping.rrd N:0.53] RRD RUNTIME[0.0012s] RRD STDOUT[OK u:0.00 s:0.00 r:0.01] RRD_STATUS[TRUE] RRD /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping_snmp.rrd already exists - no need to create. RRD CMD[update /opt/observium/rrd/rtr-slf.qld.pnet.net.au/ping_snmp.rrd N:U] RRD RUNTIME[0.0012s] RRD STDOUT[OK u:0.01 s:0.00 r:0.01] RRD_STATUS[TRUE] SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '25849' AND `process_name` = 'poller.php' AND `device_id` = '27'] ROWS[1] SQL RUNTIME[0.00302505s] ./poller.php: rtr-slf.qld.pnet.net.au - 1 devices polled in 0.155 secs ##### Completed polling run at 2018-10-08 09:40:55 ##### > $db_stats /opt/observium/poller.php:217 array( [insert] => int(1) [insert_sec] => double(0.00457406) [update] => int(0) [update_sec] => int(0) [delete] => int(1) [delete_sec] => double(0.00324702) [fetchcell] => int(4) [fetchcell_sec] => double(0.0025918483734131) [fetchrow] => int(6) [fetchrow_sec] => double(0.0036671161651611) [fetchrows] => int(8) [fetchrows_sec] => double(0.022239685058594) [fetchcol] => int(0) [fetchcol_sec] => int(0) [total] => int(20) [total_sec] => double(0.036319729597168) ) NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 1 o Poller Time 0.155 secs o Memory usage 12MB (peak: 14MB) o MySQL Usage Insert[1/0.005s] Update[0/0s] Delete[1/0.003s] Cell[4/0.003s] Row[6/0.004s] Rows[8/0.022s] Col[0/0s] (0.036s 23.432%) o RRDTool Usage update[3/0.004s] (0.004s 2.475%) o SNMP Usage snmpget[1/0.001s] (0.001s 0.608%) RRD PIPE CLOSE[TRUE] > $snmp_stats /opt/observium/poller.php:279 array( [snmpget] => array( [count] => int(1) [time] => double(0.00094199180603027) ) ) From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Adam Armstrong via observium Sent: Monday, 8 October 2018 8:38 AM To: Mal via observium <observium(a)observium.org <mailto:observium@observium.org> > Cc: Adam Armstrong <adama(a)memetic.org <mailto:adama@memetic.org> > Subject: Re: [Observium] FW: Can't add Devices/Not polling Do: ./poller.php -h <hostname> -dd And show the output. Adam. Sent from BlueMail <http://www.bluemail.me/r?b=13688> On 7 Oct 2018, at 23:33, Mal via observium <observium(a)observium.org <mailto:observium@observium.org> > wrote: From: mal(a)platinumnetworks.com.au <mailto:mal@platinumnetworks.com.au> <mal(a)platinumnetworks.com.au <mailto:mal@platinumnetworks.com.au> > Sent: Thursday, 4 October 2018 8:39 PM To: 'Observium' <observium(a)observium.org <mailto:observium@observium.org> > Subject: Can't add Devices/Not polling Hi all – my Observium installed has just decided to stop polling and reports all devices as down. I also can’t add new devices. I thought it may have been a lack of disk space so today I have updated to the current subscription version, ran the housekeeping script and cleared out as much off the machine as I can but there has been no change. My RRD directory is only about 5 G and I have around 4G free on that drive so it is not obvious to me that there is a lack of available space. I’ve been having trouble with the firewall config on that host so I also disabled the firewall in case it was blocking traffic. I can ping all the devices I am monitoring from this host and I have another SNMP tool monitoring some of the same devices successfully. So I am pretty certain it is the Observium host that is the location of the problem – I’m just not certain about what could be the problem… Below is the error I receive when I try to add a device I have checked the event logs but there are not even any entries in there to reflect that I have even tried to add a device let alone anything that will give me an indication as to what the problem is. Needless to say, after several hours trying to troubleshoot this I would really appreciate any feedback or direction! Thanks in advance Mal _____ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 2

Can ifAlias_persist include Ubuntu 18.04 config please
by Pieter De Wit 07 Oct '18

07 Oct '18

Hi Devs, Can ifAlias_persist please be updated to include Ubuntu 18.04's way of config files ? 18.04 now stores files in /etc/network/interfaces.d/* (might be since 17 something) Thanks Pieter

1 0

FW: Can't add Devices/Not polling
by mal＠platinumnetworks.com.au 07 Oct '18

07 Oct '18

From: mal(a)platinumnetworks.com.au <mal(a)platinumnetworks.com.au> Sent: Thursday, 4 October 2018 8:39 PM To: 'Observium' <observium(a)observium.org> Subject: Can't add Devices/Not polling Hi all - my Observium installed has just decided to stop polling and reports all devices as down. I also can't add new devices. I thought it may have been a lack of disk space so today I have updated to the current subscription version, ran the housekeeping script and cleared out as much off the machine as I can but there has been no change. My RRD directory is only about 5 G and I have around 4G free on that drive so it is not obvious to me that there is a lack of available space. I've been having trouble with the firewall config on that host so I also disabled the firewall in case it was blocking traffic. I can ping all the devices I am monitoring from this host and I have another SNMP tool monitoring some of the same devices successfully. So I am pretty certain it is the Observium host that is the location of the problem - I'm just not certain about what could be the problem. Below is the error I receive when I try to add a device I have checked the event logs but there are not even any entries in there to reflect that I have even tried to add a device let alone anything that will give me an indication as to what the problem is. Needless to say, after several hours trying to troubleshoot this I would really appreciate any feedback or direction! Thanks in advance Mal

2 1