- observium - lists.observium.org

db.log filling server [SEC=UNCLASSIFIED]
by Peter.Hine＠familycourt.gov.au 08 Feb '16

08 Feb '16

v0.16.1.7533 upgraded from 0.15.6.6430 ./discovery.php -u Observium Community Edition 0.16.1.7533 http://www.observium.org -- Database is up to date. it's full of entries like [2016/02/08 11:30:35 +1100] poller.php(622): Failed dbQuery (#1366 - Incorrect integer value: '' for column 'enabled' at row 1), Query: INSERT INTO `device_graphs` (` device_id`,`graph`,`enabled`) VALUES ('424','fdb_count','') [2016/02/08 11:30:35 +1100] poller.php(626): Failed dbQuery (#1366 - Incorrect integer value: '' for column 'enabled' at row 1), Query: INSERT INTO `device_graphs` (` device_id`,`graph`,`enabled`) VALUES ('427','fdb_count','') [2016/02/08 11:30:35 +1100] poller.php(622): Failed dbQuery (#1366 - Incorrect integer value: '' for column 'enabled' at row 1), Query: INSERT INTO `device_graphs` (` device_id`,`graph`,`enabled`) VALUES ('424','firewall_sessions_ipv4','') [2016/02/08 11:30:35 +1100] poller.php(610): Failed dbQuery (#1366 - Incorrect integer value: '' for column 'enabled' at row 1), Query: INSERT INTO `device_graphs` (` device_id`,`graph`,`enabled`) VALUES ('476','firewall_sessions_ipv4','') [2016/02/08 11:30:35 +1100] poller.php(626): Failed dbQuery (#1366 - Incorrect integer value: '' for column 'enabled' at row 1), Query: INSERT INTO `device_graphs` (` device_id`,`graph`,`enabled`) VALUES ('427','firewall_sessions_ipv4','') [2016/02/08 11:30:35 +1100] poller.php(603): Failed dbQuery (#1364 - Field 'ifInUcastPkts_delta' doesn't have a default value), Query: INSERT INTO `ports-state` (`pol l_time`,`poll_period`,`ifInOctets`,`ifOutOctets`,`ifInErrors`,`ifOutErrors`,`ifInUcastPkts`,`ifOutUcastPkts`,`ifInOctets_perc`,`ifOutOctets_perc`,`ifOctets_rate`,`ifU castPkts_rate`,`ifErrors_rate`,`port_id`) VALUES ('1454891434','1454891434','','','','','','','0','0','0','0','0','1668') [2016/02/08 11:30:35 +1100] poller.php(3592): Failed dbQuery (#1364 - Field 'mempool_polled' doesn't have a default value), Query: INSERT INTO `mempools-state` (`memp ool_id`) VALUES ('1973') [2016/02/08 11:30:35 +1100] poller.php(3592): Failed dbQuery (#1364 - Field 'mempool_polled' doesn't have a default value), Query: INSERT INTO `mempools-state` (`memp ool_id`) VALUES ('1974') [2016/02/08 11:30:35 +1100] poller.php(603): Failed dbQuery (#1364 - Field 'ifInUcastPkts_delta' doesn't have a default value), Query: INSERT INTO `ports-state` (`pol l_time`,`poll_period`,`ifInOctets`,`ifOutOctets`,`ifInErrors`,`ifOutErrors`,`ifInUcastPkts`,`ifOutUcastPkts`,`ifInOctets_perc`,`ifOutOctets_perc`,`ifOctets_rate`,`ifU castPkts_rate`,`ifErrors_rate`,`port_id`) VALUES ('1454891434','1454891434','','','','','','','0','0','0','0','0','1669') so the question is, how do i remediate it. thanks Peter Hine Senior Technical Support Engineer (Servers) FCoA ITS peter.hine(a)familycourt.gov.au ********************************************************************** The information contained in this e-mail (including any attachments) is for the exclusive use of the addressee. If you are not the intended recipient please notify the sender immediately and delete this e-mail. It is noted that legal privilege is not waived because you have read this e-mail. **********************************************************************

2 2

Custom Traffic Graph errors
by Roland Hill 07 Feb '16

07 Feb '16

Hi list, My installation details are as follows: Observium CE 0.16.1.7533 ##### Software versions ##### o OS Linux 4.2.0-27-generic [amd64] (Ubuntu 15.10) o Apache 2.4.12 o PHP 5.6.11-1ubuntu3.1 o Python 2.7.10 o MySQL 5.6.28-0ubuntu0.15.10.1 (extension: mysqli 5.6.28) o SNMP NET-SNMP 5.7.3 o RRDtool 1.5.4 ##### MySQL mode ##### o MySQL NO_ENGINE_SUBSTITUTION ##### Charset info ##### o PHP UTF-8 o MySQL utf8 ##### Timezones info ##### o Date Monday, 08-Feb-16 08:51:25 NZDT o PHP +13:00 o MySQL +13:00 Since upgrading to the latest CE version the Custom Traffic graphs have stopped displaying information, refer picture. I have let this run for a few days but they haven't updated. Any pointers would be appreciated. ...oh, and the new look and feel is great! -- Regards, Roland PGP Key 0xDA39319B = BCF0 1214 BAE9 5A3D 46FC 21A6 360D 9398 DA39 319B

1 0

MIB discovery - systemORD table - feature parity
by Dirk-Willem van Gulik 07 Feb '16

07 Feb '16

On some systems SNMPv2-MIB:: sysORTable contains a list of MIBs supported by the agent. Of interest is the: sysORID entry which is defined as: An authoritative identification of a capabilities statement with respect to various MIB modules supported by the local SNMPv2 entity acting in an agent role. and has the OID of those MIBs. Below tiny patch allows these to be 1) automatically included in the (sensor) scan. 2) Provides an option to have some skipped ($config['autodiscovery']['snmp_sysord']['ignore’]). Dw Index: include-dir-mib.inc.php =================================================================== --- include-dir-mib.inc.php (revision HEAD) +++ include-dir-mib.inc.php (working copy) @@ -32,17 +32,39 @@ $include_lib = isset($include_lib) && $include_lib; -foreach (get_device_mibs($device) as $mib) +$mibs = get_device_mibs($device); + +// Check for any (extra) advertized MIBs in the sysORD table; note that we are +// intentionally using 'all' - as we need the textual MIB name in order to +// create a possible file name. +// +$advertizedMIBs = snmpwalk_cache_multi_oid($device, "SNMPv2-MIB::sysORID", array(), "all"); +foreach($advertizedMIBs as $index=> $entry) { + $mib = strtoupper(reset($entry)); + if (!strstr($mib,'-mib')) { + $mib = preg_replace('/MIB$/','-MIB',$mib); + }; + + if (!preg_grep('/'.$mib.'/i',$config['autodiscovery']['snmp_sysord']['ignore']) + && !preg_grep('/'.$mib.'/i', $mibs)) + { + array_push($mibs, $mib); + }; +}; + +foreach ($mibs as $mib) { $inc_dir = $config['install_dir'] . '/' . $include_dir . '/' . strtolower($mib); $inc_file = $inc_dir . '.inc.php'; - if (is_device_mib($device, $mib)) + // We are bypassing the 'is part of the get_device_mibs list' check; as we are passing + // a list sourced from get_device_mibs with possibly additional discovery. + // + if (is_device_mib($device, $mib, TRUE, FALSE)) { if (is_file($inc_file)) { if (OBS_DEBUG) { echo("[[$mib]]"); } - include($inc_file); if ($include_lib && is_file($inc_dir . '.lib.php’)) Index: common.inc.php =================================================================== --- common.inc.php (revision HEAD) +++ common.inc.php (working copy) @@ -2172,11 +2174,14 @@ // DOCME needs phpdoc block // TESTME needs unit testing // MOVEME to includes/functions.inc.php -function is_device_mib($device, $mib, $check_permissions = TRUE) +function is_device_mib($device, $mib, $check_permissions = TRUE, $check_in_mib_list = TRUE) { global $config; - $mib_permitted = in_array($mib, get_device_mibs($device)); // Check if mib available for device + $mib_permitted = TRUE; + if ($check_in_mib_list) + $mib_permitted = in_array($mib, get_device_mibs($device)); // Check if mib available for device + if ($check_permissions && $mib_permitted && (!isset($config['mibs'][$mib]['enable']) || $config['mibs'][$mib]['enable'])) { // Check if MIB permitted by config Index: defaults.inc.php =================================================================== --- defaults.inc.php (revision HEAD) +++ defaults.inc.php (working copy) @@ -174,6 +174,7 @@ $config['snmp']['v3'][0]['cryptopass'] = ""; // Privacy (Encryption) Passphrase $config['snmp']['v3'][0]['cryptoalgo'] = "AES"; // AES | DES + // Autodiscovery Settings $config['autodiscovery']['xdp'] = TRUE; // Autodiscover hosts via discovery protocols (CDP, LLDP, FDP, AMAP and other) @@ -186,6 +187,8 @@ $config['autodiscovery']['ip_nets'] = array("127.0.0.0/8", "192.168.0.0/16", "10.0.0.0/8", "172.16.0.0/12"); // Networks to permit autodiscovery $config['autodiscovery']['ping_skip'] = FALSE; // Skip icmp echo checks during autodiscovery (beware timeouts during discovery!) +$config['autodiscovery']['snmp_sysord']['ignore'] = array('snmpMPDCompliance',' usmMIBCompliance','snmpFrameworkMIBCompliance','vacmBasicGroup','snmpNotifyFullCompliance'); + $config['discover_services'] = FALSE; // Autodiscover services via SNMP on devices of type "server" // Mailer backend Settings

2 2

syslog not working for one server
by Patrick Marquetecken 07 Feb '16

07 Feb '16

Hi, I have syslog working for more then 10 hosts but, for one I can’t get it to work. This server is not in the same location, it sent its log through a vpn tunnel, when it arrives at the router I do a natting: Just forward to the observium server. I see the ump traffic arriving but notting show up in the syslog (database) We can monitor the server without any problems. anyone a suggestion ? Thanks

2 1

Extracting port names from D-Link switches - feature parity
by Dirk-Willem van Gulik 06 Feb '16

06 Feb '16

In observium we cannot, AFAIUI from the UI, overwrite the various switch port names. Observium relies on the port names getting set ‘right’ on the agent side. However - having control over the name is useful e.g. for peering/ transit link regex()ing and what not. Unfortunately not all switches allow for this (for some reason, it seems to be mostly enterprise POE switches). One vendor that does not allow this is D-Link; their ifNames are hardcoded to Slot/0, Port0.0 or the empty string on some (most recent?) product lines. However they do allow the editing of the sysPortDescString in their private enterprise MIB (through config, API, SNMP or the web interface). Below is a small file diff that makes this possible. It is a bit inefficient; as doing it at discovery time is not enough; ifName is watched by the port poller —and I cannot see an easy place to make a ‘note’ of the expensively found OID. But may be of use as a starting point for some. Dw. beeb $ svn diff Index: observium/includes/polling/ports/companysystems.inc.php =================================================================== --- observium/includes/polling/ports/companysystems.inc.php (nonexistent) +++ observium/includes/polling/ports/companysystems.inc.php (working copy) @@ -0,0 +1,89 @@ +<?php + +/** + * companySystem - various D-Link switches have an extra sysPortDescString + * which unlike ifName/ifName can be configured (i.e. are not hardcoded + * to Slot0/0, the Emptry String or Port0.0). + * + * Here we discover them; and if set - add them to the ifName. + * + * Unfortunately - D-Link does use a different MIB for every product (even + * though the structure is pretty much identical). The path is contructed: + * + * enterprises.d-link.dlink-products.$series.$model.$type.companySystem.... + * + * with values such as dlink-DGS12XXSeriesProd.dgs-1210-28p.dgs-1210-28pcx + * for the series, model and type. + * + * Under companySystem we are after the field + * + * sysPortDescriptionTable.sysPortDescriptionEntry.sysPortDescString.<index> + * + * @package observium + * @subpackage discovery + * @copyright (C) 2013 dirkx + * + */ + +echo(" D-Link companySystem-MIB"); + +# We do a bit of a trick - and rely on the fact that the companySystem is first. # And use that to ‘tell’ us enough to get the MIB of that specific product. +# +# This way we discover the series/model/type without having to do a 35 Mbyte +# SNMP walk of the whole device. +# +# Unfortunately that does mean we have to use 'all'; which slows down +# polling (but we have to do it during polling; as any ifName set during +# discovery is uncerimouniously wacked on the next poll, with an alert +# to boot). The alternative would be to hardcode the 60-odd OID's for +# D-Link in this file. +# +# So we do this in two steps - one to check if there is any +# D-Link stuff - and then the actual more expensive pass. +# +$topoid = ".1.3.6.1.4.1.171"; +$str= snmp_get($device, $topoid,NULL,NULL,NULL,NULL, TRUE); // a getnext call + +if ($str) { + // pretty sure this is a D-Link switch of some description now. + // So do the more expensive pass. + // + + $topoid = '.iso.org.dod.internet.private.enterprises.d-link'; + $str= snmp_get($device, $topoid,NULL,'all',NULL,NULL, TRUE); // // a getnext call + + $cnt = 0; + if ($str) { + // Deconstruct the reply - to extract the actual per-product + // MIB name. + // + // DGS-1210-28P-CX::sysSwitchName.0 = STRING: 24x PoE Switch DLink + // + list($field, $skipEq, $skipStr, $name) = split(' ',$str,4); + list($mib, $skipField) = split('::', $field); + + $portOids = snmpwalk_cache_multi_oid($device, "sysPortDescString", array(), $mib); + + //Note that we are assuming that index = ifIndex (which seems to be the standard on D-Link kit). + // + foreach ($portOids as $ifIndex => $entry) + { + $descr = $entry[ sysPortDescString ]; + + if ($descr) { + $port = $port_stats[ $ifIndex ]; + $name = $port['ifName']; + + if (strlen($name)) { + $descr = "$descr ($name)"; + }; + $port_stats[$ifIndex]['ifName'] = $descr; + $cnt++; + }; + }; + }; + }; +if ($cnt) { + echo "[$cnt]"; +}; + Property changes on: companysystems.inc.php ___________________________________________________________________ Added: svn:eol-style ## -0,0 +1 ## +native \ No newline at end of property Added: svn:keywords ## -0,0 +1 ## +Author Date Id Revision \ No newline at end of property

1 0

definitions.dat and sensor_types
by Dirk-Willem van Gulik 06 Feb '16

06 Feb '16

We have a tiny sensor/discovery module (gist below) that picks up the (back)pressure, in Bar, of a cooling system. However when we add below to config.php: $config['sensor_types']['pressure']['symbol']='B'; $config['sensor_types']['pressure']['text']='Pressure'; $config['sensor_types']['pressure']['icon']=‘oicon-omega’; it seems that these values are wiped/overwritten by the values from definitions.dat. What, or perhaps, where, is the proper way to add these ? Thanks, Dw. <?php /* — Fetch backpressure on various P, C and I flows. dirkx(at)apache.org */ $oids = snmpwalk_cache_multi_oid($device, “backPressureTable", array(), “DANFLOSS-MIB"); foreach ($oids as $index => $entry) { $label = $entry[‘backPressureLabel']; $descr = $entry[‘backPressureDescr’]; // The older units have just a count - prefix with the label (firmware issue on the pump itself, // cannot be remedied through the puppet/config-deploy). // if (strlen($descr) < 3) { $descr = "$label $descr”; }; $type = ‘pressure'; foreach(array(‘backPressureTop', 'backPressureEgress','backPressureCompressure') as $field) { $oid = snmp_translate($field.'.'.$index, "DANFLOSS-MIB"); $value = $entry[ $field ]; $divisor = $entry[ $field.'Divisor' ]; if (!$divisor) $divisor = 1; if (is_numeric($value)) { /* Longer term - these prolly should go in one custom graph - rather than three */ discover_sensor($valid['sensor'], $type, $device, $oid, "$field.$index", ‘danfloss', $descr.' '.$field, 1.0/$divisor, $value); }; }; };

2 3

RRDBug ?
by Dirk-Willem van Gulik 05 Feb '16

05 Feb '16

With a fresh install - seeing quite a few cases like below — odd Y axis legend. The values are roughly at 2.2 and 2.0 and only happen for some ranges. Not sure if this is an old or new problem. Fair to assume this is purely something RRD related/bug ? Dw. Performance & Output RRDTool Output: 1233x369 Total time: 0.279 | RRDtool time: 0.277s RRDTool Command rrdtool graph /tmp/KjJTF5RCwhWzDBRY.png -Y --alt-autoscale --start 1454609307 --end 1454695707 --width 1152 --height 300 -c BACK#EEEEEE00 -c SHADEA#EEEEEE00 -c SHADEB#EEEEEE00 -c FONT#000000 -c CANVAS#FFFFFF00 -c GRID#a5a5a5 -c MGRID#FF9999 -c FRAME#5e5e5e -c ARROW#5e5e5e -R normal --font LEGEND:8:'DroidSansMono,DejaVuSansMono' --font AXIS:7:'DroidSansMono,DejaVuSansMono' --font-render-mode normal -E COMMENT:'Amperes ' COMMENT:' Now' COMMENT:' Avg' COMMENT:' Min' COMMENT:' Max' COMMENT:'\l' DEF:ds16=/usr/local/XXXXXXXXX/rrd/rts.rack/sensor-current-apc-atsOutputCurrent.1.1.1.rrd:sensor:AVERAGE DEF:ds16min=/usr/local/XXXXXXXXX/rrd/rts.rack/sensor-current-apc-atsOutputCurrent.1.1.1.rrd:sensor:MIN DEF:ds16max=/usr/local/XXXXXXXXX/rrd/rts.rack/sensor-current-apc-atsOutputCurrent.1.1.1.rrd:sensor:MAX LINE1.25:ds16#1f78b4:'Output ' GPRINT:ds16:LAST:%6.1lf%s GPRINT:ds16:AVERAGE:%6.1lf%s GPRINT:ds16min:MIN:%6.1lf%s GPRINT:ds16max:MAX:%6.1lf%s COMMENT:'\l' HRULE:0#555555 RRDTool Files Used No RRD information returned. This may be because the graph module doesn't yet return this data.

3 5

FreeBSD ports - Observium CE update to
by Dirk-Willem van Gulik 05 Feb '16

05 Feb '16

Folks, The FreeBSD port has been updated to Observium CE 0.16.1.7533; along with a whole bunch of extra/updated dependencies. This also makes the migration/activation to the professional version pretty much a ‘drop in’ now & makes the polling more efficient. SNMP internal mode is expressly disabled (it seems to suffer from the same issue as on fedora - some substitution issue). Thanks, Dw.

2 3

merge 2 observium installs
by Andy Goldschmidt 05 Feb '16

05 Feb '16

Hi Is it possible to merge 2 installs of Observium together? We have taken over another companies Observium and want to simply add it to our existing one. Thanks for your help Regards Andy

2 1

Reg: ARP Table not working
by Madhu Neal 05 Feb '16

05 Feb '16

Hi Team, I upgraded recently (a couple of times this week) and just reported that the ARP/NDP Table part of observium doesn’t load. Nothing errors in the apache error log. When I run poller.php manually, it does pull the information also. Please support, let me know what's needs to take care. Many Thanks, Madhu

3 4