- observium - lists.observium.org

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Chris Macneill 27 Feb '20

27 Feb '20

Hi Adam, OK, read that page and here's what happens when I try to switch from stable to rolling as per documentation:- root@obs:/opt/observium# svn up Updating '.': At revision 10304. root@obs:/opt/observium# svn switch https://svn.observium.org/svn/observium/trunk svn: E155025: 'svn switch' does not support switching a working copy to a different repository svn: E155025: 'http://svn.observium.org/svn/observium/branches/stable' is not the same repository as 'https://svn.observium.org/svn' Regards Chris Macneill Zelan Ltd From: "observium" <observium(a)observium.org> To: "observium" <observium(a)observium.org> Cc: "Adam Armstrong" <adama(a)memetic.org> Sent: Thursday, 27 February, 2020 15:22:50 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Read that entire page. Sent from [ http://www.bluemail.me/r?b=15818 | BlueMail ] On 27 Feb 2020, at 02:06, Chris Macneill < [ mailto:cmacneill@zelan.co.nz | cmacneill(a)zelan.co.nz ] > wrote: Hi Adam, "svn update" is what I assumed I was supposed to use and it said successfully updated to 10304. Webpage says v20.2.10302 (stable) after update. I don't see any doucmentation in [ https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… | https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… ] that references any difference between latest "stable" and latest "rolling". How do I upgrade to "rolling" 10304? Why does "svn update" tell me it's updated to 10304 when it seemingly hasn't? Regards Chris Macneill Zelan Ltd From: "observium" <observium(a)observium.org> To: "observium" <observium(a)observium.org> Cc: "Adam Armstrong" <adama(a)memetic.org> Sent: Thursday, 27 February, 2020 14:51:35 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Is this, perchance, stable, and not rolling? Adam. Sent from [ http://www.bluemail.me/r?b=15818 | BlueMail ] On 27 Feb 2020, at 01:45, Chris Macneill via observium < [ mailto:observium@observium.org | observium(a)observium.org ] > wrote: BQ_BEGIN Hi Mike, Sorry, 20.2.10304 doesn't fix it. Fields still split on commas for port_descr_type = 'cust' and debug results exactly the same as previous:- SELECT * FROM `ports` AS I , `devices` AS D WHERE `port_descr_type` = 'cust' AND `port_descr_descr` = 'GDC Westland Recreation Centre' , ' 83 High St' , ' Greymouth' AND D . device_id = I . device_id Also, a new bug added, software version number at bottom of screen is now out of step with "svn update". Update said successfully updated to 10304, but webpage says 20.2.10302 I've had a hack at the code in html/includes/graphs/customer/bits.inc.php and put the following workaround in place:- Line 16 (Original v20.2.10304 Code) foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE `port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = I.device_id", array($vars['id'])) as $port) Replaced with:- // Copy id array directly for case where port_descr_descr was NOT previosuly split/exploded on commas. $pddstr = $vars['id']; if ( count($vars['id']) > 1 ) { // Impode id array addng commas where array size > 1, i.e. original id contained commas and WAS split/exploded. $pddstr = implode(",", $vars['id']); } foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE `port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = I.device_id", array($pddstr)) as $port) $vars['id'] is the result of splitting or exploding port_descr_descr string value somewhere earlier, but I can't locate that in the code and as Adam mentioned, changing this elsewhere might have undesirable consequences. The problem only happens for port_descr_type = "cust", for other port types, e.g. core, peering, transit, port_descr_descr isn't split or exploded despite containing commas, but I can't find the locaiton in the code where this conditional behaviour occurs. Regards Chris Macneill Zelan Ltd From: "Mike Stupalov" <mike(a)observium.org> To: "observium" <observium(a)observium.org>, "observium" <observium(a)observium.org> Cc: "Chris Macneill" <cmacneill(a)cmit.nz> Sent: Thursday, 27 February, 2020 12:59:52 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi Chris, try with latest revision (r10304, trunk). Issue should be fixed. Chris Macneill via observium wrote on 26.02.2020 20:25: BQ_BEGIN Hi Adam, Looks like data is being split on commas and causing an SQL syntax error. Debug for:- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} returns:- Error in query: (You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at line 1) 1064 I can obviously fix this short-term by removing commas from the Port Descriptions, but would be good to be able to support use of commas and other punctuation in the longer term or at least update the Help page to list characters to avoid. I had a quick look earlier at the Regex that was parsing the description data, but wasn't immediately obvious commas were an issue. At least I know where the problem lies and I'll take another look later. I guess semi-colons might work if commas don't. Regards Chris Macneill Zelan Ltd From: "observium" [ mailto:observium@observium.org | <observium(a)observium.org> ] To: "observium" [ mailto:observium@observium.org | <observium(a)observium.org> ] Cc: "adama" [ mailto:adama@observium.org | <adama(a)observium.org> ] Sent: Thursday, 27 February, 2020 04:50:22 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Do you get anything useful from showing rrd command on the graph browser page? (click on the graph) Do you get anything useful from adding &debug=1 on the end of the graph image url? Can you arrange ssh/http access to the install if those two things don’t show us what the problem is? Adam. From: observium [ mailto:observium-bounces@observium.org | <observium-bounces(a)observium.org> ] On Behalf Of Chris Macneill via observium Sent: 26 February 2020 05:22 To: observium [ mailto:observium@observium.org | <observium(a)observium.org> ] Cc: Chris Macneill [ mailto:cmacneill@cmit.nz | <cmacneill(a)cmit.nz> ] Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd. _______________________________________________ observium mailing list [ mailto:observium@observium.org | observium(a)observium.org ] [ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] _______________________________________________ observium mailing list [ mailto:observium@observium.org | observium(a)observium.org ] [ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] -- Mike Stupalov Observium Limited, [ http://observium.org/ | http://observium.org ] observium mailing list observium(a)observium.org [ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] BQ_END _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium BQ_END _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 1

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Adam Armstrong 27 Feb '20

27 Feb '20

Read that entire page. ⁣Sent from BlueMail On 27 Feb 2020, 02:06, at 02:06, Chris Macneill <cmacneill(a)zelan.co.nz> wrote: >Hi Adam, > >"svn update" is what I assumed I was supposed to use and it said >successfully updated to 10304. > >Webpage says v20.2.10302 (stable) after update. > >I don't see any doucmentation in [ >https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… >| >https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… >] that references any difference between latest "stable" and latest >"rolling". > >How do I upgrade to "rolling" 10304? > >Why does "svn update" tell me it's updated to 10304 when it seemingly >hasn't? > >Regards > >Chris Macneill >Zelan Ltd > >From: "observium" <observium(a)observium.org> >To: "observium" <observium(a)observium.org> >Cc: "Adam Armstrong" <adama(a)memetic.org> >Sent: Thursday, 27 February, 2020 14:51:35 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > >Is this, perchance, stable, and not rolling? > >Adam. > >Sent from [ http://www.bluemail.me/r?b=15818 | BlueMail ] >On 27 Feb 2020, at 01:45, Chris Macneill via observium < [ >mailto:observium@observium.org | observium(a)observium.org ] > wrote: > > >Hi Mike, > >Sorry, 20.2.10304 doesn't fix it. Fields still split on commas for >port_descr_type = 'cust' and debug results exactly the same as >previous:- > >SELECT * FROM `ports` AS I , `devices` AS D WHERE `port_descr_type` = >'cust' AND `port_descr_descr` = 'GDC Westland Recreation Centre' , ' 83 >High St' , ' Greymouth' AND D . device_id = I . device_id > >Also, a new bug added, software version number at bottom of screen is >now out of step with "svn update". Update said successfully updated to >10304, but webpage says 20.2.10302 > >I've had a hack at the code in >html/includes/graphs/customer/bits.inc.php and put the following >workaround in place:- > >Line 16 (Original v20.2.10304 Code) >foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE >`port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = >I.device_id", array($vars['id'])) as $port) > >Replaced with:- > >// Copy id array directly for case where port_descr_descr was NOT >previosuly split/exploded on commas. >$pddstr = $vars['id']; >if ( count($vars['id']) > 1 ) { >// Impode id array addng commas where array size > 1, i.e. original id >contained commas and WAS split/exploded. >$pddstr = implode(",", $vars['id']); >} >foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE >`port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = >I.device_id", array($pddstr)) as $port) > >$vars['id'] is the result of splitting or exploding port_descr_descr >string value somewhere earlier, but I can't locate that in the code and >as Adam mentioned, changing this elsewhere might have undesirable >consequences. > >The problem only happens for port_descr_type = "cust", for other port >types, e.g. core, peering, transit, port_descr_descr isn't split or >exploded despite containing commas, but I can't find the locaiton in >the code where this conditional behaviour occurs. > >Regards > >Chris Macneill >Zelan Ltd > >From: "Mike Stupalov" <mike(a)observium.org> >To: "observium" <observium(a)observium.org>, "observium" ><observium(a)observium.org> >Cc: "Chris Macneill" <cmacneill(a)cmit.nz> >Sent: Thursday, 27 February, 2020 12:59:52 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > >Hi Chris, > >try with latest revision (r10304, trunk). > >Issue should be fixed. > >Chris Macneill via observium wrote on 26.02.2020 20:25: > >BQ_BEGIN > >Hi Adam, > >Looks like data is being split on commas and causing an SQL syntax >error. Debug for:- > >Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] >{Chorus CVID.113} > >returns:- > >Error in query: (You have an error in your SQL syntax; check the manual >that corresponds to your MariaDB server version for the right syntax to >use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at >line 1) 1064 > >I can obviously fix this short-term by removing commas from the Port >Descriptions, but would be good to be able to support use of commas and >other punctuation in the longer term or at least update the Help page >to list characters to avoid. > >I had a quick look earlier at the Regex that was parsing the >description data, but wasn't immediately obvious commas were an issue. >At least I know where the problem lies and I'll take another look >later. I guess semi-colons might work if commas don't. > >Regards > >Chris Macneill >Zelan Ltd > > >From: "observium" [ mailto:observium@observium.org | ><observium(a)observium.org> ] >To: "observium" [ mailto:observium@observium.org | ><observium(a)observium.org> ] >Cc: "adama" [ mailto:adama@observium.org | <adama(a)observium.org> ] >Sent: Thursday, 27 February, 2020 04:50:22 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > > > >Do you get anything useful from showing rrd command on the graph >browser page? (click on the graph) > > > >Do you get anything useful from adding &debug=1 on the end of the graph >image url? > > > >Can you arrange ssh/http access to the install if those two things >don’t show us what the problem is? > > > >Adam. > > > > >From: observium [ mailto:observium-bounces@observium.org | ><observium-bounces(a)observium.org> ] On Behalf Of Chris Macneill via >observium >Sent: 26 February 2020 05:22 >To: observium [ mailto:observium@observium.org | ><observium(a)observium.org> ] >Cc: Chris Macneill [ mailto:cmacneill@cmit.nz | <cmacneill(a)cmit.nz> ] >Subject: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > > > > > >Hi, > > > > > >We're currently using Observium v20.1.10233 and have a problem with >"Error Drawing Graph" for all ports with a "Cust" prefix. Ports with >"Core", "Peer" or "Transit" prefix correctly show graphs. > > > > > >The ports we're monitoring are VLANs, the Peer/Transit are simple >802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of >802.1q headers. > > > > > >All port types are correctly detected by SNMP and listed against the >Router. Given that "Core" displays graphs correctly, this doesn't seem >to be related to QinQ, but specifically to the "Cust" prefix. > > > > > >Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- > > > > > >Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} > > >Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus >CVID.100} > > > > > >Example (QinQ) that gives "Error Drawing Graph":- > > > > > >Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] >{Chorus CVID.113} > > > > > >All our routers are MikroTik, so can't determine if this is a router >OS/hardware specific issue. > > > > > >Regards > >Chris Macneill >Zelan Ltd. > > > > >_______________________________________________ >observium mailing list >[ mailto:observium@observium.org | observium(a)observium.org ] >[ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > > > >_______________________________________________ >observium mailing list [ mailto:observium@observium.org | >observium(a)observium.org ] [ >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > > > >-- >Mike Stupalov >Observium Limited, [ http://observium.org/ | http://observium.org ] > > > > >observium mailing list >observium(a)observium.org >[ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > >BQ_END > > >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Chris Macneill 27 Feb '20

27 Feb '20

Hi Adam, Looks like data is being split on commas and causing an SQL syntax error. Debug for:- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} returns:- Error in query: (You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at line 1) 1064 I can obviously fix this short-term by removing commas from the Port Descriptions, but would be good to be able to support use of commas and other punctuation in the longer term or at least update the Help page to list characters to avoid. I had a quick look earlier at the Regex that was parsing the description data, but wasn't immediately obvious commas were an issue. At least I know where the problem lies and I'll take another look later. I guess semi-colons might work if commas don't. Regards Chris Macneill Zelan Ltd From: "observium" <observium(a)observium.org> To: "observium" <observium(a)observium.org> Cc: "adama" <adama(a)observium.org> Sent: Thursday, 27 February, 2020 04:50:22 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Do you get anything useful from showing rrd command on the graph browser page? (click on the graph) Do you get anything useful from adding &debug=1 on the end of the graph image url? Can you arrange ssh/http access to the install if those two things don’t show us what the problem is? Adam. From: observium <observium-bounces(a)observium.org> On Behalf Of Chris Macneill via observium Sent: 26 February 2020 05:22 To: observium <observium(a)observium.org> Cc: Chris Macneill <cmacneill(a)cmit.nz> Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd. _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

3 3

smokeping integration
by cody＠mail-server.cc 27 Feb '20

27 Feb '20

I installed smokeping, generated the targets file with the script and smokeping is running and updating the rrd's. I set the smokeping directory in the gui but i do not get the smokeping tab on the devices. Is there anything else to do? I'm not seeing something wrong - how do i troubleshoot/identify why the smokeping tab doesn't appear? thanks

2 2

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by adama＠observium.org 27 Feb '20

27 Feb '20

Aha, I see what it’s doing. You missed out the actual query, which makes it more obvious what’s happening /graph.php?type=customer_bits&id=herp,derp&debug=1 Generates: SELECT * FROM `ports` AS I, `devices` AS D WHERE `port_descr_type` = 'cust' AND `port_descr_descr` = 'herp','derp' AND D.device_id = I.device_id We have a bit of code in the URL parser that expands any argument with a comma into an array of arguments, it’s used when you put in a list of port_ids for example. It’s expanding this here, and we’re passing an array of values to the SQL query builder. I’m not sure how much would need to be changed to suppress this behaviour in this instance, so I’d recommend just not putting commas in port descriptions! Thanks, Adam. From: Chris Macneill <cmacneill(a)zelan.co.nz> Sent: 26 February 2020 17:22 To: observium <observium(a)observium.org> Cc: adama <adama(a)observium.org> Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi Adam, Looks like data is being split on commas and causing an SQL syntax error. Debug for:- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} returns:- Error in query: (You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at line 1) 1064 I can obviously fix this short-term by removing commas from the Port Descriptions, but would be good to be able to support use of commas and other punctuation in the longer term or at least update the Help page to list characters to avoid. I had a quick look earlier at the Regex that was parsing the description data, but wasn't immediately obvious commas were an issue. At least I know where the problem lies and I'll take another look later. I guess semi-colons might work if commas don't. Regards Chris Macneill Zelan Ltd _____ From: "observium" <observium(a)observium.org <mailto:observium@observium.org> > To: "observium" <observium(a)observium.org <mailto:observium@observium.org> > Cc: "adama" <adama(a)observium.org <mailto:adama@observium.org> > Sent: Thursday, 27 February, 2020 04:50:22 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Do you get anything useful from showing rrd command on the graph browser page? (click on the graph) Do you get anything useful from adding &debug=1 on the end of the graph image url? Can you arrange ssh/http access to the install if those two things don’t show us what the problem is? Adam. From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Chris Macneill via observium Sent: 26 February 2020 05:22 To: observium <observium(a)observium.org <mailto:observium@observium.org> > Cc: Chris Macneill <cmacneill(a)cmit.nz <mailto:cmacneill@cmit.nz> > Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd. _______________________________________________ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Chris Macneill 26 Feb '20

26 Feb '20

Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd.

2 1

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Manish Shringarpure 26 Feb '20

26 Feb '20

I was facing the same issue, the rrd files are not generated for some routers for only ports. You can check if the rrd files are present under /opt/observium/rrd/<device_name>/port*.rrd I ran the poller explicitly and the rrd files were generated. You can try the same on that specific device, with the following command. sudo ./poller.php -h <device_id> -m ports -dd watch out for the snmpbulkwalk command that gets printed on the screen. Regard’s Manish From: observium <observium-bounces(a)observium.org> on behalf of Chris Macneill via observium <observium(a)observium.org> Reply to: observium <observium(a)observium.org> Date: Wednesday, 26 February 2020 at 10:54 AM To: observium <observium(a)observium.org> Cc: Chris Macneill <cmacneill(a)cmit.nz> Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd.

2 1

Not seeing additional CPU's.
by Scott L. Kaiser 26 Feb '20

26 Feb '20

2 1

only front page working
by Ross [Eve IT] 26 Feb '20

26 Feb '20

Hello, Recently installed the CE version on a local Debian box running nginx and I have having a bizarre issue. Only the front page loads, it loads fine. The moment I click on any link, whether it is a device or trying to go into Settings, it just throws a 404. I don't see any errors in nginx. I thought it might have something to do with the web_url & base_url, I have set that in the config.php but no luck. I'm sure it's something I have missed :/ Ross.

8 22

Re: [Observium] Port red file generation issue
by Manish Shringarpure 25 Feb '20

25 Feb '20

Hi Adam, Thanks for your reply. All the rrd files inside the device directory have user as root and group as root. Even the other devices where the graphs are showing up have user as root and group as root. Following is the screenshot of the rrdtool dump of a port file. <ds> 23 <name> OUTOCTETS </name> 24 <type> DERIVE </type> 25 <minimal_heartbeat>600</minimal_heartbeat> 26 <min>0.0000000000e+00</min> 27 <max>1.2500000000e+10</max> 28 29  30 <last_ds>472721674480</last_ds> 31 <value>NaN</value> 32 <unknown_sec> 214 </unknown_sec> 33 </ds> 34 35 <ds> 36 <name> INERRORS </name> 37 <type> DERIVE </type> 38 <minimal_heartbeat>600</minimal_heartbeat> 39 <min>0.0000000000e+00</min> 40 <max>1.2500000000e+10</max> 41 42  43 <last_ds>0</last_ds> 44 <value>NaN</value> 45 <unknown_sec> 214 </unknown_sec> 46 </ds> All values seem to be NaN. Does observium write any error logs where such errors could be seen? Regard’s Manish From: observium <observium-bounces(a)observium.org> on behalf of Adam Armstrong via observium <observium(a)observium.org> Reply to: Observium <observium(a)observium.org> Date: Monday, 24 February 2020 at 3:08 PM To: Manish Shringarpure via observium <observium(a)observium.org> Cc: Adam Armstrong <adama(a)memetic.org> Subject: Re: [Observium] Port red file generation issue This is probanly a permissioms issue. If you manually ran the poller as root, the observium user won't have write permissions to that directory. Adam. Sent from BlueMail<http://www.bluemail.me/r?b=15818> On 24 Feb 2020, at 05:30, Manish Shringarpure via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi, I am new to observium. I have a strange issue ;for only one of the devices in the network. The port*.rrd files for this device is not getting generated in the /opt/observium/rrd path. The other rrd files are being generated for this device. Because of which the dashboard does not show any graphs for the ports on this device. I ran the poller script manually for this particular device and the ports*.rrd files got generated but after I exported the files to an XML I could see all values as NaN. Also these port rrd files are not getting updated at regular intervals like the other rrd files for the same device. How do I debug this? Help would be appreciated. Regards, Manish ________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 1

API strange issue
by Daniel Rolfe 24 Feb '20

24 Feb '20

Hi All, Can anyone think of what I'm missing with this issue ? see images below: So I have an alert checker with ID 4 [image: image.png] But hitting the api directly for that id gives a 404 [image: image.png] Observium details [image: image.png] Thanks in advance images attached also in case of non html email clients Regards, Daniel

3 3

Port red file generation issue
by Manish Shringarpure 24 Feb '20

24 Feb '20

Hi, I am new to observium. I have a strange issue ;for only one of the devices in the network. The port*.rrd files for this device is not getting generated in the /opt/observium/rrd path. The other rrd files are being generated for this device. Because of which the dashboard does not show any graphs for the ports on this device. I ran the poller script manually for this particular device and the ports*.rrd files got generated but after I exported the files to an XML I could see all values as NaN. Also these port rrd files are not getting updated at regular intervals like the other rrd files for the same device. How do I debug this? Help would be appreciated. Regards, Manish

2 1

Wikimedia Map Tiles not loading - Error 429
by Gumilar Siegfried MSc. 22 Feb '20

22 Feb '20

Hello! Among other things, we display the map in the dashboard. As it seems, the Wikimedia Tiles are shown by default, because we did not set anything else in the config.php file. Since a few weeks we have the problem that some tiles are not displayed anymore. In the Chrome Console you can see that the PNGs are not loaded due to an error code 429 (too many requests). It seems that Wikimedia has introduced a limit for some time now. Since many users have the dashboard permanently open, the same PNGs are very often loaded from our public IP. Is there a workaround for this problem? It is actually not necessary that the browser constantly reloads the PNGs, because nothing changes in the display. Unfortunately I did not find a list of possible alternative tile providers anywhere in the documentation. I only know the carto base dark and light. Unfortunately I don't find them optically ideal. What other implemented variants are there? Regards, Siegfried

3 2

Change severity on alarms
by Daniel Johansson 21 Feb '20

21 Feb '20

Hi I was wondering if there are any ways of creating other seventies than Critical when creating alarm checkers? For example I would like to have severity Informational and maybe some others. Also I would like to have the posibility to only send Critical events to all recievers of the alarms and Informational to the responsible group for specific alarms. Is this possible? If so how do I do it? If it's not possible now, can it be implemented? ---- Regards Daniel

1 0

Syslog Priority Filter on Syslog Frontpage/Dashboard
by Klimek, Denis 20 Feb '20

20 Feb '20

Hi all, is there any known option to display also Informational (6) syslog messages on the Syslog Box in the dashboard view? Mit freundlichem Gruß Stadtwerke Norderstedt Denis Klimek Carrier Manager & Professional Network Engineer IP-Systemtechnik Tel: +49 (0) 40 / 521 04 - 1049 dklimek(a)stadtwerke-norderstedt.de<mailto:dklimek@stadtwerke-norderstedt.de> www.stadtwerke-norderstedt.de<http://www.stadtwerke-norderstedt.de/>

1 0

custom OID "autodiscovery" -?
by Adam Thompson 19 Feb '20

19 Feb '20

When I create a custom OID, I can turn on "Autodiscovery". What does this do? (It doesn't appear to be documented.) Thanks, -Adam Adam Thompson Consultant, Infrastructure Services [[MERLIN LOGO]] 100 - 135 Innovation Drive Winnipeg, MB, R3T 6A8 (204) 977-6824 or 1-800-430-6404 (MB only) athompson(a)merlin.mb.ca<mailto:athompson@merlin.mb.ca> www.merlin.mb.ca<http://www.merlin.mb.ca/>

2 1

Monitoring by IPv6 Only
by Junior Corazza 19 Feb '20

19 Feb '20

Hello everyone, how's it going? I'm trying to monitor some hosts in ipv6 only, but the Observium has the error: "Error Drawing Graph". Has anyone ever experienced this? If want, se the screen https://ibb.co/rKjPxnM Tks

2 3

OBS-2925 - Ping Only Hosts / OBS_SNMP_SKIP flag / snmp_skip attribute
by Colin Stubbs 18 Feb '20

18 Feb '20

For the benefit of anyone on the list who doesn't use JIRA... and also so that others who support (want/need) this feature can comment. https://jira.observium.org/browse/OBS-2925 Attached patch defines OBS_SNMP_SKIP flag and uses snmp_skip device attribute, similar to OBS_PING_SKIP and ping_skip, in order to have hosts that are ping only. Ping only hosts can still have the Observium Unix Agent installed (tested), and other poller modules such as IPMI enabled (untested). Tested: 1. Add/remove/rename ping only hosts via CLI 2. Add/remove ping only hosts via webUI 3. View/interact ping only hosts via webUI - SNMP specific features/menus etc are hidden while skip SNMP is enabled 4. Alerting - device_status equals 0 && device_status_type equals ping - will trigger alerts for host down/recovery events 5. Shifting a previously SNMP contactable host to ping only by ticking skip SNMP box - old SNMP graphs/etc are maintained and remain available - remove skip SNMP box and SNMP polling begins again Things I know kind of don't work right now: 1. Location override - poller/discovery doesn't seem to perform geocoding and whatever else is happening there Things that could be improved: 1. Unix Agent poller module etc is enabled by default for all hosts, for ping only hosts, perhaps it should be disabled by default? Will improve performance by reducing the number of processes that hang while the 10s default connect timeout happens. Totally untested: 1. Use of autodiscovery SNMP skip - should work in theory, unsure if those parts of the patch should actually be used though. Some people out there may actually want to add anything that does respond to ping and can be found thru adjacency and routing protocol info etc?? Patch generated from recent trunk, touches files as below, [root@desktop observium]# diff -r -u observium-trunk root | grep -v ^Only > ping_only_hosts.diff [root@desktop observium]# cd root [root@desktop root]# svn status M add_device.php M html/pages/addhost.inc.php M html/pages/device/edit/device.inc.php M html/pages/device/edit.inc.php M html/pages/device/graphs.inc.php M html/pages/device/perf.inc.php M includes/config-variables.inc.php M includes/defaults.inc.php M includes/definitions.inc.php M includes/discovery/functions.inc.php M includes/functions.inc.php M includes/polling/functions.inc.php M poller.php M rename_device.php [root@desktop root]# svn info | grep ^Revision Revision: 9704 [root@desktop root]# [root@desktop observium]# mv ping_only_hosts.diff ping_only_hosts_r9704.diff -Colin Email: cstubbs @ gmail . com

5 13

Adding Spectra BlackPearl devices
by Stephen Park 17 Feb '20

17 Feb '20

Hi, Can I get support added for a Spectra Black Pearl please. observium-01v ~]# snmpget -v2c -c <string> 172.16.15.96 sysObjectID.0 sysDescr.0 SNMPv2-MIB::sysObjectID.0 = OID: SNMPv2-SMI::enterprises.3478.6 SNMPv2-MIB::sysDescr.0 = STRING: Spectra Logic BlackPearl Stephen Park Murdoch Children's Research Institute The Royal Children's Hospital, 50 Flemington Road Parkville, Victoria 3052 Australia T +61 3 9936 6267 M +61 439 796 025 E stephen.park(a)mcri.edu.au<mailto:stephen.park@mcri.edu.au> W mcri.edu.au<https://www.mcri.edu.au/> Disclaimer This e-mail and any attachments to it (the "Communication") are, unless otherwise stated, confidential, may contain copyright material and is for the use only of the intended recipient. If you receive the Communication in error, please notify the sender immediately by return e-mail, delete the Communication and the return e-mail, and do not read, copy, retransmit or otherwise deal with it. Any views expressed in the Communication are those of the individual sender only, unless expressly stated to be those of Murdoch Children’s Research Institute (MCRI) ABN 21 006 566 972 or any of its related entities. MCRI does not accept liability in connection with the integrity of or errors in the Communication, computer virus, data corruption, interference or delay arising from or in respect of the Communication.

2 1

Alert Checker Examples
by Luis Londoño 13 Feb '20

13 Feb '20

Not sure if there is somewhere already, but I was wondering what different alert checkers everyone is using? Tryin to build ours up and just want to see how everyone is going about checking for different port statuses and all else that Observium monitors. TIA

1 0

Regarding Observium Services
by Ismail Hossain 11 Feb '20

11 Feb '20

Dear Observium, We are using your product and version is 17.9. we want to add our FTTH device on observium but it's not working fully for devices like V-SOL, Phyhome, BDcom. Could you please add a feature for FTTH Network. If this criteria match with us then we want to purchase your product soon. -- With Best Regards, *Md. Ismail Hossain* *Engineer | Technical* Earth Telecommunication Team Chittagong Mail : ismail.hossain(a)earth.net.bd <ismail.hossain(a)race.net.bd> <atick(a)race.net.bd> Cell : 01844543221 Cell : 01970423912 Chittagong Office : IIUC Tower, (13th floor) Sheikh Mujib Road Agrabad C/A, Chittagong - 4100, Bangladesh.

1 0

Blank space in graphs
by Ludovic Eluecque 10 Feb '20

10 Feb '20

Hello, on somes devices, i have a problem with blank space in my networking graph, i have this problem only with somes devices, others devices (same hardware and OS) work well. Please find attached examples. The devices are Cisco N3K-C3048TP-1GE running on NX-OS 6.0(2)U3(7) (uk9). On working device (with normal graph) all ports are 64bits, on devices with blank problem all ports are 32bits. When i poll a device with the blank problem, i have: o CISCO-VLAN-IFTABLE-RELATIONSHIP-MIB cviRoutedVlanIfIndex o SMON-MIB o CISCO-TRUSTSEC-INTERFACE-MIB o ADSL-LINE-MIB o EtherLike-MIB dot3StatsDuplexStatus o Q-BRIDGE-MIB o IP-MIB IP-MIB ipIfStats *Negative ifOutOctets. Possible spike on next poll!* +-----------+--------+----------+--------+----------+----------+---------+----------+--------+---------+----+ | ifIndex | Label | Type | Speed | BPS In | BPS Out | Data In | Data Out | PPS In | PPS Out | HC | +-----------+--------+----------+--------+----------+----------+---------+----------+--------+---------+----+ | 83886080 | mgmt0 | Ethernet | 1Gbps | 59.1kbps | 55.9kbps | 252kB | 239kB | 66.5 | 66.5 | N | | 436207616 | Et1/1 | Ethernet | 1Gbps | 56.2kbps | 59.4kbps | 240kB | 254kB | 66.8 | 66.8 | N | | 436211712 | Et1/2 | Ethernet | 1Gbps | 23.2kbps | 27.2kbps | 99.1kB | 116kB | 27.2 | 18.8 | N | | 436215808 | Et1/3 | Ethernet | 1Gbps | 2.6Mbps | 1.68Mbps | 10.8MB | 7.01MB | 1.04k | 1.71k | N | | 436219904 | Et1/4 | Ethernet | 1Gbps | 260Mbps | 63.7Mbps | 1.06GB | 266MB | 23k | 12.6k | N | | 436224000 | Et1/5 | Ethernet | 1Gbps | 0bps | 114kbps | 0B | 489kB | 0 | 12.5 | N | | 436228096 | Et1/6 | Ethernet | 1Gbps | 117Mbps | 453Mbps | 490MB | 1.85GB | 14.6k | 39.9k | N | | 436232192 | Et1/7 | Ethernet | 1Gbps | 0bps | 0bps | 0B | 0B | 0 | 0 | N | | 436236288 | Et1/8 | Ethernet | 1Gbps | 8.76Mbps | 3.65Mbps | 36.5MB | 15.2MB | 828 | 592 | N | | 436240384 | Et1/9 | Ethernet | 1Gbps | 0bps | 0bps | 0B | 0B | 0 | 0 | N | | 436244480 | Et1/10 | Ethernet | 1Gbps | 24.3Mbps | 44.9Mbps | 101MB | 187MB | 3.09k | 4.55k | N | ..... | 436416512 | Et1/52 | Ethernet | 10Gbps | 38.7Mbps | 0bps | 161MB | *-1.9GB * | 116k | 73k | N | On working device, i don't have this negative values and the "HC" column has "Y" value, not "N". Do you have an idea about the problem? Thank! Regards. Ludovic. --

3 2

All ports down
by ira＠cylinder.tv 10 Feb '20

10 Feb '20

2 devices discovered No graphs work Config at pastebin.com/vTg8Ukep Thank you -- Sent from myMail for Android

4 5

Cleaning up Observium
by greggy862 . 06 Feb '20

06 Feb '20

Hello, I would like to cleanup observium, please see below that my largest directories are the logs (1.6 GB) and the rrd (17 GB). I tried cleaning up the logs by running ./housekeeping -sel BUT the size of the logs did not change - nonetheless, the devices with years of logs suddenly have days of logs (since I specified logs should be no older than 30 days). My concern is that I did the cleanup to reduce disk space, but immediately after I saw an increase in disk space, moreover, the space occupied in the log file directory did not change. Is it that observium housekeeping only targets space in the database, I ask because the query hanged for over 30 min doing nothing until I uses the -d (debug) flag and I noticed it was doing an sql query. How do I cleanup the logs directory? do I delete/truncate logs such as observium.log and access.log? What about the rrd directory, if I remove some of the rrds do I loose graphs (like record duration? LAB01:/opt/observium# du -h /opt/observium/ --max-depth=1 | sort -h 20K /opt/observium/templates 52K /opt/observium/probes 472K /opt/observium/attic 512K /opt/observium/scripts 1.3M /opt/observium/tests 1.8M /opt/observium/update 3.2M /opt/observium/libs 8.7M /opt/observium/includes 26M /opt/observium/html 630M /opt/observium/mibs 799M /opt/observium/.svn 2.3G /opt/observium/logs 17G /opt/observium/rrd 21G /opt/observium/ LAB01:/opt/observium# du -h /opt/observium/logs/* --max-depth=1 | sort -h 4.0K /opt/observium/logs/debug.log 12K /opt/observium/logs/cleanup.log 384K /opt/observium/logs/error_log 712K /opt/observium/logs/update-errors.log 1.3M /opt/observium/logs/housekeeping.log 20M /opt/observium/logs/db.log 707M /opt/observium/logs/access_log 1.6G /opt/observium/logs/observium.log Regards, Greg

1 0

Cisco 9300-24p in stack with 3 units not showing all info for stack member 2
by Daniel Johansson 06 Feb '20

06 Feb '20

Hi After setting up a new stack with 3 units of C9300-24p we only see the full inventory for switch 1 and switch 3 not switch 2. That means I can't see the fans or temp sensors for switch 2. Is this an observium parsing issue or an snmp issue in the switches? I attach a full picture of the inventory page. i also have a full snmpwalk dump from the switch if you need to have a look at it. Will send it outside of the list if needed. ---- Regards Daniel

3 3