- observium - lists.observium.org

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Adam Armstrong 27 Feb '20

27 Feb '20

Read that entire page. ⁣Sent from BlueMail On 27 Feb 2020, 02:06, at 02:06, Chris Macneill <cmacneill(a)zelan.co.nz> wrote: >Hi Adam, > >"svn update" is what I assumed I was supposed to use and it said >successfully updated to 10304. > >Webpage says v20.2.10302 (stable) after update. > >I don't see any doucmentation in [ >https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… >| >https://docs.observium.org/updating/#upgrading-the-subscription-edition-to-… >] that references any difference between latest "stable" and latest >"rolling". > >How do I upgrade to "rolling" 10304? > >Why does "svn update" tell me it's updated to 10304 when it seemingly >hasn't? > >Regards > >Chris Macneill >Zelan Ltd > >From: "observium" <observium(a)observium.org> >To: "observium" <observium(a)observium.org> >Cc: "Adam Armstrong" <adama(a)memetic.org> >Sent: Thursday, 27 February, 2020 14:51:35 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > >Is this, perchance, stable, and not rolling? > >Adam. > >Sent from [ http://www.bluemail.me/r?b=15818 | BlueMail ] >On 27 Feb 2020, at 01:45, Chris Macneill via observium < [ >mailto:observium@observium.org | observium(a)observium.org ] > wrote: > > >Hi Mike, > >Sorry, 20.2.10304 doesn't fix it. Fields still split on commas for >port_descr_type = 'cust' and debug results exactly the same as >previous:- > >SELECT * FROM `ports` AS I , `devices` AS D WHERE `port_descr_type` = >'cust' AND `port_descr_descr` = 'GDC Westland Recreation Centre' , ' 83 >High St' , ' Greymouth' AND D . device_id = I . device_id > >Also, a new bug added, software version number at bottom of screen is >now out of step with "svn update". Update said successfully updated to >10304, but webpage says 20.2.10302 > >I've had a hack at the code in >html/includes/graphs/customer/bits.inc.php and put the following >workaround in place:- > >Line 16 (Original v20.2.10304 Code) >foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE >`port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = >I.device_id", array($vars['id'])) as $port) > >Replaced with:- > >// Copy id array directly for case where port_descr_descr was NOT >previosuly split/exploded on commas. >$pddstr = $vars['id']; >if ( count($vars['id']) > 1 ) { >// Impode id array addng commas where array size > 1, i.e. original id >contained commas and WAS split/exploded. >$pddstr = implode(",", $vars['id']); >} >foreach (dbFetchRows("SELECT * FROM `ports` AS I, `devices` AS D WHERE >`port_descr_type` = 'cust' AND `port_descr_descr` = ? AND D.device_id = >I.device_id", array($pddstr)) as $port) > >$vars['id'] is the result of splitting or exploding port_descr_descr >string value somewhere earlier, but I can't locate that in the code and >as Adam mentioned, changing this elsewhere might have undesirable >consequences. > >The problem only happens for port_descr_type = "cust", for other port >types, e.g. core, peering, transit, port_descr_descr isn't split or >exploded despite containing commas, but I can't find the locaiton in >the code where this conditional behaviour occurs. > >Regards > >Chris Macneill >Zelan Ltd > >From: "Mike Stupalov" <mike(a)observium.org> >To: "observium" <observium(a)observium.org>, "observium" ><observium(a)observium.org> >Cc: "Chris Macneill" <cmacneill(a)cmit.nz> >Sent: Thursday, 27 February, 2020 12:59:52 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > >Hi Chris, > >try with latest revision (r10304, trunk). > >Issue should be fixed. > >Chris Macneill via observium wrote on 26.02.2020 20:25: > >BQ_BEGIN > >Hi Adam, > >Looks like data is being split on commas and causing an SQL syntax >error. Debug for:- > >Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] >{Chorus CVID.113} > >returns:- > >Error in query: (You have an error in your SQL syntax; check the manual >that corresponds to your MariaDB server version for the right syntax to >use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at >line 1) 1064 > >I can obviously fix this short-term by removing commas from the Port >Descriptions, but would be good to be able to support use of commas and >other punctuation in the longer term or at least update the Help page >to list characters to avoid. > >I had a quick look earlier at the Regex that was parsing the >description data, but wasn't immediately obvious commas were an issue. >At least I know where the problem lies and I'll take another look >later. I guess semi-colons might work if commas don't. > >Regards > >Chris Macneill >Zelan Ltd > > >From: "observium" [ mailto:observium@observium.org | ><observium(a)observium.org> ] >To: "observium" [ mailto:observium@observium.org | ><observium(a)observium.org> ] >Cc: "adama" [ mailto:adama@observium.org | <adama(a)observium.org> ] >Sent: Thursday, 27 February, 2020 04:50:22 >Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > > > >Do you get anything useful from showing rrd command on the graph >browser page? (click on the graph) > > > >Do you get anything useful from adding &debug=1 on the end of the graph >image url? > > > >Can you arrange ssh/http access to the install if those two things >don’t show us what the problem is? > > > >Adam. > > > > >From: observium [ mailto:observium-bounces@observium.org | ><observium-bounces(a)observium.org> ] On Behalf Of Chris Macneill via >observium >Sent: 26 February 2020 05:22 >To: observium [ mailto:observium@observium.org | ><observium(a)observium.org> ] >Cc: Chris Macneill [ mailto:cmacneill@cmit.nz | <cmacneill(a)cmit.nz> ] >Subject: [Observium] Port Description Parsing - Cust Graphs "Error >Drawing Graph" > > > > > >Hi, > > > > > >We're currently using Observium v20.1.10233 and have a problem with >"Error Drawing Graph" for all ports with a "Cust" prefix. Ports with >"Core", "Peer" or "Transit" prefix correctly show graphs. > > > > > >The ports we're monitoring are VLANs, the Peer/Transit are simple >802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of >802.1q headers. > > > > > >All port types are correctly detected by SNMP and listed against the >Router. Given that "Core" displays graphs correctly, this doesn't seem >to be related to QinQ, but specifically to the "Cust" prefix. > > > > > >Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- > > > > > >Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} > > >Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus >CVID.100} > > > > > >Example (QinQ) that gives "Error Drawing Graph":- > > > > > >Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] >{Chorus CVID.113} > > > > > >All our routers are MikroTik, so can't determine if this is a router >OS/hardware specific issue. > > > > > >Regards > >Chris Macneill >Zelan Ltd. > > > > >_______________________________________________ >observium mailing list >[ mailto:observium@observium.org | observium(a)observium.org ] >[ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > > > >_______________________________________________ >observium mailing list [ mailto:observium@observium.org | >observium(a)observium.org ] [ >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > > > >-- >Mike Stupalov >Observium Limited, [ http://observium.org/ | http://observium.org ] > > > > >observium mailing list >observium(a)observium.org >[ http://postman.memetic.org/cgi-bin/mailman/listinfo/observium | >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ] > >BQ_END > > >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Chris Macneill 27 Feb '20

27 Feb '20

Hi Adam, Looks like data is being split on commas and causing an SQL syntax error. Debug for:- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} returns:- Error in query: (You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at line 1) 1064 I can obviously fix this short-term by removing commas from the Port Descriptions, but would be good to be able to support use of commas and other punctuation in the longer term or at least update the Help page to list characters to avoid. I had a quick look earlier at the Regex that was parsing the description data, but wasn't immediately obvious commas were an issue. At least I know where the problem lies and I'll take another look later. I guess semi-colons might work if commas don't. Regards Chris Macneill Zelan Ltd From: "observium" <observium(a)observium.org> To: "observium" <observium(a)observium.org> Cc: "adama" <adama(a)observium.org> Sent: Thursday, 27 February, 2020 04:50:22 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Do you get anything useful from showing rrd command on the graph browser page? (click on the graph) Do you get anything useful from adding &debug=1 on the end of the graph image url? Can you arrange ssh/http access to the install if those two things don’t show us what the problem is? Adam. From: observium <observium-bounces(a)observium.org> On Behalf Of Chris Macneill via observium Sent: 26 February 2020 05:22 To: observium <observium(a)observium.org> Cc: Chris Macneill <cmacneill(a)cmit.nz> Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd. _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

3 3

smokeping integration
by cody＠mail-server.cc 26 Feb '20

26 Feb '20

I installed smokeping, generated the targets file with the script and smokeping is running and updating the rrd's. I set the smokeping directory in the gui but i do not get the smokeping tab on the devices. Is there anything else to do? I'm not seeing something wrong - how do i troubleshoot/identify why the smokeping tab doesn't appear? thanks

2 2

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by adama＠observium.org 26 Feb '20

26 Feb '20

Aha, I see what it’s doing. You missed out the actual query, which makes it more obvious what’s happening /graph.php?type=customer_bits&id=herp,derp&debug=1 Generates: SELECT * FROM `ports` AS I, `devices` AS D WHERE `port_descr_type` = 'cust' AND `port_descr_descr` = 'herp','derp' AND D.device_id = I.device_id We have a bit of code in the URL parser that expands any argument with a comma into an array of arguments, it’s used when you put in a list of port_ids for example. It’s expanding this here, and we’re passing an array of values to the SQL query builder. I’m not sure how much would need to be changed to suppress this behaviour in this instance, so I’d recommend just not putting commas in port descriptions! Thanks, Adam. From: Chris Macneill <cmacneill(a)zelan.co.nz> Sent: 26 February 2020 17:22 To: observium <observium(a)observium.org> Cc: adama <adama(a)observium.org> Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi Adam, Looks like data is being split on commas and causing an SQL syntax error. Debug for:- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} returns:- Error in query: (You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '' 83 High St',' Greymouth' AND D.device_id = I.device_id' at line 1) 1064 I can obviously fix this short-term by removing commas from the Port Descriptions, but would be good to be able to support use of commas and other punctuation in the longer term or at least update the Help page to list characters to avoid. I had a quick look earlier at the Regex that was parsing the description data, but wasn't immediately obvious commas were an issue. At least I know where the problem lies and I'll take another look later. I guess semi-colons might work if commas don't. Regards Chris Macneill Zelan Ltd _____ From: "observium" <observium(a)observium.org <mailto:observium@observium.org> > To: "observium" <observium(a)observium.org <mailto:observium@observium.org> > Cc: "adama" <adama(a)observium.org <mailto:adama@observium.org> > Sent: Thursday, 27 February, 2020 04:50:22 Subject: Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Do you get anything useful from showing rrd command on the graph browser page? (click on the graph) Do you get anything useful from adding &debug=1 on the end of the graph image url? Can you arrange ssh/http access to the install if those two things don’t show us what the problem is? Adam. From: observium <observium-bounces(a)observium.org <mailto:observium-bounces@observium.org> > On Behalf Of Chris Macneill via observium Sent: 26 February 2020 05:22 To: observium <observium(a)observium.org <mailto:observium@observium.org> > Cc: Chris Macneill <cmacneill(a)cmit.nz <mailto:cmacneill@cmit.nz> > Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd. _______________________________________________ observium mailing list observium(a)observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Chris Macneill 26 Feb '20

26 Feb '20

Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd.

2 1

Re: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph"
by Manish Shringarpure 26 Feb '20

26 Feb '20

I was facing the same issue, the rrd files are not generated for some routers for only ports. You can check if the rrd files are present under /opt/observium/rrd/<device_name>/port*.rrd I ran the poller explicitly and the rrd files were generated. You can try the same on that specific device, with the following command. sudo ./poller.php -h <device_id> -m ports -dd watch out for the snmpbulkwalk command that gets printed on the screen. Regard’s Manish From: observium <observium-bounces(a)observium.org> on behalf of Chris Macneill via observium <observium(a)observium.org> Reply to: observium <observium(a)observium.org> Date: Wednesday, 26 February 2020 at 10:54 AM To: observium <observium(a)observium.org> Cc: Chris Macneill <cmacneill(a)cmit.nz> Subject: [Observium] Port Description Parsing - Cust Graphs "Error Drawing Graph" Hi, We're currently using Observium v20.1.10233 and have a problem with "Error Drawing Graph" for all ports with a "Cust" prefix. Ports with "Core", "Peer" or "Transit" prefix correctly show graphs. The ports we're monitoring are VLANs, the Peer/Transit are simple 802.1q VLANs, the Core/Customer VLANs are QinQ, i.e. two layers of 802.1q headers. All port types are correctly detected by SNMP and listed against the Router. Given that "Core" displays graphs correctly, this doesn't seem to be related to QinQ, but specifically to the "Cust" prefix. Examples that correctly show graphs, 1st is 802.1q, 2nd is QinQ:- Peering: Datacom CHC<->Chorus [10Gbit] {Chorus SVID.100} Core: Zelan Workshop, 50 Palmerston St, Westport [1Gbit] {Chorus CVID.100} Example (QinQ) that gives "Error Drawing Graph":- Cust: GDC Westland Recreation Centre, 83 High St, Greymouth [100Mbit] {Chorus CVID.113} All our routers are MikroTik, so can't determine if this is a router OS/hardware specific issue. Regards Chris Macneill Zelan Ltd.

2 1

Not seeing additional CPU's.
by Scott L. Kaiser 25 Feb '20

25 Feb '20

2 1

only front page working
by Ross [Eve IT] 25 Feb '20

25 Feb '20

Hello, Recently installed the CE version on a local Debian box running nginx and I have having a bizarre issue. Only the front page loads, it loads fine. The moment I click on any link, whether it is a device or trying to go into Settings, it just throws a 404. I don't see any errors in nginx. I thought it might have something to do with the web_url & base_url, I have set that in the config.php but no luck. I'm sure it's something I have missed :/ Ross.

8 22

Re: [Observium] Port red file generation issue
by Manish Shringarpure 25 Feb '20

25 Feb '20

Hi Adam, Thanks for your reply. All the rrd files inside the device directory have user as root and group as root. Even the other devices where the graphs are showing up have user as root and group as root. Following is the screenshot of the rrdtool dump of a port file. <ds> 23 <name> OUTOCTETS </name> 24 <type> DERIVE </type> 25 <minimal_heartbeat>600</minimal_heartbeat> 26 <min>0.0000000000e+00</min> 27 <max>1.2500000000e+10</max> 28 29  30 <last_ds>472721674480</last_ds> 31 <value>NaN</value> 32 <unknown_sec> 214 </unknown_sec> 33 </ds> 34 35 <ds> 36 <name> INERRORS </name> 37 <type> DERIVE </type> 38 <minimal_heartbeat>600</minimal_heartbeat> 39 <min>0.0000000000e+00</min> 40 <max>1.2500000000e+10</max> 41 42  43 <last_ds>0</last_ds> 44 <value>NaN</value> 45 <unknown_sec> 214 </unknown_sec> 46 </ds> All values seem to be NaN. Does observium write any error logs where such errors could be seen? Regard’s Manish From: observium <observium-bounces(a)observium.org> on behalf of Adam Armstrong via observium <observium(a)observium.org> Reply to: Observium <observium(a)observium.org> Date: Monday, 24 February 2020 at 3:08 PM To: Manish Shringarpure via observium <observium(a)observium.org> Cc: Adam Armstrong <adama(a)memetic.org> Subject: Re: [Observium] Port red file generation issue This is probanly a permissioms issue. If you manually ran the poller as root, the observium user won't have write permissions to that directory. Adam. Sent from BlueMail<http://www.bluemail.me/r?b=15818> On 24 Feb 2020, at 05:30, Manish Shringarpure via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi, I am new to observium. I have a strange issue ;for only one of the devices in the network. The port*.rrd files for this device is not getting generated in the /opt/observium/rrd path. The other rrd files are being generated for this device. Because of which the dashboard does not show any graphs for the ports on this device. I ran the poller script manually for this particular device and the ports*.rrd files got generated but after I exported the files to an XML I could see all values as NaN. Also these port rrd files are not getting updated at regular intervals like the other rrd files for the same device. How do I debug this? Help would be appreciated. Regards, Manish ________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 1

API strange issue
by Daniel Rolfe 24 Feb '20

24 Feb '20

Hi All, Can anyone think of what I'm missing with this issue ? see images below: So I have an alert checker with ID 4 [image: image.png] But hitting the api directly for that id gives a 404 [image: image.png] Observium details [image: image.png] Thanks in advance images attached also in case of non html email clients Regards, Daniel

3 3