- observium - lists.observium.org

Custom Names for Graphs in Custom Dashboards
by Pieter De Wit 16 Nov '18

16 Nov '18

Hi Guys, Would it be possible to rename the graphs in the custom dashboard - We have longish names and only the hostname is visible. *Kind Regards,* *Pieter De Wit*

3 5

Using port group in Alerts
by Thibault Richard 16 Nov '18

16 Nov '18

Hello, I've defined a working group of ports which indeed contains what I want : Unfortunately I cannot use this group in an alert definition because I 'm able to define a DEVICE group but not a PORT group The only solution to achieve my goal is to define alerts with the same criterium as the ones used for my group definition Did I miss something ? Best Regards Thibault

3 7

Overall traffic views empty
by Brandwatch NOC 16 Nov '18

16 Nov '18

Hi, Since the update on Tuesday the overall traffic graphs on our front page are empty i.e. Transit & Peering. I tried updating yesterday but no change. Would appreciate a fix, or a clue to the fix ;-) Version Information *Observium* 18.11.9602 (14th November 2018) *OS* Linux 3.16.0-7-amd64 [amd64] (Debian 8.11) *Apache* 2.4.10 (Debian) *PHP* 5.6.38-0+deb8u1 (OPcache: ENABLED) *Python* 2.7.9 *MySQL* 5.5.60-0+deb8u1 (extension: mysqli 5.5.60) *SNMP* NET-SNMP 5.7.2.1 *RRDtool* 1.6.0 *Fping* 3.10 (IPv4 and IPv6) Regards, *Kevin Gee* Brandwatch | Network Engineer network-admin(a)brandwatch.com <kevin(a)brandwatch.com> New York | San Francisco | *Brighton* | Berlin | Stuttgart Email disclaimer <http://www.google.com/url?q=http://www.brandwatch.com/email-disclaimer/&sa=…> Find out what it’s like to work at Brandwatch <http://www.google.com/url?q=http://www.glassdoor.co.uk/Reviews/Brandwatch-R…>

2 1

Observium stop showing pages
by Jan Horacek 16 Nov '18

16 Nov '18

Hi guys, I really need your help. Observium (latest version) stopped to show all sub pages from day to day. I can login into and I see dashboard. On dashboard I`m able to see all graphs and also weather maps are working fine. However if I try open any device or port to see details I`m getting error Not Found The requested URL /health/metric=current/ was not found on this server. Apache configuration didn`t changed at all. Any ideas ? Thanks Jan

2 2

No "mouse-over" on dashboard elements
by Silvio del Val Hinojal 14 Nov '18

14 Nov '18

Hello, "Mouse-over" function over machine names in dashboard doesn't work, I supposse this is correct by now? It works when I click on a machine name, status, alert or whatever and I pass mouse over any element in the screen, showing a floating window with corresponding statistics. This is to confirm this behaviour is right and I don't have anything misconfigured. Regards, Silvio [cid:image001.png@01D03B1C.E8E96F80]<http://www.pandasecurity.com/spain/> Silvio del Val Systems Engineer - Panda Security This e-mail contains confidential information owned by Panda Security. Any such copy, or use, or distribution or disclosure of its contents is strictly forbidden. Please notify us immediately at our phone number (+34 94 425 11 00) if you receive this e-mail and are not its consignee, and then delete this message from your system without copying it, distributing it, or disclosing its contents P Before printing this message, please make sure it is really necessary

2 3

Error in drawing firewall graph
by pierremarie.cossey＠orange.com 14 Nov '18

14 Nov '18

hello I've just updated in 9600 version to use firewall counters on JunOS. It appears a drawing error with specific message : Could not parse color in ''. Thanks for your help Pierre-Marie COSSEY Envoyé de mon Galaxy S8 Orange [firewall_juniper_draw_error.png] _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.

2 4

Poller wrapper stopped working with Rev 9600
by Andre 14 Nov '18

14 Nov '18

Hi all The poller-wrapper stopped working with Revision 9600. It showed me a problem connecting to database. Reverting to Revision 9599 worked. Best regards Andre

3 10

Alerting on Custom OID
by Pieter De Wit 14 Nov '18

14 Nov '18

Hi Guys, I am trying to build an alert for a value of a custom oid but I seem to be missing something - blame lack of coffee/sleep etc :) The OID is .1.3.6.1.4.1.13400.3.4.4041.1.1.2.1 and I would like to alert when it's below 300. I have created an Alert checker that has a test condition of the following: .1.3.6.1.4.1.13400.3.4.4041.1.1.2.1 lt 300 This doesn't appear to work as it always "OK" the alert even thou the value is +-230. I have even tried "AC Input 1 Voltage" lt 300 without luck. The name comes from the oid_name field in the oids table. How do you create an alert for a custom oid and how do I know what I can alert on, using a custom oid ? *Kind Regards,* *Pieter De Wit*

3 8

Observium updated: 0.SVN.ERROR -> 0.SVN.ERROR
by Jason La 13 Nov '18

13 Nov '18

To all experienced Observium admin, I'm new to Observium and just get the software installed few days ago, I used SVN initially to download and still able to run svn update from the CLI, however, my GUI is not reflect that and keep throwing this SVN.ERROR. Is there anything I miss or any recommendation? Thank you so much in advance. There is a newer revision of Observium available! Version 18.10.9472 (12th November 2018) is 9472 revisions ahead. Version Information Observium 0.SVN.ERROR (1st January 1970) OS Linux 3.10.0-862.14.4.el7.x86_64 [amd64] (RedHat 7.5) Apache 2.4.6 (Red Hat Enterprise Linux) PHP/7.0.32 PHP 7.0.32 (OPcache: ENABLED) Python 2.7.5 MySQL 5.5.60-MariaDB (extension: mysqli 5.5.60-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.6.0 Fping 3.10 (IPv4 only) [cid:image001.png@01D47AD7.745A2890] [cid:image002.png@01D47AD7.745A2890] Jason La | Lead Systems Engineer, Portware Infrastructure Portware, A FactSet Company 99 Park Ave, 16th Floor New York, NY 10016 (212) 370 8353 www.factset.com<http://www.factset.com/>

2 1

Dashboard Oops
by Hamilton, Kent 12 Nov '18

12 Nov '18

Okay, I was playing with the Dashboard this morning (Observium 18.11.9593) and now all I get is "This page isn't working observium.exegy.net didn't send any data." How can I reset things so I get a working Observium back? ________________________________ This e-mail and any documents accompanying it may contain legally privileged and/or confidential information belonging to Exegy, Inc. Such information may be protected from disclosure by law. The information is intended for use by only the addressee. If you are not the intended recipient, you are hereby notified that any disclosure or use of the information is strictly prohibited. If you have received this e-mail in error, please immediately contact the sender by e-mail or phone regarding instructions for return or destruction and do not use or disclose the content to others.

2 1

Re: [Observium] observium Digest, Vol 100, Issue 10
by Pieter Meyer 12 Nov '18

12 Nov '18

Thanks adam I see its resolved in version 9593 Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map <https://goo.gl/maps/WHe3soT1fHm> | website <http://www.convergedgroup.net/> | company blog <http://www.convergedgroup.net/blog/> | linkedin <http://www.linkedin.com/company/converged-telecoms>

1 0

problem with api
by Rowlands Mark 12 Nov '18

12 Nov '18

Version Information Observium 18.11.9580 (9th November 2018) OS Linux 4.4.0-116-generic [amd64] (Ubuntu 16.04) Apache 2.4.18 (Ubuntu) PHP 7.0.32-0ubuntu0.16.04.1 (OPcache: ENABLED) Python 2.7.12 MySQL 10.3.10-MariaDB-1:10.3.10+maria~xenial-log (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.5.5 (rrdcached 1.5.5: unix:/var/run/rrdcached.sock) Fping 3.13 (IPv4 and IPv6) Trying to add a device :- I have tried the following incantations :- curl -u admin:PASSWORD http://observium.riksbyggen.intra/api/v0/devices/ -H "Content-Type: application/json" -X POST -d '{"hostname":"papp01-exo"}' curl -u admin:PASSWORD http://observium.riksbyggen.intra/api/v0/devices/ -H "Content-Type: application/json" -X POST -d '{"papp01-exo":"localhost"}' curl -u admin:PASSWORD http://observium.riksbyggen.intra/api/v0/devices/ -H "Content-Type: application/json" -X POST -d '{"papp01-exo":"observium.riksbyggen.intra"}' curl -u admin:POSSWORD http://observium.riksbyggen.intra/api/v0/devices/ -H "Content-Type: application/json" -X POST -d '{'papp01-exo':'observium'}' all of which return "Hostname Required"

2 3

Re: [Observium] observium Digest, Vol 100, Issue 7
by Pieter Meyer 12 Nov '18

12 Nov '18

Hi Adam Where would I look for error in the Java console? Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map <https://goo.gl/maps/WHe3soT1fHm> | website <http://www.convergedgroup.net/> | company blog <http://www.convergedgroup.net/blog/> | linkedin <http://www.linkedin.com/company/converged-telecoms> CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated. -----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of observium-request(a)observium.org Sent: Thursday, 08 November 2018 14:00 To: observium(a)observium.org Subject: observium Digest, Vol 100, Issue 7 Send observium mailing list submissions to observium(a)observium.org To subscribe or unsubscribe via the World Wide Web, visit http://postman.memetic.org/cgi-bin/mailman/listinfo/observium or, via email, send a message with subject or body 'help' to observium-request(a)observium.org You can reach the person managing the list at observium-owner(a)observium.org When replying, please edit your Subject line so it is more specific than "Re: Contents of observium digest..." Today's Topics: 1. Re: 1024 TB limit on disks when monitored over SNMP...? (Henrik Cednert (Filmlance)) 2. Possibility of disabling a health status (Patrick Kambach) 3. Landing page goes blank if upgraded from 9556 to 9558 (Pieter Meyer) 4. Re: Landing page goes blank if upgraded from 9556 to 9558 (Markus Klock) 5. Re: Landing page goes blank if upgraded from 9556 to 9558 (Pieter Meyer) 6. Re: Landing page goes blank if upgraded from 9556 to 9558 (Adam Armstrong) 7. Re: OS version mismatch in syslog emails (Ben Chase) 8. Neighbours (Christian Eriksson) 9. Re: Neighbours (Adam Armstrong) 10. Re: Neighbours (Adam Armstrong) 11. Re: Neighbours (Adam Armstrong) 12. Re: Neighbours (Christian Eriksson) 13. Re: Neighbours (Adam Armstrong) 14. Re: 1024 TB limit on disks when monitored over SNMP...? (Henrik Cednert (Filmlance)) 15. Re: 1024 TB limit on disks when monitored over SNMP...? (Adam Armstrong) 16. Re: Landing page goes blank if upgraded from 9556 to 9558 (Robert Williams) 17. Re: Landing page goes blank if upgraded from 9556 to 9558 (Adam Armstrong) 18. Contact for Device Type (noclab) 19. Re: Landing page goes blank if upgraded from 9556 to 9558 (Niklas Larsson) 20. Re: Landing page goes blank if upgraded from 9556 to 9558 (Niklas Larsson) 21. Re: Landing page goes blank if upgraded from 9556 to 9558 (Adam Armstrong) 22. Re: Landing page goes blank if upgraded from 9556 to 9558 (Rowlands Mark) 23. Re: Landing page goes blank if upgraded from 9556 to 9558 (Adam Armstrong) ---------------------------------------------------------------------- Message: 1 Date: Wed, 7 Nov 2018 12:26:34 +0000 From: "Henrik Cednert (Filmlance)" <henrik.cednert(a)filmlance.se> To: Observium <observium(a)observium.org> Subject: Re: [Observium] 1024 TB limit on disks when monitored over SNMP...? Message-ID: <984C9B9C-F27F-4352-AAF5-B3B47A6922E1(a)filmlance.se> Content-Type: text/plain; charset="utf-8" Oh my! Oh yeah! Wow! Thanks! =) Indeed I see it now. Some draw error on graph and possible size error. But size is close enough for me. =) Will investigate the draw error. [cid:17280432-131A-4717-A20D-467E62D55BE0@metronome.local] Many thanks!!! -- Henrik Cednert / + 46 704 71 89 54 / CTO / Filmlance Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ On 7 Nov 2018, at 11:57, Adam Armstrong via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi Henrik, I've made some minor changes to the storage discovery in r9557. These might make this drive appear. It might still have broken sizes though :) adam. On 2018-11-07 09:29:03, Henrik Cednert (Filmlance) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Morning Adam I’m not sure that all data reported in dskTable is correct. I assume that there’s some sort of math that happens since I don’t really get all the numbers to add up. dskPercent for sure seems about right, but not sure about Total, Avail and Used. I did update net-snmp to latest that was available (1:5.5-60.el6 ), but no change in behaviour. df | grep ddnnas0 /dev/ddnnas0 1772965855232 979888488448 793077366784 56% /ddnnas0 snmpwalk -v2c -c ddn4ucommunity localhost dskTable | grep .1 UCD-SNMP-MIB::dskIndex.1 = INTEGER: 1 UCD-SNMP-MIB::dskPath.1 = STRING: /ddnnas0 UCD-SNMP-MIB::dskDevice.1 = STRING: /dev/ddnnas0 UCD-SNMP-MIB::dskMinimum.1 = INTEGER: -1 UCD-SNMP-MIB::dskMinPercent.1 = INTEGER: 3 UCD-SNMP-MIB::dskTotal.1 = INTEGER: 2147483647 UCD-SNMP-MIB::dskAvail.1 = INTEGER: 2147483647 UCD-SNMP-MIB::dskUsed.1 = INTEGER: 2147483647 UCD-SNMP-MIB::dskPercent.1 = INTEGER: 55 UCD-SNMP-MIB::dskPercentNode.1 = INTEGER: 3 UCD-SNMP-MIB::dskTotalLow.1 = Gauge32: 3439329280 UCD-SNMP-MIB::dskTotalHigh.1 = Gauge32: 412 UCD-SNMP-MIB::dskAvailLow.1 = Gauge32: 2803367936 UCD-SNMP-MIB::dskAvailHigh.1 = Gauge32: 184 UCD-SNMP-MIB::dskUsedLow.1 = Gauge32: 635961344 UCD-SNMP-MIB::dskUsedHigh.1 = Gauge32: 228 UCD-SNMP-MIB::dskErrorFlag.1 = INTEGER: noError(0) UCD-SNMP-MIB::dskErrorMsg.1 = STRING: Cheers -- Henrik Cednert / + 46 704 71 89 54 / CTO / Filmlance Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ On 7 Nov 2018, at 08:33, Adam Armstrong via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi Henrik, Can you tell if the data reported in dskTable is correct? We use dskTable to fill in invalid data in hrStorageTable sometimes, but we don't outright collect data from dskTable. I seem to recall this is an issue with ZFS too, and switching to a later version of net-snmp fixes it. There are sadly no 5.8 (or even 5.7) packages for EL6 though (not that I could find!), so you would have to create one. Nothing really depends upon net-snmp, so no real risk in breaking anything! Once upon a time I had 5.6 packages for EL6 floating around from an old requirement, but I seem to have lost them. adam. On 2018-11-06 22:00, Henrik Cednert (Filmlance) via observium wrote: Heya I really wish i was at your level of expertise here Adam, sadly I’m not. =( I googled a bit and walked hrStorageTable and this is the hrStorageDescr from that: HOST-RESOURCES-MIB::hrStorageDescr.1 = STRING: Physical memory HOST-RESOURCES-MIB::hrStorageDescr.3 = STRING: Virtual memory HOST-RESOURCES-MIB::hrStorageDescr.6 = STRING: Memory buffers HOST-RESOURCES-MIB::hrStorageDescr.7 = STRING: Cached memory HOST-RESOURCES-MIB::hrStorageDescr.10 = STRING: Swap space HOST-RESOURCES-MIB::hrStorageDescr.31 = STRING: / HOST-RESOURCES-MIB::hrStorageDescr.35 = STRING: /dev/shm HOST-RESOURCES-MIB::hrStorageDescr.36 = STRING: /boot HOST-RESOURCES-MIB::hrStorageDescr.37 = STRING: /boot-rcvy HOST-RESOURCES-MIB::hrStorageDescr.38 = STRING: /crash HOST-RESOURCES-MIB::hrStorageDescr.39 = STRING: /rcvy HOST-RESOURCES-MIB::hrStorageDescr.40 = STRING: /var HOST-RESOURCES-MIB::hrStorageDescr.41 = STRING: /var-rcvy So no luck there. In diskTable I do see it though: UCD-SNMP-MIB::dskPath.1 = STRING: /ddnnas0 UCD-SNMP-MIB::dskPath.2 = STRING: / So with this, any hints on how to make it work? Or is the first step to update net-snmp? Installed Packages net-snmp.x86_64 1:5.5-54.el6_7.1 @ddn-dvd Cheers and thanks a million -- Henrik Cednert / + 46 704 71 89 54 / CTO / FILMLANCE Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ On 6 Nov 2018, at 22:53, Adam Armstrong via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: We actually use the HOST-RESOURCES-MIB hrStorage table, not the UCD-MIB dskTable. Have you checked what SNMP is sending? You can walk the hrStorageTable and dskTable to see what is returned. I seem to remember some issue with SNMP not picking up "strange" filesystems. Making sure you're running the very latest net-snmp might help. Adam. On 2018-11-06 21:17, Henrik Cednert (Filmlance) via observium wrote: Hello So I got the ‘go ahead’ from DDN to monitor it directly on the server. Strange thing is, I’ve added the mount point to the /etc/snmpd.conf but it still doesn’t appear in observium. I’ve played with the syscontact just to make sure that the snmpd.conf is actually read properly upon discovery and poll, and it is. But it does not seem to take this string from conf: disk /ddnnas0 80% And that is the actual mount point, as seen from ‘mount’ here: /dev/ddnnas0 on /ddnnas0 type gpfs (rw,relatime,mtime,nfssync,dev=ddnnas0) Am i missing something obvious? If so, please be gentle and throw me with great force, and maybe anger, in the right direction. =) Cheers and thanks -- Henrik Cednert / + 46 704 71 89 54 / CTO / FILMLANCE Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ On 23 Oct 2018, at 21:32, Chris Neam via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: We monitor our GPFS system directly from the GridScaler and have been able to monitor up to 2.6PB so far. I'd guess it is something with the way Windows is handling it. On Tue, Oct 23, 2018 at 12:54 PM Henrik Cednert (Filmlance) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hello We just expanded a volume on a DDN GPFS system to over 1 PB. I monitor this volume via SNMP via a Windows server. Noticed that I run into a 1024TB cap on the size there though. Trying to understand where this cap is comping from, if it’s the SNMP on windows or something in observium. Anyone that’ve dealt with this? Cheers and thanks -- Henrik Cednert / + 46 704 71 89 54 / CTO / FILMLANCE Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ DISCLAIMER The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- CHRIS NEAM US Mobile: +1 (703) 628 7897 [1] E-mail: chris.neam(a)vricon.com<mailto:chris.neam@vricon.com> VRICON Visiting address US: 8280 Greensboro Drive, Suite 850, McLean, VA, 22102, USA Sweden: Bröderna Ugglas gata, 581 88 Linköping, Sweden www.vricon.com<http://www.vricon.com/> [1] [2] This e-mail is private and confidential between the sender and the addressee. In the event of misdirection, the recipient is prohibited from using, copying or disseminating it or any information in it. Please notify the above if any misdirection. <Screen Shot 2018-10-23 at 15.29.23.png>_______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium Links: ------ [1] tel:%2B1%20%28703%29%20628%207897 [2] http://www.vricon.com/ _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium DISCLAIMER The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. Links: ------ [1] http://www.vricon.com/ _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 1

One line change to make Teams notifications look good on phone
by Niklas Larsson 12 Nov '18

12 Nov '18

Hi, adding a summary line/item makes Teams notifications look so much better in lists/phone: Index: includes/alerting/teams.inc.php =================================================================== --- includes/alerting/teams.inc.php (revision 9590) +++ includes/alerting/teams.inc.php (working copy) @@ -19,6 +19,7 @@ // JSON data $data_string = json_encode(array( 'title' => $message_tags['TITLE'], + 'summary' => $message_tags['TITLE'], 'text' => ' ', 'sections' => array( array(

2 1

Status boxes expanding all
by Tomasz Karczewski 10 Nov '18

10 Nov '18

HI, It would be nice status boxes expand after click on „more…” Earlier all status boxes were displayed on frontpage. Tomasz Karczewski Administrator Sieci <mailto:tkarczewski@man.olsztyn.pl> tkarczewski(a)man.olsztyn.pl <http://www.man.olsztyn.pl> http://www.man.olsztyn.pl <http://www.uwm.edu.pl> http://www.uwm.edu.pl tel. (89) 523 45 55 fax. (89) 523 43 47 Ośrodek Eksploatacji i Zarządzania Miejską Siecią Komputerową OLMAN w Olsztynie Uniwersytet Warmińsko-Mazurski w Olsztynie

1 0

Changed 'smtp_host' address in config.php isn't being recognized
by Joe Brouillette 09 Nov '18

09 Nov '18

Hey all, we upgraded our Exchange server and now it has a new address. I changed the old address, xxx.xxx.xxx.102 to the new address, xxx.xxx.xxx.105 in config.php and Observium still sees the old address. Nov 6 12:00:19 Observe postfix/smtp[27371]: connect to 192.168.2.102[192.168.2.102]:25: No route to host The new address was also changed in /etc/postfix/main.cf. I've rebooted the server a couple of times but no joy. I must be missing something really simple here but I don't have a clue what it could be. Is there still another location where I need to change my new Exchange server's address? Thanks, Joe Brouillette IT Specialist Link Transit 509.664.7643 jobee(a)linktransit.com<mailto:jobee@linktransit.com> [EmailFooter]

2 2

Intentionally adding a duplicate device
by Jason Lixfeld 09 Nov '18

09 Nov '18

Hello, Previously I was able to add a duplicate entry for a device. At the time, it seemed like the easiest way to work around IOS-XR not being able to pull BGP session information inside a VRF from the default snmp context. Creating a separate SNMP context on the box for the VRF(s) in question, with a different community for each would let the duplicate entries poll the BGP session info from within whatever VRF that context included. Now, when I try to add a duplicate it fails due to pre-existing sysName, snmpEngineID and entPhysicalSerialNum. Is there a way to add duplicates anymore, or perhaps a different way to collect BGP session info from within VRF (in addition to the global table)? Thanks in advance.

2 2

Cisco Firepower (FTD)
by Benjamin Moore 09 Nov '18

09 Nov '18

I saw a thread back a while regarding Cisco Firepower and Observium. I'm currently testing version 6.3 (testing for 6.4 will begin soon) and would be happy to provide anything needed to get the device fully supported in Observium. Always happy to help!

1 0

Status boxes not configured
by Tomasz Karczewski 09 Nov '18

09 Nov '18

After dashboard changes my device status boxes dissapeared. When i try to add status boxes in new way i see „unconfigured module” How to set up this? Tomasz Karczewski Administrator Sieci <mailto:tkarczewski@man.olsztyn.pl> tkarczewski(a)man.olsztyn.pl <http://www.man.olsztyn.pl> http://www.man.olsztyn.pl <http://www.uwm.edu.pl> http://www.uwm.edu.pl tel. (89) 523 45 55 fax. (89) 523 43 47 Ośrodek Eksploatacji i Zarządzania Miejską Siecią Komputerową OLMAN w Olsztynie Uniwersytet Warmińsko-Mazurski w Olsztynie

5 9

Missing Ports
by Tim Schmidt 09 Nov '18

09 Nov '18

I've got a Peplink Balance 310 that I've put into Observium. It reads the device and picks up processor, memory, etc. For the ports though, it is only picking up 2 wan ports and one lan port. There are another 3 lan ports that it is not picking up. Peplink is a newer product for me so I'm not sure if I'm missing something or what. I'm guessing it's something to do with the EtherLike-MIB that is being used. Any help would be appreciated. Thanks! Tim Schmidt

4 5

New Device AKCP SensorProbe2Plus
by Stefan.Immel＠stroeher.de 09 Nov '18

09 Nov '18

We startet to use a SensorProbe2 Plus from AKCP but unfortunatly it is not yet supported by observium. Anybody out there who uses it too and has it implemented? If not, I'm looking for ways to integrate it but unfortunatly I cannot find the right files to do that. Where are the definitions that contain the mappings from sysObjectID to the right OS and MIBS?

2 1

Landing page goes blank if upgraded from 9556 to 9558
by Pieter Meyer 08 Nov '18

08 Nov '18

Hi Adam Below is my landing page on version 9556 After upgrade to 9558 it is just blank? Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map <https://goo.gl/maps/WHe3soT1fHm> | website <http://www.convergedgroup.net/> | company blog <http://www.convergedgroup.net/blog/> | linkedin <http://www.linkedin.com/company/converged-telecoms>

6 10

Contact for Device Type
by noclab 08 Nov '18

08 Nov '18

Hello, Is it possible to add a contact, to get emails only for specific type devices listed under Power? Thanks in advanced Br José

1 0

1024 TB limit on disks when monitored over SNMP...?
by Henrik Cednert (Filmlance) 08 Nov '18

08 Nov '18

Hello We just expanded a volume on a DDN GPFS system to over 1 PB. I monitor this volume via SNMP via a Windows server. Noticed that I run into a 1024TB cap on the size there though. Trying to understand where this cap is comping from, if it’s the SNMP on windows or something in observium. Anyone that’ve dealt with this? Cheers and thanks -- Henrik Cednert / + 46 704 71 89 54 / CTO / Filmlance Disclaimer, the hideous bs disclaimer at the bottom is forced, sorry. ¯\_(ツ)_/¯ Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

4 15

Neighbours
by Christian Eriksson 07 Nov '18

07 Nov '18

Hi Adam https://jira.observium.org/browse/OBS-2809 This seems to have broken something. Not able to filter by device at all now. It show all results regardless Vänliga hälsningar / Best regards, [Advania_Trappa_CMYK] Christian Eriksson System Consultant [cid:image002.png@01D476E4.558EF400]<mailto:christian.eriksson@advania.se>[Advania-Bikupa Facebook]<https://www.facebook.com/advania.se/>[Advania-Bikupa LinkedIn]<https://www.linkedin.com/company/advania-ab/>[Advania-Bikupa Twitter]<https://twitter.com/advania_se> +4641090488<tel:+4641090488> | +46761400400<tel:+46761400400> www.advania.se<http://www.advania.se/> | Stockholm<https://www.google.se/maps/place/Advania+Sverige+AB/@59.3062176,18.0278762,…>

2 5

OS version mismatch in syslog emails
by Ben Chase 07 Nov '18

07 Nov '18

Hi all, I’m getting syslog emails from a particular router (Juniper MX) that reports an older OS version than what is installed. The observium web interface and other email alerts show the correct version as does ’show version’ on the box itself. I’d like to determine if the router is sending bad info or if Observium is reporting old data in this one instance for some reason. Thanks for any help. ---- Version Information Observium 18.11.9556 (6th November 2018) OS Linux 3.10.0-693.21.1.el7.x86_64 [amd64] (CentOS 7) Apache 2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_fcgid/2.3.9 PHP/7.0.29 PHP 7.0.29 (OPcache: ENABLED) Python 2.7.5 MySQL 5.5.56-MariaDB (extension: mysqli 5.5.56-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.6.0 Fping 3.10 (IPv4 only) -- Ben Chase

2 2

SNMP Centos 7 - Traffic flow
by John Morris 07 Nov '18

07 Nov '18

Hi All, I have multiple centos servers which are collecting data in Observium, but it doesn't show network traffic or sensor information? Any ideas? Thanks John Morris Head of Cloud Services Tel: 01978 858512 Web: www.pacetelecom.co.uk<http://www.pacetelecom.co.uk/> Address: Unit 2 Zenith House, Gresford Industrial Park, Wrexham, LL12 8LX [cid:image001.png@01D41F71.F3E93720]<http://www.pacetelecom.co.uk/refer>

2 1

FW: Changed 'smtp_host' address in config.php isn't being recognized
by Joe Brouillette 06 Nov '18

06 Nov '18

Sigh... It just started working. I guess I didn't wait long enough for something's internal timer to kick over. Thanks, Joe Brouillette IT Specialist Link Transit 509.664.7643 jobee(a)linktransit.com<mailto:jobee@linktransit.com> From: Joe Brouillette Sent: Tuesday, November 6, 2018 12:36 PM To: 'Observium' <observium(a)observium.org> Subject: Changed 'smtp_host' address in config.php isn't being recognized Hey all, we upgraded our Exchange server and now it has a new address. I changed the old address, xxx.xxx.xxx.102 to the new address, xxx.xxx.xxx.105 in config.php and Observium still sees the old address. Nov 6 12:00:19 Observe postfix/smtp[27371]: connect to 192.168.2.102[192.168.2.102]:25: No route to host The new address was also changed in /etc/postfix/main.cf. I've rebooted the server a couple of times but no joy. I must be missing something really simple here but I don't have a clue what it could be. Is there still another location where I need to change my new Exchange server's address? Thanks, Joe Brouillette IT Specialist Link Transit 509.664.7643 jobee(a)linktransit.com<mailto:jobee@linktransit.com> [EmailFooter]

3 2

observium 18.10.9550
by Pieter Meyer 06 Nov '18

06 Nov '18

Hi Adam After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating. We also notice that smokeping rrd graphs was still working, Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs. Downgrading to 18.10.9519 resolved all issues Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 <https://goo.gl/maps/WHe3soT1fHm> map | <http://www.convergedgroup.net/> website | <http://www.convergedgroup.net/blog/> company blog | <http://www.linkedin.com/company/converged-telecoms> linkedin CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

2 12

device status
by Eric W. Bates 06 Nov '18

06 Nov '18

I've got a device whose status has changed to 0. How does that happen? How do I revert the status (other than obvious SQL change)? -- Clark 159a, MS 46 508/289-3112

2 2

BGP Prefix Count Graphs
by Robert Williams 06 Nov '18

06 Nov '18

Hi, It's only occasional that we use these particular graphs, so I can't say when it stopped working unfortunately :( As far as I can see, every 'Prefix Count' graphs is broken / non-existent for every platform we have (IOS + IOS-XR). <server>/routing/protocol=bgp/view=graphs/graph=prefixes_ipv4unicast/ [cid:image002.png@01D4751F.0680B040] However, all the 'Update Counters' graphs are OK, for exactly the same neighbours: [cid:image004.jpg@01D4751F.0680B040] A quick check of the RRDs in the device folders shows that anything starting with "cbgp-" appears to contain the neighbour and address-family, rather than a 'numeric' name: [cid:image007.png@01D4751E.6EAFF140] So maybe it should be looking at those? Rather than cbgp-3176.rrd for example? We have recently completed a round of IOS-XR upgrades so I'm not entirely confident this is caused by an issue on the Observium side to be honest! Cheers, Robert Williams Custodian Data Centres https://www.CustodianDC.com

2 2

Monitoring Fortinet firewalls
by Scott Kaiser 06 Nov '18

06 Nov '18

3 2

Frontpage map not zoom
by Tomasz Karczewski 05 Nov '18

05 Nov '18

Hi, After update to latest version frontpage map stopped zooming ($config['frontpage']['map']['zoom'] = '8';). Tomasz Karczewski Administrator Sieci <mailto:tkarczewski@man.olsztyn.pl> tkarczewski(a)man.olsztyn.pl <http://www.man.olsztyn.pl> http://www.man.olsztyn.pl <http://www.uwm.edu.pl> http://www.uwm.edu.pl tel. (89) 523 45 55 fax. (89) 523 43 47 Ośrodek Eksploatacji i Zarządzania Miejską Siecią Komputerową OLMAN w Olsztynie Uniwersytet Warmińsko-Mazurski w Olsztynie

3 4

Cisco Firepower Threat Defense, Version 6.2.3.4 (Build 42), ASA Version 9.9(2)15
by David Jesus Maturano Sanchez 05 Nov '18

05 Nov '18

Hello. I just added new Cisco FTD appliance, but there is no information about CPU, Memory, firewall statistics. And this is how the graphics looks like: [cid:image001.png@01D47501.57E9E370] As far as I know, MIBs has not changed. Would you please let me know if would it be supported? Regards. David.

3 3

Linux distro
by Jason Vanlandingham 05 Nov '18

05 Nov '18

I'm building a new box to replace my ancient Observium server. I'm most comfortable with CentOS, but most of the help docs I've seen appear to be geared toward Ubuntu. Is there a great reason to go Ubuntu over CentOS? Or is there another distro that is better for Observium? I stayed away from Ubuntu because I didn't care for the GUI, but I realized I have probably spent less than a hour per year in the GUI of that machine.

3 2

Cisco C6848 cbQoS
by Svensson Fredrik A 05 Nov '18

05 Nov '18

Hello! We are marking traffic with an input policymap, but in Observium all the classes are named / (input) , we have to guess what class is in what graph. Is there a way to fix this? I Guess its a IOS issue, we are on 15.2(2)SY3. Regards Fredrik

2 1

get Inventory via API
by Henry Möller 05 Nov '18

05 Nov '18

Hello, We trying to get information's about the Inventory from Observium. Mainly we trying to get the Serial Number and the Model Number from observium. This works well for a single switch. But it is not working if we have a stacked switch. In this case we get only the serial number of the stack-master. Is there a way to get all the information's that are listed on the inventory via API? [cid:image001.jpg@01D474E6.70D7D4C0] Best Regards Henry Möller ------------------------------------------------------------ Phone: +49 30 520 041 698 Fax: +49 30 520 041 699 Mail: Henry.Moeller(a)pinguin.ag ------------------------------------------------------------ Phone: +49.30.30 36 63 366 Fax: +49.30.30 36 63 367 E-Mail: info(a)pinguin.ag<mailto:info@pinguin.ag> www.pinguin.ag<http://www.pinguin.ag> ------------------------------------------------------------ [cid:pinguin.ag_f1f2f94b-4088-4a1c-afba-e73816a444e1.png] Pinguin AG Hauptstraße 8 | 10827 Berlin | Germany USt-ID: DE240701807 Sitz der Gesellschaft: Berlin-Schöneberg, AG Berlin-Charlottenburg, HRB 101380 B Vorstand: Roland Becker, Aufsichtsratsvorsitzender: Clemens C. Vogelsberg

3 3

fs.com device support
by Pieter Meyer 02 Nov '18

02 Nov '18

HI Adam Can you please add support for devices from fs.com https://www.fs.com/products/72945.html https://www.fs.com/products/29127.html https://www.fs.com/products/73467.html https://www.fs.com/products/29122.html https://www.fs.com/products/29123.html Regards Pieter Meyer

1 0

'rrdcached' Config Issue
by Gordon Cheng (gocheng) 02 Nov '18

02 Nov '18

Hi all, In an attempt to improve the performance (previous email thread with subject Performance Issue - High CPU with 'mysqld'?), I'm trying to use 'rrdcached' on a new setup (version 18.9.9428 (9th September 2018) with the following configuration: === sjc-observium-1:/etc/init.d# cat rrdcached <...snipped...> # Path to the apachectl script, server binary, and short-form for messages. rrdcached=/usr/sbin/rrdcached prog=rrdcached pidfile=/var/run/rrdcached/rrdcached.pid sockfile=/var/run/rrdcached/rrdcached.sock lockfile=/var/lock/subsys/rrdcached RETVAL=0 <...snipped...> - sjc-observium-1:/etc/sysconfig# cat rrdcached <...snipped...> RRDCACHED_USER="apache" OPTIONS="-w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B" SOCKPERMS=0660 <...snipped...> - sjc-observium-1:/usr/lib/tmpfiles.d# cat rrdcached.conf d /run/rrdcached - apache apache sjc-observium-1:/usr/lib/tmpfiles.d# - sjc-observium-1:/opt/observium# grep rrd config.php //rrdcached #$config['rrdcached'] = "unix:/var/run/rrdcached/rrdcached.sock"; <<<====== will un-comment once rrdcached is configured and running sjc-observium-1:/opt/observium# - sjc-observium-1:/root# service rrdcached stop Stopping rrdcached (via systemctl): [ OK ] sjc-observium-1:/root# service rrdcached start Starting rrdcached (via systemctl): Job for rrdcached.service failed because a timeout was exceeded. See "systemctl status rrdcached.service" and "journalctl -xe" for details. [FAILED] sjc-observium-1:/root# - sjc-observium-1:/opt/observium# systemctl status rrdcached.service -l ● rrdcached.service - SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file Loaded: loaded (/etc/rc.d/init.d/rrdcached; bad; vendor preset: disabled) Active: failed (Result: timeout) since Wed 2018-10-31 16:39:48 PDT; 11min ago Docs: man:systemd-sysv-generator(8) Process: 2449 ExecStart=/etc/rc.d/init.d/rrdcached start (code=exited, status=0/SUCCESS) CGroup: /system.slice/rrdcached.service └─2453 /usr/sbin/rrdcached -w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B -p /var/run/rrdcached/rrdcached.pid -l /var/run/rrdcached/rrdcached.sock Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd: illegal attempt to update using time 1541024231 when last update time is 1541028534 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd: illegal attempt to update using time 1541024224 when last update time is 1541028525 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd: illegal attempt to update using time 1541024165 when last update time is 1541028466 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd: illegal attempt to update using time 1541024166 when last update time is 1541028467 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd: illegal attempt to update using time 1541024223 when last update time is 1541028524 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd: illegal attempt to update using time 1541024147 when last update time is 1541028719 (minimum one second step)) Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service start operation timed out. Terminating. Oct 31 16:39:48 sjc-observium-1 systemd[1]: Failed to start SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file. Oct 31 16:39:48 sjc-observium-1 systemd[1]: Unit rrdcached.service entered failed state. Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service failed. sjc-observium-1:/opt/observium# === Any suggestions or docs/links showing how it can be resolved? Thanks. - Gordon

2 4

Sensor issues since approx November 1st
by Anthony Somerset 02 Nov '18

02 Nov '18

Hi There I’m running a test bed of observium at home seperately of our main installation - i had previously written a very basic observium agent module that polls current power usage for a home monitoring sensor and outputs it, and then a custom polling module that reads this data and basically graphs it as a power sensor under a device (https://gist.github.com/anthonysomerset/3860b7a3b650d8bbbf53faac2d5eeab5 <https://gist.github.com/anthonysomerset/3860b7a3b650d8bbbf53faac2d5eeab5>) the unix-agent is working same as before but since i updated overnight on 1st november the graph has disappeared and my event log is filled up with sensor added events: also under the device itself the sensor is saying deleted around 5 days ago (2018-10-27 00:01:04) this looks like immediately after it updated on that day (looks like last commit on that day was 9517) any thoughts on how i need to fix? Kind regards, Anthony Somerset Somerset Technical Solutions Ltd. www.somersettechsolutions.co.uk Registered in the UK – Company no. 07738444 VAT Registration No: 140 6916 22 T: +44 (0) 33 0088 2751 E: anthony(a)somersettechsolutions.co.uk PGP: 0x7C892BF5

2 2

Observium Syslog issues
by David Rossi 01 Nov '18

01 Nov '18

I have an installation of Observium that has been up and running perfectly for about 18 months. Last Friday I ran updates and now syslog is no longer working. I have found that prior to the upgrade, rsyslog was version 7, now I am at Version 8. In searching I found that a few configuration file changes, I did those, and still a no go. Has anyone else come across this? I am a novice at Linux, and totally at a loss here. I can do a tcpdump and sure enough the syslog messages are hitting the server, but not displayed within Observium. Any help would be appreciated, but, please keep in mind I am a Centos novice. Dave Rossi.

4 11

Juniper
by Christian Eriksson 01 Nov '18

01 Nov '18

Hi, I have some MX104 routers and now there is a firewall button with some empty graphs. What is the meaning of this? :) [cid:image001.png@01D471D0.1A58CAF0] Regards Christian

2 1

Auto install script
by Scott L. Kaiser 31 Oct '18

31 Oct '18

2 1

New Device AKCP SensorProbe2Plus
by Stefan.Immel＠stroeher.de 31 Oct '18

31 Oct '18

We startet to use a SensorProbe2 Plus from AKCP but unfortunatly it is not yet supported by observium. Anybody out there who uses it too and has it implemented? If not, I'm looking for ways to integrate it but unfortunatly I cannot find the right files to do that. Where are the definitions that contain the mappings from sysObjectID to the right OS and MIBS?

1 0

Support for Dell Storage (Compellent)
by Thomas Stather 31 Oct '18

31 Oct '18

Hi I am using the professional edition of Observium and was wondering, if it supports Dell storage arrays. I am particularly interested in the Dell Compellent series as i have 2 of them in production. I have the official Dell MIBS ()MIB2014.01.29) and im willing to help if not implemented. Thanks in advance :) Best, Thomas -- Thomas Stather IT Services VCP4, VCP6-DCV, VCP6.5-DCV Tel: +49 6221-486 628 Fax: +49 6221-486 561 ------------------------------------------------------------------------ Max Planck Institute for Medical Research (MPImF) Jahnstrasse 29, 69120 Heidelberg Germany

2 1

Re: [Observium] Performance Issue - High CPU with 'mysqld'?
by Gordon Cheng (gocheng) 31 Oct '18

31 Oct '18

Thanks all. Yes, it's a new set up and a lot of new devices were added about 4 weeks ago. An update here. We just have the number of Cores increased from 4 to 16, and looks like there has been improvement in terms of performance now. But there is a new issue observed. Quite frequently (~1 out of 4 times), Observium is responding HTTP response code 500 with blank page when logging in, or when clicking around after login. Any thoughts or suggestions on this? Here are the logs when it happens: /opt/observium/logs/access_log: 171.68.241.12 - - [30/Oct/2018:21:29:53 -0700] "GET / HTTP/1.1" 500 1728 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:63.0) Gecko/20100101 Firefox/63.0" /opt/observium/logs/error_log: [Tue Oct 30 21:29:54.329931 2018] [:error] [pid 21511] [client 171.68.241.12:54771] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 135168 bytes) in /opt/observium/includes/db/mysqli.inc.php on line 316 [cid:image001.png@01D47099.AD6D0FA0] Thanks. - Gordon From: observium <observium-bounces(a)observium.org> on behalf of Mike Stupalov via observium <observium(a)observium.org> Reply-To: Observium <observium(a)observium.org> Date: Sunday, October 28, 2018 at 4:09 AM To: Observium <observium(a)observium.org> Cc: Mike Stupalov <mike(a)observium.org> Subject: Re: [Observium] Performance Issue - High CPU with 'mysqld'? Simon Mousey Smith via observium wrote on 27/10/2018 23:55: Hi Gordon I think from what I can see from the pics, the 3rd graph along, bottom row It looks like about 3-4 weeks ago its JUMPED UP in the wrapper processing times which means its taking too long to execute on each device or the main server As I see, 4 weeks ago added many new devices. It's not should be big trouble, but seems as need more optimizations, like: - use rrdcached - switch to SSD disks for such number of devices - RRDs and DB must use faster disks, SSD is mandatory for you. Did you change any configs then? Any updates to hardware, software, etc? Have u also tried the latest stable ? 9472 Have u also tried doing /opt/observium/poller.php -h gz-core01 -dd to see where it might be getting stuck? Regards Simon On 26 Oct 2018, at 03:15, Gordon Cheng (gocheng) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Thanks Adam. Our pollerlog pages are below. Should we still try to disable fdb-table as suggested? If so, any docs we can follow to disable it? Any other thoughts or suggestions? Thanks. - Gordon <image001.png> <image002.png> <image003.png> From: observium <observium-bounces(a)observium.org<mailto:observium-bounces@observium.org>> on behalf of Adam Armstrong via observium <observium(a)observium.org<mailto:observium@observium.org>> Reply-To: Observium <observium(a)observium.org<mailto:observium@observium.org>> Date: Tuesday, October 23, 2018 at 12:50 PM To: Chris Neam via observium <observium(a)observium.org<mailto:observium@observium.org>> Cc: Adam Armstrong <adama(a)memetic.org<mailto:adama@memetic.org>> Subject: Re: [Observium] Performance Issue - High CPU with 'mysqld'? Hi, You probably (definitely) need more cores and/or more I/O throughput capacity. It's likely that you have multiple overlapping poller_wrapper processes running because they can't finish quickly enough. what do the graphs on this page look like? http://dev.observium.org/pollerlog/ and what are the slowest devices on this : http://dev.observium.org/pollerlog/view=devices/ You may be able to disable a module or two you don't care about that's taking time : http://dev.observium.org/pollerlog/view=modules/ fdb-table is usually a good candidate. adam. On 2018-10-23 19:54:32, Gordon Cheng (gocheng) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi all, I have a new Observium setup (verion 18.9.9428 (9th September 2018)) with the following VM spec: Cores 4 Memory 64GB HD 500GB CentOS 7 PHP 7.0.31 MySQL 5.5.60-MariaDB and with the following network devices to be monitored: Devices - 634 (total), 597 (up), 37 (down) Ports - 58,032 (total), 27,664 (up), 19,967 (down) Sensors - 47,639 (total), 43,243 (ok), 4,396 (down) Statuses - 5,880 (total), 5,854 (ok), 10 (alert) --- Issue is that we are frequently seeing the following error when connecting on GUI/CLI, with slow response time on GUI/CLI: DB Error 1040: Too many connections And we are seeing gaps (broken graphs) like the following: [cid:image001.png@01D46AC5.2F7A6900] We have tried to bump up the number of 'max_connections' from original 151 to 500 and then 200, but it didn't help: sjc-observium-1:/etc# grep max_conn my.cnf max_connections=200 sjc-observium-1:/etc# And it's observed that the CPU load is heavy with 'mysqld': top - 09:36:17 up 35 days, 18:54, 2 users, load average: 74.18, 89.49, 82.67 Tasks: 665 total, 79 running, 586 sleeping, 0 stopped, 0 zombie %Cpu(s): 62.9 us, 36.9 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st KiB Mem : 65810376 total, 2511836 free, 5989292 used, 57309248 buff/cache KiB Swap: 4193020 total, 4141016 free, 52004 used. 59172312 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5152 mysql 20 0 2749132 664216<tel:0%202749132%20664216> 9164 S 20.7 1.0 4058:17 mysqld 31879 root 20 0 419676 27564 8264 R 4.2 0.0 0:00.13 php 31769 root 20 0 417212 25532 8336 S 3.6 0.0 0:00.12 php 31933 root 20 0 416868 25116 8148 S 3.2 0.0 0:00.10 php 31935 root 20 0 416736 24700 7832 S 3.2 0.0 0:00.10 php <snip> My 'config.php' is pretty much with default values. --- I'm new to Observium. It'd be greatly appreciated if someone can shed some light how it can be resolved. Thanks. - Gordon _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- Mike Stupalov Observium Limited, http://observium.org

2 1

Observium PRO - Last Update
by Serghei Golipad 30 Oct '18

30 Oct '18

Guys, has anyone updated to latest rolling? Now getting the following: Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator at [no address given] to inform them of the time this error occurred, and the actions you performed just before this error. More information about this error may be available in the server error log. PLEASE CONSIDER THE ENVIRONMENT BEFORE PRINTING THIS EMAIL. CDW Limited is a Company registered in England and Wales. This email is sent for and on behalf of CDW Finance Holdings Limited. CDW Finance Holdings Limited is the UK holding company for CDW Limited trading as CDW. The registered office for CDW Finance Holdings Limited (Company Number 05872067) and its UK group undertakings is 10 Fleet Place, London, EC4M 7RB. VAT Registration 902 1949 39. Confidentiality: This e-mail contains proprietary information, some or all of which may be confidential and/or legally privileged. It is for the intended recipient only. If an addressing or transmission error has misdirected this e-mail, please notify the author by replying to this e-mail and then delete the original. If you are not the intended recipient you may not use, disclose, distribute, copy, print or rely on any information contained in this e-mail. You must not inform any other person other than CDW or the sender of its existence. For more information about CDW please visit www.uk.cdw.com

2 1

Performance Issue - High CPU with 'mysqld'?
by Gordon Cheng (gocheng) 26 Oct '18

26 Oct '18

Hi all, I have a new Observium setup (verion 18.9.9428 (9th September 2018)) with the following VM spec: Cores 4 Memory 64GB HD 500GB CentOS 7 PHP 7.0.31 MySQL 5.5.60-MariaDB and with the following network devices to be monitored: Devices - 634 (total), 597 (up), 37 (down) Ports - 58,032 (total), 27,664 (up), 19,967 (down) Sensors - 47,639 (total), 43,243 (ok), 4,396 (down) Statuses - 5,880 (total), 5,854 (ok), 10 (alert) --- Issue is that we are frequently seeing the following error when connecting on GUI/CLI, with slow response time on GUI/CLI: DB Error 1040: Too many connections And we are seeing gaps (broken graphs) like the following: [cid:image001.png@01D46AC5.2F7A6900] We have tried to bump up the number of 'max_connections' from original 151 to 500 and then 200, but it didn't help: sjc-observium-1:/etc# grep max_conn my.cnf max_connections=200 sjc-observium-1:/etc# And it's observed that the CPU load is heavy with 'mysqld': top - 09:36:17 up 35 days, 18:54, 2 users, load average: 74.18, 89.49, 82.67 Tasks: 665 total, 79 running, 586 sleeping, 0 stopped, 0 zombie %Cpu(s): 62.9 us, 36.9 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st KiB Mem : 65810376 total, 2511836 free, 5989292 used, 57309248 buff/cache KiB Swap: 4193020 total, 4141016 free, 52004 used. 59172312 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5152 mysql 20 0 2749132 664216 9164 S 20.7 1.0 4058:17 mysqld 31879 root 20 0 419676 27564 8264 R 4.2 0.0 0:00.13 php 31769 root 20 0 417212 25532 8336 S 3.6 0.0 0:00.12 php 31933 root 20 0 416868 25116 8148 S 3.2 0.0 0:00.10 php 31935 root 20 0 416736 24700 7832 S 3.2 0.0 0:00.10 php <snip> My 'config.php' is pretty much with default values. --- I'm new to Observium. It'd be greatly appreciated if someone can shed some light how it can be resolved. Thanks. - Gordon

2 2

DB and Polling issues after upgrading to r9505
by Christopher Smith 25 Oct '18

25 Oct '18

We had many devices not set to the correct location due to https://jira.observium.org/browse/OBS-2767 Updated to r9505 and after doing so we reset the geo location via web interface (device properties -> Geolocation -> Reset GEO location) On any device that this was done to it seems like they do not exist to the poller any longer, none have been polled since the above action was taken. I based this info from the Per Device stats in the Pollerlog section (all of the devices that had their geo location reset were last polled 5+ hours ago, everything else that was not touched are being polled as expected every 5 minutes) I see these errors in the db.log file, they appear to have shown up when the Reset GEO location operation was done on each device: [2018/10/24 14:48:43 -0400] index.php(4115): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:49:44 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:23 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:57 -0400] index.php(44932): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:51:28 -0400] index.php(25685): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:52:29 -0400] index.php(25888): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? Observium system info: Observium 18.10.9505 (24th October 2018) OS Linux 3.10.0-862.3.3.el7.x86_64 [amd64] (CentOS 7) Apache 2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.0.31 PHP 7.0.31 (OPcache: ENABLED) Python 2.7.5 MySQL 5.5.56-MariaDB (extension: mysqli 5.5.56-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.6.0 Fping 3.10 (IPv4 only)

2 2

Update - Port descripton changed ( possible bug or ... )
by Sigurður Hannesson 23 Oct '18

23 Oct '18

Hi, just updated Version Information Observium 18.10.9472 (16th October 2018) OS Linux 4.9.0-3-amd64 [amd64] (Debian 9.1) Apache 2.4.25 (Debian) PHP 7.0.19-1 (OPcache: ENABLED) Python 2.7.13 MySQL 10.1.23-MariaDB-9+deb9u1 (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.6.0 Fping 3.15 (IPv4 and IPv6) . Noticed that most of my port groups had 0 ports in them. Looking at the port description they had changed deviceA 1/1/3<http://172.24.41.34/device/device=31/tab=port/port=5230/> \AKRA-3 No1\ instead of AKRA-3 No1 this of course means that all my port groups are not matching the criteria. br., SH

1 0