- observium - lists.observium.org

SNMP Centos 7 - Traffic flow
by John Morris 07 Nov '18

07 Nov '18

Hi All, I have multiple centos servers which are collecting data in Observium, but it doesn't show network traffic or sensor information? Any ideas? Thanks John Morris Head of Cloud Services Tel: 01978 858512 Web: www.pacetelecom.co.uk<http://www.pacetelecom.co.uk/> Address: Unit 2 Zenith House, Gresford Industrial Park, Wrexham, LL12 8LX [cid:image001.png@01D41F71.F3E93720]<http://www.pacetelecom.co.uk/refer>

2 1

FW: Changed 'smtp_host' address in config.php isn't being recognized
by Joe Brouillette 06 Nov '18

06 Nov '18

Sigh... It just started working. I guess I didn't wait long enough for something's internal timer to kick over. Thanks, Joe Brouillette IT Specialist Link Transit 509.664.7643 jobee(a)linktransit.com<mailto:jobee@linktransit.com> From: Joe Brouillette Sent: Tuesday, November 6, 2018 12:36 PM To: 'Observium' <observium(a)observium.org> Subject: Changed 'smtp_host' address in config.php isn't being recognized Hey all, we upgraded our Exchange server and now it has a new address. I changed the old address, xxx.xxx.xxx.102 to the new address, xxx.xxx.xxx.105 in config.php and Observium still sees the old address. Nov 6 12:00:19 Observe postfix/smtp[27371]: connect to 192.168.2.102[192.168.2.102]:25: No route to host The new address was also changed in /etc/postfix/main.cf. I've rebooted the server a couple of times but no joy. I must be missing something really simple here but I don't have a clue what it could be. Is there still another location where I need to change my new Exchange server's address? Thanks, Joe Brouillette IT Specialist Link Transit 509.664.7643 jobee(a)linktransit.com<mailto:jobee@linktransit.com> [EmailFooter]

3 2

observium 18.10.9550
by Pieter Meyer 06 Nov '18

06 Nov '18

Hi Adam After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating. We also notice that smokeping rrd graphs was still working, Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs. Downgrading to 18.10.9519 resolved all issues Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 <https://goo.gl/maps/WHe3soT1fHm> map | <http://www.convergedgroup.net/> website | <http://www.convergedgroup.net/blog/> company blog | <http://www.linkedin.com/company/converged-telecoms> linkedin CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

2 12

device status
by Eric W. Bates 06 Nov '18

06 Nov '18

I've got a device whose status has changed to 0. How does that happen? How do I revert the status (other than obvious SQL change)? -- Clark 159a, MS 46 508/289-3112

2 2

BGP Prefix Count Graphs
by Robert Williams 06 Nov '18

06 Nov '18

Hi, It's only occasional that we use these particular graphs, so I can't say when it stopped working unfortunately :( As far as I can see, every 'Prefix Count' graphs is broken / non-existent for every platform we have (IOS + IOS-XR). <server>/routing/protocol=bgp/view=graphs/graph=prefixes_ipv4unicast/ [cid:image002.png@01D4751F.0680B040] However, all the 'Update Counters' graphs are OK, for exactly the same neighbours: [cid:image004.jpg@01D4751F.0680B040] A quick check of the RRDs in the device folders shows that anything starting with "cbgp-" appears to contain the neighbour and address-family, rather than a 'numeric' name: [cid:image007.png@01D4751E.6EAFF140] So maybe it should be looking at those? Rather than cbgp-3176.rrd for example? We have recently completed a round of IOS-XR upgrades so I'm not entirely confident this is caused by an issue on the Observium side to be honest! Cheers, Robert Williams Custodian Data Centres https://www.CustodianDC.com

2 2

Monitoring Fortinet firewalls
by Scott Kaiser 06 Nov '18

06 Nov '18

3 2

Frontpage map not zoom
by Tomasz Karczewski 05 Nov '18

05 Nov '18

Hi, After update to latest version frontpage map stopped zooming ($config['frontpage']['map']['zoom'] = '8';). Tomasz Karczewski Administrator Sieci <mailto:tkarczewski@man.olsztyn.pl> tkarczewski(a)man.olsztyn.pl <http://www.man.olsztyn.pl> http://www.man.olsztyn.pl <http://www.uwm.edu.pl> http://www.uwm.edu.pl tel. (89) 523 45 55 fax. (89) 523 43 47 Ośrodek Eksploatacji i Zarządzania Miejską Siecią Komputerową OLMAN w Olsztynie Uniwersytet Warmińsko-Mazurski w Olsztynie

3 4

Cisco Firepower Threat Defense, Version 6.2.3.4 (Build 42), ASA Version 9.9(2)15
by David Jesus Maturano Sanchez 05 Nov '18

05 Nov '18

Hello. I just added new Cisco FTD appliance, but there is no information about CPU, Memory, firewall statistics. And this is how the graphics looks like: [cid:image001.png@01D47501.57E9E370] As far as I know, MIBs has not changed. Would you please let me know if would it be supported? Regards. David.

3 3

Linux distro
by Jason Vanlandingham 05 Nov '18

05 Nov '18

I'm building a new box to replace my ancient Observium server. I'm most comfortable with CentOS, but most of the help docs I've seen appear to be geared toward Ubuntu. Is there a great reason to go Ubuntu over CentOS? Or is there another distro that is better for Observium? I stayed away from Ubuntu because I didn't care for the GUI, but I realized I have probably spent less than a hour per year in the GUI of that machine.

3 2

Cisco C6848 cbQoS
by Svensson Fredrik A 05 Nov '18

05 Nov '18

Hello! We are marking traffic with an input policymap, but in Observium all the classes are named / (input) , we have to guess what class is in what graph. Is there a way to fix this? I Guess its a IOS issue, we are on 15.2(2)SY3. Regards Fredrik

2 1

get Inventory via API
by Henry Möller 05 Nov '18

05 Nov '18

Hello, We trying to get information's about the Inventory from Observium. Mainly we trying to get the Serial Number and the Model Number from observium. This works well for a single switch. But it is not working if we have a stacked switch. In this case we get only the serial number of the stack-master. Is there a way to get all the information's that are listed on the inventory via API? [cid:image001.jpg@01D474E6.70D7D4C0] Best Regards Henry Möller ------------------------------------------------------------ Phone: +49 30 520 041 698 Fax: +49 30 520 041 699 Mail: Henry.Moeller(a)pinguin.ag ------------------------------------------------------------ Phone: +49.30.30 36 63 366 Fax: +49.30.30 36 63 367 E-Mail: info(a)pinguin.ag<mailto:info@pinguin.ag> www.pinguin.ag<http://www.pinguin.ag> ------------------------------------------------------------ [cid:pinguin.ag_f1f2f94b-4088-4a1c-afba-e73816a444e1.png] Pinguin AG Hauptstraße 8 | 10827 Berlin | Germany USt-ID: DE240701807 Sitz der Gesellschaft: Berlin-Schöneberg, AG Berlin-Charlottenburg, HRB 101380 B Vorstand: Roland Becker, Aufsichtsratsvorsitzender: Clemens C. Vogelsberg

3 3

fs.com device support
by Pieter Meyer 02 Nov '18

02 Nov '18

HI Adam Can you please add support for devices from fs.com https://www.fs.com/products/72945.html https://www.fs.com/products/29127.html https://www.fs.com/products/73467.html https://www.fs.com/products/29122.html https://www.fs.com/products/29123.html Regards Pieter Meyer

1 0

'rrdcached' Config Issue
by Gordon Cheng (gocheng) 02 Nov '18

02 Nov '18

Hi all, In an attempt to improve the performance (previous email thread with subject Performance Issue - High CPU with 'mysqld'?), I'm trying to use 'rrdcached' on a new setup (version 18.9.9428 (9th September 2018) with the following configuration: === sjc-observium-1:/etc/init.d# cat rrdcached <...snipped...> # Path to the apachectl script, server binary, and short-form for messages. rrdcached=/usr/sbin/rrdcached prog=rrdcached pidfile=/var/run/rrdcached/rrdcached.pid sockfile=/var/run/rrdcached/rrdcached.sock lockfile=/var/lock/subsys/rrdcached RETVAL=0 <...snipped...> - sjc-observium-1:/etc/sysconfig# cat rrdcached <...snipped...> RRDCACHED_USER="apache" OPTIONS="-w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B" SOCKPERMS=0660 <...snipped...> - sjc-observium-1:/usr/lib/tmpfiles.d# cat rrdcached.conf d /run/rrdcached - apache apache sjc-observium-1:/usr/lib/tmpfiles.d# - sjc-observium-1:/opt/observium# grep rrd config.php //rrdcached #$config['rrdcached'] = "unix:/var/run/rrdcached/rrdcached.sock"; <<<====== will un-comment once rrdcached is configured and running sjc-observium-1:/opt/observium# - sjc-observium-1:/root# service rrdcached stop Stopping rrdcached (via systemctl): [ OK ] sjc-observium-1:/root# service rrdcached start Starting rrdcached (via systemctl): Job for rrdcached.service failed because a timeout was exceeded. See "systemctl status rrdcached.service" and "journalctl -xe" for details. [FAILED] sjc-observium-1:/root# - sjc-observium-1:/opt/observium# systemctl status rrdcached.service -l ● rrdcached.service - SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file Loaded: loaded (/etc/rc.d/init.d/rrdcached; bad; vendor preset: disabled) Active: failed (Result: timeout) since Wed 2018-10-31 16:39:48 PDT; 11min ago Docs: man:systemd-sysv-generator(8) Process: 2449 ExecStart=/etc/rc.d/init.d/rrdcached start (code=exited, status=0/SUCCESS) CGroup: /system.slice/rrdcached.service └─2453 /usr/sbin/rrdcached -w 1800 -z 1800 -f 3600 -s apache -l unix:/var/run/rrdcached/rrdcached.sock -j /var/tmp -m 664 -F -b /opt/observium/rrd -B -p /var/run/rrdcached/rrdcached.pid -l /var/run/rrdcached/rrdcached.sock Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-fdb-table.rrd: illegal attempt to update using time 1541024231 when last update time is 1541028534 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-entity-physical.rrd: illegal attempt to update using time 1541024224 when last update time is 1541028525 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-hr-mib.rrd: illegal attempt to update using time 1541024165 when last update time is 1541028466 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-ipSystemStats.rrd: illegal attempt to update using time 1541024166 when last update time is 1541028467 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-loadbalancer.rrd: illegal attempt to update using time 1541024223 when last update time is 1541028524 (minimum one second step)) Oct 31 16:34:51 sjc-observium-1 rrdcached[2453]: queue_thread_main: rrd_update_r (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd) failed with status -1. (/opt/observium/rrd/aan-oob01/perf-pollermodule-mempools.rrd: illegal attempt to update using time 1541024147 when last update time is 1541028719 (minimum one second step)) Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service start operation timed out. Terminating. Oct 31 16:39:48 sjc-observium-1 systemd[1]: Failed to start SYSV: rrdcached is a daemon that receives updates to existing rrd files, accumulates them, and writes updates to file. Oct 31 16:39:48 sjc-observium-1 systemd[1]: Unit rrdcached.service entered failed state. Oct 31 16:39:48 sjc-observium-1 systemd[1]: rrdcached.service failed. sjc-observium-1:/opt/observium# === Any suggestions or docs/links showing how it can be resolved? Thanks. - Gordon

2 4

Sensor issues since approx November 1st
by Anthony Somerset 02 Nov '18

02 Nov '18

Hi There I’m running a test bed of observium at home seperately of our main installation - i had previously written a very basic observium agent module that polls current power usage for a home monitoring sensor and outputs it, and then a custom polling module that reads this data and basically graphs it as a power sensor under a device (https://gist.github.com/anthonysomerset/3860b7a3b650d8bbbf53faac2d5eeab5 <https://gist.github.com/anthonysomerset/3860b7a3b650d8bbbf53faac2d5eeab5>) the unix-agent is working same as before but since i updated overnight on 1st november the graph has disappeared and my event log is filled up with sensor added events: also under the device itself the sensor is saying deleted around 5 days ago (2018-10-27 00:01:04) this looks like immediately after it updated on that day (looks like last commit on that day was 9517) any thoughts on how i need to fix? Kind regards, Anthony Somerset Somerset Technical Solutions Ltd. www.somersettechsolutions.co.uk Registered in the UK – Company no. 07738444 VAT Registration No: 140 6916 22 T: +44 (0) 33 0088 2751 E: anthony(a)somersettechsolutions.co.uk PGP: 0x7C892BF5

2 2

Observium Syslog issues
by David Rossi 01 Nov '18

01 Nov '18

I have an installation of Observium that has been up and running perfectly for about 18 months. Last Friday I ran updates and now syslog is no longer working. I have found that prior to the upgrade, rsyslog was version 7, now I am at Version 8. In searching I found that a few configuration file changes, I did those, and still a no go. Has anyone else come across this? I am a novice at Linux, and totally at a loss here. I can do a tcpdump and sure enough the syslog messages are hitting the server, but not displayed within Observium. Any help would be appreciated, but, please keep in mind I am a Centos novice. Dave Rossi.

4 11

Juniper
by Christian Eriksson 01 Nov '18

01 Nov '18

Hi, I have some MX104 routers and now there is a firewall button with some empty graphs. What is the meaning of this? :) [cid:image001.png@01D471D0.1A58CAF0] Regards Christian

2 1

Auto install script
by Scott L. Kaiser 31 Oct '18

31 Oct '18

2 1

New Device AKCP SensorProbe2Plus
by Stefan.Immel＠stroeher.de 31 Oct '18

31 Oct '18

We startet to use a SensorProbe2 Plus from AKCP but unfortunatly it is not yet supported by observium. Anybody out there who uses it too and has it implemented? If not, I'm looking for ways to integrate it but unfortunatly I cannot find the right files to do that. Where are the definitions that contain the mappings from sysObjectID to the right OS and MIBS?

1 0

Support for Dell Storage (Compellent)
by Thomas Stather 31 Oct '18

31 Oct '18

Hi I am using the professional edition of Observium and was wondering, if it supports Dell storage arrays. I am particularly interested in the Dell Compellent series as i have 2 of them in production. I have the official Dell MIBS ()MIB2014.01.29) and im willing to help if not implemented. Thanks in advance :) Best, Thomas -- Thomas Stather IT Services VCP4, VCP6-DCV, VCP6.5-DCV Tel: +49 6221-486 628 Fax: +49 6221-486 561 ------------------------------------------------------------------------ Max Planck Institute for Medical Research (MPImF) Jahnstrasse 29, 69120 Heidelberg Germany

2 1

Re: [Observium] Performance Issue - High CPU with 'mysqld'?
by Gordon Cheng (gocheng) 31 Oct '18

31 Oct '18

Thanks all. Yes, it's a new set up and a lot of new devices were added about 4 weeks ago. An update here. We just have the number of Cores increased from 4 to 16, and looks like there has been improvement in terms of performance now. But there is a new issue observed. Quite frequently (~1 out of 4 times), Observium is responding HTTP response code 500 with blank page when logging in, or when clicking around after login. Any thoughts or suggestions on this? Here are the logs when it happens: /opt/observium/logs/access_log: 171.68.241.12 - - [30/Oct/2018:21:29:53 -0700] "GET / HTTP/1.1" 500 1728 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:63.0) Gecko/20100101 Firefox/63.0" /opt/observium/logs/error_log: [Tue Oct 30 21:29:54.329931 2018] [:error] [pid 21511] [client 171.68.241.12:54771] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 135168 bytes) in /opt/observium/includes/db/mysqli.inc.php on line 316 [cid:image001.png@01D47099.AD6D0FA0] Thanks. - Gordon From: observium <observium-bounces(a)observium.org> on behalf of Mike Stupalov via observium <observium(a)observium.org> Reply-To: Observium <observium(a)observium.org> Date: Sunday, October 28, 2018 at 4:09 AM To: Observium <observium(a)observium.org> Cc: Mike Stupalov <mike(a)observium.org> Subject: Re: [Observium] Performance Issue - High CPU with 'mysqld'? Simon Mousey Smith via observium wrote on 27/10/2018 23:55: Hi Gordon I think from what I can see from the pics, the 3rd graph along, bottom row It looks like about 3-4 weeks ago its JUMPED UP in the wrapper processing times which means its taking too long to execute on each device or the main server As I see, 4 weeks ago added many new devices. It's not should be big trouble, but seems as need more optimizations, like: - use rrdcached - switch to SSD disks for such number of devices - RRDs and DB must use faster disks, SSD is mandatory for you. Did you change any configs then? Any updates to hardware, software, etc? Have u also tried the latest stable ? 9472 Have u also tried doing /opt/observium/poller.php -h gz-core01 -dd to see where it might be getting stuck? Regards Simon On 26 Oct 2018, at 03:15, Gordon Cheng (gocheng) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Thanks Adam. Our pollerlog pages are below. Should we still try to disable fdb-table as suggested? If so, any docs we can follow to disable it? Any other thoughts or suggestions? Thanks. - Gordon <image001.png> <image002.png> <image003.png> From: observium <observium-bounces(a)observium.org<mailto:observium-bounces@observium.org>> on behalf of Adam Armstrong via observium <observium(a)observium.org<mailto:observium@observium.org>> Reply-To: Observium <observium(a)observium.org<mailto:observium@observium.org>> Date: Tuesday, October 23, 2018 at 12:50 PM To: Chris Neam via observium <observium(a)observium.org<mailto:observium@observium.org>> Cc: Adam Armstrong <adama(a)memetic.org<mailto:adama@memetic.org>> Subject: Re: [Observium] Performance Issue - High CPU with 'mysqld'? Hi, You probably (definitely) need more cores and/or more I/O throughput capacity. It's likely that you have multiple overlapping poller_wrapper processes running because they can't finish quickly enough. what do the graphs on this page look like? http://dev.observium.org/pollerlog/ and what are the slowest devices on this : http://dev.observium.org/pollerlog/view=devices/ You may be able to disable a module or two you don't care about that's taking time : http://dev.observium.org/pollerlog/view=modules/ fdb-table is usually a good candidate. adam. On 2018-10-23 19:54:32, Gordon Cheng (gocheng) via observium <observium(a)observium.org<mailto:observium@observium.org>> wrote: Hi all, I have a new Observium setup (verion 18.9.9428 (9th September 2018)) with the following VM spec: Cores 4 Memory 64GB HD 500GB CentOS 7 PHP 7.0.31 MySQL 5.5.60-MariaDB and with the following network devices to be monitored: Devices - 634 (total), 597 (up), 37 (down) Ports - 58,032 (total), 27,664 (up), 19,967 (down) Sensors - 47,639 (total), 43,243 (ok), 4,396 (down) Statuses - 5,880 (total), 5,854 (ok), 10 (alert) --- Issue is that we are frequently seeing the following error when connecting on GUI/CLI, with slow response time on GUI/CLI: DB Error 1040: Too many connections And we are seeing gaps (broken graphs) like the following: [cid:image001.png@01D46AC5.2F7A6900] We have tried to bump up the number of 'max_connections' from original 151 to 500 and then 200, but it didn't help: sjc-observium-1:/etc# grep max_conn my.cnf max_connections=200 sjc-observium-1:/etc# And it's observed that the CPU load is heavy with 'mysqld': top - 09:36:17 up 35 days, 18:54, 2 users, load average: 74.18, 89.49, 82.67 Tasks: 665 total, 79 running, 586 sleeping, 0 stopped, 0 zombie %Cpu(s): 62.9 us, 36.9 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st KiB Mem : 65810376 total, 2511836 free, 5989292 used, 57309248 buff/cache KiB Swap: 4193020 total, 4141016 free, 52004 used. 59172312 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5152 mysql 20 0 2749132 664216<tel:0%202749132%20664216> 9164 S 20.7 1.0 4058:17 mysqld 31879 root 20 0 419676 27564 8264 R 4.2 0.0 0:00.13 php 31769 root 20 0 417212 25532 8336 S 3.6 0.0 0:00.12 php 31933 root 20 0 416868 25116 8148 S 3.2 0.0 0:00.10 php 31935 root 20 0 416736 24700 7832 S 3.2 0.0 0:00.10 php <snip> My 'config.php' is pretty much with default values. --- I'm new to Observium. It'd be greatly appreciated if someone can shed some light how it can be resolved. Thanks. - Gordon _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium(a)observium.org<mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- Mike Stupalov Observium Limited, http://observium.org

2 1

Observium PRO - Last Update
by Serghei Golipad 30 Oct '18

30 Oct '18

Guys, has anyone updated to latest rolling? Now getting the following: Internal Server Error The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator at [no address given] to inform them of the time this error occurred, and the actions you performed just before this error. More information about this error may be available in the server error log. PLEASE CONSIDER THE ENVIRONMENT BEFORE PRINTING THIS EMAIL. CDW Limited is a Company registered in England and Wales. This email is sent for and on behalf of CDW Finance Holdings Limited. CDW Finance Holdings Limited is the UK holding company for CDW Limited trading as CDW. The registered office for CDW Finance Holdings Limited (Company Number 05872067) and its UK group undertakings is 10 Fleet Place, London, EC4M 7RB. VAT Registration 902 1949 39. Confidentiality: This e-mail contains proprietary information, some or all of which may be confidential and/or legally privileged. It is for the intended recipient only. If an addressing or transmission error has misdirected this e-mail, please notify the author by replying to this e-mail and then delete the original. If you are not the intended recipient you may not use, disclose, distribute, copy, print or rely on any information contained in this e-mail. You must not inform any other person other than CDW or the sender of its existence. For more information about CDW please visit www.uk.cdw.com

2 1

Performance Issue - High CPU with 'mysqld'?
by Gordon Cheng (gocheng) 26 Oct '18

26 Oct '18

Hi all, I have a new Observium setup (verion 18.9.9428 (9th September 2018)) with the following VM spec: Cores 4 Memory 64GB HD 500GB CentOS 7 PHP 7.0.31 MySQL 5.5.60-MariaDB and with the following network devices to be monitored: Devices - 634 (total), 597 (up), 37 (down) Ports - 58,032 (total), 27,664 (up), 19,967 (down) Sensors - 47,639 (total), 43,243 (ok), 4,396 (down) Statuses - 5,880 (total), 5,854 (ok), 10 (alert) --- Issue is that we are frequently seeing the following error when connecting on GUI/CLI, with slow response time on GUI/CLI: DB Error 1040: Too many connections And we are seeing gaps (broken graphs) like the following: [cid:image001.png@01D46AC5.2F7A6900] We have tried to bump up the number of 'max_connections' from original 151 to 500 and then 200, but it didn't help: sjc-observium-1:/etc# grep max_conn my.cnf max_connections=200 sjc-observium-1:/etc# And it's observed that the CPU load is heavy with 'mysqld': top - 09:36:17 up 35 days, 18:54, 2 users, load average: 74.18, 89.49, 82.67 Tasks: 665 total, 79 running, 586 sleeping, 0 stopped, 0 zombie %Cpu(s): 62.9 us, 36.9 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st KiB Mem : 65810376 total, 2511836 free, 5989292 used, 57309248 buff/cache KiB Swap: 4193020 total, 4141016 free, 52004 used. 59172312 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5152 mysql 20 0 2749132 664216 9164 S 20.7 1.0 4058:17 mysqld 31879 root 20 0 419676 27564 8264 R 4.2 0.0 0:00.13 php 31769 root 20 0 417212 25532 8336 S 3.6 0.0 0:00.12 php 31933 root 20 0 416868 25116 8148 S 3.2 0.0 0:00.10 php 31935 root 20 0 416736 24700 7832 S 3.2 0.0 0:00.10 php <snip> My 'config.php' is pretty much with default values. --- I'm new to Observium. It'd be greatly appreciated if someone can shed some light how it can be resolved. Thanks. - Gordon

2 2

DB and Polling issues after upgrading to r9505
by Christopher Smith 25 Oct '18

25 Oct '18

We had many devices not set to the correct location due to https://jira.observium.org/browse/OBS-2767 Updated to r9505 and after doing so we reset the geo location via web interface (device properties -> Geolocation -> Reset GEO location) On any device that this was done to it seems like they do not exist to the poller any longer, none have been polled since the above action was taken. I based this info from the Per Device stats in the Pollerlog section (all of the devices that had their geo location reset were last polled 5+ hours ago, everything else that was not touched are being polled as expected every 5 minutes) I see these errors in the db.log file, they appear to have shown up when the Reset GEO location operation was done on each device: [2018/10/24 14:48:43 -0400] index.php(4115): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:49:44 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:23 -0400] index.php(9439): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:50:57 -0400] index.php(44932): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:51:28 -0400] index.php(25685): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? [2018/10/24 14:52:29 -0400] index.php(25888): Failed dbQuery (#1064 - You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'WHERE `location_id` = ?' at line 1), Query: UPDATE `devices_locations` set WHERE `location_id` = ? Observium system info: Observium 18.10.9505 (24th October 2018) OS Linux 3.10.0-862.3.3.el7.x86_64 [amd64] (CentOS 7) Apache 2.4.6 (CentOS) OpenSSL/1.0.2k-fips PHP/7.0.31 PHP 7.0.31 (OPcache: ENABLED) Python 2.7.5 MySQL 5.5.56-MariaDB (extension: mysqli 5.5.56-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.6.0 Fping 3.10 (IPv4 only)

2 2

Update - Port descripton changed ( possible bug or ... )
by Sigurður Hannesson 23 Oct '18

23 Oct '18

Hi, just updated Version Information Observium 18.10.9472 (16th October 2018) OS Linux 4.9.0-3-amd64 [amd64] (Debian 9.1) Apache 2.4.25 (Debian) PHP 7.0.19-1 (OPcache: ENABLED) Python 2.7.13 MySQL 10.1.23-MariaDB-9+deb9u1 (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.6.0 Fping 3.15 (IPv4 and IPv6) . Noticed that most of my port groups had 0 ports in them. Looking at the port description they had changed deviceA 1/1/3<http://172.24.41.34/device/device=31/tab=port/port=5230/> \AKRA-3 No1\ instead of AKRA-3 No1 this of course means that all my port groups are not matching the criteria. br., SH

1 0

Redundancy Mode (C2900)
by Robert Williams 22 Oct '18

22 Oct '18

Hi, We've had a few customer devices generate alerts overnight for 'Operational Redundancy Mode' = nonRedundant Example below: It appears to be a newly detected element during a discovery run - but in all (of our) scenarios it is now in alarm as the customers do not have them operating in redundancy mode. As far as I can tell it's not configured at all on them. Obviously I can filter them out from the alert ("Customer - Status Alert") but it would be nice if I could hide them from the main pages (or stop it from being polled at all). Alternatively, does anyone know what element in our device config may be triggering this to show up, so that I can modify the configs to remove it? Thanks! Robert Williams Custodian Data Centres https://www.CustodianDC.com

3 3