- observium - lists.observium.org

losing device information after adding IP SLA
by Bastiaan Topper 23 Feb '16

23 Feb '16

Hi, We have a few devices in our Observium installation which lost some sensor en memory pools during discovery. See below. It looks like the problem started around 5 days ago. [cid:image004.png@01D16E44.AA924840] It looks like that after enabling a new IP SLA config on a new device, and running a discovery, first the new IP SLA entity appeared. But after waiting a few minutes, the IP SLA and more entities, disappeared. [cid:image005.png@01D16E46.CFB02A50] I attached the discovery debug information for both hosts. How can we get this back to work? Did anything change in the discovery and/or IP SLA around 5 days ago? Thanks and regards, Bastiaan

1 0

Mini-graphs not clickable?
by Jason Vanlandingham 23 Feb '16

23 Feb '16

I did the CE update a few days ago and now the minigraphs in the header of a device's overview aren't clickable anymore. I rather liked having that shortcut.

1 0

Normal Users not getting permissions using Active Directory
by Schrader, Spencer R 23 Feb '16

23 Feb '16

I have included the link at the bottom to where I described the issue which was marked “resolved” and I was pointed here for help. I have the professional version of observium where users are all successfully authenticating, but when normal users log in they can’t see anything. I edited there permissions and allowed them all to see multiple devices(screenshot in link),but they still can’t see anything. Observium recognizes they log in as normal users, but doesn’t let them see any of the other devices they have access to. Global Read, and administrators work fine. I posted my ldap config and a few screenshots in the link. http://jira.observium.org/browse/OBSERVIUM-1684 Thanks for your time! -Spencer

5 8

Dell ESXi v6 hosts RAM not reporting
by Pedrosi, Derek G. 22 Feb '16

22 Feb '16

I have a few host that were recently upgraded from ESXi5.1 to ESXi6.0. After upgrading, Observium no longer is reporting on physical RAM, at all. Host are Dell r810/r720; at time of upgrade their OpenManage was also upgraded to 8.2. The Observium event log for the servers say... "Memory pool removed: mib host-resources-mib, index 27, descr Real Memory" So I see it was removed, but why? I did an smptwalk on the box "snmpwalk -v2c -c XXXXX 10.X.X.X .1.3.6.1.2.1.25.2.2.0"--> HOST-RESOURCES-MIB::hrMemorySize.0 = INTEGER: 536857360 Kbytes It looks like the value it still there. Can anyone shed some light on this? Thanx in advance, derek

1 0

Alert Checker for Smokeping
by Lyndon Labuschagne 22 Feb '16

22 Feb '16

Hi All does anyone know if you can setup an alert checker for smokeping, say at 20ms etc send an email alert? Still trying to get my head around some of the alerting options, Is there a global list off all the Conditions somewhere?

3 4

Non-Critical - Device Allocation
by Cameron Murray 22 Feb '16

22 Feb '16

Guys, Thought you might want to add a definition for the Dell Networking X4012 10Gb Siwtch. Currently appears as a Generic Device. [cid:image001.png@01D16D4B.6B18B090] Regards, Cameron Murray Remote Support Engineer How am I doing? Please click here<http://www.techpath.com.au/contact-us/feedback/> to rate my work. [cid:image002.png@01D16D4B.6B18B090]<http://www.techpath.com.au/> P 1300 033 300 F 07 3809 3999 E cameron(a)techpath.com.au www.techpath.com.au<http://www.techpath.com.au> Unit 2/55 Tradelink Rd, Hillcrest QLD 4118 [Facebook]<http://www.facebook.com/techpathau> [Twitter]<http://twitter.com/techpathau> [LinkedIn]<http://www.linkedin.com/company/techpathau> Note: This message may contain privileged and confidential information that is the property of the intended recipient. The information herein is intended only for use of the addressee. If you are not the intended recipient, then you are requested to return e-mail to TechPath Pty Ltd and destroy any copies made. Copying or disseminating any of this message is prohibited. Any views expressed in this message are those of the individual sender and may not necessarily reflect the views of TechPath Pty Ltd.

2 1

Problens BGP peers
by Layon - NOC ISPNETWORK 20 Feb '16

20 Feb '16

Hello currently use to monitor my obsrvium BGP sessions with Cisco routers is the best monitoring system that already utilized it is exelente , I have some routers mikrotik and would like to know how to monitor sessions BGP , OSPF routers MikroTik could help me Thank you IT Manager Layon Santos Cota

2 2

Re: [Observium] mysqld: The table 'ports_cbqos' is full - solved, probably
by Fältman, Mikael 20 Feb '16

20 Feb '16

Hi again. Increased innodb_buffer_pool_size and restarted mysqld - solved the problem. Buffer_pool_size has probably nothing to do with this issue but I was also getting warnings about buffer pool is occupied by InnoDB: lock heaps or the adaptive hash index. It is a good thing to sometimes keep a peek into /var/log/mysqld.log file (or where ever it is stored). BR Mikael From: observium [mailto:observium-bounces@observium.org] On Behalf Of Fältman, Mikael Sent: den 18 februari 2016 10:27 To: Observium Network Observation System Subject: [Observium] mysqld: The table 'ports_cbqos' is full Hello. Running: Observium CE 0.16.1.7533 on RedHat 6.4 Keep getting this error msg in /var/log/mysqld.log 160218 10:21:28 [ERROR] /usr/libexec/mysqld: The table 'ports_cbqos' is full What can I do to fix it ? Disk space is available. BR Mikael

3 3

Development questions
by Philipp Griess 19 Feb '16

19 Feb '16

Dear all, I am currently developing a new application agent for Oracle databases and need some guidance on how to implement it properly. My first goal is to get the current and historical usage of each tablespace - a DB consists of multiple tablespaces. This would give a good overview of data growth inside a database. My application agent running on my DB is polling the data via SQL and returning it to observium as comma spaced values. The output looks as follows: CIT;600;596.63 COMPASS;28488;1406.5 COMPASS_IDX;27996;1568.06 CONFIG;1000;959.69 CONTROLLING;600;596.69 CSR;40960;4966 Now I'm almost at my question. All existing application agents I know are rather static, containing only certain fixed (and hard coded) entities. Tablespaces are much like storage in my point of view so I think it would be a good idea to implement them as a new storage-type in the storage table of the observium database. Is this a proper way to do it or do you suggest a different approach? I'd like to be as compatible as possible to future updates and would also contribute my code if anyone needs it. Please let me know your thoughts. Thanks and kind regards, Philipp

1 0

mysqld: The table 'ports_cbqos' is full
by Fältman, Mikael 18 Feb '16

18 Feb '16

Hello. Running: Observium CE 0.16.1.7533 on RedHat 6.4 Keep getting this error msg in /var/log/mysqld.log 160218 10:21:28 [ERROR] /usr/libexec/mysqld: The table 'ports_cbqos' is full What can I do to fix it ? Disk space is available. BR Mikael

1 0

Fwd: Removing Dashboard
by Andres P 18 Feb '16

18 Feb '16

Hi Guys! After do the observium upgrade appears in the frontpage on the left a Dashboard, there is any form to remove it and come back to the old template. Regards Andres

3 3

Unknown Locations in Device > Locations menu
by Jacob Bisby 18 Feb '16

18 Feb '16

Hi All I'm having some trouble with Observium's mapping - we have it configured to build the Location list and geolocation, etc automatically based on the address/location pulled via SNMP. This works for almost every device we have, but there are two devices which show up under Unknown Location, even though Observium has pulled correct and valid address data for them. It does not appear to successfully pull co-ordinates for the address either, as the two devices appear on the map in the middle of the ocean. I have tried switching from the Yahoo API to the Google API (with API key) but this has not changed the behaviour of the issue. Currently on version 0.16.2.7592, we update via SVN once a month and we were having this same issue on 0.16.1.x as-well. Hoping somebody here has seen this issue before and can help me out or point me in the right direction.

2 5

High CPU usage on Observium
by Jose Colin 17 Feb '16

17 Feb '16

Hello Guys i see a lot of php processes running on the server, do you have any idea about this behavior if it needs to change some configuration stuff? top - 23:43:36 up 1:33, 1 user, load average: 19.78, 18.44, 16.29 Tasks: 240 total, 24 running, 216 sleeping, 0 stopped, 0 zombie %Cpu(s): 82.7 us, 16.6 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.7 si, 0.0 st KiB Mem: 3945832 total, 2334788 used, 1611044 free, 235988 buffers KiB Swap: 4194300 total, 0 used, 4194300 free. 954876 cached Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 12364 root 20 0 136472 30692 10532 R 4.983 0.778 0:22.10 php 23927 root 20 0 139032 33248 10536 R 4.983 0.843 0:39.62 php 32704 root 20 0 145432 39780 10536 R 4.983 1.008 1:11.48 php 30112 root 20 0 134652 28824 10532 R 3.654 0.730 0:16.65 php 5722 root 20 0 155420 49628 10536 R 3.322 1.258 2:25.48 php 17915 root 20 0 133372 27524 10532 S 3.322 0.698 0:09.60 php 20140 root 20 0 152344 46608 10536 R 3.322 1.181 1:55.92 php 26947 root 20 0 136984 31220 10536 R 3.322 0.791 0:26.82 php 10380 root 20 0 154136 48280 10536 S 2.990 1.224 2:10.99 php 20593 root 20 0 142360 36632 10536 S 2.990 0.928 0:55.83 php 30207 root 20 0 151320 45408 10536 S 2.990 1.151 1:50.79 php 1680 mysql 20 0 979436 141336 7308 S 2.326 3.582 1:15.83 mysqld 17979 root 20 0 143896 38228 10536 R 2.326 0.969 1:06.13 php 530 root 20 0 133884 28112 10532 R 1.993 0.712 0:11.50 php 9628 root 20 0 138520 32664 10536 R 1.993 0.828 0:33.49 php 30062 root 20 0 148504 42712 10536 R 1.661 1.082 1:28.73 php 6361 root 20 0 141088 35480 10536 S 1.329 0.899 0:47.94 php 3407 root 20 0 142616 36804 10536 S 0.997 0.933 1:00.61 php 13068 root 20 0 150040 44220 10536 S 0.997 1.121 1:41.53 php 15851 root 20 0 152600 46744 10536 R 0.997 1.185 2:02.85 php 8427 root 20 0 154648 48844 10536 S 0.664 1.238 2:19.62 php 15440 root 20 0 146456 40572 10536 S 0.664 1.028 1:19.81 php 595 root 20 0 12032 3800 672 S 0.332 0.096 0:14.53 haveged 3474 root 20 0 133116 27260 10532 S 0.332 0.691 0:07.57 php 11900 root 20 0 16100 1692 1108 R 0.332 0.043 0:03.48 top 12576 root 20 0 153112 47328 10536 S 0.332 1.199 2:07.73 php thanks for your attention. Jose

3 5

Missing dBm in Cisco IOS
by chott＠praha1.net 17 Feb '16

17 Feb '16

Hello team, after some upgrade in history now missing SFP dBm in Cisco 3750 platform in Cisco Catalyst 6500 show dBm SFPs [email-header-praha1] Tomas Chott technický ředitel chott(a)praha1.net<mailto:chott@praha1.net> Phone: +420 245 004 005 Mobile: +420 733 123 135 Metropolitní síť Praha 1 z.s.p.o. Jindrisska 18 110 00 Praha 1 Czech Republic www.praha1.net<http://www.praha1.net> [Popis: Facebook]<http://www.facebook.com/praha1net> <http://www.linkedin.com/pub/tomas-chott/49/97a/1aa>

2 2

Device mix-up
by Laz C. Peterson 17 Feb '16

17 Feb '16

So, weird thing happened today … We had a network outage that lasted for maybe 45 minutes that kept Observium from monitoring one site. When Observium resumed its normal monitoring activities, it somehow added a whole bunch of inventory items for a Cisco router to a KVM virtual server. About 10 minutes ago, it deleted all of the Cisco items, and is now back to normal. Has anyone seen anything like this before? Does anyone know what might have caused this? ~ Laz Peterson Paravis, LLC

2 3

Traffic Accounting not updating
by Cameron Murray 16 Feb '16

16 Feb '16

Adam, It appears that our OBS isn't updating the accounting details such as 95%ile. The cron task is identical to the how-to. What command can we run to manually update these figures?

3 6

Purchase observium subscription for multiple years (2-3)
by Arya, Renuka [MED] 16 Feb '16

16 Feb '16

Hi Team, Our subscription for the year 2015 has been expired. Is there a way we can by the subscription for Observium for multiple years (2 or 3 years)? Please let us know. Thanks! Regards Renuka ******************************************************************************** This e-mail is intended only for the use of the individual or entity to which it is addressed and may contain information that is privileged and confidential. If the reader of this e-mail message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is prohibited. If you have received this e-mail in error, please notify the sender and destroy all copies of the transmittal. Thank you University of Chicago Medicine and Biological Sciences ********************************************************************************

2 1

Speeding up caching and database
by Louis Bailleul 16 Feb '16

16 Feb '16

Hi Team, I have a performance issue with the web interface. My Observium is monitoring 3095 devices from which 168 are switches (Just a bit less than 20000 ports total). My server is an IBM X3650 M4, 32G of ram, 6 cores and a raid 10 of SSD. I am more than happy with the polling performance has it finishing in under 200seconds. But the web interface is quite annoying : I have a minimum Time to first bit of ~2seconds. Once these two seconds have passed the page load almost instantly, graphs included. So the question is, can I speed things up ? And if yes how ? It looks like Observium is spending about a second in the database and says that the Cache took 2 seconds to process (?). Do I have some leverage on these points to make it faster ? Page load time (Just a device page) : Connection Setup TIME Queueing 5.24 ms Stalled 1.26 ms Request sent 0.80 ms Waiting (TTFB) 3.29 s Content Download 26.62 ms Explanation 3.33 s Observium Performance report : Page 2.281s Cache 2.047s MySQL Cell 50/0.0633s Row 35/0.0113s Rows 49/0.7822s Column 8/0.0564s Memory Cached 180MB Page 189MB Peak 229MB Versions: Observium 0.16.1.7535 (27th January 2016) OS Linux 3.10.0-327.el7.x86_64 [amd64] (CentOS 7.2.1511) Apache 2.4.6 (CentOS) PHP/5.4.16 PHP 5.4.16 Python 2.7.5 MySQL 5.5.44-MariaDB-log (extension: mysqli 5.5.44-MariaDB) SNMP NET-SNMP 5.7.2 RRDtool 1.4.8 Stats : Statistics DB size 606MB RRD size 134GB Devices 3095 Ports 19390 IPv4 Addresses 6148 IPv4 Networks 44 IPv6 Addresses 2959 IPv6 Networks 1 Services 0 Applications 0 Processors 61262 Memory 15563 Storage 11742 Disk I/O 97461 HR-MIB 96815 Entity-MIB 7292 Syslog Entries 0 Eventlog Entries 172938 Sensors 3863 Toner Mysqltuner output : -------- Performance Metrics ------------------------------------------------- [--] Up for: 2d 21h 57m 9s (260M q [1K qps], 5K conn, TX: 283B, RX: 45B) [--] Reads / Writes: 59% / 41% [--] Binary logging is disabled [--] Total buffers: 10.5G global + 4.7M per thread (650 max threads) [OK] Maximum reached memory usage: 11.2G (35.94% of installed RAM) [OK] Maximum possible memory usage: 13.5G (43.37% of installed RAM) [OK] Slow queries: 0% (14K/260M) [OK] Highest usage of available connections: 21% (142/650) [OK] Aborted connections: 0.00% (0/5477) [OK] Query cache efficiency: 32.3% (74M cached / 230M selects) [OK] Query cache prunes per day: 0 [OK] Sorts requiring temporary tables: 0% (129 temp sorts / 182K sorts) [OK] Temporary tables created on disk: 0% (201 on disk / 112K total) [OK] Thread cache hit rate: 97% (142 created / 5K connections) [OK] Table cache hit rate: 102% (922 open / 896 opened) [OK] Open file limit used: 5% (52/1K) [OK] Table locks acquired immediately: 97% (244M immediate / 249M locks) -------- MyISAM Metrics ----------------------------------------------------- [!!] Key buffer used: 18.0% (28M used / 157M cache) [OK] Key buffer size / total MyISAM indexes: 150.0M/99.0K [!!] Read Key buffer hit rate: 93.3% (15 cached / 1 reads) -------- InnoDB Metrics ----------------------------------------------------- [--] InnoDB is enabled. [OK] InnoDB buffer pool / data size: 8.0G/579.1M [!!] InnoDB buffer pool instances: 1 [!!] InnoDB Used buffer: 6.67% (34952 used/ 524287 total) [OK] InnoDB Read buffer efficiency: 100.00% (2079385726 hits/ 2079395120 total) [!!] InnoDB Write buffer efficiency: 0.00% (0 hits/ 1 total) [OK] InnoDB log waits: 0.00% (0 waits / 11253445 writes) -------- AriaDB Metrics ----------------------------------------------------- [--] AriaDB is disabled. -------- Replication Metrics ------------------------------------------------- [--] No replication slave(s) for this server. [--] This is a standalone server.. -------- Recommendations ----------------------------------------------------- General recommendations: Run OPTIMIZE TABLE to defragment tables for better performance Remove Anonymous User accounts - there are 2 anonymous accounts. Set up a Password for user with the following SQL statement ( SET PASSWORD FOR 'user'@'SpecificDNSorIp' = PASSWORD('secure_password'); ) Set up a Secure Password for user@host ( SET PASSWORD FOR 'user'@'SpecificDNSorIp' = PASSWORD('secure_password'); ) Restrict Host for user@% to user@SpecificDNSorIp Variables to adjust: innodb_buffer_pool_instances(=8) ------------------------------------------------------------------------------------- Thanks. Best regards, Louis [http://www.pgs.com/mediaFiles/Exclaimer%20graphics/PGS_LOGO_RGB_42x53px.jpg]<http://www.pgs.com> Louis Bailleul Computer Systems Engineer Imaging & Engineering | Imaging Telephone: +44 1932 376000 Direct: +44 1932 376842 VOIP: 74416842 Mobile: +44 7786 525307 Email: louis.bailleul(a)pgs.com<mailto:Louis.Bailleul@pgs.com> A Clearer Image | www.pgs.com<http://www.pgs.com> [http://www.pgs.com/mediaFiles/Exclaimer%20graphics/150731-ColourWave-660x14…] Address: 4 The Heights, Brooklands, Weybridge, Surrey, KT13 0NY, United Kingdom This e-mail, including any attachments and response string, may contain proprietary information which is confidential and may be legally privileged. It is for the intended recipient only. If you are not the intended recipient or transmission error has misdirected this e-mail, please notify the author by return e-mail and delete this message and any attachment immediately. If you are not the intended recipient you must not use, disclose, distribute, forward, copy, print or rely on this e-mail in any way except as permitted by the author.

4 6

Accounting for Power/Current
by chott＠praha1.net 16 Feb '16

16 Feb '16

Hello team, we are looking for solution how we can create accounting for Power/Current like Mettered PDU from APC Thank you Tom [email-header-praha1] Tomas Chott technický ředitel chott(a)praha1.net<mailto:chott@praha1.net> Phone: +420 245 004 005 Mobile: +420 733 123 135 Metropolitní síť Praha 1 z.s.p.o. Jindrisska 18 110 00 Praha 1 Czech Republic www.praha1.net<http://www.praha1.net> [Popis: Facebook]<http://www.facebook.com/praha1net> <http://www.linkedin.com/pub/tomas-chott/49/97a/1aa>

2 1

Sorting on traffic bug?
by Steffie Morris 13 Feb '16

13 Feb '16

Hi, when you are in the ports view of a switch, and you sort on the column traffic. speeds op 900Mbit are sorted before 1.5Gbit. probably because 900 is larger than 1.5 but the unit is different so i guess that needs to be taken into account somehow?

2 1

All ports at each polling showing "interface changed:" event log
by Matt Ladewig 13 Feb '16

13 Feb '16

We are at 7608. During each polling run, every port on our system shows an interface changed event log: https://s3.amazonaws.com/uploads.hipchat.com/131939/956300/RLSqGEGgF09oIZS/… Here is the port poller from one device showing this issue: https://s3.amazonaws.com/uploads.hipchat.com/131939/956300/4ADJVr2DdsmjgXT/… This error stands out: SQL[UPDATE `ports` set `port_label_base` ='Null',`port_label_num` ='0',`ifLastChange` ='2015-05-19 05:42:34' WHERE `port_id` = '3872'] SQL RUNTIME[0.00006795s] ERROR[Error in query: (Unknown column 'port_label_base' in 'field list') 1054] PORT updated rows= Looks like I'm missing some structure from my DB. Please let me know what is needed to sort this out. Thanks, Matt

2 6

Password reset not working
by Damien Burke 13 Feb '16

13 Feb '16

Hello, Password reset on https://www.observium.org/subs/index.php does not appear to be working. My observium username and password is not working on the svn anymore and I cannot login to account management. Is this a known issue?

3 4

Re: [Observium] After SVN update all my devices show down
by Aaron Hite 12 Feb '16

12 Feb '16

Here is an example of the test I ran. root@Observium:/opt/observium# ./discovery.php -h coln01-n7k-infra-01 ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 0.16.2.7609 http://www.observium.org ##### Starting discovery run at 2016-02-12 14:09:17 ##### ##### Finished discovery run at 2016-02-12 14:09:17 ##### WARNING: 0 devices discovered. Did you specify a device that does not exist? o Devices Discovered 0 o Discovery Time 0.003 secs o Memory usage 6MB (peak: 6.25MB) o MySQL Usage Cell[0/0s] Row[4/0s] Rows[2/0.001s] Column[0/0s] Update[0/0s] Insert[0/0s] Delete[0/0s] o RRDTool Usage root@Observium:/opt/observium# ping coln01-n7k-infra-01 PING coln01-n7k-infra-01 (216.46.59.23) 56(84) bytes of data. 64 bytes from coln01-n7k-infra-01 (216.46.59.23): icmp_seq=1 ttl=254 time=1.29 ms 64 bytes from coln01-n7k-infra-01 (216.46.59.23): icmp_seq=2 ttl=254 time=0.756 ms ^C --- coln01-n7k-infra-01 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1001ms rtt min/avg/max/mdev = 0.756/1.026/1.296/0.270 ms root@Observium:/opt/observium# Aaron From: observium <observium-bounces(a)observium.org<mailto:observium-bounces@observium.org>> on behalf of Aaron Hite <ahite(a)cosentry.com<mailto:ahite@cosentry.com>> Reply-To: Observium Network Observation System <observium(a)observium.org<mailto:observium@observium.org>> Date: Friday, February 12, 2016 at 2:06 PM To: Observium Network Observation System <observium(a)observium.org<mailto:observium@observium.org>> Subject: [Observium] After SVN update all my devices show down Guys, need some assistance here. I updated Observium this morning to Observium Professional 0.16.2.7609. Since that upgrade all my devices have shown down. If I go to the command line I am able to ping via DNS all the devices. I did notice that during the svn update it seemed that a lot of the MIB’s were updated. Any guidance on what direction I should be looking to bring my system back online? Thanks, Aaron

2 2

After SVN update all my devices show down
by Aaron Hite 12 Feb '16

12 Feb '16

Guys, need some assistance here. I updated Observium this morning to Observium Professional 0.16.2.7609. Since that upgrade all my devices have shown down. If I go to the command line I am able to ping via DNS all the devices. I did notice that during the svn update it seemed that a lot of the MIB’s were updated. Any guidance on what direction I should be looking to bring my system back online? Thanks, Aaron

1 0

Monitor Network services
by Matt Zillmann 12 Feb '16

12 Feb '16

Hello everyone, I am inquiring on whether it is possible to monitor some key network services on Windows servers using the subscription version of Observium. An example would be: IIS web service (UP/DOWN). Thank you, Matt.

1 0