- observium - lists.observium.org

An interesting issue with Cisco 2960Cs...
by Richard Kuhns 03 Feb '15

03 Feb '15

Hi all, This is just on the order of a 'watch out' notice. We're currently on 0.15.1.6206, but had the same issue with earlier versions and with the CE. We have 5 Cisco 2960Cs that we monitor, and all were taking horrible amounts of time to poll. Always at least 200 seconds, and often over 300. After some experiment, we discovered that they apparently don't care to talk about CEF (Cisco Express Forwarding). If Observium asks them about it, the CPU usage climbs above 60% and stays there for quite a while. If I go to the device --> edit --> Modules and disable cicso-cef, everything is fine. The CPU drops under 5%, and the poll time is 5 seconds or less. I'm pretty sure we're not losing any useful info, since I don't believe the 2960Cs support CEF in the first place. As I said, this is just a heads up. Observium is a great tool. Thanks! -- Richard Kuhns <rjk(a)wintek.com> Main Number: 765-742-8428 Wintek Corporation Direct: 765-269-8541 427 N 6th Street Internet Support: 765-269-8503 Lafayette, IN 47901-2211 Consulting: 765-269-8504

6 10

Per-user timezone settings
by Steve Costaras 02 Feb '15

02 Feb '15

Been playing w/ observium CE 14.11.6000. We have people in several timezones, currently I have the observium system configured itself for UTC, but it would be better if there was a way to have each user account have their own 'local' timezone setting so that the graphs would show up in their local timezone. Is there any way to accomplish this? Thanks, Steve

4 4

OT: GMail (WAS: RE: Not Receiving Alerts ??)
by Phillip Baker 02 Feb '15

02 Feb '15

Off topic rant: In case this wasn’t already obvious from this symptom, nobody should use Gmail for anything important. Some of our customers (one a google apps “partner” or whatever) have seen it silently drop mails including invoice mails etc (despite aligned SPF, DKIM, DMARC, reverse dns, and no current reputational issue). Even if anything is wrong with the message, they shouldn’t be silently dropping mail on the floor. It’s unbelievably broken as a model for handling “spam” which is what I presume they think they’re doing. It’s just about adequate for a personal searchable mailing list archive. That’s about it. Phil From: observium [mailto:observium-bounces@observium.org] On Behalf Of Torsten-Sven Urbas Sent: 02 February 2015 07:12 To: Observium Network Observation System Subject: Re: [Observium] Not Receiving Alerts ?? Thats interesting. We do see the same issue with google mail. Basically, only recoveries make it through, i barely see a single alert in my mailbox. /Torsten 2015-01-31 3:21 GMT+01:00 Michael Loftis <mloftis(a)wgops.com<mailto:mloftis@wgops.com>>: Gmail randomly eats mail nowadays. I have had an ongoing g issue with it discarding (not flagging as spam) alerts from observium. Specifically my port down alerts. Recovery for the same port comes through just fine. Other alerts and recoveries are all fine. -- Torsten-Sven Urbas ==== Bitte beachten Sie unsere neuen Rufnummern ==== ProfitBricks GmbH • Greifswalder Str. 207 • D - 10405 Berlin Tel: +49 (30) 57700 8234 • Mobile: +49 (170) 77 38 251 • Fax: +49 (30) 57700 8296 www.profitbricks.de<http://www.profitbricks.de/> • torsten-sven.urbas(a)profitbricks.com<mailto:torsten-sven.urbas@profitbricks.com> Sitz der Gesellschaft: Berlin. Registergericht: Amtsgericht Charlottenburg, HRB 125506 B. Geschäftsführer: Andreas Gauger, Achim Weiss. Please consider the environment before printing this email.

1 0

Speed up graph rendering
by Louis Bailleul 02 Feb '15

02 Feb '15

Hi, I am currently using Observium on 149 switches with a total of 10173 ports. I can't say that anything is wrong with it, but the web interface seems a bit slow especially when you want to display pages with a lot of graphs. Observium is currently running in a VM with 4 xeon E5-2650 cores and 3Gb of ram. It's virtual disks are on a local raid5 composed of 10K SAS disks. Observium report that it's VM use on average 25% of its CPUs with spikes at 40% when the web interface is heavily used. The disk I/O doesn't go past 150 ops OUT and rare spikes at 50 IN. Anyone could advise on what kind of hardware or software tweaking could help speed up the thing ? Are they special requirements/tunnings for the rrd storage or the mysql database ? Best regards, Louis

13 35

Not Receiving Alerts ??
by Andres P 02 Feb '15

02 Feb '15

Hi Observium Team! Since 14 Jan I'm not receiving Alerts It seems to be a problem of the mail server. I did the following test, and not receive it. Any idea? root@Observium:/opt/observium# ./test_mail.php -h rcn-rou-01 Observium 0.15.1.6218 Test E-mail Configuration See mail backend options here: http://www.observium.org/wiki/Configuration_Options#Email_backend_settings My Hostname: Observium.Observium.cabase.org.ar E-mails ENABLED globally ($config['email']['enable']) E-mails use PHP-builtin MAIL backend ($config['email']['backend']) E-mails use these default recipient(s) ($config['email']['default']): noc(a)cabase.org.ar E-mails send from ($config['email']['from']): "Observium" <observium(a)Observium.Observium.cabase.org.ar> E-mails send to recipients based on default recipient from config and/or device sysContact. Try send test notification for rcn-rou-01 to these email(s): noc(a)cabase.org.ar Notification for rcn-rou-01 SENT.

4 3

Re: [Observium] Java JVM Monitoring
by Jurasovic Kresimir 01 Feb '15

01 Feb '15

Hi Tom, Thank you for the feeedback. I will look into code for shoutcast and memcached for implementation details. Right now I am trying to cover as much as information as possible. Code it already publicly available on Bitbucket. I am willing to share the results when I complete all the graphs I need and make some usefull tutorial. Will send all the info when I am done. Best regards, Krešimir === Heya, That sounds very interesting! I hope you'll share the result with us. Our app system is a bit basic, but it supports application "instances". I've never actually implemented something with those myself, but things like shoutcast or memcached can support multiple installs on a machine. I think that's the direction you need, but I have no practical information.. check their observium-side code to see how to use, feel free to sollicit feedback either by this list or on IRC. Tom On 23/01/2015 22:18, Kresimir Jurasovic wrote: > Hi, > > I am in the beginning phase of using Observium. I have everything > set-up and working. No problems so far. > > One feature I am missing is Java JVM Monitoring. In your Bug Tracker I > found the following ticket: > > http://jira.observium.org/browse/OBSERVIUM-554?jql=text%20~%20%22JVM%22 > > In it you mention that this should be implemented using unix-agent. > This is perfectly fine by me. > I have implemented a Java application which is run by unix-agent and > retrieves data from the JVM using the JMX protocol. I have graphs > set-up and so far every is running ok. > > There is only one feature I cannot figure out how to implement. This > feature is very important for me. In most cases there will be more > then one JVM on a single machine. From monitoring perspective this > should be treated as separate application but handled by the same > agent. Is this even possible on Observium? If it is can you please > point me to the right code so I can see how this is done. > > Thanks, > Kre?imir > _______________________________________________ > observium mailing list > observium(a)observium.org > http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

4 3

Monitoring Logs
by Constantinos Coudounaris 31 Jan '15

31 Jan '15

Hello everyone, I'm trying to setup observium to monitor logs but i'm having some issues. I've configured rsyslog and i've followed the instructions at http://www.observium.org/wiki/Rsyslog_Syslog_Server however I get the following error in observium. I've configured the following files: /etc/rsyslog.conf - added forwarding rule to observium rule aswell as the following. The spool files get created successfully. $WorkDirectory /var/lib/rsyslog # where to place spool files $ActionQueueFileName fwdRule1 # unique name prefix for spool files $ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible) $ActionQueueSaveOnShutdown on # save messages to disk on shutdown $ActionQueueType LinkedList # run asynchronously $ActionResumeRetryCount -1 # infinite retries if host is down /etc/rsyslog.d/30-observium.conf - added as per observium documentation Error Message I get in Observium: No syslog entries found! This device does not have any syslog entries. Check that the syslog daemon and Observium configuration options are set correctly, that this device is configured to send syslog to Observium and that there are no firewalls blocking the messages. Thank you. -- Constantinos Coudounaris

1 0

rrdcached worked for me! (Or "How to solve gaps in your graphs")
by Tristan Rhodes 30 Jan '15

30 Jan '15

I was seeing gaps in my Observium graphs, so I knew that something was wrong with my system. The output from the Observium "poller-wrapper.py" cron job has statistics on how long it takes to complete each polling cycle. These are scheduled every 5 minutes (300 seconds). Here is what I found: "INFO: poller-wrapper polled 312 devices in 1142 seconds with 20 workers WARNING: the process took more than 5 minutes to finish, you need faster hardware or more threads INFO: in sequential style polling the elapsed time would have been: 21663 seconds WARNING: Consider setting a minimum of 77 threads. (This does not constitute professional advice!)" I tried increasing threads on the poller-wrapper.py cron job, but this did not speed things up. The "top" command showed me that this system was always waiting for disk I/O, which is indicated by a high value for "wa". I decided to give rrdcached a try, after reading this blog: http://blog.best-practice.se/2014/10/using-rrdcached-with-observium.html With rrdcached enabled, I am finally completing my polls with 5-minutes! INFO: poller-wrapper polled 312 devices in 51 seconds with 20 workers Yes, it went from 1142 seconds to 51 seconds, over 22 times faster! I know people have said the web interface would be slower, but from my perspective it is loading much faster now that rrdcached is saving some disk IOPS for Apache. (Disclaimer: I have compiled and installed rrdtool 1.4.9 to try to maximize speed on the web-interface) I hope this help people who are bottle-necked on IOPS from their disks, like I was. Cheers, Tristan *Tristan Rhodes* Network Engineer Weber State University 801.626.8549

3 2

Slow polling for ports.inc.php module
by Jaynee Shah 30 Jan '15

30 Jan '15

Hi, We have heavily loaded Brocade MLXe routers, and polling time is very high for these devices. The same is seen for few Arista switches (at longer distances) as well. This certainly is related to IF-MIB, trying to poll lots of data statistics for all interfaces, resulting in ports.inc.php module run time of ~150sec+. Ideally, we want to reduce this polling time to <60sec. time /usr/bin/snmpbulkwalk -Cr60 -v2c -c 'jtv' -OQUs -m IF-MIB -M /home/jtv/observium//mibs/rfc:/home/jtv/observium//mibs/net-snmp 'udp':'br02.lhr02':'161' ifEntry real 0m57.616s user 0m0.044s sys 0m0.012s time /usr/bin/snmpbulkwalk -Cr60 -v2c -c 'jtv' -OQUs -m IF-MIB -M /home/jtv/observium//mibs/rfc:/home/jtv/observium//mibs/net-snmp 'udp':'br02.lhr02':'161' ifXEntry real 0m52.763s user 0m0.032s sys 0m0.024s We do not care about some of the interface statistics, for example, mtu, speed, duplex, promiscuous mode, trunk, vlan, etc. We only want interface traffic in/out and error statistics. Is there a way to selectively modify any discovery/polling/MIB files, and only keep the statistics we are interested in? Thanks, Jaynee

3 5

Not Receiving Alerts ??
by Andres P 29 Jan '15

29 Jan '15

Hi Observium Team, >From last two weeks I left to receive my Alerts. I did a test

1 0