- observium - lists.observium.org

HTTP Error 500
by Adam Summerfield 13 Dec '12

13 Dec '12

We have just created a new virtal server for Obserium and are getting the following error when attempting to go the following URL... http://observium.harbour/ports/ HTTP Error 500 (Internal Server Error): An unexpected condition was encountered while the server was attempting to fulfil the request. Would appreciate any advice? Regards, Adam

3 7

Alert Question
by Lance Raymond 12 Dec '12

12 Dec '12

Sorry if this comes as a double post, as I sent it out, then was prompted to confirm my email to the list. If so, disregard (or answer since I haven't seen one yet) ;) So I have nagios running smooth for one company and working with another was introduced to observium. Interface is excellent, but I have 2 questions. 1. Alerts. I had a dev box hit around 97% disk space with no notice. So there is an alerts tab, but I don't see how to configure alerts, thresholds, etc. Looking at the wiki ( http://observium.org/wiki/Configuration_Options#Simple_API_Settings) I do see some things, but no simple [add alert] type thing, so is there something I can read, etc. as I continue to play? 2. Search header. The one I was shown before I did the install had the company logo (I see where to change that, colors, etc.) but they had the searchbar just not there (and I can see why). I can click the [hide] but I would like to completely remove it, but don't see where/how to accomplish. Again, sorry if this is a double, but I just saw my first one come through, so I know i'm in the loop. Tnx -- *e*. lraymond(a)weatherflow.com *c.* 386.561.1509 *f.* 386.409.5178

5 11

Re: [Observium] Out of curiosity, how big is everyones installation?
by Jukka Kosonen 12 Dec '12

12 Dec '12

Devices 480 (479 up 1 down 0 ignored 0 disabled ) Ports 20983 (11539 up 9019 down 0 ignored 425 shutdown ) Server is dual cpu (4 cores/cpu), 24GB RAM and 4x146GB 15k rpm disks in RAID10

1 0

Chrome issue with 6k Crossbar
by Robert Williams 11 Dec '12

11 Dec '12

Hi, There seems to be an issue with ‘Normal’ view and the Catalyst 6k Crossbar graph images in Chrome (latest 23.0.1271.95 m) It’s fine in Widescreen view and it’s also fine in Internet Explorer. Normal View: Widescreen View: Our SVN auto-updates so this has probably come with one of the most recent versions. No urgency at all and no feedback needed - just reporting it so it can be tweaked when convenient :) Cheers! Robert Williams Custodian DataCentre email: Robert(a)CustodianDC.com

1 0

Re: [Observium] Problems with setting up bills in rev0.12.12.3474
by Adam Armstrong 09 Dec '12

09 Dec '12

hmmm. I just tested this a few days ago on chrome. Which browser? Daniel Preussker <daniel(a)preussker.net> wrote: >Hi, > >it seems the JavaScript bugs when adding a bill, whenever I click on "Add Port" it redirects me back to "/#addport", displaying my log-overview. >Also adding a bill from the view of a port wont work either, even though I open "/bills/view=add/port=27/", the port is not added to the created bill. > >Is this a known "feauture"? >I remember having to add bills and services raw into the SQL, I dont mind doing so but I cant seem to find the wiki-entry for it again... > > >Cheers, > >Daniel Preussker > >[ Security Consultant, Network & Protocol Security and Cryptography >[ LPI & Novell Certified Linux Engineer and Researcher >[ +49 178 600 96 30 >[ Daniel(a)Preussker.Net >[ http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x87E736968E490AA1 > > >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 5

Problems with setting up bills in rev0.12.12.3474
by Daniel Preussker 08 Dec '12

08 Dec '12

Hi, it seems the JavaScript bugs when adding a bill, whenever I click on "Add Port" it redirects me back to "/#addport", displaying my log-overview. Also adding a bill from the view of a port wont work either, even though I open "/bills/view=add/port=27/", the port is not added to the created bill. Is this a known "feauture"? I remember having to add bills and services raw into the SQL, I dont mind doing so but I cant seem to find the wiki-entry for it again... Cheers, Daniel Preussker [ Security Consultant, Network & Protocol Security and Cryptography [ LPI & Novell Certified Linux Engineer and Researcher [ +49 178 600 96 30 [ Daniel(a)Preussker.Net [ http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x87E736968E490AA1

1 0

Moving an interface from one device to another and having the graph follow
by Jason Lixfeld 07 Dec '12

07 Dec '12

I just moved a transit link from router 1 to router 2. I cleared the old interface on router 1 and copied it to router 2. When I went back to my Observium graphs, the aggregate graphs picked up the interface in the transit aggregate graph, but all the old data was lost. I guess this doesn't really surprise me, although it might be kinda cool to have Observium automagically move the graph to the new interface if the new interface description matches, but that might be a little problematic if there was ever a case where a dedupe was required on interface descriptions, so I digress.. Is there a way to get that old data back somehow? Thanks in advance.

7 23

Re: [Observium] future of Service Monitoring & Discovery
by Daniel Preussker 06 Dec '12

06 Dec '12

Hi Tom, I've been afraid you would say something like that. Lets just hope there'll be a replacement in future... About Nagios, I've been on nagios for quite a while now and just switched back to Observium once again. I definitely prefer Observium over Nagios to be honest, after all I always ended up with Observium in the end ;) However, I could imagine an NMap integration into Observium for probing Ports and Services; Since Observium already knows which ports are open, it should be possible to wrap NMap in a shell-script and let it execute along service-polling for probing and service analysis. Cheers, Daniel Preussker [ Security Consultant, Network & Protocol Security and Cryptography [ LPI & Novell Certified Linux Engineer and Researcher [ +49 178 600 96 30 [ Daniel(a)Preussker.Net [ http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x87E736968E490AA1

1 0

future of Service Monitoring & Discovery
by Daniel Preussker 06 Dec '12

06 Dec '12

Hello Obversium-List, I've read on the wiki (http://observium.org/wiki/Services) that Services are going to be removed in future. Will there be a replacement without extra software on the clients? Alternatively, whats the most efficient way of monitoring TCP/UDP Port states when Services are being removed? Thanks and Kind regards from snow-white germany, Daniel Preussker [ Security Consultant, Network & Protocol Security and Cryptography [ LPI & Novell Certified Linux Engineer and Researcher [ +49 178 600 96 30 [ Daniel(a)Preussker.Net [ http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x87E736968E490AA1

2 1

Out of curiosity, how big is everyones installation?
by Morgan McLean 04 Dec '12

04 Dec '12

Just curious what the average size of an observium installation is among the users on the email list. I have ~150 devices with ~6000 ports across three sites. Anybody else? Morgan

23 37

Wrong VLAN port member info
by Zafar Pravaiz 04 Dec '12

04 Dec '12

HI All There is something wrong on VLAN info page. I see incorrect no of port in a VLAN in observium while on switch its different. Please see the attachment. Am i missing something ? Thanks -- *Zafar Pravaiz *IT Senior Systems Engineer Information Technology Department AUS /> </span><span style='font-size:10.0pt;font-family:Times;mso-bidi-font-family: Tel +971 6 515 2164 Fax +971 6515 2112 American University of Sharjah PO Box 26666, Sharjah United Arab Emirates http://www.aus.edu <http://www.aus.edu/> zpravaiz(a)aus.edu <mailto:youremail@aus.edu>

4 5

Transparent background
by Mike 29 Nov '12

29 Nov '12

Hello. After the recent commits, all popup graphs are displayed with a transparent background. It is not pretty. Thanks -- Mike Stupalov

4 3

Missing info
by Mike Richardson 29 Nov '12

29 Nov '12

Hiya, We're just started using Observium and are quite impressed. We've added a few of our devices - just the key ones. What were seeing is that for the devices they are missing some of the data. For example the following tabs are missing - Health, VLANs, Map and Inventory. The environment panels are missing (Processors, Memory etc.) The poller is running successfully and the port information is being populated and graphs are draw correctly. What we're not doing is running the Discover command. AFAICT it will add to Observium devices it finds from CDP as a matter of course. We don't want that to happen. My uneducated guess is that the discover command is also picking up some of the information we're missing. (I've run the command briefly then killed it when I realised what it was doing, and some of the devices are populated with Health, VLANs etc.) If I'm right, is there a way to gather the above information about the devices already present but not add any more? I've got: $config['dp_autocreate'] = false; ## Autodiscover unknown hosts seen via discovery protocols in the config but discover still seems to add new devices. If I'm wrong then could someone set me straight please? Thanks, Mike -- Mike Richardson Networks (network(a)manchester.ac.uk) IT Services, University of Manchester *Plain text only please - attachments stripped on arrival*

3 4

Re: [Observium] 404 page problem on fresh installation
by Rompetechos rompetechos 28 Nov '12

28 Nov '12

I think, that may be other thing, because mod_rewrite is enabled and the directory of installation has the AllowOverride Option. Any more sugestion? Thanks for the help

2 1

Re: [Observium] can't get syslog working
by Tom Laermans 27 Nov '12

27 Nov '12

Hi, Did you follow the documentation on the website? The fact that you "tried with 2 different daemons" leads me to believe that you didn't... Tom Sent from my mobile, please excuse brevity and spelling errors. ----- Reply message ----- From: "Stefan Milo" <stefan(a)zendata.dk> To: "observium(a)observium.org" <observium(a)observium.org> Subject: [Observium] can't get syslog working Date: Mon, Nov 26, 2012 17:40 Hi I'm having a hard time getting syslog to work. I've enabled the syslog menu in config.php by inserting "$config['enable_syslog'] = 1;" Ive tried using both rsyslog and syslog-ng. But the syslog menu in observium is just blank? The syslog server is working and receiving info on udp port 514. 2012 Nov 26 17:35:36 10.0.0.33 Address=10.0.0.253 This is a test message generated by Kiwi SyslogGen Any advice? BR Stefan Milo Noobie Observium User _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

4 15

404 page problem on fresh installation
by Rompetechos rompetechos 27 Nov '12

27 Nov '12

I have a fresh installation of Observium on Centos 6 64 bits. I can see the main page without problems, but when a i try to click on any page, devices, locations, etc i get a 404 code. The installation is on a dedicate vhost, any idea of what can be wrong?. Thanks in advanced

2 1

question about arista devices
by Maarten Kruyswijk 27 Nov '12

27 Nov '12

Hi we have added a couple of arista devices to observium. But we are missing a few things. Ospf neighbours are not showing. The routing tab on the device page is not showing And the config tab is not coming up on the device page. Are we doing something wrong? Or is it something we can easily fix? Kind regards, maarten

3 8

30 minute poll issue
by Robert Williams 26 Nov '12

26 Nov '12

Hi Guys, Got a weird issue which has just started, seemingly by itself but I imagine there was a cause (I just don't know it yet!). In short, every 30 minute the poller decides that approximately a third of all devices (92 in total) are 'Offline'. They then magically recover on the next poller interval. The devices are not offline, and the Observium host does not loose connectivity (I've tested with numerous pings etc. during this predictable failure period). Interestingly, the host on which Observium runs does record these interesting CPU and RAM metrics during that particular polling run: [cid:image001.png@01CDCBDF.93DC5B50] [cid:image002.png@01CDCBDF.93DC5B50] Now, I'm guessing that there is maybe a more substantial 'discovery' run or similar every 30 minutes. For some reason, this more intensive run seems to be resulting in a load of devices going allegedly offline. The problem started on Friday around 11pm and has repeated like clockwork since. We are running the latest SVN. I'm a bit uncertain where to start with this one as although it's predictable I can't really see anything which would cause it to happen. Pointers for diagnosing further very welcome :) Cheers as always! Robert Williams Custodian DataCentre email: Robert(a)CustodianDC.com

3 12

Re: [Observium] 30 minute poll issue
by Tom Laermans 26 Nov '12

26 Nov '12

The poller doesnt run 'out of time', no hosts are ever skipped. The poller simply runs to completion. If it takes longer than 5 minutes, it simply starts a new one while the other is still running, which may blow up your system in the longer run. Sent from my mobile, please excuse brevity and spelling errors. ----- Reply message ----- From: "Robert Williams" <Robert(a)CustodianDC.com> To: "'Observium Network Observation System'" <observium(a)observium.org> Subject: [Observium] 30 minute poll issue Date: Mon, Nov 26, 2012 21:09 Hi – yes it is indeed virtualised, the host is a Dell R710 - 12 Cores @ 2.4GHz / 16GB according to ESX. It’s running on an enterprise grade Kingston SSD, along with Cacti. The host is fairly low-load (it only runs a few monitoring systems and a couple of virtual routers). CPU and network load on the physical host for today are: It has a 1GB NIC and I’ve already checked but over the last 4 hours it hasn’t dropped a single ICMP ping to any of the 4 targets I’ve been continuously polling directly from the Observium VM. Three of the targets were repeatedly showing as down, until I suspended a few hosts on the total devices list. For what it’s worth, the other monitoring instance on there (Cacti) has about 7,000 data sources and isn’t missing a single one. It is on a one-minute polling interval and takes between 10 and 12 seconds to complete. Observium has also been flawless up until now. Interestingly, at 19:10 I moved to the poller-wrapper and re-enabled the hosts that I had disabled. Now CPU usage during each poll is approx 2x and the duration of the polling event is now about 45 seconds according to the wrapper. Since that change, I’ve not had a host go down? It could be coincidence, so I’m going to leave it overnight without making any other changes and see if by the morning it has started doing it again. Out of curiosity - is it possible, with a single poller instance (i.e. what I had before) that should a host respond correctly to the first SNMP get / ping, but then take a very long time to respond to the rest of the polls (say 5 seconds per OID), that it could delay the polling process enough for it to run out of time before hitting all the targets? Thus declare the rest it missed as ‘down’ because it never got around to them? I only ask because if this is possible then it could explain why adding more hosts could lead to this as there are a couple which I know are particularly slow to respond. Specifically they are hardware-integrated SNMP modules on systems which run tiny ARM chips and linux 2.4.21-rmk1. They are _slow_ to get their answers back, especially if two systems are concurrently polling them. If it isn’t possible, then that’s obviously off the mark, but the fact that the wrapper (appears) to have resolved it makes me wonder enough to ask :) Cheers! Robert Williams Custodian DataCentre email: Robert(a)CustodianDC.com From: observium-bounces(a)observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 26 November 2012 19:49 To: Observium Network Observation System Subject: Re: [Observium] 30 minute poll issue Almost all recent changes have been web-interface related. We did change the loop around the rrdtool binary, but that shouldn't affect polling. Detecting up/down doesn't really have any prerequisites. It does an ICMP ping and a UDP snmpget. If either of those fail to return, and the host isn't already down, it changes the value in the database to down and skips the rest of the poll. There is nothing really code-related that could cause the effects you're seeing, only the return packets failing to reach the PHP process in time. This kind of thing isn't even observed on very, very heavily loaded systems. Is this a virtualised system? adam. On 26/11/2012 13:27, Robert Williams wrote:Hi, well any ignoring you think I’m doing is certainly not the case – you said to check for other cron jobs and I did. There aren’t any (literally, this system has only Observium on it). I also checked for any processes running at the point of the ‘host down’ events as was also suggested; the only one is the poller / php process itself. Which takes more CPU on every 6th poll, but nothing more interesting than that. If there were other suggestions then I’m really sorry I’ve obviously missed them (which is quite likely as I’ve noticed before some postings from this list have been dropped by our filtering system). Either way, I’m certainly not ignoring you, I think it would be a bit stupid to ignore any advice from the creator of the product which you are having trouble with :) Always suspect the last change you made broke it – so since there were five or six hosts added last week my initial suspicion was maybe the poller was running out of time. The higher number hosts failing, in order, suggested to me that (assuming it polls them in numerical order) again maybe it is running out of time before completing. This was slightly confirmed by removing hosts at random and suddenly the problem went away. I’m just trying to fault-find at the same time as asking for pointers and I’m happy to check anything that anyone on here may suggest. Incidentally I’m just deploying Job’s poller-wrapper script which I’ve been meaning to do for a while but never got around to it. I’ll know in 30 minutes or so if it’s helped at all and I’ll let you know. In the meantime, please do let me know if I’ve missed or ignored something, as I’ve most certainly not intended to – cheers! Robert WilliamsCustodian DataCentreemail: Robert(a)CustodianDC.com From: observium-bounces(a)observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 26 November 2012 18:59 To: Observium Network Observation System Subject: Re: [Observium] 30 minute poll issue You're looking in completely the wrong place, and you've totally ignored everything i've said, so I give up. have fun. On 26/11/2012 12:24, Robert Williams wrote:Right – I’ve disabled a few of the recent additions and each time I disable one the number of hosts which are ‘down’ decreases. Now, with 3 hosts disabled I only have 2 hosts which are failing. Also, the hosts which fail are always numbered sequentially and are always high-numbered, say above host ID 90. Is it possible the poller is simply running out of time? Can the time be extended? Either way, why only on exactly every 6 polls / 30 minutes? Weird… Robert WilliamsCustodian DataCentreemail: Robert(a)CustodianDC.com From: observium-bounces(a)observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 26 November 2012 16:58 To: Observium Network Observation System Subject: Re: [Observium] 30 minute poll issue Btw, when one single installation out of thousands starts doing something like this, it's almost never related to the code, and almost always related to the system it's installed on. adam. On 26/11/2012 10:38, Robert Williams wrote:Hi – no other cron jobs on that box, it’s purely running Observium and the only jobs are the poller itself and a selection of jobs which run at weekly or daily intervals for various system functions. There is also a weekly SVN pull for Observium :) As a test we have removed the most recently added device to see if that helps, but I could do with some way of recording what is happening on that particular poll. It’s like clockwork but I can’t see anything that would cause that on the network side, and everything definitely responds (from the Observium console) 100% during the poll itself. Cheers! Robert WilliamsCustodian DataCentreemail: Robert(a)CustodianDC.com From: observium-bounces(a)observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 26 November 2012 16:07 To: Observium Network Observation System Subject: Re: [Observium] 30 minute poll issue Look for other, newly added cron jobs. Discovery is only run once every 6 hours. It's pretty difficult to make the poller believe that something is offline without network issues, as all it does to decide is a ping and an snmp get. adam. On 26/11/2012 08:14, Robert Williams wrote:Hi Guys, Got a weird issue which has just started, seemingly by itself but I imagine there was a cause (I just don’t know it yet!). In short, every 30 minute the poller decides that approximately a third of all devices (92 in total) are ‘Offline’. They then magically recover on the next poller interval. The devices are not offline, and the Observium host does not loose connectivity (I’ve tested with numerous pings etc. during this predictable failure period). Interestingly, the host on which Observium runs does record these interesting CPU and RAM metrics during that particular polling run: Now, I’m guessing that there is maybe a more substantial ‘discovery’ run or similar every 30 minutes. For some reason, this more intensive run seems to be resulting in a load of devices going allegedly offline. The problem started on Friday around 11pm and has repeated like clockwork since. We are running the latest SVN. I’m a bit uncertain where to start with this one as although it’s predictable I can’t really see anything which would cause it to happen. Pointers for diagnosing further very welcome J Cheers as always! Robert WilliamsCustodian DataCentreemail: Robert(a)CustodianDC.com _______________________________________________observium mailing listobservium@observium.orghttp://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________observium mailing listobservium@observium.orghttp://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________observium mailing listobservium@observium.orghttp://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________observium mailing listobservium@observium.orghttp://postman.memetic.org/cgi-bin/mailman/listinfo/observium

1 0

can't get syslog working
by Stefan Milo 26 Nov '12

26 Nov '12

Hi I'm having a hard time getting syslog to work. I've enabled the syslog menu in config.php by inserting "$config['enable_syslog'] = 1;" Ive tried using both rsyslog and syslog-ng. But the syslog menu in observium is just blank? The syslog server is working and receiving info on udp port 514. 2012 Nov 26 17:35:36 10.0.0.33 Address=10.0.0.253 This is a test message generated by Kiwi SyslogGen Any advice? BR Stefan Milo Noobie Observium User

1 0

adding ATM0 port
by Norman Daniel 26 Nov '12

26 Nov '12

I have an 878 router with SHDSL interface, it shows ATM0 in inventory but no statistics or port discovered.

3 2

Observium stopped graphing and not showing anything on "ports" Tab
by Timo Ament 21 Nov '12

21 Nov '12

Hey Guys, I'm fairly new to Observium. This monday my observium installation suddenly stopped populating the Graphs and when on the Page of a device selecting the POrts-Tab the site is now empty. Do you have a hint where to check? Regards Timo

2 1

upgrading ios cause new sensors oid appear
by Nikolay Shopik 19 Nov '12

19 Nov '12

Hi, So we just upgraded one our cisco7201 device from 15.0(1)M3 to 15.1(3)S4, and all sensors data disappear, after while it rediscover some of them but using different(?) OID. At least what I see is, old RRD files still exist but no longer updated, here is example new files: mempool-cemp-4.1.rrd mempool-cemp-4.2.rrd mempool-cemp-4.3.rrd and old mempool-cemp-3.1.rrd mempool-cemp-3.2.rrd mempool-cemp-3.3.rrd Temperature sensors move into different MIB? because old files was: sensor-temperature-cisco-entity-sensor-19.rrd sensor-temperature-cisco-entity-sensor-18.rrd sensor-temperature-cisco-entity-sensor-17.rrd and new: sensor-temperature-cisco-2.rrd sensor-temperature-cisco-3.rrd sensor-temperature-cisco-1.rrd All voltage sensors now gone, which is kinda weird, but probably is some kind cisco weirdness or just move them to other MIB. Is this some kind Cisco MIB(OID) mess we have here or something else?

2 3

Switch 4510G 48-Port
by Alex Vitola 19 Nov '12

19 Nov '12

Currently I have two Switch 4510G 48-Port Software Version 5.20 Release 2202P18, and is not generated graphics of Memory, CPU and Temperature. I saw that this switch is not officially supported. As I understand I need to make this switch model files in the directories: / opt / observium / includes / discovery / temperature / opt / observium / includes / discovery / processors / opt / observium / includes / discovery / mempools Is this correct? Somebody use this model?

3 3

VMware VM's vanished
by Robert Williams 17 Nov '12

17 Nov '12

Hi all, I recently added all our ESXi hosts to Observium, previously they were only in our other systems. I was pleased to see all the VMs appear on it (this didn't work last time I tried about a year ago, which is why they weren't in Observium). However, about an hour later I checked up on them and they have all disappeared; well, sort of: [cid:image001.png@01CDC4B4.8D572B70] All of this 'was' correct (honest) when I first added them. The same is true for all the hosts I've added, although they do all have the correct number of 'blank' entries though? Attached is the slightly cleaned-up output from a debug run on one of the ESX hosts. Any thoughts welcome :) Cheers, Robert Williams Custodian DataCentre email: Robert(a)CustodianDC.com

2 2