- observium - lists.observium.org

Geographically distributed pollers with poller-wrapper.py
by Michael Hsu 26 Jun '13

26 Jun '13

The problem is that the pollers write to rrd's local to the poller box and observium isn't written in a way where these can be easily distributed. I wrote the patch that added that comment as that was my goal. I tested using parallel rsync methods as well as using glusterfs replicated filesystem across multiple datacenters but couldn't get my polling runs + syncing to complete within 5 minute runs (quickest I could get were 8 minute runs writing to about 16,000+ rrds). I have a large number of ports however so smaller installations could probably work. I wonder what the plans are for being able to distribute observium across multiple hosts, geographically or not. Or if anyone else has attempted this. What would be great would be the option to use something like graphite for the graphing backend so pollers could just send data to graphite and observium could use graphite to create the graphs for the web interface. >On 2013-06-24 14:46, Benjamin Abadie wrote: >> Hi, >> I'm reading the following as a comment in poller-wrapper.py : >> >> Additionally, if a hostname wildcard is passed, add it to the where >> clause. This is >> important in cases where you have pollers distributed geographically >> and want to limit >> pollers to polling hosts matching their geographic naming scheme. >> >> Do you have some advice on how I could implement this (that is, >> multiple pollers on multiple servers) ? Even if it is not shiny enough >> to be put in production, that's just for testing purposes. >> >> I hope my brain cured since last time I posted on this ML, and is now >> compatible with Adam's one. > >There is no geographic distribution possible. > >adam.

2 1

Problem with geolocation
by Joniel Gagné-Laurin 26 Jun '13

26 Jun '13

Hi everyone, Been using for some time Observium as a potential replacement for our reporting system and we are now ready to put in production our server but I'm stuck at the moment. I know some people had this issue in the past and some fix were put in place but it doesn't work for me. On a newly installed server, when I try to add a host by addhost.php, the mysql insert query is not going through because the location_geoapi is empty. The easiest way of dealing would be to just allow null value or put a default value, but I would like to have a clean solution as we will use it for production. I don't know if there is something missing in my setup or what, but something I'm sure, the request to get the geo location doesn't go out as I don't see anything on my proxy. So, can someone can help me here? I can provide some debugging if you need more information. Fantastic product by the way, loving it. Thank you Joniel Gagné-Laurin Administrateur Infrastructure - Infrastructure Administrator Square-Enix Europe t. 514-670-6310 / c. 514-209-7924 ______________________________________________________________________ This email has been scanned by the MessageLabs ______________________________________________________________________

2 3

Re: [Observium] Y U NO SLACKWARE?
by Adam Armstrong 26 Jun '13

26 Jun '13

Why no Slackware version? Laurens Vets <laurens(a)daemon.be> wrote: >Following can be added to the distro script: > >+ elif [ -f /etc/slackware-version ]; then >+ DISTRO="Slackware" > >-Laurens >_______________________________________________ >observium mailing list >observium(a)observium.org >http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

2 1

Y U NO SLACKWARE?
by Laurens Vets 25 Jun '13

25 Jun '13

Following can be added to the distro script: + elif [ -f /etc/slackware-version ]; then + DISTRO="Slackware" -Laurens

1 0

negative ifInOctets?
by McDonald Richards 25 Jun '13

25 Jun '13

1 0

Geographically distributed pollers with poller-wrapper.py
by Benjamin Abadie 24 Jun '13

24 Jun '13

Hi, I'm reading the following as a comment in poller-wrapper.py : > Additionally, if a hostname wildcard is passed, add it to the where clause. This is > important in cases where you have pollers distributed geographically and want to limit > pollers to polling hosts matching their geographic naming scheme. Do you have some advice on how I could implement this (that is, multiple pollers on multiple servers) ? Even if it is not shiny enough to be put in production, that's just for testing purposes. I hope my brain cured since last time I posted on this ML, and is now compatible with Adam's one. Cheers, Benjamin Abadie

2 1

Adding new OS and types of devices
by Jon Auer 24 Jun '13

24 Jun '13

1) I have some devices that aren't known to Observium that I'd like to track. I've followed the instructions at http://observium.org/wiki/Developing/NewOS and made a new OS type for Ubiquiti EdgeOS routers. Diff here: http://www.tapodi.net/~jda/dev/edgeos.diff <http://www.tapodi.net/%7Ejda/dev/edgeos.diff> Did I do that correctly, and if so, how do I contribute it back into Observium? 2) Is there a preferred way to handle point to multipoint aggregation devices such as DSLAMs, GPON OLTs, and Wireless APs where you have client signal levels, modulation, etc? In particular I'd like to add support for Ubiquiti and Canopy APs where one would track multiple metrics for each associated client in addition to metrics from the device itself. E.g. Stats for the downlink can be gathered from the AP, but uplink has to be gathered from the client radios. Clients are only loosely associated with APs (they are discovered through a AP, can migrate to other APs, and don't have a static IP address). Client devices like this break the hostname-required rule but perhaps it isn't mandatory if they are discovered via the AP? <http://observium.org/wiki/Developing/NewOS>

2 1

Re: [Observium] Problem very LONG poll times
by Zach Underwood 23 Jun '13

23 Jun '13

UPDATE:I just recheck and the polling is back to where it should be. Now time to fine what happened. On Sat, Jun 22, 2013 at 9:31 PM, Zach Underwood <zunder1990(a)gmail.com>wrote: > I ran "snmpwalk -v 1 -c public 216.105.128.35" on my observium host and > another host. I have listed the time it took to run the command. > > observim = 2m29.119s (this is a vm) > other host = 3m22.429s ( this dell PE2900 with 8gb ram and 2x quad cpu) > > > > On Sat, Jun 22, 2013 at 9:09 PM, Cameron Daniel <cdaniel(a)nurve.com.au>wrote: > >> What about if you snmpwalk your switch from the server. Does it respond >> quickly or is it slower than you'd expect, ie line by line on a host <10ms >> away? >> >> That should help narrow down whether or not it's a local issue >> >> >> >> -- Zach Underwood (RHCE,RHCSA,RHCT) My website <http://zachunderwood.me> My photes <http://zunder1990.openphoto.me>

1 0

Problem very LONG poll times
by Zach Underwood 23 Jun '13

23 Jun '13

Last night when I went to bed the avg polling on a device was 5-50 sec and then morning it is 300-600 sec per device. My system is a vmware VM with 4 vcpu. 4gb ram and 15k drives in a SAN. I have check the easy stuff like SAN load or CPU load and look fine. Please help. -- Zach Underwood (RHCE,RHCSA,RHCT) My website <http://zachunderwood.me> My photes <http://zunder1990.openphoto.me>

3 9

Re: [Observium] Problem very LONG poll times
by Tom Laermans 23 Jun '13

23 Jun '13

Mysql on the same machine? What does show processlist or mytop say? Sent from my mobile, please excuse brevity and spelling errors. ----- Reply message ----- From: "Zach Underwood" <zunder1990(a)gmail.com> To: "Observium Network Observation System" <observium(a)observium.org> Subject: [Observium] Problem very LONG poll times Date: Sat, Jun 22, 2013 22:21 Ok I pick one network switch and disable about 75% of the unused module on this switch and I got the poll down to 109 sec. This same 24 port switch was taking only 10sec to poll. In watch the debug poll on a few devices it looks like all of the modules are slow. On Sat, Jun 22, 2013 at 3:22 PM, Adam Armstrong <adama(a)memetic.org> wrote: Even less of an idea now. What happens if you try to run one of the snmp queries it runs? Have you noticed any particular module being slow? On 2013-06-22 19:38, Zach Underwood wrote: Here is top. This was taken during a poll There is almost no network traffic. This vm is only uesd for observium. [root@observium init.d]# top top - 14:12:01 up 3:34, 4 users, load average: 0.00, 0.01, 0.00 Tasks: 143 total, 1 running, 142 sleeping, 0 stopped, 0 zombie Cpu(s): 0.4%us, 0.1%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 3924572k total, 591700k used, 3332872k free, 42380k buffers Swap: 4063224k total, 0k used, 4063224k free, 282400k cached PID to kill: PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 10878 root 20 0 116m 3044 1656 S 1.0 0.1 0:00.06 /usr/bin/snmpget -v1 -c -Otv -M /opt/observium/mibs udp:p 10862 root 20 0 15024 1344 1012 R 0.5 0.0 0:00.06 top 1 root 20 0 19356 1572 1268 S 0.0 0.0 0:01.65 /sbin/init 2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 [kthreadd] 3 root RT 0 0 0 0 S 0.0 0.0 0:00.01 [migration/0] 4 root 20 0 0 0 0 S 0.0 0.0 0:00.09 [ksoftirqd/0] -- Zach Underwood (RHCE,RHCSA,RHCT) My website [1] My photes [2] Links: ------ [1] http://zachunderwood.me [2] http://zunder1990.openphoto.me _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium(a)observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium -- Zach Underwood (RHCE,RHCSA,RHCT)My website My photes

2 1