Ah, I had found in the mailing list some people using '64'.  I've dropped it back to 10 and will see how things do.  

One additional thing.  I noticed in the defaults.inc.php file there was an option to enable the "-Cr#" flag for snmpbulkwalk and there was indication this would greatly speed up things.  The default is set to off however.  Doing some testing I've found a walk that took almost 6 minutes "-m IF-MIB -M /data/observium/mibs for ifEntry" was dropped to around a minute when "-Cr5" was set.  I did this on the command line, not in Obs.  Just curious what the downside is, google-fu isn't revealing much.

Thanks again,

--chip


On Wed, Nov 6, 2013 at 6:43 PM, Adam Armstrong <adama@memetic.org> wrote:
25 is a very, very high number. It's probably too high if you're not running off a very expensive SSD or ramdisk.

You can see how long devices take to poll in the web interface, look under the globe menu,

adam.


On 2013-11-06 23:36, chip wrote:
Ok, just to circle back, I've made some changes:

1:  Set the number of poller-wrapper.py processes to 25, this greatly
speeded up things.  Thanks!

2:  I still noticed I had a few devices that would take 8-12 minutes
to finish a poll.  "ps kstart_time -ef | grep "wrap|poller.php" will
help identify when processes started and what devices were taking so
long.  Incidentally this is found in the "observium.log" file as well,
but this is a bit more real time.  The devices that were taking a
really long time have only a handful of interfaces but around 2500
vlans and associated SVI/VE interfaces.  The hardware doesn't supply
traffic stats on these interfaces so I disabled lots of polling and
discovery modules.  There are lots of ARP entries on these devices as
well, I don't really require those so I disabled those modules as
well.  Looked through the "includes/defaults.inc.php" and put a lot of
the stuff I didn't need or want into "config.php" and set to disable.
 The devices still take around 3 minutes to finish, but at least its
not 5!

I think things are much better now, thanks for the help!

--chip

On Wed, Nov 6, 2013 at 3:55 PM, Adam Armstrong <adama@memetic.org> wrote:

On 2013-11-06 20:45, Tom Laermans wrote:

Sure sounds like it doesn't finish in 5min.. because of "I added some
devices and..." ...

He's running the poller wrapper with only a single process, that probably explains it...

:D

adam.

_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]


--
Just my $.02, your mileage may vary,  batteries not included, etc....

_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium



--
Just my $.02, your mileage may vary,  batteries not included, etc....