Observium scales primarily on port count rather than device count, especially when it comes to I/O requirements. Our port RRDs are pretty big, so they have the biggest individual contribution to I/O.

96GB is a lot of RAM, you might be better off with an SSD, since dumping all of that data out of RAM disk frequently for backup will be painful (too slow to disk, and pretty punishing to an SSD). :)

adam.

------ Original Message ------
From: todevnull@free.fr
To: "Observium" <observium@observium.org>
Sent: 2018-04-11 12:14:01
Subject: Re: [Observium] Performance issue

Hi Markus,

Thank you for your answer.

I played with the config and read carrefully the performance tuning guide on the website and see my conclusion :

If i poll all 844 devices (routers and switches), then i need 28min by default...
After tunning to 48 threads, it takes 17min ...
I disable polling on every switches (less critical than routers for me), it takes less than 60 sec for 350 routers !!!

I assume that switches need to write data in more rrd files ...

So, i'm now tuning the config and i will ask my boss to provide me 96GB of RAM for implement an RAM drive.
I will keep you informed about the result.

Tarik.




11 avril 2018 07:02 "Markus Klock" <markus@best-practice.se> a écrit:
Yeah you shuld really use SSD-storage when polling 800+ devices.
Other than that, how many poller-wrapper threads have you configured? You can probably bump Them up to 48 with that many CPU cores in the server.
/Markus
Den tis 10 apr. 2018 22:23 <todevnull@free.fr> skrev:
with pictures in attached files ...


10 avril 2018 22:18 todevnull@free.fr a écrit:
Hello all,

After a long period of test, i'm putting in production this great software in my company.
The server is quite good generaly in term of performance except for the disks ...
According to the fact that a polling task shouldn't exceed 5 min, i'm in some trouble ... :-/
A polling session (not the first one), needs 25min to be completed :_(

Except the fact that i should optimize my rrd storage, is there is some particular settings for such installation ?

Thanks in advance for your help.

Tarik.


2x intel xeon X5650 (total of 24 threads), 24GB of RAM, RAID 5 logical drive with 3x15k disks





_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium