Hi Lars,
we had a similar problem but in our case we could identify that certain devices were always slow to respond.
I created a group called 'Slow-Responders' to contain these devices.
The poller-wrapper.py script allows you to include or exclude groups (by group-id not name).
You can also play around with the number of worker threads, if you have a lot of workers waiting for a response, you might as well use up some of that idle time.
Our cron job entries look like:

*/5 *     * * *   root    /opt/observium/poller-wrapper.py -w 96 --exclude-groups 225 ...
*/5 *     * * *   root    /opt/observium/poller-wrapper.py -w 32 --include-groups 225 ...

Hope this helps,
Michael.


On Tue, 18 May 2021 at 20:32, Lars Joergensen via observium <observium@observium.org> wrote:

Hi

 

We have one Observium server looking at

 

  • 476 devices (mainly switches, some firewalls, some WAN routers)
  • 3666 ports
  • 8692 sensors

 

The server has 6 cores  (~70% idle, ~3% iowait) and 8 GB memory. We have configured 15 poller threads with max 6 allowed wrapper processes.

 

The server is struggling to keep the polling cycle below 300 seconds (averaging 376 secs).

 

Is this workload realistic for one server, and if so where do you suggest we tune? Or do we need to use a distributed setup?

 

 

Lars

Disclaimer: This e-mail, including any attachments, is for the intended recipient only. If you have received this e-mail by mistake please notify the sender immediately by return e-mail and delete this e-mail and any attachments, without opening the attachments, from your system. Access, disclosure, copying, distribution or reliance on any part of this e-mail by anyone else is prohibited. This e-mail is confidential and may be legally privileged. Chr. Hansen does not represent and/or warrant that the information sent and/or received by or with this e-mail is correct and does not accept any liability for damages related thereto. https://www.chr-hansen.com/en/legal-notice
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium