I'm actually working on building a distributed Observium with separate webfront, database, RRD-storage and pollers to be able to scale polling very far.To be able to be fully efficient some improvements has to be done to the observium rrdcached-code (to be able to do all rrd-operations via rrdcached) but this is in the works.with these improvements I think its possible to scale Observium very very far when it comes to polling devices./Markus2016-11-16 18:56 GMT+01:00 Johann Mallet <johann.mallet@zayo.com>:Another question : Someone have already deployed Observium in "distributed" mode?Because if the tools works with 150k interfaces, we will scale up by integrating all our networks equipments.
This represents between 300k and 500k interfaces (physical + virtuel + subinterface etc) :-)
I don't think a single server can make the deal here ;-)Johann2016-11-16 18:40 GMT+01:00 Johann Mallet <johann.mallet@zayo.com>:Many core for many poller in same time. Great SSD for I/O with as much RRD files.I think with really good hardware (big CPU, many core, RAID SSD and great network interface), we can monitor 150k+ interfaces with Observium.And the latency between poller server and the equipment :-)So yes, we can poller many equipments in same time.We have not problem with RRDcached on 3 deployments :-)Good question : > 300 equipments.
> If the switch is slow you will have a problem.
Based on your feedback :Thank you all :-)Johann2016-11-12 13:33 GMT+01:00 Markus Klock <markus@best-practice.se>:If you have a decent SSD for RRD storage you will probably not need rrdcached. I Monitor Close to 100k interfaces without rrdcached. No IOwait on the SSD at all :)
But there are a lot of if's regarding monitoring 150k interfaces. One parameter is how many devices are the 150k interfaces devided on? As a single device can only be polled by one poller, Nexus switches for example can be horribel as a single switch can have 1000+ ports. If the switch is slow you will have a problem.Den 12 nov. 2016 12:54 em skrev "Youssef BENGELLOUN - ZAHR" <ybzahr@prodware.fr>:That's very helpful ;-)
Why would you say that ?
Y.
Youssef BENGELLOUN - ZAHR - Consultant Expert
Prodware France
T : +33 979 999 000 - F : +33 988 814 001 - ybzahr@prodware.fr
Web : prodware.fr
On 12 Nov 2016, at 11:02, Youssef BENGELLOUN - ZAHR <ybzahr@prodware.fr> wrote:Hello,
I don¹t pretend that we have the same amount of intefaces to poll but we
are keen on performance and found entries about the rrdcached capability.
In your opinion, what is the tipping point to reach before considering
using rrdcached capability ?
Best regards.
On 12/11/2016 11:56, "observium on behalf of Steffen Klemer"
<observium-bounces@observium.org on behalf of steffen.klemer@gwdg.de>
wrote:And don't forget about rrdcached. I only recently got aware of it and
it's fabulous (if you are alright with loosing some amount of data in
case of server failure).
Am Thu, 10.11.2016 um 17:17 schrieb "Adam Armstrong"
<adama@memetic.org>:SSD or ramdisk storage, many cores for poller. Exact numbers may
vary ;)
adam.
Sent from Mailbird
[http://www.getmailbird.com/?utm_source=Mailbird&utm_med ium=email&
;utm_campaign=sent-from-mailbird]
On 10/11/2016 17:06:41, Youssef BENGELLOUN - ZAHR
<ybzahr@prodware.fr> wrote: Dear Johann,
You should take a look at the online documentation with recommended
system sizing.
Best regards.
From: observium <observium-bounces@observium.org
[mailto:observium-bounces@observium.org ]> on behalf of Johann Mallet
<johann.mallet@zayo.com [mailto:johann.mallet@zayo.com]> Reply-To:
Observium Network Observation System <observium@observium.org
[mailto:observium@observium.org ]> Date: jeudi 10 novembre 2016 17:52
To: Observium Network Observation System <observium@observium.org
[mailto:observium@observium.org ]> Subject: [Observium] Monitor 147k
interfaces with Observium?
Hello,
We must monitor 147,000 interfaces (logical) with Observium.
Anyone has already building an architecture with so many network
ports?
Observium can monitor 150k network ports without failed?
What is hardware recommendations? :-)
Thanks !
Johann
Youssef BENGELLOUN - ZAHR - Consultant Expert
Prodware France
T : +33 979 999 000 - F : +33 988 814 001 - ybzahr@prodware.fr
[mailto:ybzahr@prodware.fr]
Web : prodware.fr [http://www.prodware.fr]
[http://twitter.com/Prodware/] [http://www.facebook.com/Prodware /]
[https://www.linkedin.com/company/prodwarefrance ]
[https://www.youtube.com/c/ProdwareFrance ]
[http://www.viadeo.com/fr/company/prodware ]
[http://www.prodware.fr/social-network /]
lg
/Steffen
--
Steffen Klemer E-Mail: Steffen.Klemer@gwdg.de
Tel: +49 551 201 2170
GWDG - Gesellschaft für wissenschaftliche
Datenverarbeitung mbH Göttingen
Am Faßberg 11, 37077 Göttingen
Service-Hotline:
Tel: +49 551 201-1523
E-Mail: support@gwdg.de
Kontakt:
Tel: 0551 201-1510
Fax: 0551 201-2150
E-Mail: gwdg@gwdg.de
WWW: https://www.gwdg.de
Geschäftsführer: Prof. Dr. Ramin Yahyapour
Aufsichtsratsvorsitzender: Prof. Dr. Christian Griesinger
Sitz der Gesellschaft: Göttingen
Registergericht: Göttingen, Handelsregister-Nr. B 598
Zertifiziert nach ISO 9001
BENGELLOUN - ZAHR Youssef - Consultant Expert
Prodware France
T : +33 979 999 000 F : +33 988 814 001 - ybzahr@prodware.fr
Web : prodware.fr
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observiu m _______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observiu m
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observiu m
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observiu m
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observiu m
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/ observium