Observium Capacity for large networks
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
On 2014-07-11 00:52, Daniel Josue Rodriguez Paiz wrote:
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Hi,
Observium scales primarily on I/O throughput for writing RRDs, which scale mostly by port numbers on network devices. (servers scale more by device number).
15,000 is a very large number, are they switches, cpe, servers?
I don't think we have any installations scaling that high, I think the largest I know of is ~3000 devices, mostly switches, so a very large number of ports.
adam.
Thanks for your reply, the equipments are switches and servers, is for the monitoring of a ISP so is a large network.
Thank you very much for your reply.
2014-07-10 18:03 GMT-06:00 Adam Armstrong adama@memetic.org:
On 2014-07-11 00:52, Daniel Josue Rodriguez Paiz wrote:
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Hi,
Observium scales primarily on I/O throughput for writing RRDs, which scale mostly by port numbers on network devices. (servers scale more by device number).
15,000 is a very large number, are they switches, cpe, servers?
I don't think we have any installations scaling that high, I think the largest I know of is ~3000 devices, mostly switches, so a very large number of ports.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
You can probably ignore the servers. Calculate how many ports are on the switches, and you'll perhaps get a rough idea of the requirements.
As you can now fit 24 cores in a single system relatively inexpensively, we can scale pretty far on a single system as our poller runs multiple parallel processes. :)
Splitting MySQL to a separate server with fewer, faster cores helps. Storing RRDs on SSD (or ramdisk if you can afford the RAM) is very important too.
adam.
On 2014-07-11 01:37, Daniel Josue Rodriguez Paiz wrote:
Thanks for your reply, the equipments are switches and servers, is for the monitoring of a ISP so is a large network.
Thank you very much for your reply.
2014-07-10 18:03 GMT-06:00 Adam Armstrong adama@memetic.org:
On 2014-07-11 00:52, Daniel Josue Rodriguez Paiz wrote:
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Hi,
Observium scales primarily on I/O throughput for writing RRDs, which scale mostly by port numbers on network devices. (servers scale more by device number).
15,000 is a very large number, are they switches, cpe, servers?
I don't think we have any installations scaling that high, I think the largest I know of is ~3000 devices, mostly switches, so a very large number of ports.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]
Links:
[1] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Thank you very much for the information, it was very usefull :D
2014-07-10 19:22 GMT-06:00 Adam Armstrong adama@memetic.org:
You can probably ignore the servers. Calculate how many ports are on the switches, and you'll perhaps get a rough idea of the requirements.
As you can now fit 24 cores in a single system relatively inexpensively, we can scale pretty far on a single system as our poller runs multiple parallel processes. :)
Splitting MySQL to a separate server with fewer, faster cores helps. Storing RRDs on SSD (or ramdisk if you can afford the RAM) is very important too.
adam.
On 2014-07-11 01:37, Daniel Josue Rodriguez Paiz wrote:
Thanks for your reply, the equipments are switches and servers, is for the monitoring of a ISP so is a large network.
Thank you very much for your reply.
2014-07-10 18:03 GMT-06:00 Adam Armstrong adama@memetic.org:
On 2014-07-11 00:52, Daniel Josue Rodriguez Paiz wrote:
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Hi,
Observium scales primarily on I/O throughput for writing RRDs, which scale mostly by port numbers on network devices. (servers scale more by device number).
15,000 is a very large number, are they switches, cpe, servers?
I don't think we have any installations scaling that high, I think the largest I know of is ~3000 devices, mostly switches, so a very large number of ports.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]
Links:
[1] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
I installed it at a local datacenter with 10K devices and over 40 Gbps of bandwidth. Ran it on a VM on 2x L5420 CPU and 8 GB of ram. Ran like a dream. It still runs today without any issues.
-- Sincerely, Joshua Hopper, A+ CE Network Administrator [cid:image001.jpg@01CF9CED.275DE1C0] 420 3rd Ave NW Hickory NC 28601 Office: 828-449-1839x2160 | Cell: 828-855-7565
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Daniel Josue Rodriguez Paiz Sent: Thursday, July 10, 2014 7:52 PM To: observium@observium.org Subject: [Observium] Observium Capacity for large networks
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation.
That's nice!
Care to share the port count?
Regular 7200rpm disks, or faster?
Tom
On 07/11/2014 03:47 PM, Josh Hopper wrote:
I installed it at a local datacenter with 10K devices and over 40 Gbps of bandwidth. Ran it on a VM on 2x L5420 CPU and 8 GB of ram.
Ran like a dream. It still runs today without any issues.
--
Sincerely,
Joshua Hopper, A+ CE
/Network Administrator///
http://www.protectplus.com/images/ppluslogo.jpg
420 3^rd Ave NW Hickory NC 28601
Office: 828-449-1839x2160 | Cell: 828-855-7565
*From:*observium [mailto:observium-bounces@observium.org] *On Behalf Of *Daniel Josue Rodriguez Paiz *Sent:* Thursday, July 10, 2014 7:52 PM *To:* observium@observium.org *Subject:* [Observium] Observium Capacity for large networks
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Your signature SCREAMS... ;)
On 11 July 2014 15:47, Josh Hopper joshhopper@protectplus.com wrote:
I installed it at a local datacenter with 10K devices and over 40 Gbps of bandwidth. Ran it on a VM on 2x L5420 CPU and 8 GB of ram.
Ran like a dream. It still runs today without any issues.
--
Sincerely,
Joshua Hopper, A+ CE
*Network Administrator*
[image: http://www.protectplus.com/images/ppluslogo.jpg]
420 3rd Ave NW Hickory NC 28601
Office: 828-449-1839x2160 | Cell: 828-855-7565
*From:* observium [mailto:observium-bounces@observium.org] *On Behalf Of *Daniel Josue Rodriguez Paiz *Sent:* Thursday, July 10, 2014 7:52 PM *To:* observium@observium.org *Subject:* [Observium] Observium Capacity for large networks
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
A+ Community Edition ;-)
On 07/11/2014 04:25 PM, Wouter Prins wrote:
Your signature SCREAMS... ;)
On 11 July 2014 15:47, Josh Hopper <joshhopper@protectplus.com mailto:joshhopper@protectplus.com> wrote:
I installed it at a local datacenter with 10K devices and over 40 Gbps of bandwidth. Ran it on a VM on 2x L5420 CPU and 8 GB of ram. Ran like a dream. It still runs today without any issues. -- Sincerely, Joshua Hopper, A+ CE /Network Administrator/// http://www.protectplus.com/images/ppluslogo.jpg 420 3^rd Ave NW Hickory NC 28601 Office: 828-449-1839x2160 | Cell: 828-855-7565 *From:*observium [mailto:observium-bounces@observium.org <mailto:observium-bounces@observium.org>] *On Behalf Of *Daniel Josue Rodriguez Paiz *Sent:* Thursday, July 10, 2014 7:52 PM *To:* observium@observium.org <mailto:observium@observium.org> *Subject:* [Observium] Observium Capacity for large networks Hello, I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less. Does anyone know if observium works fine in a large network? Thanks in advance for your replies. Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation. _______________________________________________ observium mailing list observium@observium.org <mailto:observium@observium.org> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
-- Wouter Prins wp@null0.nl mailto:wp@null0.nl
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
:) I work with old people and they are blind. :)
-- Sincerely, Joshua Hopper, A+ CE Network Administrator [cid:image001.jpg@01CF9CF3.A0AB4A80] 420 3rd Ave NW Hickory NC 28601 Office: 828-449-1839x2160 | Cell: 828-855-7565
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Friday, July 11, 2014 10:31 AM To: Observium Network Observation System Subject: Re: [Observium] Observium Capacity for large networks
A+ Community Edition ;-)
On 07/11/2014 04:25 PM, Wouter Prins wrote: Your signature SCREAMS... ;)
On 11 July 2014 15:47, Josh Hopper <joshhopper@protectplus.commailto:joshhopper@protectplus.com> wrote: I installed it at a local datacenter with 10K devices and over 40 Gbps of bandwidth. Ran it on a VM on 2x L5420 CPU and 8 GB of ram. Ran like a dream. It still runs today without any issues.
-- Sincerely, Joshua Hopper, A+ CE Network Administrator [cid:image001.jpg@01CF9CF3.A0AB4A80] 420 3rd Ave NW Hickory NC 28601 Office: 828-449-1839x2160 | Cell: 828-855-7565
From: observium [mailto:observium-bounces@observium.orgmailto:observium-bounces@observium.org] On Behalf Of Daniel Josue Rodriguez Paiz Sent: Thursday, July 10, 2014 7:52 PM To: observium@observium.orgmailto:observium@observium.org Subject: [Observium] Observium Capacity for large networks
Hello,
I'm interested on using Observium Pro to monitoring a large network of 15,000 devices more or less.
Does anyone know if observium works fine in a large network?
Thanks in advance for your replies.
Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation.
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
-- Wouter Prins wp@null0.nlmailto:wp@null0.nl
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Protect Plus Air Holdings, LLC and Affiliates, Protect Plus, LLC and Affiliates, Imagine One Resources, LLC and Affiliates, Protect Plus Surfaces, LLC and Affiliates Confidentiality Notice: This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation.
Well played Josh
On 11 июля 2014 г., at 18:34, Josh Hopper joshhopper@protectplus.com wrote:
I work with old people and they are blind.
Joshua, Did you adjust anything, eg add more numbers after /opt/observium/poller-wrapper.py in cron. I'm think your poller takes longer than five minutes to run.
Do you know how the poller takes to run thru just once ?
thanks
Peter Hine
********************************************************************** The information contained in this e-mail (including any attachments) is for the exclusive use of the addressee. If you are not the intended recipient please notify the sender immediately and delete this e-mail. It is noted that legal privilege is not waived because you have read this e-mail. **********************************************************************
participants (7)
-
Adam Armstrong
-
Daniel Josue Rodriguez Paiz
-
Josh Hopper
-
Nikolay Shopik
-
Peter.Hine@familycourt.gov.au
-
Tom Laermans
-
Wouter Prins