I followed that guide for my deployment at the moment. My single server installation (older server) couldn’t keep up with 800+ devices 45k+ ports.

Things to keep in mind, alerts source from the individual poller, so each poller will need smtp access, I’m still not sure if custom alert checks are working on the individual poller though. Which is kind of important, but other than that that guide is good. I ran into an issue where a remote poller based on php 7.1 wouldn’t work with rrdcachced, but that was just recently fixed in r8956. http://jira.observium.org/browse/OBS-2528. Though I haven’t upgraded back to php7.1 to confirm, so my remote poller is still running php 7.0 at the moment.

Thanks,

---------------------------- This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient of this e-mail (even if the e-mail address above is yours), (i) you may not use, copy or retransmit it, (ii) please delete this message and (iii) please notify the sender immediately. Any disclosure, copying, or distribution of this message or the taking of any action based on it, is strictly prohibited. ----------------------------

From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, November 28, 2017 10:36 AM To: observium@observium.org Subject: Re: [Observium] Distributed-remote poĺlers (again)

Hi,

Some work has been done, but it's still very much "if it breaks you get to keep both halves". If you want to do some pioneering work, Marcus wrote up a blog post about it here: http://blog.best-practice.se/2017/10/scaling-observium-horizontally.html

Tom

On 28/11/2017 16:28, Edvinas K wrote: Hello,

I would like to know if there any plans or solutions to make Observium run in distributed poller setup ?

Thanks

_______________________________________________

observium mailing list

observium@observium.orgmailto:observium@observium.org

http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

It's already a feature. It's possible we might add some other infrastructure around it, but it works well enough for anyone who's capable of setting it up, I think.

adam.

Adam Armstrong Managing Director & Lead Architect Observium Limited http://www.observium.org http://docs.observium.org http://jira.observium.org On 2017-11-28 18:07:54, Edvinas K edvinas.email@gmail.com wrote: thank you, is it possible to know - if this job is in progress and would end up in some official - stable feature ?:)

On Tue, Nov 28, 2017 at 5:59 PM, Sam Hernandez-gill <Sam.Hernandez-gill@qvc.com [mailto:Sam.Hernandez-gill@qvc.com]> wrote:

I followed that guide for my deployment at the moment. My single server installation (older server) couldn’t keep up with 800+ devices 45k+ ports. Things to keep in mind, alerts source from the individual poller, so each poller will need smtp access, I’m still not sure if custom alert checks are working on the individual poller though. Which is kind of important, but other than that that guide is good. I ran into an issue where a remote poller based on php 7.1 wouldn’t work with rrdcachced, but that was just recently fixed in r8956. http://jira.observium.org/browse/OBS-2528 [http://jira.observium.org/browse/OBS-2528]. Though I haven’t upgraded back to php7.1 to confirm, so my remote poller is still running php 7.0 at the moment. Thanks, ---------------------------- This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient of this e-mail (even if the e-mail address above is yours), (i) you may not use, copy or retransmit it, (ii) please delete this message and (iii) please notify the sender immediately. Any disclosure, copying, or distribution of this message or the taking of any action based on it, is strictly prohibited. ----------------------------

From: observium [mailto:observium-bounces@observium.org [mailto:observium-bounces@observium.org]] On Behalf Of Tom Laermans Sent: Tuesday, November 28, 2017 10:36 AM To: observium@observium.org [mailto:observium@observium.org] Subject: Re: [Observium] Distributed-remote poĺlers (again) Hi,

Some work has been done, but it's still very much "if it breaks you get to keep both halves". If you want to do some pioneering work, Marcus wrote up a blog post about it here: http://blog.best-practice.se/2017/10/scaling-observium-horizontally.html [http://blog.best-practice.se/2017/10/scaling-observium-horizontally.html]

Tom

On 28/11/2017 16:28, Edvinas K wrote: Hello, I would like to know if there any plans or solutions to make Observium run in distributed poller setup ? Thanks

_______________________________________________ observium mailing list observium@observium.org [mailto:observium@observium.org] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [http://postman.memetic.org/cgi-bin/mailman/listinfo/observium]

_______________________________________________ observium mailing list observium@observium.org [mailto:observium@observium.org] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [http://postman.memetic.org/cgi-bin/mailman/listinfo/observium]

_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

No, sorry but that will not work. The a distributed poller SNMP-polls its devices(which is pretty random, you can not tell it to only poll the devices on the same continent) and as soon as it gets a SNMP-response it will try to write to the MySQL-database and rrdcached at the master, if it fails to contact the master then it will fail to save the data. Data is not saved locally on the poller.

/Markus

2017-11-30 10:38 GMT+01:00 Edvinas K edvinas.email@gmail.com:

So, i've some questions:

do it's possible to scale the already running setup ?

1. Is it possible to make already running single server as a "master"

where would RRD/MYSQL databases reside and that "master" server also would be as a one of the pollers. And addition to that add two other pollers.

So in summary I just want to add two additional pollers to existing Observium poller, while all the device ID's and all the history would be kept.

Our DC is not big ~200 devices. We're considering this option to allow us to see what's going on when there problems in the network occur - when setup with single poller cannot reach the network node which is in other continent - all the data is lost. As I understand in distributed poller setup the poller which would reside in other continent would be able to 'grap' the monitoring data and (when the connection would be available again) it would send the information from other continent 'local' poller to the 'main; server. Do i'm correctly understand distributed poller principle ? Do the data saved in one (distant) poller could be resented when connection between two Pollers is up again ?

Thank you

On Tue, Nov 28, 2017 at 10:38 PM, Adam Armstrong adama@observium.org wrote:

...

It's already a feature. It's possible we might add some other infrastructure around it, but it works well enough for anyone who's capable of setting it up, I think.

adam.

Adam Armstrong Managing Director & Lead Architect Observium Limited http://www.observium.org http://docs.observium.org http://jira.observium.org

On 2017-11-28 18:07:54, Edvinas K edvinas.email@gmail.com wrote: thank you, is it possible to know - if this job is in progress and would end up in some official - stable feature ?:)

On Tue, Nov 28, 2017 at 5:59 PM, Sam Hernandez-gill < Sam.Hernandez-gill@qvc.com> wrote:

...

I followed that guide for my deployment at the moment. My single server installation (older server) couldn’t keep up with 800+ devices 45k+ ports.

Things to keep in mind, alerts source from the individual poller, so each poller will need smtp access, I’m still not sure if custom alert checks are working on the individual poller though. Which is kind of important, but other than that that guide is good. I ran into an issue where a remote poller based on php 7.1 wouldn’t work with rrdcachced, but that was just recently fixed in r8956. http://jira.observium.org/br owse/OBS-2528. Though I haven’t upgraded back to php7.1 to confirm, so my remote poller is still running php 7.0 at the moment.

Thanks,

---

This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient of this e-mail (even if the e-mail address above is yours), (i) you may not use, copy or retransmit it, (ii) please delete this message and (iii) please notify the sender immediately. Any disclosure, copying, or distribution of this message or the taking of any action based on it, is strictly prohibited.

---

*From:* observium [mailto:observium-bounces@observium.org] *On Behalf Of *Tom Laermans *Sent:* Tuesday, November 28, 2017 10:36 AM *To:* observium@observium.org *Subject:* Re: [Observium] Distributed-remote poĺlers (again)

Hi,

Some work has been done, but it's still very much "if it breaks you get to keep both halves". If you want to do some pioneering work, Marcus wrote up a blog post about it here: http://blog.best-practice.se/2 017/10/scaling-observium-horizontally.html

Tom

On 28/11/2017 16:28, Edvinas K wrote:

Hello,

I would like to know if there any plans or solutions to make Observium run in distributed poller setup ?

Thanks

---

observium mailing list

observium@observium.org

http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi -bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

Thank you,

Regarding the first section of question.

If you can't say to the particular Poller which devices to POLL, how every poller chooses which devices to POLL ? Do they do it round-robin ?

On Thu, Nov 30, 2017 at 3:22 PM, Tom Laermans tom.laermans@powersource.cx wrote:

On 30/11/2017 10:38, Edvinas K wrote:

...

So, i've some questions:

do it's possible to scale the already running setup ?

1. Is it possible to make already running single server as a "master"

where would RRD/MYSQL databases reside and that "master" server also would be as a one of the pollers. And addition to that add two other pollers.

So in summary I just want to add two additional pollers to existing Observium poller, while all the device ID's and all the history would be kept.

Up to here, that is completely correct - adding extra pollers will keep all your current devices set up, with ids and all...

...

Our DC is not big ~200 devices. We're considering this option to allow us to see what's going on when there problems in the network occur - when setup with single poller cannot reach the network node which is in other continent - all the data is lost. As I understand in distributed poller setup the poller which would reside in other continent would be able to 'grap' the monitoring data and (when the connection would be available again) it would send the information from other continent 'local' poller to the 'main; server. Do i'm correctly understand distributed poller principle ? Do the data saved in one (distant) poller could be resented when connection between two Pollers is up again ?

... but it writes directly to the same database and there is no "backing up the data until the main controller becomes available again".

Tom

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium