Hi,

It's entirely possible that there is no way to accommodate your syslog requirements on our platform.

MySQL isn't the fastest way to store late amounts of data, and there are very real hard limits to performance when you're trying to store large numbers of rows.

If you have data older than 3 months in the table, remove to and see how it affects performance. If you don't, your data volume is probably too large to effectively handle in MySQL.

Adam.

⁣Sent from BlueMail ​

On 26 Aug 2017, 12:10, at 12:10, dorje2007@seznam.cz wrote:

Dear Adam

thank you for your message.

We need to keep the logs for at least 3 months, and collecting them from 150 Cisco devices.

So there is no purpose to truncate the Syslog table, rather to tune it , to be able to use the Syslog messages.

Housekeeping is set to remove the messages older then 3 months

is it possible to do so ? ( mysql tuning, observium loading page , ... )

Thank you very much

greetigns ---------- Původní e-mail ---------- Od: Adam Armstrong adama@memetic.org Komu: Observium observium@observium.org Datum: 26. 8. 2017 12:06:55 Předmět: Re: [Observium] Slow page when accessing the Syslog message " Hi,

At this point you probably need to truncate the syslog page, and then afterwards investigate the housekeeping pages on our website.

Housekeeping will remove excess logs and speed things up in general.

Adam.

Sent from BlueMail(http://www.bluemail.me/r?b=10455)

On 26 Aug 2017, at 12:02, dorje2007@seznam.cz(mailto:dorje2007@seznam.cz) wrote:" Dears,

in my Observium, i have about 80M records in the  Syslog message.

When i want to access it via Observium - Syslog page, it take about 10-15 minutes.

My HW is : 8 GB RAM, 8 cores, HyperV

Would you be so kind to let me know, how can i tune it ? Also the other

pages of Observium are quite slow

Thank you

<hr><br>observium mailing list<br>observium@observium.org<br><a href='http://postman.memetic.org/cgi-bin/mailman/listinfo/observium'>http://postman.memetic.org/cgi-bin/mailman/listinfo/observium</a><br> " _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium "

---

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

Relying on Observium for long term syslog is madness.

Build an ELK stack or something similar and have it pass on relevant syslog messages to Observium for short term visibility, prune them out after a month maybe, and rely on your other system for long term analysis.

On 26 August 2017 at 20:23, dorje2007@seznam.cz wrote:

Dear Adam

thank you for your answer, i understand your point Anyway, do you have some tips, how can we tune it ? Based on your experiences, what are the limits for the Syslog data to be stored ( the record number )

Thank you very much

---------- Původní e-mail ---------- Od: Adam Armstrong adama@memetic.org Komu: Observium observium@observium.org Datum: 26. 8. 2017 12:18:15

Předmět: Re: [Observium] Slow page when accessing the Syslog message

Hi,

It's entirely possible that there is no way to accommodate your syslog requirements on our platform.

MySQL isn't the fastest way to store late amounts of data, and there are very real hard limits to performance when you're trying to store large numbers of rows.

If you have data older than 3 months in the table, remove to and see how it affects performance. If you don't, your data volume is probably too large to effectively handle in MySQL.

Adam.

Sent from BlueMail http://www.bluemail.me/r?b=10455 On 26 Aug 2017, at 12:10, dorje2007@seznam.cz wrote:

Dear Adam

thank you for your message. We need to keep the logs for at least 3 months, and collecting them from 150 Cisco devices. So there is no purpose to truncate the Syslog table, rather to tune it , to be able to use the Syslog messages.

Housekeeping is set to remove the messages older then 3 months

is it possible to do so ? ( mysql tuning, observium loading page , ... ) Thank you very much

greetigns ---------- Původní e-mail ---------- Od: Adam Armstrong adama@memetic.org Komu: Observium observium@observium.org Datum: 26. 8. 2017 12:06:55 Předmět: Re: [Observium] Slow page when accessing the Syslog message

Hi,

At this point you probably need to truncate the syslog page, and then afterwards investigate the housekeeping pages on our website.

Housekeeping will remove excess logs and speed things up in general.

Adam.

Sent from BlueMail http://www.bluemail.me/r?b=10455 On 26 Aug 2017, at 12:02, dorje2007@seznam.cz wrote:

Dears,

in my Observium, i have about 80M records in the Syslog message. When i want to access it via Observium - Syslog page, it take about 10-15 minutes.

My HW is : 8 GB RAM, 8 cores, HyperV

Would you be so kind to let me know, how can i tune it ? Also the other pages of Observium are quite slow

Thank you

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium

---

observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium