Hi guys, We just started having this problem on Friday and am not sure where to look for the problem. Some of our data just doesn't show up anymore. See the attached image. Some servers work fine and some don't. The 6 hour view will work ok, but the historical data seems to have disappeard. We are seeing odd ?'s on many of the graphs installed of numbers. Here is the SVN info:
[root@noc observium]# svn info Path: . URL: http://svn.observium.org/svn/observium/trunk Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 5503 Node Kind: directory Schedule: normal Last Changed Author: adama Last Changed Rev: 5503 Last Changed Date: 2014-05-19 01:40:38 -0700 (Mon, 19 May 2014)
Any help is greatly appreciated!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.comhttp://www.maxlinear.com/ 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011 [Description: Description: http://wiki/download/attachments/1704274/Maxlinear+Logo.png?version=1&mo...]
________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
You have some very, very large spikes in your data.
adam.
On 2014-05-19 17:31, Joshua Elson wrote:
Hi guys, We just started having this problem on Friday and am not sure where to look for the problem. Some of our data just doesn't show up anymore. See the attached image. Some servers work fine and some don't. The 6 hour view will work ok, but the historical data seems to have disappeard. We are seeing odd ?'s on many of the graphs installed of numbers. Here is the SVN info:
[root@noc observium]# svn info
Path: .
URL: http://svn.observium.org/svn/observium/trunk
Repository Root: http://svn.observium.org/svn
Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8
Revision: 5503
Node Kind: directory
Schedule: normal
Last Changed Author: adama
Last Changed Rev: 5503
Last Changed Date: 2014-05-19 01:40:38 -0700 (Mon, 19 May 2014)
Any help is greatly appreciated!
JOSH ELSON | Linux Systems Administrator MAXLINEAR | www.maxlinear.com [1] 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
Links:
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: Monday, May 19, 2014 5:04 PM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
You have some very, very large spikes in your data.
adam.
On 2014-05-19 17:31, Joshua Elson wrote:
Hi guys, We just started having this problem on Friday and am not sure where to look for the problem. Some of our data just doesn't show up anymore. See the attached image. Some servers work fine and some don't. The 6 hour view will work ok, but the historical data seems to have disappeard. We are seeing odd ?'s on many of the graphs installed of numbers. Here is the SVN info:
[root@noc observium]# svn info
Path: .
URL: http://svn.observium.org/svn/observium/trunk
Repository Root: http://svn.observium.org/svn
Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8
Revision: 5503
Node Kind: directory
Schedule: normal
Last Changed Author: adama
Last Changed Rev: 5503
Last Changed Date: 2014-05-19 01:40:38 -0700 (Mon, 19 May 2014)
Any help is greatly appreciated!
JOSH ELSON | Linux Systems Administrator MAXLINEAR | www.maxlinear.com [1] 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
Links:
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam.
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Thanks for the detailed explanation Adam. We definitely saw some weirdness on a few servers this past week. Things appear to be back to normal for the most part with the exception of the distorted/skewed 48 hour, one week and one month views.
Tom, do you think removespikes.php will help with this? Do I just run it from the command line and are there any additional arguments to pass or just run "php /opt/observium/scripts/removespikes.php"?
The help is greatly appreciated from both of you guys!!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
Nevermind, I found the syntax for the removespikes.php. For anybody else having this issue:
php scripts/removespikes.php --rrdfile=rrd/foo/fum.rrd
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Joshua Elson Sent: Tuesday, May 20, 2014 10:08 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Thanks for the detailed explanation Adam. We definitely saw some weirdness on a few servers this past week. Things appear to be back to normal for the most part with the exception of the distorted/skewed 48 hour, one week and one month views.
Tom, do you think removespikes.php will help with this? Do I just run it from the command line and are there any additional arguments to pass or just run "php /opt/observium/scripts/removespikes.php"?
The help is greatly appreciated from both of you guys!!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
Ahh, didn't get around to responding before now - glad you found this yourself.
Does it work for you like that? My PHP (Debian 7) doesn't seem to like it unless I specify the full absolute path to the php (so php /opt/observium/scripts/remo..) and to the rrd.
Did it kill your spikes, data all good?
On 20/05/2014 20:39, Joshua Elson wrote:
Nevermind, I found the syntax for the removespikes.php. For anybody else having this issue:
php scripts/removespikes.php --rrdfile=rrd/foo/fum.rrd
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Joshua Elson Sent: Tuesday, May 20, 2014 10:08 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Thanks for the detailed explanation Adam. We definitely saw some weirdness on a few servers this past week. Things appear to be back to normal for the most part with the exception of the distorted/skewed 48 hour, one week and one month views.
Tom, do you think removespikes.php will help with this? Do I just run it from the command line and are there any additional arguments to pass or just run "php /opt/observium/scripts/removespikes.php"?
The help is greatly appreciated from both of you guys!!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Tom, Yes, it worked without the path to php and fixed my issues on the two servers. We are running Centos 5 for what it's worth. I am still very curious what happened, but am glad it's fixed for now.
Thanks again for the help!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 PM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Ahh, didn't get around to responding before now - glad you found this yourself.
Does it work for you like that? My PHP (Debian 7) doesn't seem to like it unless I specify the full absolute path to the php (so php /opt/observium/scripts/remo..) and to the rrd.
Did it kill your spikes, data all good?
On 20/05/2014 20:39, Joshua Elson wrote:
Nevermind, I found the syntax for the removespikes.php. For anybody else having this issue:
php scripts/removespikes.php --rrdfile=rrd/foo/fum.rrd
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Joshua Elson Sent: Tuesday, May 20, 2014 10:08 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Thanks for the detailed explanation Adam. We definitely saw some weirdness on a few servers this past week. Things appear to be back to normal for the most part with the exception of the distorted/skewed 48 hour, one week and one month views.
Tom, do you think removespikes.php will help with this? Do I just run it from the command line and are there any additional arguments to pass or just run "php /opt/observium/scripts/removespikes.php"?
The help is greatly appreciated from both of you guys!!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
This problem has popped back up again. The weird thing is that we ran the removespikes.php script again which fixed it and then 2 minutes later the same servers had the issue again. Any suggestions on what to look at, so this doesn't keep happening? There doesn't appear to be heavy load/traffic on these servers when it's happening.
Thanks,
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Joshua Elson Sent: Tuesday, May 20, 2014 3:38 PM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Hi Tom, Yes, it worked without the path to php and fixed my issues on the two servers. We are running Centos 5 for what it's worth. I am still very curious what happened, but am glad it's fixed for now.
Thanks again for the help!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 PM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Ahh, didn't get around to responding before now - glad you found this yourself.
Does it work for you like that? My PHP (Debian 7) doesn't seem to like it unless I specify the full absolute path to the php (so php /opt/observium/scripts/remo..) and to the rrd.
Did it kill your spikes, data all good?
On 20/05/2014 20:39, Joshua Elson wrote:
Nevermind, I found the syntax for the removespikes.php. For anybody else having this issue:
php scripts/removespikes.php --rrdfile=rrd/foo/fum.rrd
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 760-517-1431 | cell # 760-212-6852 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Joshua Elson Sent: Tuesday, May 20, 2014 10:08 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
Thanks for the detailed explanation Adam. We definitely saw some weirdness on a few servers this past week. Things appear to be back to normal for the most part with the exception of the distorted/skewed 48 hour, one week and one month views.
Tom, do you think removespikes.php will help with this? Do I just run it from the command line and are there any additional arguments to pass or just run "php /opt/observium/scripts/removespikes.php"?
The help is greatly appreciated from both of you guys!!
Josh Elson | Linux Systems Administrator MaxLinear | www.maxlinear.com 2051 Palomar Airport Road, Suite 100 | Carlsbad, CA 92011
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Tom Laermans Sent: Tuesday, May 20, 2014 1:23 AM To: Observium Network Observation System Subject: Re: [Observium] Graphing/data problem
scripts/removespikes.php could perhaps help?
On 20/05/2014 03:26, Adam Armstrong wrote:
On 2014-05-19 19:18, Joshua Elson wrote:
I don't disagree. The stats have disappeared on the 24 hour and 48 hour view. I just tried upgrading to the latest version of Observium via SVN thinking the update I did last week might have done something funky. Only the 6 hour and 1 year work on 2 particular servers. All other data has simply disappeared from the graphs. Here is the same server but a different graph, so the traffic was definitely there. Any ideas?
You're being confused by the scale of the graph. The information hasn't "disappeared". That would be simply and absolutely impossible.
You have spikes which are distorting the scale of the graph to such an extent that the information you believe has "disappeared" is squashed down to be smaller than a single pixel at the bottom of the graph.
Quite impressive. I've never seen a spike for which rrdtool didn't even know what the SI prefix would be! (hence the ?)
This isn't anything we can fix, it's not a bug. It's just what happens when you use rrdtool. We have a lot of mechanisms to prevent it, but it's impossible to prevent in all circumstances.
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. ________________________________
This electronic mail (including any attachments) may contain information that is privileged, confidential, and/or otherwise protected from disclosure to anyone other than its intended recipient(s). Any dissemination or use of this electronic mail or its contents (including any attachments) by persons other than the intended recipient(s) is strictly prohibited. If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety.
participants (3)
-
Adam Armstrong -
Joshua Elson -
Tom Laermans