Hi
Is anyone using 95th billing in observium? I've been having slowness issues with it, so I setup a new server, downloaded the latest version and cleared all the billing tables and let it start polling again. This was fine and the polling has been working. The page was loading in less than a second. As the days have gone on, the bills page has been getting slower and slower and now takes at least 20 seconds to load.
I am just wondering if this is normal or if there is something wrong. Thanks.
Kind regards,
Mahomed Hussein
Senior Operations Engineer
[cid:image936b14.jpg@74cffa9e.a72241e4]http://www.custodiandc.com/
Tel:
+44 (0)1622 230 382
Email: Mahomed@CustodianDC.commailto:support@CustodianDC.com
Web:
www.CustodianDC.comhttp://www.custodiandc.com/
Status:
status.CustDC.nethttp://status.custdc.net/
[cid:image98c948.png@112a1189.765f4e73] ISO:27001 IS:567248
Click to view our email disclaimerhttp://www.custodiandc.com/disclaimer.txt
The speed of the billing stuff is a function of how many data points are in the database, which is related to how many bills you have, and how long it's been running.
If you're getting issues so quickly, you're probably tracking a *lot* of bills.
Sounds like you need a bigger database server, with lots of RAM.
Don't forget that you're basically putting an entry into the database every 5 minutes for every bill, and when you generate a bill you're sorting that entire table.
It's possible there are some optimisations that can be done to the billing code and/or database, too. Perhaps table-per-bill would be quicker.
adam.
On Thu, 20 Oct 2011 17:56:42 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi
Is anyone using 95th billing in observium? I've been having slowness issues with it, so I setup a new server, downloaded the latest version
and
cleared all the billing tables and let it start polling again. This was fine and the polling has been working. The page was loading in less than
a
second. As the days have gone on, the bills page has been getting slower and slower and now takes at least 20 seconds to load.
I am just wondering if this is normal or if there is something wrong. Thanks.
Kind regards,
Mahomed Hussein
Senior Operations Engineer
[cid:image936b14.jpg@74cffa9e.a72241e4]http://www.custodiandc.com/
Tel:
+44 (0)1622 230 382
Email: Mahomed@CustodianDC.commailto:support@CustodianDC.com
Web:
www.CustodianDC.comhttp://www.custodiandc.com/
Status:
status.CustDC.nethttp://status.custdc.net/
[cid:image98c948.png@112a1189.765f4e73] ISO:27001 IS:567248
Click to view our email disclaimerhttp://www.custodiandc.com/disclaimer.txt
Hi Adam
Thanks for your response and sorry for my delay in responding. It has been quite busy here.
It does indeed seem to be getting worse with the number of records. It is now taking over 30 seconds and this is the number of records in the tables.
Port_in_measurements: 501720 Port_out_measurements: 501680 Bill_data: 300733 Bills: 70 Bill_Ports: 118
These really seem like small numbers for MySQL and PHP.
The server is an ESXi VM running Ubuntu 11.04 (GNU/Linux 2.6.38-11-server x86_64) with 8GB of RAM with 8 vCPUs. The host is also a powerful IBM server with 2 x Xeon X7560 2.27GHZ 8 Core processors and 96GB of RAM.
Is there any roadmap for some updates/improvements to the 95th billing?
Kind regards,
Mahomed Hussein Senior Operations Engineer Custodian DataCentre tel: +44 (0)1622 230382 email: Mahomed@CustodianDC.com http://www.custodiandc.com/disclaimer.txt
-----Original Message----- From: observium-bounces@observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 20 October 2011 18:16 To: Observium Network Observation System Subject: Re: [Observium] Anyone using 95th Billing?
The speed of the billing stuff is a function of how many data points are in the database, which is related to how many bills you have, and how long it's been running.
If you're getting issues so quickly, you're probably tracking a *lot* of bills.
Sounds like you need a bigger database server, with lots of RAM.
Don't forget that you're basically putting an entry into the database every 5 minutes for every bill, and when you generate a bill you're sorting that entire table.
It's possible there are some optimisations that can be done to the billing code and/or database, too. Perhaps table-per-bill would be quicker.
adam.
On Thu, 20 Oct 2011 17:56:42 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi
Is anyone using 95th billing in observium? I've been having slowness issues with it, so I setup a new server, downloaded the latest version
and
cleared all the billing tables and let it start polling again. This was fine and the polling has been working. The page was loading in less than
a
second. As the days have gone on, the bills page has been getting slower and slower and now takes at least 20 seconds to load.
I am just wondering if this is normal or if there is something wrong. Thanks.
Kind regards,
Mahomed Hussein
Senior Operations Engineer
[cid:image936b14.jpg@74cffa9e.a72241e4]http://www.custodiandc.com/
Tel:
+44 (0)1622 230 382
Email: Mahomed@CustodianDC.commailto:support@CustodianDC.com
Web:
www.CustodianDC.comhttp://www.custodiandc.com/
Status:
status.CustDC.nethttp://status.custdc.net/
[cid:image98c948.png@112a1189.765f4e73] ISO:27001 IS:567248
Click to view our email disclaimerhttp://www.custodiandc.com/disclaimer.txt
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
This e-mail has been scanned by www.CustodianDC.com for viruses, explicit material and spam
Hi,
I've split the generation of bill statistics into another script that you can run occasionally.
do an svn up, then add billing-calculate.php to the crontab with whatever frequency you want it to update the cached bill values.
After that, the /bills/ page will show only the cached billing values, which should speed up that page a lot.
adam.
On Tue, 25 Oct 2011 18:07:54 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi Adam
Thanks for your response and sorry for my delay in responding. It has
been
quite busy here.
It does indeed seem to be getting worse with the number of records. It
is
now taking over 30 seconds and this is the number of records in the
tables.
Port_in_measurements: 501720 Port_out_measurements: 501680 Bill_data: 300733 Bills: 70 Bill_Ports: 118
These really seem like small numbers for MySQL and PHP.
The server is an ESXi VM running Ubuntu 11.04 (GNU/Linux
2.6.38-11-server
x86_64) with 8GB of RAM with 8 vCPUs. The host is also a powerful IBM server with 2 x Xeon X7560 2.27GHZ 8 Core processors and 96GB of RAM.
Is there any roadmap for some updates/improvements to the 95th billing?
Kind regards,
Mahomed Hussein Senior Operations Engineer Custodian DataCentre tel: +44 (0)1622 230382 email: Mahomed@CustodianDC.com http://www.custodiandc.com/disclaimer.txt
-----Original Message----- From: observium-bounces@observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 20 October 2011 18:16 To: Observium Network Observation System Subject: Re: [Observium] Anyone using 95th Billing?
The speed of the billing stuff is a function of how many data points are in the database, which is related to how many bills you have, and how
long
it's been running.
If you're getting issues so quickly, you're probably tracking a *lot* of bills.
Sounds like you need a bigger database server, with lots of RAM.
Don't forget that you're basically putting an entry into the database every 5 minutes for every bill, and when you generate a bill you're
sorting
that entire table.
It's possible there are some optimisations that can be done to the
billing
code and/or database, too. Perhaps table-per-bill would be quicker.
adam.
On Thu, 20 Oct 2011 17:56:42 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi
Is anyone using 95th billing in observium? I've been having slowness issues with it, so I setup a new server, downloaded the latest version
and
cleared all the billing tables and let it start polling again. This was fine and the polling has been working. The page was loading in less than
a
second. As the days have gone on, the bills page has been getting slower and slower and now takes at least 20 seconds to load.
I am just wondering if this is normal or if there is something wrong. Thanks.
Kind regards,
Mahomed Hussein
Senior Operations Engineer
[cid:image936b14.jpg@74cffa9e.a72241e4]http://www.custodiandc.com/
Tel:
+44 (0)1622 230 382
Email: Mahomed@CustodianDC.commailto:support@CustodianDC.com
Web:
www.CustodianDC.comhttp://www.custodiandc.com/
Status:
status.CustDC.nethttp://status.custdc.net/
[cid:image98c948.png@112a1189.765f4e73] ISO:27001 IS:567248
Click to view our email disclaimerhttp://www.custodiandc.com/disclaimer.txt
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
This e-mail has been scanned by www.CustodianDC.com for viruses,
explicit
material and spam
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam
Thanks for this. Unfortunately I won't be able to test this until next week, but I will let you know as soon as I do.
Kind regards,
Mahomed Hussein Senior Operations Engineer Custodian DataCentre tel: +44 (0)1622 230382 email: Mahomed@CustodianDC.com http://www.custodiandc.com/disclaimer.txt
-----Original Message----- From: observium-bounces@observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 02 November 2011 18:24 To: Observium Network Observation System Subject: Re: [Observium] Anyone using 95th Billing?
Hi,
I've split the generation of bill statistics into another script that you can run occasionally.
do an svn up, then add billing-calculate.php to the crontab with whatever frequency you want it to update the cached bill values.
After that, the /bills/ page will show only the cached billing values, which should speed up that page a lot.
adam.
On Tue, 25 Oct 2011 18:07:54 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi Adam
Thanks for your response and sorry for my delay in responding. It has
been
quite busy here.
It does indeed seem to be getting worse with the number of records. It
is
now taking over 30 seconds and this is the number of records in the
tables.
Port_in_measurements: 501720 Port_out_measurements: 501680 Bill_data: 300733 Bills: 70 Bill_Ports: 118
These really seem like small numbers for MySQL and PHP.
The server is an ESXi VM running Ubuntu 11.04 (GNU/Linux
2.6.38-11-server
x86_64) with 8GB of RAM with 8 vCPUs. The host is also a powerful IBM server with 2 x Xeon X7560 2.27GHZ 8 Core processors and 96GB of RAM.
Is there any roadmap for some updates/improvements to the 95th billing?
Kind regards,
Mahomed Hussein Senior Operations Engineer Custodian DataCentre tel: +44 (0)1622 230382 email: Mahomed@CustodianDC.com http://www.custodiandc.com/disclaimer.txt
-----Original Message----- From: observium-bounces@observium.org [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 20 October 2011 18:16 To: Observium Network Observation System Subject: Re: [Observium] Anyone using 95th Billing?
The speed of the billing stuff is a function of how many data points are in the database, which is related to how many bills you have, and how
long
it's been running.
If you're getting issues so quickly, you're probably tracking a *lot* of bills.
Sounds like you need a bigger database server, with lots of RAM.
Don't forget that you're basically putting an entry into the database every 5 minutes for every bill, and when you generate a bill you're
sorting
that entire table.
It's possible there are some optimisations that can be done to the
billing
code and/or database, too. Perhaps table-per-bill would be quicker.
adam.
On Thu, 20 Oct 2011 17:56:42 +0100, Mahomed Hussein Mahomed@CustodianDC.com wrote:
Hi
Is anyone using 95th billing in observium? I've been having slowness issues with it, so I setup a new server, downloaded the latest version
and
cleared all the billing tables and let it start polling again. This was fine and the polling has been working. The page was loading in less than
a
second. As the days have gone on, the bills page has been getting slower and slower and now takes at least 20 seconds to load.
I am just wondering if this is normal or if there is something wrong. Thanks.
Kind regards,
Mahomed Hussein
Senior Operations Engineer
[cid:image936b14.jpg@74cffa9e.a72241e4]http://www.custodiandc.com/
Tel:
+44 (0)1622 230 382
Email: Mahomed@CustodianDC.commailto:support@CustodianDC.com
Web:
www.CustodianDC.comhttp://www.custodiandc.com/
Status:
status.CustDC.nethttp://status.custdc.net/
[cid:image98c948.png@112a1189.765f4e73] ISO:27001 IS:567248
Click to view our email disclaimerhttp://www.custodiandc.com/disclaimer.txt
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
This e-mail has been scanned by www.CustodianDC.com for viruses,
explicit
material and spam
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (2)
-
Adam Armstrong -
Mahomed Hussein