Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail
On 5 Nov 2018, 10:17, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam
Please see versions below, it seems to me the poller wrapper was running,
/usr/bin/python -V
Python 2.7.9
cat /etc/debian_version
8.11
I wanted to also check if we can upgrade this server to Debian 9 via apt-get dist-upgrade or is this unsafe?
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 4:54 PM To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Copy DB/config.php/rrds, install ubuntu 18.04, install observium, overwrite db/config/rrds :)
I don't think it was the wrapper changes, since my dev install is running a close version :
root@zeta:/home/observium/dev# python -V Python 2.7.13 root@zeta:/home/observium/dev#
Can you put a second install on that server and see why the poller doesn't work? :D
adam. On 2018-11-05 16:13:44, Pieter Meyer via observium observium@observium.org wrote: Hi Adam Please see versions below, it seems to me the poller wrapper was running, /usr/bin/python -V Python 2.7.9 cat /etc/debian_version 8.11 I wanted to also check if we can upgrade this server to Debian 9 via apt-get dist-upgrade or is this unsafe? Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map [https://goo.gl/maps/WHe3soT1fHm%5D%7C website [http://www.convergedgroup.net/] | company blog [http://www.convergedgroup.net/blog/] | linkedin [http://www.linkedin.com/company/converged-telecoms] CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated. From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 4:54 PM To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550 What OS is this running on? What version of python? The only changes recently which may cause this were to the small amount of python we use for the poller wrapper. Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?) Adam. Sent from BlueMail [http://www.bluemail.me/r?b=14063] On 5 Nov 2018, at 10:17, Pieter Meyer via observium <observium@observium.org [mailto:observium@observium.org]> wrote: Hi Adam After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating. We also notice that smokeping rrd graphs was still working, Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs. Downgrading to 18.10.9519 resolved all issues Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map [https://goo.gl/maps/WHe3soT1fHm%5D%7C website [http://www.convergedgroup.net/] | company blog [http://www.convergedgroup.net/blog/] | linkedin [http://www.linkedin.com/company/converged-telecoms] CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [http://postman.memetic.org/cgi-bin/mailman/listinfo/observium]
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data © http://www.openstreetmap.org/copyright OpenStreetMap contributors, © https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail
On 6 Nov 2018, 14:58, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data �� http://www.openstreetmap.org/copyright OpenStreetMap contributors, ��
https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in
poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam
I have updated to ver 9556, but as mentioned in this version we still have issues with both the map not working on the landing page and rrd graphs not updating,
Please can you assist troubleshooting this we do have a valid subscription
Version Information
Observium
18.10.9535 (31st October 2018)
OS
Linux 4.9.0-8-amd64 [amd64] (Debian 9 (stretch))
Apache
2.4.25 (Debian)
PHP
7.0.30-0+deb9u1 (OPcache: ENABLED)
Python
2.7.13
MySQL
5.7.19-17-log (extension: mysqli 5.0.12-dev)
SNMP
NET-SNMP 5.7.3
RRDtool
1.6.0
Fping
3.15 (IPv4 and IPv6)
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data © http://www.openstreetmap.org/copyright OpenStreetMap contributors, © https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Do you have an adblocker on your browser which is interfering in the map's downloading of the geojson file?
You're the only person who has reported that the poller isn't working, and that change was made some days ago.
Does the poller.php still run if you run it manually? Does poller-wrapper.py run if you run it manually?
The error message you posted earlier was something fixed some days ago, the current version of the poller-wrapper.py doesn't have that line of code.
adam. On 2018-11-06 16:44:14, Pieter Meyer via observium observium@observium.org wrote: Hi Adam I have updated to ver 9556, but as mentioned in this version we still have issues with both the map not working on the landing page and rrd graphs not updating, Please can you assist troubleshooting this we do have a valid subscription Version Information Observium 18.10.9535 (31st October 2018) OS Linux 4.9.0-8-amd64 [amd64] (Debian 9 (stretch)) Apache 2.4.25 (Debian) PHP 7.0.30-0+deb9u1 (OPcache: ENABLED) Python 2.7.13 MySQL 5.7.19-17-log (extension: mysqli 5.0.12-dev) SNMP NET-SNMP 5.7.3 RRDtool 1.6.0 Fping 3.15 (IPv4 and IPv6) Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map [https://goo.gl/maps/WHe3soT1fHm%5D%7C website [http://www.convergedgroup.net/] | company blog [http://www.convergedgroup.net/blog/] | linkedin [http://www.linkedin.com/company/converged-telecoms] CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated. From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550 The current version is 9556, anything before that is irrelevant. Adam. Sent from BlueMail [http://www.bluemail.me/r?b=14063] On 6 Nov 2018, at 14:58, Pieter Meyer via observium <observium@observium.org [mailto:observium@observium.org]> wrote: Hi Adam I have now since updated to Debian 9.5 and running the same version python that you use, root@mon:/opt/observium# python -V Python 2.7.13 root@mon:/opt/observium# cat /etc/debian_version 9.5 And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs Last working version seems to be 9535 With version 9536 I get the below output when running it manually root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24 WARNING! Using number of threads without command argument (-w or --workers) is deprecated! Please replace your poller wrapper command line with: observium-wrapper poller -w 24 Traceback (most recent call last): File "/opt/observium/poller-wrapper.py", line 463, in <module> print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC KeyError: 'poller_name' Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21 I also see the below message in blue that was bot there before This is the default poller. Will only poll devices with no specified poller set. We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544 Leaflet [http://leafletjs.com/%5D%C2%A0%7C Map data © OpenStreetMap [http://www.openstreetmap.org/copyright%5D%C2%A0contributors, © CARTO [https://carto.com/attributions] U html/js/leaflet.js U html/css/leaflet.css U html/geo.php U html/includes/map/leaflet.inc.php U html/pages/dashboard.inc.php Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map [https://goo.gl/maps/WHe3soT1fHm%5D%7C website [http://www.convergedgroup.net/] | company blog [http://www.convergedgroup.net/blog/] | linkedin [http://www.linkedin.com/company/converged-telecoms] CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated. From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550 What OS is this running on? What version of python? The only changes recently which may cause this were to the small amount of python we use for the poller wrapper. Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?) Adam. Sent from BlueMail [http://www.bluemail.me/r?b=14063] On 5 Nov 2018, at 10:17, Pieter Meyer via observium <observium@observium.org [mailto:observium@observium.org]> wrote: Hi Adam After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating. We also notice that smokeping rrd graphs was still working, Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs. Downgrading to 18.10.9519 resolved all issues Regards Pieter Meyer Converged Group | Licensed ISP 0258/IECNS/JAN/09 75 Witkoppen Rd, North Riding, Gauteng, 2162 Office: +27 10 591 4600 | Mobile: +27 83 233 6614 map [https://goo.gl/maps/WHe3soT1fHm%5D%7C website [http://www.convergedgroup.net/] | company blog [http://www.convergedgroup.net/blog/] | linkedin [http://www.linkedin.com/company/converged-telecoms] CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you. DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [http://postman.memetic.org/cgi-bin/mailman/listinfo/observium]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [http://postman.memetic.org/cgi-bin/mailman/listinfo/observium]
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data © http://www.openstreetmap.org/copyright OpenStreetMap contributors, © https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Why are you installing PHP 7.0?
Adam.
Sent from BlueMail
On 6 Nov 2018, 18:59, at 18:59, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data �� http://www.openstreetmap.org/copyright OpenStreetMap contributors, ��
https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in
poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
You seem to have managed to break your database.
You need to create the poller_id field in the devices table, the SQL commands to do this will be in the most recent file in update/
Note that you can not upgrade and downgrade versions randomly, because it can break your database.
Adam.
Sent from BlueMail
On 6 Nov 2018, 18:59, at 18:59, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data �� http://www.openstreetmap.org/copyright OpenStreetMap contributors, ��
https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in
poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Oh, and you may also have to create the pollers table which was probably created in the same file!
Adam.
Sent from BlueMail
On 6 Nov 2018, 19:15, at 19:15, Adam Armstrong via observium observium@observium.org wrote:
You seem to have managed to break your database.
You need to create the poller_id field in the devices table, the SQL commands to do this will be in the most recent file in update/
Note that you can not upgrade and downgrade versions randomly, because it can break your database.
Adam.
Sent from BlueMail
On 6 Nov 2018, 18:59, at 18:59, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that
is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy
this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening
or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data �� http://www.openstreetmap.org/copyright OpenStreetMap contributors,
��
https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that
is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy
this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening
or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small
amount
of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps
in
poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed
that
our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not
the
rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that
is
confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy
this
email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening
or
using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Thanks Adam, seems that resolved my issue
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 21:16 To: Pieter Meyer via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
You seem to have managed to break your database.
You need to create the poller_id field in the devices table, the SQL commands to do this will be in the most recent file in update/
Note that you can not upgrade and downgrade versions randomly, because it can break your database.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 18:59, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data © http://www.openstreetmap.org/copyright OpenStreetMap contributors, © https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (2)
-
Adam Armstrong -
Pieter Meyer