Thanks Adam, seems that resolved my issue
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 21:16 To: Pieter Meyer via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
You seem to have managed to break your database.
You need to create the poller_id field in the devices table, the SQL commands to do this will be in the most recent file in update/
Note that you can not upgrade and downgrade versions randomly, because it can break your database.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 18:59, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log
I used the below commands to restore my config and we use external mysql DB
https://docs.observium.org/install_debian/
Manual Installation
apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \
php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \
mtr-tiny ipmitool graphviz imagemagick apache2
apt-get install libvirt-bin
mkdir -p /opt/observium && cd /opt
svn co http://svn.observium.org/svn/observium/trunk observium
cd /opt
cp observium-bck/config.php observium
mv observium-bck/rrd observium-bck/logs observium
cd observium
./discovery.php -u
Version 9556
[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs
[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs
[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs
[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs
[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs
[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs
[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38
Vs
Version 9519
[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs
[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs
[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs
[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs
[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs
[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs
[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs
[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs
[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs
[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42
We are also seeing the following in the db.log when in version 9556
2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC
[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Tuesday, 06 November 2018 18:13 To: Eric W. Bates via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
The current version is 9556, anything before that is irrelevant.
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 6 Nov 2018, at 14:58, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
I have now since updated to Debian 9.5 and running the same version python that you use,
root@mon:/opt/observium# python -V
Python 2.7.13
root@mon:/opt/observium# cat /etc/debian_version
9.5
And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs
Last working version seems to be 9535
With version 9536 I get the below output when running it manually
root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24
WARNING! Using number of threads without command argument (-w or --workers) is deprecated!
Please replace your poller wrapper command line with:
observium-wrapper poller -w 24
Traceback (most recent call last):
File "/opt/observium/poller-wrapper.py", line 463, in <module>
print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC
KeyError: 'poller_name'
Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds
INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21
I also see the below message in blue that was bot there before
This is the default poller. Will only poll devices with no specified poller set.
We have also noticed with latest versions the map on the landing page stops working? Last version where the map on the landing page is working is 9544
http://leafletjs.com/ Leaflet | Map data © http://www.openstreetmap.org/copyright OpenStreetMap contributors, © https://carto.com/attributions CARTO
U html/js/leaflet.js
U html/css/leaflet.css
U html/geo.php
U html/includes/map/leaflet.inc.php
U html/pages/dashboard.inc.php
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
From: Adam Armstrong [mailto:adama@memetic.org] Sent: Monday, 05 November 2018 16:54 To: Svensson Fredrik A via observium Cc: Pieter Meyer Subject: Re: [Observium] observium 18.10.9550
What OS is this running on? What version of python?
The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.
Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)
Adam.
Sent from BlueMail http://www.bluemail.me/r?b=14063
On 5 Nov 2018, at 10:17, Pieter Meyer via observium observium@observium.org wrote:
Hi Adam
After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.
We also notice that smokeping rrd graphs was still working,
Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.
Downgrading to 18.10.9519 resolved all issues
Regards
Pieter Meyer
Converged Group | Licensed ISP 0258/IECNS/JAN/09
75 Witkoppen Rd, North Riding, Gauteng, 2162
Office: +27 10 591 4600 | Mobile: +27 83 233 6614
https://goo.gl/maps/WHe3soT1fHm map | http://www.convergedgroup.net/ website | http://www.convergedgroup.net/blog/ company blog | http://www.linkedin.com/company/converged-telecoms linkedin
CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.
DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_____
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
