You seem to have managed to break your database.

You need to create the poller_id field in the devices table, the SQL commands to do this will be in the most recent file in update/

Note that you can not upgrade and downgrade versions randomly, because it can break your database.

Adam.

Sent from BlueMail
On 6 Nov 2018, at 18:59, Pieter Meyer via observium <observium@observium.org> wrote:

Hi Adam

 

I have now done a fresh install on debian 9.5 and restored my still seeing this issue, see output from observium.log

 

I used the below commands to restore my config and we use external mysql DB

 

https://docs.observium.org/install_debian/

Manual Installation

 

apt-get install libapache2-mod-php7.0 php7.0-cli php7.0-mysql php7.0-mysqli php7.0-gd php7.0-mcrypt \

php7.0-json php-pear snmp fping mariadb-client python-mysqldb rrdtool subversion whois \

mtr-tiny ipmitool graphviz imagemagick apache2

 

apt-get install libvirt-bin

 

mkdir -p /opt/observium && cd /opt

 

svn co http://svn.observium.org/svn/observium/trunk observium

 

cd /opt

cp observium-bck/config.php observium

mv observium-bck/rrd observium-bck/logs observium

cd observium

./discovery.php -u

 

 

Version 9556

 

[2018/11/06 20:36:18 +0200] poller.php(13897): /opt/observium/poller.php: 134 - 0 devices polled in 0.024 secs

[2018/11/06 20:36:18 +0200] poller.php(13912): /opt/observium/poller.php: 33 - 0 devices polled in 0.017 secs

[2018/11/06 20:36:18 +0200] poller.php(13914): /opt/observium/poller.php: 238 - 0 devices polled in 0.010 secs

[2018/11/06 20:36:18 +0200] poller.php(13928): /opt/observium/poller.php: 100 - 0 devices polled in 0.009 secs

[2018/11/06 20:36:18 +0200] poller.php(13921): /opt/observium/poller.php: 176 - 0 devices polled in 0.006 secs

[2018/11/06 20:36:18 +0200] poller.php(13930): /opt/observium/poller.php: 414 - 0 devices polled in 0.005 secs

[2018/11/06 20:36:18 +0200] poller-wrapper.py(12683): /opt/observium/poller-wrapper.py: processed 209 devices in 15.40 seconds with 12 threads, load average (5min) 1.38

 

 

Vs

 

Version 9519

 

[2018/11/06 20:39:36 +0200] poller.php(25300): /opt/observium/poller.php: storage01.converged.local - 1 devices polled in 1.673 secs

[2018/11/06 20:39:36 +0200] poller.php(25525): /opt/observium/poller.php: broll-chr.converged.local - 1 devices polled in 0.716 secs

[2018/11/06 20:39:36 +0200] poller.php(25415): /opt/observium/poller.php: ast02.converged.local - 1 devices polled in 1.272 secs

[2018/11/06 20:39:36 +0200] poller.php(25514): /opt/observium/poller.php: corev.converged.local - 1 devices polled in 0.779 secs

[2018/11/06 20:39:36 +0200] poller.php(25448): /opt/observium/poller.php: ns2.converged.local - 1 devices polled in 1.130 secs

[2018/11/06 20:39:37 +0200] poller.php(25478): /opt/observium/poller.php: db04.converged.local - 1 devices polled in 1.041 secs

[2018/11/06 20:39:37 +0200] poller.php(25453): /opt/observium/poller.php: broll-kat-logger.converged.local - 1 devices polled in 1.211 secs

[2018/11/06 20:39:37 +0200] poller.php(25442): /opt/observium/poller.php: fusion01.converged.local - 1 devices polled in 1.316 secs

[2018/11/06 20:39:37 +0200] poller.php(25450): /opt/observium/poller.php: msa-jhb-voice.convergedgroup.co.za - 1 devices polled in 1.368 secs

[2018/11/06 20:39:37 +0200] poller-wrapper.py(14037): /opt/observium/poller-wrapper.py: processed 209 devices in 110.87 seconds with 12 threads, load average (5min) 1.42

 

 

 

We are also seeing the following in the db.log when in version 9556

 

2018/11/06 20:36:17 +0200] poller.php(13860): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '262' AND `poller_id` = '0' ORDER BY `device_id` ASC

[2018/11/06 20:36:18 +0200] poller.php(13891): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '247' AND `poller_id` = '0' ORDER BY `device_id` ASC

[2018/11/06 20:36:18 +0200] poller.php(13883): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '394' AND `poller_id` = '0' ORDER BY `device_id` ASC

[2018/11/06 20:36:18 +0200] poller.php(13901): Failed dbQuery (#1054 - Unknown column 'poller_id' in 'where clause'), Query: SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `device_id` = '56' AND `poller_id` = '0' ORDER BY

 

 

Regards

Pieter Meyer

Converged Group | Licensed ISP 0258/IECNS/JAN/09

75 Witkoppen Rd, North Riding, Gauteng, 2162

Office: +27 10 591 4600 | Mobile: +27 83 233 6614  

map | website | company blog | linkedin

 

CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.

 

DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

 

From: Adam Armstrong [mailto:adama@memetic.org]
Sent: Tuesday, 06 November 2018 18:13
To: Eric W. Bates via observium
Cc: Pieter Meyer
Subject: Re: [Observium] observium 18.10.9550

 

The current version is 9556, anything before that is irrelevant.

Adam.

Sent from BlueMail

On 6 Nov 2018, at 14:58, Pieter Meyer via observium <observium@observium.org> wrote:

Hi Adam

 

I have now since updated to Debian 9.5 and running the same version python that you use,

 

root@mon:/opt/observium# python -V

Python 2.7.13

 

root@mon:/opt/observium# cat /etc/debian_version

9.5

 

And I have upgraded revision by revision to see where the poller-wrapper.py stops updating the rrd graphs

 

Last working version seems to be 9535

 

With version 9536 I get the below output when running it manually

 

root@mon:/opt/observium# /opt/observium/poller-wrapper.py 24

WARNING! Using number of threads without command argument (-w or --workers) is deprecated!

Please replace your poller wrapper command line with:

observium-wrapper poller -w 24

Traceback (most recent call last):

  File "/opt/observium/poller-wrapper.py", line 463, in <module>

    print bcolors.OKBLUE + 'INFO: This is poller '+config['poller_name']+' ('+str(poller_id)+') using poller-restricted devices list' + bcolors.ENDC

KeyError: 'poller_name'

 

Then from version 9539 it runs again but the duration is very short pulled 209 devices in 23 secs where it used to be like 140 odd seconds

 

INFO: poller-wrapper.py poller processed 209 devices in 23.78 seconds with 24 threads, load average (5min) 3.21

 

I also see the below message in blue that was bot there before

 

This is the default poller. Will only poll devices with no specified poller set.

 

 

 

 

We have also noticed with latest versions the map on the landing page stops working?  Last version where the map on the landing page is working is 9544

 

 

Leaflet | Map data © OpenStreetMap contributors, © CARTO

 

 

U    html/js/leaflet.js

U    html/css/leaflet.css

U    html/geo.php

U    html/includes/map/leaflet.inc.php

U    html/pages/dashboard.inc.php

 

Regards

Pieter Meyer

Converged Group | Licensed ISP 0258/IECNS/JAN/09

75 Witkoppen Rd, North Riding, Gauteng, 2162

Office: +27 10 591 4600 | Mobile: +27 83 233 6614  

map | website | company blog | linkedin

 

CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.

 

DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

 

From: Adam Armstrong [mailto:adama@memetic.org]
Sent: Monday, 05 November 2018 16:54
To: Svensson Fredrik A via observium
Cc: Pieter Meyer
Subject: Re: [Observium] observium 18.10.9550

 

What OS is this running on? What version of python?

The only changes recently which may cause this were to the small amount of python we use for the poller wrapper.

Can you see if the poller just wasn't running for that period? (Gaps in poller graph or in poller and poller wrapper graphs?)

Adam.

Sent from BlueMail

On 5 Nov 2018, at 10:17, Pieter Meyer via observium <observium@observium.org> wrote:

Hi Adam

 

After upgrading to 18.10.9550 from observium 18.10.9519 we noticed that our map on the landing page stopped working and that rrd graphs stopped updating.

 

We also notice that smokeping rrd graphs was still working,

 

Downgrading to 18.10.9542 fixed the map on the landing page but not the rrd graphs.

 

Downgrading to 18.10.9519 resolved all issues

 

Regards

Pieter Meyer

Converged Group | Licensed ISP 0258/IECNS/JAN/09

75 Witkoppen Rd, North Riding, Gauteng, 2162

Office: +27 10 591 4600 | Mobile: +27 83 233 6614  

map | website | company blog | linkedin

 

CAUTION: This email and any attachments may contain information that is confidential and subject to legal privilege. If you are not the intended recipient, you must not read, use, disseminate, distribute or copy this email or any attachments. If you have received this email in error, please notify us immediately and erase this email and any attachments. Thank you.

 

DISCLAIMER: To the maximum extent permitted by law, Converged Group is not liable (including in respect of negligence) for viruses or other defects or for changes made to this email or to any attachments. Before opening or using attachments, check them for viruses and other defects. The information contained in this document is confidential to the addressee and is not the view nor the official policy of Converged Group unless otherwise stated.

  

    

observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
    
   

observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium