Hi I've upgraded to this version: ./discovery.php -V Observium 17.5.8580
It seemed to be a great update but then MySQL died and I found this in the logs:
[2017/06/29 15:05:20 +0200] poller-wrapper.py(29309): /opt/observium/poller-wrapper.py: URGENT: poller-wrapper not started because already running 34 processes, load average (5min) 37.17
And it kept increasing upton load over 70 where I killed all python, CROND and for some reason A LOT of ps processes. An example of processes below.
26133 ? D 0:00 ps -ww -o ppid,uid,args -p 23434 26331 ? R 0:00 ps -ww -o ppid,uid,args -p 2981 26354 ? R 0:00 ps -ww -o ppid,uid,args -p 10439 26355 ? R 0:00 ps -ww -o ppid,uid,args -p 11755 26356 ? R 0:00 ps -ww -o ppid,uid,args -p 5772 26357 ? R 0:00 ps -ww -o ppid,uid,args -p 2624 26360 ? R 0:00 ps -ww -o ppid,uid,args -p 19699
846 purify 20 0 342884 70760 1636 S 1.0 1.9 0:33.02 python 4424 purify 20 0 354536 11156 1632 S 1.0 0.3 1:27.40 python 4739 purify 20 0 356676 11832 1632 S 1.0 0.3 1:36.27 python 9718 purify 20 0 349728 10108 1636 S 1.0 0.3 1:03.00 python 20551 purify 20 0 361020 12280 1632 S 1.0 0.3 2:01.39 python 31260 purify 20 0 348144 76392 1636 S 1.0 2.0 0:56.62 python 402 purify 20 0 345244 33752 1636 S 0.7 0.9 0:43.67 python 1315 purify 20 0 343148 59904 1632 S 0.7 1.6 0:35.71 python 3219 purify 20 0 341844 47340 1632 S 0.7 1.3 0:28.92 python 3298 purify 20 0 353204 11376 1632 S 0.7 0.3 1:19.76 python
Anyone know whats going on? I see this when I try to run the debug output
Your PHP version is too old (5.4.16), | | functionality may be broken. Please update your PHP! | | Currently recommended version(s): 7.0.x or 5.6.x
I guess I should upgrade PHP first.
Regards
-John
My guess is that your system is not fast enough to poll all your devices in 5min, creating new poller processes before the old ones are done. You should start by upgrading your PHP to version 7 as this is much faster, if the problem still persists then post a screenshot of the /pollerlog-page in the Observium GUI please.
/Markus
2017-06-29 19:48 GMT+02:00 John Klasa John.Klasa@itiviti.com:
Hi I’ve upgraded to this version:
./discovery.php -V
Observium 17.5.8580
It seemed to be a great update but then MySQL died and I found this in the logs:
[2017/06/29 15:05:20 +0200] poller-wrapper.py(29309): /opt/observium/poller-wrapper.py: URGENT: poller-wrapper not started because already running 34 processes, load average (5min) 37.17
And it kept increasing upton load over 70 where I killed all python, CROND and for some reason A LOT of ps processes. An example of processes below.
26133 ? D 0:00 ps -ww -o ppid,uid,args -p 23434
26331 ? R 0:00 ps -ww -o ppid,uid,args -p 2981
26354 ? R 0:00 ps -ww -o ppid,uid,args -p 10439
26355 ? R 0:00 ps -ww -o ppid,uid,args -p 11755
26356 ? R 0:00 ps -ww -o ppid,uid,args -p 5772
26357 ? R 0:00 ps -ww -o ppid,uid,args -p 2624
26360 ? R 0:00 ps -ww -o ppid,uid,args -p 19699
846 purify 20 0 342884 70760 1636 S 1.0 1.9 0:33.02 python
4424 purify 20 0 354536 11156 1632 S 1.0 0.3 1:27.40 python
4739 purify 20 0 356676 11832 1632 S 1.0 0.3 1:36.27 python
9718 purify 20 0 349728 10108 1636 S 1.0 0.3 1:03.00 python
20551 purify 20 0 361020 12280 1632 S 1.0 0.3 2:01.39 python
31260 purify 20 0 348144 76392 1636 S 1.0 2.0 0:56.62 python
402 purify 20 0 345244 33752 1636 S 0.7 0.9 0:43.67 python
1315 purify 20 0 343148 59904 1632 S 0.7 1.6 0:35.71 python
3219 purify 20 0 341844 47340 1632 S 0.7 1.3 0:28.92 python
3298 purify 20 0 353204 11376 1632 S 0.7 0.3 1:19.76 python
Anyone know whats going on? I see this when I try to run the debug output
Your PHP version is too old (5.4.16), |
| functionality may be broken. Please update your PHP! |
| Currently recommended version(s): 7.0.x or 5.6.x
I guess I should upgrade PHP first.
Regards
-John
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Markus, thanks for your input. However the system went from 0.16.X -> 0.17.5.X and is behaving badly. It might be as you say but before I upgrade PHP any more ideas? System have 39 devices to poll. Have four CPUs and 6Gb RAM. It starts to behave badly directly from the beginning when enabling the CRON job.
Regards __________________________________________________ John Klasa Managed Services • Itiviti Senior Network Administrator
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Markus Klock Sent: den 30 juni 2017 01:55 To: Observium observium@observium.org Subject: Re: [Observium] python-wrapper loop?
My guess is that your system is not fast enough to poll all your devices in 5min, creating new poller processes before the old ones are done. You should start by upgrading your PHP to version 7 as this is much faster, if the problem still persists then post a screenshot of the /pollerlog-page in the Observium GUI please.
/Markus
2017-06-29 19:48 GMT+02:00 John Klasa <John.Klasa@itiviti.commailto:John.Klasa@itiviti.com>: Hi I’ve upgraded to this version: ./discovery.php -V Observium 17.5.8580
It seemed to be a great update but then MySQL died and I found this in the logs:
[2017/06/29 15:05:20 +0200] poller-wrapper.py(29309): /opt/observium/poller-wrapper.py: URGENT: poller-wrapper not started because already running 34 processes, load average (5min) 37.17
And it kept increasing upton load over 70 where I killed all python, CROND and for some reason A LOT of ps processes. An example of processes below.
26133 ? D 0:00 ps -ww -o ppid,uid,args -p 23434 26331 ? R 0:00 ps -ww -o ppid,uid,args -p 2981 26354 ? R 0:00 ps -ww -o ppid,uid,args -p 10439 26355 ? R 0:00 ps -ww -o ppid,uid,args -p 11755 26356 ? R 0:00 ps -ww -o ppid,uid,args -p 5772 26357 ? R 0:00 ps -ww -o ppid,uid,args -p 2624 26360 ? R 0:00 ps -ww -o ppid,uid,args -p 19699
846 purify 20 0 342884 70760 1636 S 1.0 1.9 0:33.02 python 4424 purify 20 0 354536 11156 1632 S 1.0 0.3 1:27.40 python 4739 purify 20 0 356676 11832 1632 S 1.0 0.3 1:36.27 python 9718 purify 20 0 349728 10108 1636 S 1.0 0.3 1:03.00 python 20551 purify 20 0 361020 12280 1632 S 1.0 0.3 2:01.39 python 31260 purify 20 0 348144 76392 1636 S 1.0 2.0 0:56.62 python 402 purify 20 0 345244 33752 1636 S 0.7 0.9 0:43.67 python 1315 purify 20 0 343148 59904 1632 S 0.7 1.6 0:35.71 python 3219 purify 20 0 341844 47340 1632 S 0.7 1.3 0:28.92 python 3298 purify 20 0 353204 11376 1632 S 0.7 0.3 1:19.76 python
Anyone know whats going on? I see this when I try to run the debug output
Your PHP version is too old (5.4.16), | | functionality may be broken. Please update your PHP! | | Currently recommended version(s): 7.0.x or 5.6.x
I guess I should upgrade PHP first.
Regards
-John
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (2)
-
John Klasa -
Markus Klock