Wow :) fast work.
Impressed.
Thanks Adam
/Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:36 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet, Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium