Upgrade to 4737 broke some graphs
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
Small typo to 4737 from 4670...
Kind regards, Chris
On 04/11/13 19:12, Chris Pelling wrote:
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
that we could help, show: 1. Screenshots 2. debug poller out: ./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote:
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote:
that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote:
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote:
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote:
The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote:
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote:
The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote:
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Chris,
What *exactly* is and isn't working?
adam.
On 2013-11-05 13:24, Chris Pelling wrote:
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam,
Essentially as per the first post, prior to 4737, everything (that I use and play with) was aok, all switches were seen;
Was working in realtime, rddtool showed output (in gui) and showing graphs "4670" : Fabric A (M6220 Stacked pair) Fabric B (M6348 stacked pair) Fabric C (M6220 stacked pair) Nexetra (storage) Firewall *customer site ASA5510* Vyatta A and B - aok everytihg works Cisco switch - aok everything works Xen Servers So all above showed correctly.
After upgrade : Fabric A works gui graphs, rdd info
Fabric B no graph updated, click "RRD command" on right hand side, shows all the RRD stuff, click Graph Previous and hey presto yesterdays graph appears.
Fabric C (same as B) namely : no graph updated, click "RRD command" on right hand side, shows all the RRD stuff, click Graph Previous and hey presto yesterdays graph appears.
Nexetra no graph updated Firewall no graph updated Vyatta - works as before Cisco switch works as before
Now something interesting just found in the observium.log file :
Before and after update.
The line at 11:38 is from manually running "./discovery.php -h none"
/opt/observium/discovery.php new November 4, 2013, 11:35 - 0 devices discovered in 0.022 secs /opt/observium/poller.php 6/8 November 4, 2013, 11:35 - 1 devices polled in 10.65 secs /opt/observium/poller.php 7/8 November 4, 2013, 11:35 - 1 devices polled in 10.66 secs /opt/observium/poller.php 0/8 November 4, 2013, 11:35 - 1 devices polled in 13.32 secs /opt/observium/poller.php 1/8 November 4, 2013, 11:35 - 2 devices polled in 15.21 secs /opt/observium/poller.php 5/8 November 4, 2013, 11:35 - 2 devices polled in 15.87 secs /opt/observium/poller.php 2/8 November 4, 2013, 11:35 - 2 devices polled in 18.84 secs /opt/observium/poller.php 4/8 November 4, 2013, 11:35 - 2 devices polled in 19.79 secs /opt/observium/poller.php 3/8 November 4, 2013, 11:35 - 2 devices polled in 28.62 secs
Upgraded to latest and ran discovery :
./discovery.php none November 4, 2013, 11:38 - 0 devices discovered in 0.504 secs
/opt/observium/discovery.php new November 4, 2013, 11:40 - 0 devices discovered in 0.019 secs /opt/observium/poller.php 6/8 November 4, 2013, 11:40 - 1 devices polled in 7.070 secs /opt/observium/poller.php 7/8 November 4, 2013, 11:40 - 1 devices polled in 7.489 secs /opt/observium/poller.php 0/8 November 4, 2013, 11:40 - 1 devices polled in 10.92 secs /opt/observium/discovery.php new November 4, 2013, 11:45 - 0 devices discovered in 0.007 secs /opt/observium/poller.php 6/8 November 4, 2013, 11:45 - 1 devices polled in 7.188 secs /opt/observium/poller.php 7/8 November 4, 2013, 11:45 - 1 devices polled in 7.456 secs /opt/observium/poller.php 0/8 November 4, 2013, 11:45 - 1 devices polled in 11.01 secs
and for good measure, just in case this is the crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1 */5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1 01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Adam - more than willing to create you an account if you want to take a peak.
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:44:44 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Chris,
What *exactly* is and isn't working?
adam.
On 2013-11-05 13:24, Chris Pelling wrote:
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
On 05.11.2013 17:24, Chris Pelling wrote:
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Если можете If you can downgrade back, then do it and again make debug out for poller.
Also, please show your mysql env:
mysql -u root -p
use observium; DESCRIBE ports-state; SHOW VARIABLES LIKE '%max%';
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=sharin...
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
HI Thomas,
OK at least I am not going mad :)
I am more than willing to open up to one of the main devs my observium if they want to have a poke around? Admitidly I was on 4670 rather than 4736 as Thomas was, but, if having a nose around my setup could assist I am all for it :)
Kind regards, Chris
On 05/11/13 19:31, Thomas Raabo - Zitcom A/S wrote:
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Mmm It looks like I had the same problem. The problem began this morning after upgrading to version 4744, almost all (but not all!) my graphs went blank (no new data was saved in the RRD's, checked this with rrdtool) After reverting back to version 4743, the problem disappeared. 2 devices kept working, all the other went wrong (all equipment (cisco, a10, apc, akcp)). Now it is running fine. Tomorrow at 8.00 it will do a svn update to the latest version than again, will see what it will bring us. For example: [cid:image001.png@01CEDA69.268BF210]
Regards,
Bastiaan
From: Chris Pelling [mailto:chris@netearth.net] Sent: dinsdag 5 november 2013 20:43 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
HI Thomas,
OK at least I am not going mad :)
I am more than willing to open up to one of the main devs my observium if they want to have a poke around? Admitidly I was on 4670 rather than 4736 as Thomas was, but, if having a nose around my setup could assist I am all for it :)
Kind regards,
Chris On 05/11/13 19:31, Thomas Raabo - Zitcom A/S wrote:
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all
After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse-----
Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling
Sendt: 5. november 2013 14:24
Til: Observium Network Observation System
Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message -----
From: "Adam Armstrong" adama@memetic.orgmailto:adama@memetic.org
To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org
Sent: Tuesday, 5 November, 2013 1:04:43 PM
Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what
the svn upgrade did :
A attic/adva.inc.php
A attic/observernms-custom.inc.php
A html/images/os/audiocodes.png
A html/images/os/barracuda.png
U html/includes/functions.inc.php
U html/includes/cache-data.inc.php
U html/includes/authenticate.inc.php
U html/includes/graphs/graph.inc.php
U html/includes/graphs/cefswitching/graph.inc.php
D html/includes/graphs/device/fanspeed.inc.php
D html/includes/graphs/device/voltage.inc.php
D html/includes/graphs/device/dbm.inc.php
D html/includes/graphs/device/humidity.inc.php
D html/includes/graphs/device/current.inc.php
D html/includes/graphs/device/power.inc.php
D html/includes/graphs/device/frequency.inc.php
D html/includes/graphs/device/temperature.inc.php
A html/includes/graphs/device/graph.inc.php
D html/includes/graphs/sensor/humidity.inc.php
A html/includes/graphs/sensor/percent.inc.php
U html/includes/graphs/sensor/graph.inc.php
A html/includes/graphs/sensor/runtime.inc.php
U html/includes/collectd/functions.php
U html/includes/print/device.inc.php
U html/includes/print/events.inc.php
U html/includes/api/functions.inc.php
U html/includes/authentication/ldap.inc.php
A html/js/ref.js
U html/img/sprite.png
U html/css/sprite.css
A html/css/ref.css
U html/pages/device/port.inc.php
A html/pages/device/port/data.inc.php
U html/pages/device/apps/mssql.inc.php
U html/pages/device/apps/mssql/memory.inc.php
U html/pages/device/apps/mssql/processor.inc.php
U html/pages/health/toner.inc.php
U html/pages/health/mempool.inc.php
U html/pages/health/sensors.inc.php
U html/pages/health/processor.inc.php
U html/pages/health/storage.inc.php
U html/pages/ports/list.inc.php
U html/pages/eventlog.inc.php
U html/pages/bill/ports.inc.php
U html/pages/graphs.inc.php
U html/pages/routing/vrf.inc.php
U html/pages/front/default.php
U html/pages/device.inc.php
U html/pages/pollerlog.inc.php
U includes/definitions/os.inc.php
A includes/definitions/sensors.inc.php
U includes/snmp.inc.php
U includes/common.php
U includes/rrdtool.inc.php
A includes/debug/ref.inc.php
A includes/wmi.inc.php
U includes/rewrites.php
U includes/functions.php
U includes/geolocation.inc.php
U includes/polling/fdb-table.inc.php
U includes/polling/os/ciena.inc.php
A includes/polling/os/barracudangfw.inc.php
U includes/polling/os/apc.inc.php
U includes/polling/bgp-peers.inc.php
U includes/polling/applications/exchange.inc.php
U includes/polling/applications/mssql.inc.php
U includes/polling/applications/powerdns-recursor.inc.php
U includes/polling/wmi.inc.php
U includes/polling/mempools/ciena.inc.php
U includes/polling/functions.inc.php
U includes/polling/unix-agent.inc.php
U includes/polling/system.inc.php
U includes/polling/sensors.inc.php
U includes/polling/processors/ciena.inc.php
U includes/polling/storage.inc.php
U includes/polling/ospf.inc.php
U includes/polling/ports.inc.php
U includes/defaults.inc.php
D includes/discovery/current
D includes/discovery/voltages
D includes/discovery/power
D includes/discovery/dbm
D includes/discovery/temperatures
D includes/discovery/humidity
D includes/discovery/frequencies
U includes/discovery/sensors/ipomanii-mib.inc.php
U includes/discovery/sensors/ups-mib.inc.php
U includes/discovery/sensors/sentry3-mib.inc.php
A includes/discovery/sensors/oadwdm-mib.inc.php
U includes/discovery/sensors/dell-vendor-mib.inc.php
U includes/discovery/sensors/zyxel-as-mib.inc.php
U includes/discovery/sensors/juniper-mib.inc.php
U includes/discovery/sensors/p8510-mib.inc.php
U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php
U includes/discovery/sensors/papouch-smi.inc.php
A includes/discovery/sensors/f10-chassis-mib.inc.php
U includes/discovery/sensors/gamatronic-mib.inc.php
U includes/discovery/sensors/mikrotik-mib.inc.php
A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php
U includes/discovery/sensors/nscrtv-root.inc.php
U includes/discovery/sensors/supermicro-health-mib.inc.php
U includes/discovery/sensors/juniper-system-mib.inc.php
A includes/discovery/sensors/foundry-sn-agent-mib.inc.php
U includes/discovery/sensors/cisco-envmon-mib.inc.php
A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php
U includes/discovery/sensors/lm-sensors-mib.inc.php
U includes/discovery/sensors/siconups-mib.inc.php
A includes/discovery/sensors/powernet-mib.inc.php
A includes/discovery/sensors/carel-ug40cdz-mib.inc.php
U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php
A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php
U includes/discovery/sensors/eqlmember-mib.inc.php
U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php
U includes/discovery/sensors/radlan-hwenviroment.inc.php
U includes/discovery/sensors/roomalert24e-mib.inc.php
U includes/discovery/sensors/deltaups-mib.inc.php
U includes/discovery/sensors/rbn-envmon-mib.inc.php
A includes/discovery/sensors/s5-chassis-mib.inc.php
U includes/discovery/sensors/mg-snmp-ups-mib.inc.php
U includes/discovery/sensors/dell-rac-mib.inc.php
U includes/discovery/sensors/areca-snmp-mib.inc.php
U includes/discovery/sensors/airespace-wireless-mib.inc.php
U includes/discovery/sensors/pdu-mib.inc.php
U includes/discovery/sensors/juniper-dom-mib.inc.php
U includes/discovery/sensors/sw-mib.inc.php
U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php
A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php
A includes/discovery/sensors/netbotzv2-mib.inc.php
U includes/discovery/sensors/asyncos-mail-mib.inc.php
U includes/discovery/sensors/xups-mib.inc.php
U includes/discovery/sensors/spagent-mib.inc.php
U includes/discovery/sensors/ns-root-mib.inc.php
U includes/discovery/functions.inc.php
A includes/discovery/os/barracuda.inc.php
U includes/discovery/os/ciena.inc.php
U includes/discovery/sensors.inc.php
U includes/discovery/mempools/ciena.inc.php
U includes/definitions.inc.php
U includes/port-descr-parser.inc.php
U poll-billing.php
A update/105.sql
D mibs/apc
U mibs/PowerNet-MIB
Updated to revision 4737.
root@observium:/opt/observium# ./discovery.php -h none Observium
v0.13.11.4737 Discovery
-- Updating database/file schema
104 -> 105 ... (db) done.
-- Done
Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s]
Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message -----
From: "Chris Pelling" chris@netearth.netmailto:chris@netearth.net
To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org
Sent: Tuesday, 5 November, 2013 9:28:50 AM
Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file :
https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=
sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote:
The commandlines will include SNMP communities (but they *should* be
worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp
session information.
Nothing really worth protecting, but also not something I'd put in
public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote:
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me
being a "tool") does the debug output carry anything that needs
removing, I see the hostname in there, but, although I removed the
hostnames from the screenshot, pretty pointless now when looking at
this file, I just want to make sure no passwords or anything are in
it. :)
Here is the pic of the networks page. Sorry about the inverted
screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote:
that we could help, show:
1. Screenshots
2. debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file
/tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.netmailto:chris@netearth.net
wrote:
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch
graphs
(dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x
Dell
M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now
stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click
realtime, its showing realtime information - so we know that works.
Billing
also seems unaffected, just the graphs at :
/devices/type=network/format=graphs/graph=bits/ stopped for these 2
devices (albeit one is identical to a working device) exactly at the
time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update
./discovery.php -h none
So now stumped, what can I do to get them back showing the current
data (they have the historical few hours before update) and/or what
can I run to aid in finding a poss issue ? :-)
--
Kind regards,
Chris
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
4743 sounds right :) I´am not 100% sure when this happened.
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Bastiaan Topper Sent: 5. november 2013 20:54 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Mmm It looks like I had the same problem. The problem began this morning after upgrading to version 4744, almost all (but not all!) my graphs went blank (no new data was saved in the RRD's, checked this with rrdtool) After reverting back to version 4743, the problem disappeared. 2 devices kept working, all the other went wrong (all equipment (cisco, a10, apc, akcp)). Now it is running fine. Tomorrow at 8.00 it will do a svn update to the latest version than again, will see what it will bring us. For example: [cid:image001.png@01CEDA6D.09513350]
Regards,
Bastiaan
From: Chris Pelling [mailto:chris@netearth.net] Sent: dinsdag 5 november 2013 20:43 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
HI Thomas,
OK at least I am not going mad :)
I am more than willing to open up to one of the main devs my observium if they want to have a poke around? Admitidly I was on 4670 rather than 4736 as Thomas was, but, if having a nose around my setup could assist I am all for it :)
Kind regards,
Chris On 05/11/13 19:31, Thomas Raabo - Zitcom A/S wrote:
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all
After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse-----
Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling
Sendt: 5. november 2013 14:24
Til: Observium Network Observation System
Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message -----
From: "Adam Armstrong" adama@memetic.orgmailto:adama@memetic.org
To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org
Sent: Tuesday, 5 November, 2013 1:04:43 PM
Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what
the svn upgrade did :
A attic/adva.inc.php
A attic/observernms-custom.inc.php
A html/images/os/audiocodes.png
A html/images/os/barracuda.png
U html/includes/functions.inc.php
U html/includes/cache-data.inc.php
U html/includes/authenticate.inc.php
U html/includes/graphs/graph.inc.php
U html/includes/graphs/cefswitching/graph.inc.php
D html/includes/graphs/device/fanspeed.inc.php
D html/includes/graphs/device/voltage.inc.php
D html/includes/graphs/device/dbm.inc.php
D html/includes/graphs/device/humidity.inc.php
D html/includes/graphs/device/current.inc.php
D html/includes/graphs/device/power.inc.php
D html/includes/graphs/device/frequency.inc.php
D html/includes/graphs/device/temperature.inc.php
A html/includes/graphs/device/graph.inc.php
D html/includes/graphs/sensor/humidity.inc.php
A html/includes/graphs/sensor/percent.inc.php
U html/includes/graphs/sensor/graph.inc.php
A html/includes/graphs/sensor/runtime.inc.php
U html/includes/collectd/functions.php
U html/includes/print/device.inc.php
U html/includes/print/events.inc.php
U html/includes/api/functions.inc.php
U html/includes/authentication/ldap.inc.php
A html/js/ref.js
U html/img/sprite.png
U html/css/sprite.css
A html/css/ref.css
U html/pages/device/port.inc.php
A html/pages/device/port/data.inc.php
U html/pages/device/apps/mssql.inc.php
U html/pages/device/apps/mssql/memory.inc.php
U html/pages/device/apps/mssql/processor.inc.php
U html/pages/health/toner.inc.php
U html/pages/health/mempool.inc.php
U html/pages/health/sensors.inc.php
U html/pages/health/processor.inc.php
U html/pages/health/storage.inc.php
U html/pages/ports/list.inc.php
U html/pages/eventlog.inc.php
U html/pages/bill/ports.inc.php
U html/pages/graphs.inc.php
U html/pages/routing/vrf.inc.php
U html/pages/front/default.php
U html/pages/device.inc.php
U html/pages/pollerlog.inc.php
U includes/definitions/os.inc.php
A includes/definitions/sensors.inc.php
U includes/snmp.inc.php
U includes/common.php
U includes/rrdtool.inc.php
A includes/debug/ref.inc.php
A includes/wmi.inc.php
U includes/rewrites.php
U includes/functions.php
U includes/geolocation.inc.php
U includes/polling/fdb-table.inc.php
U includes/polling/os/ciena.inc.php
A includes/polling/os/barracudangfw.inc.php
U includes/polling/os/apc.inc.php
U includes/polling/bgp-peers.inc.php
U includes/polling/applications/exchange.inc.php
U includes/polling/applications/mssql.inc.php
U includes/polling/applications/powerdns-recursor.inc.php
U includes/polling/wmi.inc.php
U includes/polling/mempools/ciena.inc.php
U includes/polling/functions.inc.php
U includes/polling/unix-agent.inc.php
U includes/polling/system.inc.php
U includes/polling/sensors.inc.php
U includes/polling/processors/ciena.inc.php
U includes/polling/storage.inc.php
U includes/polling/ospf.inc.php
U includes/polling/ports.inc.php
U includes/defaults.inc.php
D includes/discovery/current
D includes/discovery/voltages
D includes/discovery/power
D includes/discovery/dbm
D includes/discovery/temperatures
D includes/discovery/humidity
D includes/discovery/frequencies
U includes/discovery/sensors/ipomanii-mib.inc.php
U includes/discovery/sensors/ups-mib.inc.php
U includes/discovery/sensors/sentry3-mib.inc.php
A includes/discovery/sensors/oadwdm-mib.inc.php
U includes/discovery/sensors/dell-vendor-mib.inc.php
U includes/discovery/sensors/zyxel-as-mib.inc.php
U includes/discovery/sensors/juniper-mib.inc.php
U includes/discovery/sensors/p8510-mib.inc.php
U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php
U includes/discovery/sensors/papouch-smi.inc.php
A includes/discovery/sensors/f10-chassis-mib.inc.php
U includes/discovery/sensors/gamatronic-mib.inc.php
U includes/discovery/sensors/mikrotik-mib.inc.php
A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php
U includes/discovery/sensors/nscrtv-root.inc.php
U includes/discovery/sensors/supermicro-health-mib.inc.php
U includes/discovery/sensors/juniper-system-mib.inc.php
A includes/discovery/sensors/foundry-sn-agent-mib.inc.php
U includes/discovery/sensors/cisco-envmon-mib.inc.php
A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php
U includes/discovery/sensors/lm-sensors-mib.inc.php
U includes/discovery/sensors/siconups-mib.inc.php
A includes/discovery/sensors/powernet-mib.inc.php
A includes/discovery/sensors/carel-ug40cdz-mib.inc.php
U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php
A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php
U includes/discovery/sensors/eqlmember-mib.inc.php
U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php
U includes/discovery/sensors/radlan-hwenviroment.inc.php
U includes/discovery/sensors/roomalert24e-mib.inc.php
U includes/discovery/sensors/deltaups-mib.inc.php
U includes/discovery/sensors/rbn-envmon-mib.inc.php
A includes/discovery/sensors/s5-chassis-mib.inc.php
U includes/discovery/sensors/mg-snmp-ups-mib.inc.php
U includes/discovery/sensors/dell-rac-mib.inc.php
U includes/discovery/sensors/areca-snmp-mib.inc.php
U includes/discovery/sensors/airespace-wireless-mib.inc.php
U includes/discovery/sensors/pdu-mib.inc.php
U includes/discovery/sensors/juniper-dom-mib.inc.php
U includes/discovery/sensors/sw-mib.inc.php
U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php
A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php
A includes/discovery/sensors/netbotzv2-mib.inc.php
U includes/discovery/sensors/asyncos-mail-mib.inc.php
U includes/discovery/sensors/xups-mib.inc.php
U includes/discovery/sensors/spagent-mib.inc.php
U includes/discovery/sensors/ns-root-mib.inc.php
U includes/discovery/functions.inc.php
A includes/discovery/os/barracuda.inc.php
U includes/discovery/os/ciena.inc.php
U includes/discovery/sensors.inc.php
U includes/discovery/mempools/ciena.inc.php
U includes/definitions.inc.php
U includes/port-descr-parser.inc.php
U poll-billing.php
A update/105.sql
D mibs/apc
U mibs/PowerNet-MIB
Updated to revision 4737.
root@observium:/opt/observium# ./discovery.php -h none Observium
v0.13.11.4737 Discovery
-- Updating database/file schema
104 -> 105 ... (db) done.
-- Done
Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s]
Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message -----
From: "Chris Pelling" chris@netearth.netmailto:chris@netearth.net
To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org
Sent: Tuesday, 5 November, 2013 9:28:50 AM
Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file :
https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp=
sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote:
The commandlines will include SNMP communities (but they *should* be
worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp
session information.
Nothing really worth protecting, but also not something I'd put in
public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote:
Hi Mike,
Here is the screen shot, before I paste up the debug output (and me
being a "tool") does the debug output carry anything that needs
removing, I see the hostname in there, but, although I removed the
hostnames from the screenshot, pretty pointless now when looking at
this file, I just want to make sure no passwords or anything are in
it. :)
Here is the pic of the networks page. Sorry about the inverted
screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote:
that we could help, show:
1. Screenshots
2. debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file
/tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.netmailto:chris@netearth.net
wrote:
Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch
graphs
(dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x
Dell
M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now
stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click
realtime, its showing realtime information - so we know that works.
Billing
also seems unaffected, just the graphs at :
/devices/type=network/format=graphs/graph=bits/ stopped for these 2
devices (albeit one is identical to a working device) exactly at the
time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update
./discovery.php -h none
So now stumped, what can I do to get them back showing the current
data (they have the historical few hours before update) and/or what
can I run to aid in finding a poss issue ? :-)
--
Kind regards,
Chris
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.orgmailto:observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris
On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Ok, you probably want to join us in 2013. ;)
replace your poller.php instances with poller-wrapper.py. It maintains a queue of devices and makes sure x number of pollers are running (in the below case, 8)
I would recommend putting your cron jobs into /etc/cron.d/observium, rather than in root's user cron, like this :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 8 >> /dev/null 2>&1
On 2013-11-05 20:24, Chris Pelling wrote:
No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam,
OK, Ill put my hands up and say *£$& it.... Let me change that now and see if that starts working.
however, any reason why some would work and some would not then ? I am only asking so that I can understand :)
Kind regards, Chris
On 05/11/13 20:30, Adam Armstrong wrote:
Ok, you probably want to join us in 2013. ;)
replace your poller.php instances with poller-wrapper.py. It maintains a queue of devices and makes sure x number of pollers are running (in the below case, 8)
I would recommend putting your cron jobs into /etc/cron.d/observium, rather than in root's user cron, like this :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 8 >> /dev/null 2>&1
On 2013-11-05 20:24, Chris Pelling wrote:
No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1]
sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
The first device of every poller process was polling correctly, then the second one was breaking the poller by redeclaring the same function a second time.
Landy didn't expect people to be running without the poller-wrapper, and there was some confusion about whether your memory tables were updating. I had a thought it may be something like this earlier, but I've been quite busy today and forgot!
adam.
On 2013-11-05 20:37, Chris Pelling wrote:
Hi Adam,
OK, Ill put my hands up and say *£$& it.... Let me change that now and see if that starts working.
however, any reason why some would work and some would not then ? I am only asking so that I can understand :)
Kind regards, Chris On 05/11/13 20:30, Adam Armstrong wrote:
Ok, you probably want to join us in 2013. ;)
replace your poller.php instances with poller-wrapper.py. It maintains a queue of devices and makes sure x number of pollers are running (in the below case, 8)
I would recommend putting your cron jobs into /etc/cron.d/observium, rather than in root's user cron, like this :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 8 >> /dev/null 2>&1
On 2013-11-05 20:24, Chris Pelling wrote:
No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
:)
/opt/observium/poller-wrapper.py 8 File "/opt/observium/poller-wrapper.py", line 96 with open(config_file) as f: pass ^ SyntaxError: invalid syntax
/Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:31 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Ok, you probably want to join us in 2013. ;)
replace your poller.php instances with poller-wrapper.py. It maintains a queue of devices and makes sure x number of pollers are running (in the below case, 8)
I would recommend putting your cron jobs into /etc/cron.d/observium, rather than in root's user cron, like this :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 8 >> /dev/null 2>&1
On 2013-11-05 20:24, Chris Pelling wrote:
No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
CentOS 5 with python older than me?
I think 2.6 is the minimum. There was a thread on the list about it not so long ago.
adam.
On 2013-11-05 20:55, Thomas Raabo - Zitcom A/S wrote:
:)
/opt/observium/poller-wrapper.py 8 File "/opt/observium/poller-wrapper.py", line 96 with open(config_file) as f: pass ^ SyntaxError: invalid syntax
/Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:31 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Ok, you probably want to join us in 2013. ;)
replace your poller.php instances with poller-wrapper.py. It maintains a queue of devices and makes sure x number of pollers are running (in the below case, 8)
I would recommend putting your cron jobs into /etc/cron.d/observium, rather than in root's user cron, like this :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 8 >> /dev/null 2>&1
On 2013-11-05 20:24, Chris Pelling wrote: No idea, I pasted what I the crons are running earlier, but for completeness :
crontab -l
33 */6 * * * /opt/observium/discovery.php -h all >> /dev/null 2>&1
*/5 * * * * /opt/observium/discovery.php -h new >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
*/5 * * * * /opt/observium/poll-billing.php >> /dev/null 2>&1
01 * * * * /opt/observium/billing-calculate.php >> /dev/null 2>&1
Kind regards, Chris On 05/11/13 20:21, Adam Armstrong wrote:
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet, Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet, Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Ok read this thanks for the explanation :)
Kind regards, Chris
On 05/11/13 20:35, Adam Armstrong wrote:
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards, Chris
On 05/11/13 20:35, Adam Armstrong wrote:
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Adam.
Did you change anything else?
I have a FortiNET device not showing its interfaces after a poll
[cid:image001.png@01CEDA78.B40B4050]
And its getting this error on the poll
Port port1(1) dot3Duplex, VLAN == ifDescr ifType ifDuplex bps(0bps/0bps)bytes(0B/0B)pkts(0pps/0pps) Checking alerts Certain MEMORY DB error for table 'ports-state'.
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Chris Pelling Sent: 5. november 2013 22:05 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards,
Chris On 05/11/13 20:35, Adam Armstrong wrote: Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.orgmailto:adama@memetic.org To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.netmailto:chris@netearth.net To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show: 1. Screenshots 2. debug poller out: ./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.netmailto:chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
On 2013-11-05 21:45, Thomas Raabo - Zitcom A/S wrote:
Adam.
Did you change anything else?
I have a FortiNET device not showing its interfaces after a poll
And its getting this error on the poll
Port port1(1) dot3Duplex, VLAN == ifDescr ifType ifDuplex bps(0bps/0bps)bytes(0B/0B)pkts(0pps/0pps)
Checking alerts
Certain MEMORY DB error for table 'ports-state'.
I didn't change anything at all :)
This error happens when the memory table heap is full, but it can't really cause having these things not update their rrds.
Try running the ports poller for that device in debug mode.
adam.
This was a device bug as always …… ☹
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Thomas Raabo - Zitcom A/S Sent: 5. november 2013 22:45 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Adam.
Did you change anything else?
I have a FortiNET device not showing its interfaces after a poll
[cid:image001.png@01CEDA7F.4891F5B0]
And its getting this error on the poll
Port port1(1) dot3Duplex, VLAN == ifDescr ifType ifDuplex bps(0bps/0bps)bytes(0B/0B)pkts(0pps/0pps) Checking alerts Certain MEMORY DB error for table 'ports-state'.
From: observium [mailto:observium-bounces@observium.org] On Behalf Of Chris Pelling Sent: 5. november 2013 22:05 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards,
Chris On 05/11/13 20:35, Adam Armstrong wrote: Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote: My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.orgmailto:adama@memetic.org To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.netmailto:chris@netearth.net To: "Observium Network Observation System" observium@observium.orgmailto:observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show: 1. Screenshots 2. debug poller out: ./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.netmailto:chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.orgmailto:observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
That error suggests you need to increase your MySQL heap table size, too :)
On 2013-11-05 22:32, Thomas Raabo - Zitcom A/S wrote:
This was a device bug as always …… L
FROM: observium [mailto:observium-bounces@observium.org] ON BEHALF OF Thomas Raabo - Zitcom A/S SENT: 5. november 2013 22:45 TO: Observium Network Observation System SUBJECT: Re: [Observium] Upgrade to 4737 broke some graphs
Adam.
Did you change anything else?
I have a FortiNET device not showing its interfaces after a poll
And its getting this error on the poll
Port port1(1) dot3Duplex, VLAN == ifDescr ifType ifDuplex bps(0bps/0bps)bytes(0B/0B)pkts(0pps/0pps)
Checking alerts
Certain MEMORY DB error for table 'ports-state'.
FROM: observium [mailto:observium-bounces@observium.org] ON BEHALF OF Chris Pelling SENT: 5. november 2013 22:05 TO: Observium Network Observation System SUBJECT: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards,
Chris
On 05/11/13 20:35, Adam Armstrong wrote:
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Okay.
Thanks for the tip.
Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 23:35 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
That error suggests you need to increase your MySQL heap table size, too :)
On 2013-11-05 22:32, Thomas Raabo - Zitcom A/S wrote:
This was a device bug as always …… L
FROM: observium [mailto:observium-bounces@observium.org] ON BEHALF OF Thomas Raabo - Zitcom A/S SENT: 5. november 2013 22:45 TO: Observium Network Observation System SUBJECT: Re: [Observium] Upgrade to 4737 broke some graphs
Adam.
Did you change anything else?
I have a FortiNET device not showing its interfaces after a poll
And its getting this error on the poll
Port port1(1) dot3Duplex, VLAN == ifDescr ifType ifDuplex bps(0bps/0bps)bytes(0B/0B)pkts(0pps/0pps)
Checking alerts
Certain MEMORY DB error for table 'ports-state'.
FROM: observium [mailto:observium-bounces@observium.org] ON BEHALF OF Chris Pelling SENT: 5. november 2013 22:05 TO: Observium Network Observation System SUBJECT: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards,
Chris
On 05/11/13 20:35, Adam Armstrong wrote:
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [1] sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2]
Links:
[1] https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= [2] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Hi Adam,
OK, all now working - if you ever get your ass down to London, and certainly anywhere near docklands, Ill buy you a few pints :)
Kind regards, Chris
On 05/11/13 21:04, Chris Pelling wrote:
Hi Adam,
OK, I added your points - and I ran the poller-wrapper on its own and nowt, so removed the dev null stuff and got :
/opt/observium/poller-wrapper.py 8 ERROR: missing the mysql python module: On ubuntu: apt-get install python-mysqldb On FreeBSD: cd /usr/ports/*/py-MySQLdb && make install clean
So, in case anyone else sees zip, you might need to install the python module for mysql :)
Its now running again with that python mysql thingy installed :)
Kind regards, Chris On 05/11/13 20:35, Adam Armstrong wrote:
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet,
Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Wow :) fast work.
Impressed.
Thanks Adam
/Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:36 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Please replace this with the poller wrapper :
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
The bug was caused by the ports poller including a file which defined a function twice, it shouldn't happen since we switched to the poller-wrapper, but it turns out that not everyone switched when we announced it :)
I've fixed the bug with include_once, but you should replace those old lines anyways.
adam.
On 2013-11-05 20:27, Bastiaan Topper wrote:
My cron looks like:
*/5 * * * * root /opt/observium/poller.php -i 6 -n 0 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 1 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 2 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 3 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 4 >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller.php -i 6 -n 5 >> /dev/null 2>&1
Met vriendelijke groet, Bastiaan
-----Original Message----- From: Adam Armstrong [mailto:adama@memetic.org] Sent: dinsdag 5 november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
No.
33 */6 * * * /var/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * /var/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
It seem like it does not take all the devices.. :)
I have one device not working but if I put in */5 * * * * /var/observium/poller.php -h device in to cron ( it starts working )
Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
That's the problem! :)
See elsewhere in the thread for instructions on move to poller-wrapper.
I've patched the ports poller using include_once, but we aren't anymore paying too much attention to using a single poller process to poll multiple hosts, you're supposed to use the wrapper :)
adam.
On 2013-11-05 20:49, Thomas Raabo - Zitcom A/S wrote:
No.
33 */6 * * * /var/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * /var/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 0 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 1 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 2 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 3 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 4 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 5 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 6 >> /dev/null 2>&1 */5 * * * * /var/observium/poller.php -i 8 -n 7 >> /dev/null 2>&1
It seem like it does not take all the devices.. :)
I have one device not working but if I put in */5 * * * * /var/observium/poller.php -h device in to cron ( it starts working )
Thomas
-----Original Message----- From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong Sent: 5. november 2013 21:21 To: Observium Network Observation System Subject: Re: [Observium] Upgrade to 4737 broke some graphs
You guys are running the poller wrapper, aren't you?
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote: It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
The first device of every poller process was working, the second device was dying at the start of the ports poller as it was redeclaring a function.
You should have switched to the poller wrapper ages ago! :)
33 */6 * * * root /opt/observium/discovery.php -h all >> /dev/null 2>&1 */5 * * * * root /opt/observium/discovery.php -h new >> /dev/null 2>&1 */5 * * * * root /opt/observium/poller-wrapper.py 6 >> /dev/null 2>&1
(where 6 is the number of concurrent pollers)
I've removed the bug with include_once, but you should still replace your crontab entries!
adam.
On 2013-11-05 20:02, Thomas Raabo - Zitcom A/S wrote:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote: Also, apart from the shared debug output, if this helps this was what the svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737
MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s] Insert[0/0s] Delete[0/0s]
Kind regards,
Chris
----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Morning Adam :)
Ok, I have removed as much as I can.
Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing
Kind regards,
Chris
On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session information.
Nothing really worth protecting, but also not something I'd put in public :)
adam.
On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike,
Here is the screen shot, before I paste up the debug output (and me being a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen, but I am blind as a bat :-)
Kind regards,
Chris
On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file /tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys,
Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected.
For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis.
a = worked before and after, graph looks aok b = worked before, now stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click realtime, its showing realtime information - so we know that works. Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2 devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki :
svn update ./discovery.php -h none
So now stumped, what can I do to get them back showing the current data (they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Someone give me snmp access to device (with broken graphs).
P.s. send to my personal mail (not to list).
Thomas Raabo - Zitcom A/S tr@zitcom.dk 6 ноября 2013 г. 0:02:01 написал:
It´s wierd.
Some graphs work. Others do not.
What do you need me to run to debug this issue?
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Thomas Raabo - Zitcom A/S Sendt: 5. november 2013 20:31 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
I´am seeing 100% samething.
Going back to 4736 fixes graphing.
Before 4737 it take long time to run polling.php -h all After 4736 it takes 20 secs.
Poller.php was updated from 4736 to 4737
Thomas
-----Oprindelig meddelelse----- Fra: observium [mailto:observium-bounces@observium.org] På vegne af Chris Pelling Sendt: 5. november 2013 14:24 Til: Observium Network Observation System Emne: Re: [Observium] Upgrade to 4737 broke some graphs
Hi Adam,
Cheers for the confirmation of the rdd stuff, what puzzles me (and this could be something) is nothing else changed, all the crons are as they were before, so no users have changed or permissions (unless doing the svn upgrade changed ownership of the files which I will check shortly).
The most curious thing is from the pic sent, some work, some dont. I assume (rightly or wrongly) that as the realtime graphs worked ok - it was not connection based.
Would a downgrade back to 4670 be advisable, what implication DB wise would this have??
Kind regards,
Chris
----- Original Message ----- From: "Adam Armstrong" adama@memetic.org To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 1:04:43 PM Subject: Re: [Observium] Upgrade to 4737 broke some graphs
Hi,
The poller output is normal, it shows rrdtool updating the rrd file fine without errors.
You probably want to check the cron entries for syntax errors and make sure the user the cron job is run as has the correct permissions.
I doubt it's related to the svn up.
adam.
On 2013-11-05 12:43, Chris Pelling wrote:
Also, apart from the shared debug output, if this helps this was what the
svn upgrade did :
A attic/adva.inc.php A attic/observernms-custom.inc.php A html/images/os/audiocodes.png A html/images/os/barracuda.png U html/includes/functions.inc.php U html/includes/cache-data.inc.php U html/includes/authenticate.inc.php U html/includes/graphs/graph.inc.php U html/includes/graphs/cefswitching/graph.inc.php D html/includes/graphs/device/fanspeed.inc.php D html/includes/graphs/device/voltage.inc.php D html/includes/graphs/device/dbm.inc.php D html/includes/graphs/device/humidity.inc.php D html/includes/graphs/device/current.inc.php D html/includes/graphs/device/power.inc.php D html/includes/graphs/device/frequency.inc.php D html/includes/graphs/device/temperature.inc.php A html/includes/graphs/device/graph.inc.php D html/includes/graphs/sensor/humidity.inc.php A html/includes/graphs/sensor/percent.inc.php U html/includes/graphs/sensor/graph.inc.php A html/includes/graphs/sensor/runtime.inc.php U html/includes/collectd/functions.php U html/includes/print/device.inc.php U html/includes/print/events.inc.php U html/includes/api/functions.inc.php U html/includes/authentication/ldap.inc.php A html/js/ref.js U html/img/sprite.png U html/css/sprite.css A html/css/ref.css U html/pages/device/port.inc.php A html/pages/device/port/data.inc.php U html/pages/device/apps/mssql.inc.php U html/pages/device/apps/mssql/memory.inc.php U html/pages/device/apps/mssql/processor.inc.php U html/pages/health/toner.inc.php U html/pages/health/mempool.inc.php U html/pages/health/sensors.inc.php U html/pages/health/processor.inc.php U html/pages/health/storage.inc.php U html/pages/ports/list.inc.php U html/pages/eventlog.inc.php U html/pages/bill/ports.inc.php U html/pages/graphs.inc.php U html/pages/routing/vrf.inc.php U html/pages/front/default.php U html/pages/device.inc.php U html/pages/pollerlog.inc.php U includes/definitions/os.inc.php A includes/definitions/sensors.inc.php U includes/snmp.inc.php U includes/common.php U includes/rrdtool.inc.php A includes/debug/ref.inc.php A includes/wmi.inc.php U includes/rewrites.php U includes/functions.php U includes/geolocation.inc.php U includes/polling/fdb-table.inc.php U includes/polling/os/ciena.inc.php A includes/polling/os/barracudangfw.inc.php U includes/polling/os/apc.inc.php U includes/polling/bgp-peers.inc.php U includes/polling/applications/exchange.inc.php U includes/polling/applications/mssql.inc.php U includes/polling/applications/powerdns-recursor.inc.php U includes/polling/wmi.inc.php U includes/polling/mempools/ciena.inc.php U includes/polling/functions.inc.php U includes/polling/unix-agent.inc.php U includes/polling/system.inc.php U includes/polling/sensors.inc.php U includes/polling/processors/ciena.inc.php U includes/polling/storage.inc.php U includes/polling/ospf.inc.php U includes/polling/ports.inc.php U includes/defaults.inc.php D includes/discovery/current D includes/discovery/voltages D includes/discovery/power D includes/discovery/dbm D includes/discovery/temperatures D includes/discovery/humidity D includes/discovery/frequencies U includes/discovery/sensors/ipomanii-mib.inc.php U includes/discovery/sensors/ups-mib.inc.php U includes/discovery/sensors/sentry3-mib.inc.php A includes/discovery/sensors/oadwdm-mib.inc.php U includes/discovery/sensors/dell-vendor-mib.inc.php U includes/discovery/sensors/zyxel-as-mib.inc.php U includes/discovery/sensors/juniper-mib.inc.php U includes/discovery/sensors/p8510-mib.inc.php U includes/discovery/sensors/wwp-leos-port-xcvr-mib.inc.php U includes/discovery/sensors/papouch-smi.inc.php A includes/discovery/sensors/f10-chassis-mib.inc.php U includes/discovery/sensors/gamatronic-mib.inc.php U includes/discovery/sensors/mikrotik-mib.inc.php A includes/discovery/sensors/f10-c-series-chassis-mib.inc.php U includes/discovery/sensors/nscrtv-root.inc.php U includes/discovery/sensors/supermicro-health-mib.inc.php U includes/discovery/sensors/juniper-system-mib.inc.php A includes/discovery/sensors/foundry-sn-agent-mib.inc.php U includes/discovery/sensors/cisco-envmon-mib.inc.php A includes/discovery/sensors/alcatel-ind1-health-mib.inc.php U includes/discovery/sensors/lm-sensors-mib.inc.php U includes/discovery/sensors/siconups-mib.inc.php A includes/discovery/sensors/powernet-mib.inc.php A includes/discovery/sensors/carel-ug40cdz-mib.inc.php U includes/discovery/sensors/wwp-leos-chassis-mib.inc.php A includes/discovery/sensors/f10-s-series-chassis-mib.inc.php U includes/discovery/sensors/eqlmember-mib.inc.php U includes/discovery/sensors/fastpath-boxservices-private-mib.inc.php U includes/discovery/sensors/radlan-hwenviroment.inc.php U includes/discovery/sensors/roomalert24e-mib.inc.php U includes/discovery/sensors/deltaups-mib.inc.php U includes/discovery/sensors/rbn-envmon-mib.inc.php A includes/discovery/sensors/s5-chassis-mib.inc.php U includes/discovery/sensors/mg-snmp-ups-mib.inc.php U includes/discovery/sensors/dell-rac-mib.inc.php U includes/discovery/sensors/areca-snmp-mib.inc.php U includes/discovery/sensors/airespace-wireless-mib.inc.php U includes/discovery/sensors/pdu-mib.inc.php U includes/discovery/sensors/juniper-dom-mib.inc.php U includes/discovery/sensors/sw-mib.inc.php U includes/discovery/sensors/webgraph-8xthermometer-us-mib.inc.php A includes/discovery/sensors/foundry-sn-switch-group-mib.inc.php A includes/discovery/sensors/netbotzv2-mib.inc.php U includes/discovery/sensors/asyncos-mail-mib.inc.php U includes/discovery/sensors/xups-mib.inc.php U includes/discovery/sensors/spagent-mib.inc.php U includes/discovery/sensors/ns-root-mib.inc.php U includes/discovery/functions.inc.php A includes/discovery/os/barracuda.inc.php U includes/discovery/os/ciena.inc.php U includes/discovery/sensors.inc.php U includes/discovery/mempools/ciena.inc.php U includes/definitions.inc.php U includes/port-descr-parser.inc.php U poll-billing.php A update/105.sql D mibs/apc U mibs/PowerNet-MIB Updated to revision 4737. root@observium:/opt/observium# ./discovery.php -h none Observium v0.13.11.4737 Discovery
-- Updating database/file schema 104 -> 105 ... (db) done. -- Done Current Revision : 4737 MySQL: Cell[2/0s] Row[16/0s] Rows[3/0s] Column[0/0s] Update[1/0.06s]
Insert[0/0s] Delete[0/0s]
Kind regards, Chris ----- Original Message ----- From: "Chris Pelling" chris@netearth.net To: "Observium Network Observation System" observium@observium.org Sent: Tuesday, 5 November, 2013 9:28:50 AM Subject: Re: [Observium] Upgrade to 4737 broke some graphs Morning Adam :) Ok, I have removed as much as I can. Here is a link to the file : https://drive.google.com/file/d/0BwFhv5Lh2EoiRWNBUzU3VXAxUjQ/edit?usp= sharing Kind regards, Chris On 05/11/2013 9:00 AM, Adam Armstrong wrote: The commandlines will include SNMP communities (but they *should* be
worthless without source-ip, and are clear text on the wire anyways).
The debug output will also contain interface descriptions and bgp session
information.
Nothing really worth protecting, but also not something I'd put in public :) adam. On 2013-11-05 08:52, Chris Pelling wrote: Hi Mike, Here is the screen shot, before I paste up the debug output (and me being
a "tool") does the debug output carry anything that needs removing, I see the hostname in there, but, although I removed the hostnames from the screenshot, pretty pointless now when looking at this file, I just want to make sure no passwords or anything are in it. :)
Here is the pic of the networks page. Sorry about the inverted screen,
but I am blind as a bat :-)
Kind regards, Chris On 05/11/2013 4:00 AM, Mike Stupalov wrote: that we could help, show:
- Screenshots
- debug poller out:
./poller.php -d -h [your_f_dell] > /tmp/poller.debug (file
/tmp/poller.debug send by pastebin or in mail attachment)
On Mon, Nov 4, 2013 at 11:12 PM, Chris Pelling chris@netearth.net wrote: Hi Guys, Upgraded today using "svn update" to 4737 from 4760 and 2 switch graphs (dell) stopped showing data, cisco, vyatta and one dell unaffected. For example, we have 2 x Dell M6220 stacked blades *a and c* and 1 x Dell M6348 stacked blade switch all in M1000e chassis. a = worked before and after, graph looks aok b = worked before, now
stopped c = worked before, now stopped
An interesting observation, if I drill down to a port on B, and click
realtime, its showing realtime information - so we know that works.
Billing also seems unaffected, just the graphs at : /devices/type=network/format=graphs/graph=bits/ stopped for these 2
devices (albeit one is identical to a working device) exactly at the time of upgrade.
I confirmed we did do the upgrade as per the wiki : svn update ./discovery.php -h none So now stumped, what can I do to get them back showing the current data
(they have the historical few hours before update) and/or what can I run to aid in finding a poss issue ? :-)
-- Kind regards, Chris
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Ohh. I forgot about this old style polling ;) Sorry guys and always use poller-wrapper. It's awesome!
Mike.
Adam Armstrong adama@memetic.org 6 ноября 2013 г. 0:41:42 написал:
On 2013-11-05 20:38, Mike Stupalov wrote:
Someone give me snmp access to device (with broken graphs). P.s. send to my personal mail (not to list).
Never fear, Yeltsin is here! Cold war is over!
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Don't worry, Putin kills Yeltsin. And Lenin lives forever!
Mike.
Adam Armstrong adama@memetic.org 6 ноября 2013 г. 0:41:42 написал:
On 2013-11-05 20:38, Mike Stupalov wrote:
Someone give me snmp access to device (with broken graphs). P.s. send to my personal mail (not to list).
Never fear, Yeltsin is here! Cold war is over!
adam. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (5)
-
Adam Armstrong -
Bastiaan Topper -
Chris Pelling -
Mike Stupalov -
Thomas Raabo - Zitcom A/S