Hi All,
For a while now it appears that all our devices which also have IPMI cards are seeing every single sensor added and deleted (in that order) on every poll.
A relevant snippet from the debug of one device gives:
(319ms) Discover sensor: temperature, Array, , 1, ipmi, System Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 31.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '1'] SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','1','ipmi','System Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223532 inserted ) + SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 1 System Temp')] Discover sensor: temperature, Array, , 2, ipmi, Peripheral Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 37.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '2'] SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','2','ipmi','Peripheral Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223533 inserted ) + SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 2 Peripheral Temp')] Discover sensor: fanspeed, Array, , 4, ipmi, FAN, 1 , 1, 450.000, 600.000, 18975.000, 19050.000, 3150.000 , ipmi, , , ,
<Repeats for all sensors>
…(Section cropped)…
<Then the removals follow immediately afterwards>
SQL[SELECT * FROM sensors AS S, devices AS D WHERE S.sensor_class='voltage' AND S.device_id = D.device_id AND D.device_id = '190' AND S.poller_type = 'ipmi'] - SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223535'] SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 5 Vcore')] - SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223536'] SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 6 3.3VCC')] - SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223537'] SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 7 12V')] - SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223538']
From what I can tell, it’s doing this for all devices with IPMI, regardless of make / model etc. - and it is only doing it to the IPMI sensors, nothing else is affected.
Feedback / suggestions welcome!
Cheers :)
Robert Williams Custodian Data Centre Email: Robert@CustodianDC.com http://www.CustodianDC.com
I posted this earlier (as did a couple of other people) but it was never fixed.
On 4/20/2013 6:33 AM, Robert Williams wrote:
Hi All,
For a while now it appears that all our devices which also have IPMI cards are seeing every single sensor added and deleted (in that order) on every poll.
A relevant snippet from the debug of one device gives:
(319ms) Discover sensor: temperature, Array, , 1, ipmi, System Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 31.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '1']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','1','ipmi','System Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223532 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 1 System Temp')] Discover sensor: temperature, Array, , 2, ipmi, Peripheral Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 37.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '2']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','2','ipmi','Peripheral Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223533 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 2 Peripheral Temp')] Discover sensor: fanspeed, Array, , 4, ipmi, FAN, 1 , 1, 450.000, 600.000, 18975.000, 19050.000, 3150.000 , ipmi, , , ,
<Repeats for all sensors>
...(Section cropped)...
<Then the removals follow immediately afterwards>
SQL[SELECT * FROM sensors AS S, devices AS D WHERE S.sensor_class='voltage' AND S.device_id = D.device_id AND D.device_id = '190' AND S.poller_type = 'ipmi'] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223535']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 5 Vcore')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223536']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 6 3.3VCC')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223537']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 7 12V')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223538']
From what I can tell, it's doing this for all devices with IPMI, regardless of make / model etc. - and it is only doing it to the IPMI sensors, nothing else is affected.
Feedback / suggestions welcome!
Cheers :)
Robert Williams Custodian Data Centre Email: Robert@CustodianDC.com http://www.CustodianDC.com
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
You need to be extra nice to Tom, as the IPMI stuff is written by him :)
adam.
On 2013-04-20 21:25, List User wrote:
I posted this earlier (as did a couple of other people) but it was never fixed.
On 4/20/2013 6:33 AM, Robert Williams wrote:
Hi All,
For a while now it appears that all our devices which also have IPMI cards are seeing every single sensor added and deleted (in that order) on every poll.
A relevant snippet from the debug of one device gives:
(319ms) Discover sensor: temperature, Array, , 1, ipmi, System Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 31.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '1']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','1','ipmi','System Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223532 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 1 System Temp')] Discover sensor: temperature, Array, , 2, ipmi, Peripheral Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 37.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '2']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','2','ipmi','Peripheral Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223533 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 2 Peripheral Temp')] Discover sensor: fanspeed, Array, , 4, ipmi, FAN, 1 , 1, 450.000, 600.000, 18975.000, 19050.000, 3150.000 , ipmi, , , ,
<Repeats for all sensors>
…(Section cropped)…
<Then the removals follow immediately afterwards>
SQL[SELECT * FROM sensors AS S, devices AS D WHERE S.sensor_class='voltage' AND S.device_id = D.device_id AND D.device_id = '190' AND S.poller_type = 'ipmi'] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223535']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 5 Vcore')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223536']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 6 3.3VCC')]
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223537']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 7 12V')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223538']
From what I can tell, it's doing this for all devices with IPMI, regardless of make / model etc. - and it is only doing it to the IPMI sensors, nothing else is affected.
Feedback / suggestions welcome!
Cheers :)
Robert Williams Custodian Data Centre Email: Robert@CustodianDC.com http://www.CustodianDC.com [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]
Links:
[1] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] http://www.CustodianDC.com
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Tom shelved this issue due to constant nagging combined with the fact that it works on his hardware from 4 different management controller vendors (hp, dell, supermicro, intel). So "working again" is not a correct question, it has always worked and it still does. ;-)
Patches welcome, sponsoring to look into it also welcome, otherwise free time and ipmi access will be needed...
Tom
PS: I'll need full proof of the existence of this cake you speak of.
On 20/04/2013 22:44, Adam Armstrong wrote:
You need to be extra nice to Tom, as the IPMI stuff is written by him :)
adam.
On 2013-04-20 21:25, List User wrote:
I posted this earlier (as did a couple of other people) but it was never fixed.
On 4/20/2013 6:33 AM, Robert Williams wrote:
Hi All,
For a while now it appears that all our devices which also have IPMI cards are seeing every single sensor added and deleted (in that order) on every poll.
A relevant snippet from the debug of one device gives:
(319ms) Discover sensor: temperature, Array, , 1, ipmi, System Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 31.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '1']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','1','ipmi','System Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223532 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 1 System Temp')] Discover sensor: temperature, Array, , 2, ipmi, Peripheral Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 37.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '2']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','2','ipmi','Peripheral Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223533 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 2 Peripheral Temp')] Discover sensor: fanspeed, Array, , 4, ipmi, FAN, 1 , 1, 450.000, 600.000, 18975.000, 19050.000, 3150.000 , ipmi, , , ,
<Repeats for all sensors>
…(Section cropped)…
<Then the removals follow immediately afterwards>
SQL[SELECT * FROM sensors AS S, devices AS D WHERE S.sensor_class='voltage' AND S.device_id = D.device_id AND D.device_id = '190' AND S.poller_type = 'ipmi'] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223535']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 5 Vcore')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223536']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 6 3.3VCC')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223537']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 7 12V')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223538']
From what I can tell, it's doing this for all devices with IPMI, regardless of make / model etc. - and it is only doing it to the IPMI sensors, nothing else is affected.
Feedback / suggestions welcome!
Cheers :)
Robert Williams Custodian Data Centre Email: Robert@CustodianDC.com http://www.CustodianDC.com [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]
Links:
[1] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] http://www.CustodianDC.com
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
The cake is a lie!
On 2013-04-21 21:40, Tom Laermans wrote:
Tom shelved this issue due to constant nagging combined with the fact that it works on his hardware from 4 different management controller vendors (hp, dell, supermicro, intel). So "working again" is not a correct question, it has always worked and it still does. ;-)
Patches welcome, sponsoring to look into it also welcome, otherwise free time and ipmi access will be needed...
Tom
PS: I'll need full proof of the existence of this cake you speak of.
On 20/04/2013 22:44, Adam Armstrong wrote: You need to be extra nice to Tom, as the IPMI stuff is written by him :)
adam.
On 2013-04-20 21:25, List User wrote: I posted this earlier (as did a couple of other people) but it was never fixed.
On 4/20/2013 6:33 AM, Robert Williams wrote:
Hi All,
For a while now it appears that all our devices which also have IPMI cards are seeing every single sensor added and deleted (in that order) on every poll.
A relevant snippet from the debug of one device gives:
(319ms) Discover sensor: temperature, Array, , 1, ipmi, System Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 31.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '1']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','1','ipmi','System Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223532 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 1 System Temp')] Discover sensor: temperature, Array, , 2, ipmi, Peripheral Temp, 1 , 1, -7.000, -5.000, 80.000, 85.000, 37.000 , ipmi, , , ,
SQL[SELECT COUNT(sensor_id) FROM `sensors` WHERE `poller_type`= 'ipmi' AND `sensor_class` = 'temperature' AND `device_id` = '190' AND sensor_type = 'ipmi' AND `sensor_index` = '2']
SQL[INSERT INTO `sensors` (`poller_type`,`sensor_class`,`device_id`,`sensor_oid`,`sensor_index`,`sensor_type`,`sensor_descr`,`sensor_divisor`,`sensor_multiplier`,`sensor_limit`,`sensor_limit_warn`,`sensor_limit_low`,`sensor_limit_low_warn`,`entPhysicalIndex`,`entPhysicalIndex_measured`,`measured_class`,`measured_entity`) VALUES ('ipmi','temperature','190','','2','ipmi','Peripheral Temp','1','1','85.000','80.000','-7.000','-5.000','','','','')] ( 223533 inserted )
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Added: temperature ipmi 2 Peripheral Temp')] Discover sensor: fanspeed, Array, , 4, ipmi, FAN, 1 , 1, 450.000, 600.000, 18975.000, 19050.000, 3150.000 , ipmi, , , ,
<Repeats for all sensors>
…(Section cropped)…
<Then the removals follow immediately afterwards>
SQL[SELECT * FROM sensors AS S, devices AS D WHERE S.sensor_class='voltage' AND S.device_id = D.device_id AND D.device_id = '190' AND S.poller_type = 'ipmi'] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223535']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 5 Vcore')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223536']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 6 3.3VCC')]
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223537']
SQL[INSERT INTO `eventlog` (`device_id`,`reference`,`type`,`timestamp`,`message`) VALUES ('190','NULL','sensor',NOW(),'Sensor Deleted: voltage ipmi 7 12V')] -
SQL[DELETE FROM `sensors` WHERE `sensor_id` = '223538']
From what I can tell, it's doing this for all devices with IPMI, regardless of make / model etc. - and it is only doing it to the IPMI sensors, nothing else is affected.
Feedback / suggestions welcome!
Cheers :)
Robert Williams Custodian Data Centre Email: Robert@CustodianDC.com http://www.CustodianDC.com [2]
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [1]
Links:
[1] http://postman.memetic.org/cgi-bin/mailman/listinfo/observium [2] http://www.CustodianDC.com
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (4)
-
Adam Armstrong
-
List User
-
Robert Williams
-
Tom Laermans