db.log full after upgrade to Observium CE 0.16.1.7533
After upgrade, all seemed well until my disk filled up. db.log contains countless entries about unknown columns. A couple examples are below.
I completed the schema update and full discovery at the end of the upgrade process per: http://www.observium.org/docs/updating/ http://www.observium.org/docs/updating/.
Rerunning discovery.php -u says my schema is up to date. But something isn’t right. Is there a way to force the schema update to run again? Perhaps that will install all the missing columns?
[2016/03/07 18:01:22 +0000] poller.php(9947): Failed dbQuery (#1054 - Unknown column 'port_label_short' in 'field list'), Query: UPDATE `ports` set `port_label` ='Vlan1',`port_label_short` ='Vlan1',`ifLastChange` ='2016-03-04 22:27:35' WHERE `port_id` = '2412'
[2016/03/07 16:16:10 +0000] poller.php(23363): Failed dbQuery (#1054 - Unknown column 'entity_id' in 'field list'), Query: INSERT INTO `eventlog` (`device_id`,`entity_id`,`entity_type`,`timestamp`,`severity`,`message`) VALUES ('78','42018','port',NOW(),'6','Interface changed: [port_label] '' -> 'xe-0/1/1'; [port_label_short] '' -> 'xe-0/1/1'; [ifLastChange] '2015-04-27 15:45:11' -> '2015-04-27 22:47:09'')
Hi mike,
You can either pick through the SQL updates to work out which one failed to apply, or you can kill off your database and recreate it.
Trying to reapply the schema updates would likely cause even more broken things.
Adam.
Sent from BlueMail
On Mar 7, 2016, 18:15, at 18:15, Mike Driscoll mike.driscoll@oracle.com wrote:
After upgrade, all seemed well until my disk filled up. db.log contains countless entries about unknown columns. A couple examples are below.
I completed the schema update and full discovery at the end of the upgrade process per: http://www.observium.org/docs/updating/ http://www.observium.org/docs/updating/.
Rerunning discovery.php -u says my schema is up to date. But something isn’t right. Is there a way to force the schema update to run again? Perhaps that will install all the missing columns?
[2016/03/07 18:01:22 +0000] poller.php(9947): Failed dbQuery (#1054 - Unknown column 'port_label_short' in 'field list'), Query: UPDATE `ports` set `port_label` ='Vlan1',`port_label_short` ='Vlan1',`ifLastChange` ='2016-03-04 22:27:35' WHERE `port_id` = '2412'
[2016/03/07 16:16:10 +0000] poller.php(23363): Failed dbQuery (#1054 - Unknown column 'entity_id' in 'field list'), Query: INSERT INTO `eventlog` (`device_id`,`entity_id`,`entity_type`,`timestamp`,`severity`,`message`) VALUES ('78','42018','port',NOW(),'6','Interface changed: [port_label] '' -> 'xe-0/1/1'; [port_label_short] '' -> 'xe-0/1/1'; [ifLastChange] '2015-04-27 15:45:11' -> '2015-04-27 22:47:09'')
observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
I’m glad Mike posted this as it made me look at mine and I have a different problem…
[2016/03/07 19:24:15 -0700] poller.php(6187): Failed dbQuery (#1062 - Duplicate entry ’47-landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-' for key 'unique_key'), Query: INSERT INTO `packages` (`device_id`,`name`,`manager`,`status`,`version`,`build`,`arch`,`size`) VALUES ('47','landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software','deb','1','4','','all','65536')
A bunch of our Ubuntu machines are tied to Landscape and they all get a special package applied. Our event log is full of the package change every time the poller runs and the db.log is filled with the above error message.
Aha. That's a different problem, caused by a very long package name!
Do these systems perchance get two packages which start with "landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-", but have different endings?
adam.
Sent from Mailbird [http://www.getmailbird.com/?utm_source=Mailbird&utm_medium=email&utm...] On 08/03/2016 02:38:35, Joey Stanford joey@stan4d.net wrote: I’m glad Mike posted this as it made me look at mine and I have a different problem…
[2016/03/07 19:24:15 -0700] poller.php(6187): Failed dbQuery (#1062 - Duplicate entry ’47-landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-' for key 'unique_key'), Query: INSERT INTO `packages` (`device_id`,`name`,`manager`,`status`,`version`,`build`,`arch`,`size`) VALUES ('47','landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software','deb','1','4','','all','65536')
A bunch of our Ubuntu machines are tied to Landscape and they all get a special package applied. Our event log is full of the package change every time the poller runs and the db.log is filled with the above error message.
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
I think it's just trying to insert as it didnt find the exact package name in the db....
On Mar 8, 2016 8:44 AM, Adam Armstrong adama@memetic.org wrote:
Aha. That's a different problem, caused by a very long package name!
Do these systems perchance get two packages which start with "landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-", but have different endings?
adam.
Sent from Mailbird
On 08/03/2016 02:38:35, Joey Stanford joey@stan4d.net wrote:
I’m glad Mike posted this as it made me look at mine and I have a different problem…
[2016/03/07 19:24:15 -0700] poller.php(6187): Failed dbQuery (#1062 - Duplicate entry ’47-landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-' for key 'unique_key'), Query: INSERT INTO `packages` (`device_id`,`name`,`manager`,`status`,`version`,`build`,`arch`,`size`) VALUES ('47','landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software','deb','1','4','','all','65536')
A bunch of our Ubuntu machines are tied to Landscape and they all get a special package applied. Our event log is full of the package change every time the poller runs and the db.log is filled with the above error message.
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
Ahh, yes. That's the more obvious explanation. Solution is increasing the field size. I'll do that in a bit!
adam.
Sent from Mailbird [http://www.getmailbird.com/?utm_source=Mailbird&utm_medium=email&utm...] On 08/03/2016 08:02:13, Tom Laermans tom.laermans@powersource.cx wrote: Aha. That's a different problem, caused by a very long package name!
Do these systems perchance get two packages which start with "landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-", but have different endings?
adam.
Sent from Mailbird [http://www.getmailbird.com/?utm_source=Mailbird&utm_medium=email&utm...] On 08/03/2016 02:38:35, Joey Stanford joey@stan4d.net wrote: I’m glad Mike posted this as it made me look at mine and I have a different problem…
[2016/03/07 19:24:15 -0700] poller.php(6187): Failed dbQuery (#1062 - Duplicate entry ’47-landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-' for key 'unique_key'), Query: INSERT INTO `packages` (`device_id`,`name`,`manager`,`status`,`version`,`build`,`arch`,`size`) VALUES ('47','landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software','deb','1','4','','all','65536')
A bunch of our Ubuntu machines are tied to Landscape and they all get a special package applied. Our event log is full of the package change every time the poller runs and the db.log is filled with the above error message.
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
On Mar 8, 2016, at 24:44 , Adam Armstrong adama@memetic.org wrote:
Do these systems perchance get two packages which start with "landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-", but have different endings?
ii landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software 4 all Landscape meta-package for profile rmham-minimum-software
So the package name is “landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software” and it’s currently at version 4.
I think Tom’s call-out is correct… the field size for package names is just a wee bit short.
Yeah, that was already fixed this morning :)
Might take a few days to filter down to stable. (i.e., when i next remember to do a merge!)
adam.
Sent from Mailbird [http://www.getmailbird.com/?utm_source=Mailbird&utm_medium=email&utm...] On 09/03/2016 01:08:57, Joey Stanford joey@stan4d.net wrote:
On Mar 8, 2016, at 24:44 , Adam Armstrong wrote:
Do these systems perchance get two packages which start with "landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-", but have different endings?
ii landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software 4 all Landscape meta-package for profile rmham-minimum-software
So the package name is “landscape-profile-rocky-mountain-ham-radio-inc-rmham-minimum-software” and it’s currently at version 4.
I think Tom’s call-out is correct… the field size for package names is just a wee bit short. _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
On Wed, Mar 09, 2016 at 01:36:14AM +0000, Adam Armstrong wrote:
Yeah, that was already fixed this morning :)
Might take a few days to filter down to stable. (i.e., when i next remember to do a merge!)
adam.
How about a rss feed for stable updates? They aren't included in http://observium.org/svn.rss -Nick
No advice on how to rerun db updates that didn’t occur the first time?
Mike
On Mar 8, 2016, at 18:10, Nick Schmalenberger nick@schmalenberger.us wrote:
On Wed, Mar 09, 2016 at 01:36:14AM +0000, Adam Armstrong wrote:
Yeah, that was already fixed this morning :)
Might take a few days to filter down to stable. (i.e., when i next remember to do a merge!)
adam.
How about a rss feed for stable updates? They aren't included in http://observium.org/svn.rss -Nick _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
There is no real way to do this. Probably your MySQL server was/is running in strict mode, and has failed an update. This is unrecoverable without a /lot/ of effort.
adam.
Sent from Mailbird [http://www.getmailbird.com/?utm_source=Mailbird&utm_medium=email&utm...] On 09/03/2016 16:03:42, Mike Driscoll mike.driscoll@oracle.com wrote: No advice on how to rerun db updates that didn’t occur the first time?
Mike
On Mar 8, 2016, at 18:10, Nick Schmalenberger wrote:
On Wed, Mar 09, 2016 at 01:36:14AM +0000, Adam Armstrong wrote:
Yeah, that was already fixed this morning :)
Might take a few days to filter down to stable. (i.e., when i next remember to do a merge!)
adam.
How about a rss feed for stable updates? They aren't included in http://observium.org/svn.rss -Nick _______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________ observium mailing list observium@observium.org http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
participants (5)
-
Adam Armstrong -
Joey Stanford -
Mike Driscoll -
Nick Schmalenberger -
Tom Laermans