- observium - lists.observium.org

Re: [Observium] 'Duplicate entry' issues on vlans_fdb
by Tom Laermans 18 Aug '15

18 Aug '15

If you're running multiple simultaneous pollers against the same device is not unthinkable they'll all be trying to insert the same data into the table... Tom On Aug 12, 2015 8:02 AM, Aaron Mayfield <amayfield(a)artisaninfrastructure.com> wrote: > > Here is the requested output. I had to kill all the other poller processes running on the system to get it to run (they were hosing the CPU). Oddly enough, once I killed all the other processes, I didn’t any problems running it (back to being fast). Also don’t seem to be getting the errors in the db.log when running the poller ‘one-at-a-time’. > > > > > > > > From: observium [mailto:observium-bounces@observium.org] On Behalf Of Adam Armstrong > Sent: Tuesday, August 11, 2015 11:52 PM > To: observium(a)observium.org > Subject: Re: [Observium] 'Duplicate entry' issues on vlans_fdb > > > > Hi Aaron, > > > > These seem to be gone from my db.log. Could you send me a ./poller.php -h 54 -m fdb-table -d ? > > > > Thanks, > > adam. >> >> On 12/08/2015 05:01:53, Aaron Mayfield <amayfield(a)artisaninfrastructure.com> wrote: >> >> Just today I updated to the latest and greatest (0.15.8.6882). I was several revisions behind and several database updates were done as a result. After the update, I noticed my poller.php processes started taking all the CPU, started getting gaps in the graphs, etc. I noticed thousands of these entries in db.log: >> >> >> [2015/08/11 22:01:02 -0500] poller.php(21342): Failed dbQuery (#1062 - Duplicate entry '54-2083-6ef88537f91f' for key 'dev_vlan_mac'), Query: INSERT INTO `vlans_fdb` (`device_id`,`vlan_id`,`port_id`,`mac_address`,`fdb_status`) VALUES ('54','2083','220115','6ef88537f91f','learned') >> [2015/08/11 22:01:02 -0500] poller.php(21342): Failed dbQuery (#1062 - Duplicate entry '54-2084-005056a927c2' for key 'dev_vlan_mac'), Query: INSERT INTO `vlans_fdb` (`device_id`,`vlan_id`,`port_id`,`mac_address`,`fdb_status`) VALUES ('54','2084','220115','005056a927c2','learned') >> [2015/08/11 22:01:02 -0500] poller.php(21342): Failed dbQuery (#1062 - Duplicate entry '54-2084-a66aaf0bf4cc' for key 'dev_vlan_mac'), Query: INSERT INTO `vlans_fdb` (`device_id`,`vlan_id`,`port_id`,`mac_address`,`fdb_status`) VALUES ('54','2084','220115','a66aaf0bf4cc','learned') >> [2015/08/11 22:01:02 -0500] poller.php(21342): Failed dbQuery (#1062 - Duplicate entry '54-2085-228a3d193c66' for key 'dev_vlan_mac'), Query: INSERT INTO `vlans_fdb` (`device_id`,`vlan_id`,`port_id`,`mac_address`,`fdb_status`) VALUES ('54','2085','220115','228a3d193c66','learned') >> [2015/08/11 22:01:02 -0500] poller.php(21342): Failed dbQuery (#1062 - Duplicate entry '54-2086-0ee7c729643b' for key 'dev_vlan_mac'), Query: INSERT INTO `vlans_fdb` (`device_id`,`vlan_id`,`port_id`,`mac_address`,`fdb_status`) VALUES ('54','2086','220115','0ee7c729643b','learned') >> >> If I run a poller process against a switch manually, everything seems to run fine with the exception of the fdb-table module, which is taking over 600 seconds to run. >> >> Here is the schema of my vlans_fdb file: >> >> mysql> show columns from vlans_fdb >> -> ; >> +-------------+-------------+------+-----+---------+-------+ >> | Field | Type | Null | Key | Default | Extra | >> +-------------+-------------+------+-----+---------+-------+ >> | device_id | int(11) | NO | PRI | NULL | | >> | vlan_id | int(11) | NO | PRI | NULL | | >> | port_id | int(11) | YES | MUL | NULL | | >> | mac_address | varchar(32) | NO | PRI | NULL | | >> | fdb_status | varchar(32) | NO | | NULL | | >> +-------------+-------------+------+-----+---------+-------+ >> 5 rows in set (0.00 sec) >> >> mysql> >> mysql> show index from vlans_fdb >> -> ; >> +-----------+------------+--------------+--------------+-------------+-----------+-------------+---- ----+--------+------+------------+---------+ >> | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub art | Packed | Null | Index_type | Comment | >> +-----------+------------+--------------+--------------+-------------+-----------+-------------+---- ----+--------+------+------------+---------+ >> | vlans_fdb | 0 | dev_vlan_mac | 1 | device_id | A | 15 | ULL | NULL | | BTREE | | >> | vlans_fdb | 0 | dev_vlan_mac | 2 | vlan_id | A | 18348 | ULL | NULL | | BTREE | | >> | vlans_fdb | 0 | dev_vlan_mac | 3 | mac_address | A | 128440 | ULL | NULL | | BTREE | | >> | vlans_fdb | 1 | device_id | 1 | device_id | A | 78 | ULL | NULL | | BTREE | | >> | vlans_fdb | 1 | port_id | 1 | port_id | A | 431 | ULL | NULL | YES | BTREE | | >> +-----------+------------+--------------+--------------+-------------+-----------+-------------+---- ----+--------+------+------------+---------+ >> 5 rows in set (0.04 sec) >> >> mysql> >> >> Does my table structure look right? I see someone else on the list has had this same issue, but there is no indication that this should be a problem in the latest version. >> >> What should I check? Thanks for any help. >> >> >> >> >> Aaron Mayfield >> Cloud Expert >> Networking Specialist >> >> 12400 Hwy. 71 W. Suite 350-407 >> Austin, TX 78738 >> T. 512.600.4297 >> www.artisaninfrastructure.com >> Partner portal: https://portal.vpdc.us >> Partner support: support(a)artisaninfrastructure.com >> >> >> >> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager. Please note that any views or opinions present in this email are solely those of the author and do not necessarily represent those of the company. Finally the recipient should check this email and any attachment for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. (Proprietary & Confidential – Artisan Infrastructure, Inc. et all.) >> _______________________________________________ >> observium mailing list >> observium(a)observium.org >> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium > > This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager. Please note that any views or opinions present in this email are solely those of the author and do not necessarily represent those of the company. Finally the recipient should check this email and any attachment for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. (Proprietary & Confidential – Artisan Infrastructure, Inc. et all.)

5 28

SolidFire SSD Storage
by Serghei Golipad 18 Aug '15

18 Aug '15

Guys, Any chance adding support for SolidFire storage? Cheers PLEASE CONSIDER THE ENVIRONMENT BEFORE PRINTING THIS EMAIL. Kelway (UK) Ltd is a Company registered in England and Wales. This email is sent for and on behalf of Kelway Holdings Limited. Kelway Holdings Limited is the UK holding company for Kelway (UK) Limited trading as Kelway. The registered office for Kelway Holdings Limited (Company Number 05872067) and its UK group undertakings is 10 Fleet Place, London, EC4M 7RB. VAT Registration 902 1949 39. Confidentiality: This e-mail contains proprietary information, some or all of which may be confidential and/or legally privileged. It is for the intended recipient only. If an addressing or transmission error has misdirected this e-mail, please notify the author by replying to this e-mail and then delete the original. If you are not the intended recipient you may not use, disclose, distribute, copy, print or rely on any information contained in this e-mail. You must not inform any other person other than Kelway or the sender of its existence. For more information about Kelway please visit www.kelway.co.uk

1 0

Allerting by port
by chott＠praha1.net 18 Aug '15

18 Aug '15

Hello team, in Cisco IOS switch i have aler for Device match "hostname match sw29" and Entity "ifDescr match FastEthernet4/0/3" I can can set same for Cisco Small business set like this "hostname match lsgsw28" and Entity "ifDescr match gi5" but probably there is another Entity for Cisco Small Business for name of port because Observium after Rebuild Alert does not find Device and port Tomas [email-header-praha1] Tomas Chott technický ředitel chott(a)praha1.net<mailto:chott@praha1.net> Phone: +420 245 004 005 Mobile: +420 604 930 119 Metropolitní síť Praha 1 z.s.p.o. Jindrisska 18 110 00 Praha 1 Czech Republic www.praha1.net<http://www.praha1.net> [Popis: Facebook]<http://www.facebook.com/praha1net> <http://www.linkedin.com/pub/tomas-chott/49/97a/1aa>

2 6

Alerts not clearing
by Johnston, Tom 17 Aug '15

17 Aug '15

I’m going to piggy back off the issue of the Alerts not clearing. I’m getting the same issue and I’m pretty sure its SQL config related though I don’t know much past that. For example if I add a new device, I will get alerts for ports in the Admin up / physical down as I’m checking for that with an alert checker. That’s to be expected as I haven’t had a chance to turn off alerting on interfaces I don’t care about yet. Once it polls I turn off polling/alerting on interfaces (such as access ports) So if I go in and turn polling/alerting off on those interfaces I’d assume the alerts would clear. However the alerts persist and keep firing even if I have them turned off on those specific interfaces. I have figured out I can manually clear these alerts by restarting the mysql service. Here is part of the poller run (not sure if you want it all) ##### Completed polling run at 2015-08-17 11:34:51 ##### o Devices Polled 1 o Poller Time 7.877 secs o Memory usage 7.25MB (peak: 7.25MB) o MySQL Usage Cell[3/0.001s] Row[8/0.002s] Rows[52/0.02s] Column[2/0.001s] Update[20/0.014s] Insert[4/0.016s] Delete[0/0s] o RRDTool Usage update[29/0.033s] ——————— Output of my.cnf —————————— I have tweaked some of these in an effort to fix past and this current issue. [client] port = 3306 socket = /var/run/mysqld/mysqld.sock # Here is entries for some specific programs # The following values assume you have at least 32M ram # This was formally known as [safe_mysqld]. Both versions are currently parsed. [mysqld_safe] socket = /var/run/mysqld/mysqld.sock nice = 0 [mysqld] # # * Basic Settings # user = mysql pid-file = /var/run/mysqld/mysqld.pid socket = /var/run/mysqld/mysqld.sock port = 3306 basedir = /usr datadir = /var/lib/mysql tmpdir = /tmp lc-messages-dir = /usr/share/mysql skip-external-locking # # Instead of skip-networking the default is now to listen only on # localhost which is more compatible and is not less secure. bind-address = 127.0.0.1 # # * Fine Tuning # key_buffer = 64M #Was 16 max_allowed_packet = 64M #Was 16 thread_stack = 192K thread_cache_size = 8 # This replaces the startup script and checks MyISAM tables if needed # the first time they are touched myisam-recover = BACKUP #max_connections = 100 #table_cache = 64 #thread_concurrency = 10 # # * Query Cache Configuration # query_cache_limit = 32M #Was 1M on 7/2 Tom Changed to test query_cache_size = 32M #Was 16 8/17 # # * Logging and Replication # # Both location gets rotated by the cronjob. # Be aware that this log type is a performance killer. # As of 5.1 you can enable the log at runtime! #general_log_file = /var/log/mysql/mysql.log #general_log = 1 # # Error log - should be very few entries. # log_error = /var/log/mysql/error.log # # Here you can see queries with especially long duration #log_slow_queries = /var/log/mysql/mysql-slow.log #long_query_time = 2 #log-queries-not-using-indexes # # The following can be used as easy to replay backup logs or for replication. # note: if you are setting up a replication slave, see README.Debian about # other settings you may need to change. #server-id = 1 #log_bin = /var/log/mysql/mysql-bin.log expire_logs_days = 10 max_binlog_size = 100M #binlog_do_db = include_database_name #binlog_ignore_db = include_database_name # # * InnoDB # # InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/. # Read the manual for more InnoDB related options. There are many! # # * Security Features # # Read the manual, too, if you want chroot! # chroot = /var/lib/mysql/ # # For generating SSL certificates I recommend the OpenSSL GUI "tinyca". # # ssl-ca=/etc/mysql/cacert.pem # ssl-cert=/etc/mysql/server-cert.pem # ssl-key=/etc/mysql/server-key.pem tmp_table_size = 2G max_heap_table_size = 2G [mysqldump] quick quote-names max_allowed_packet = 32M [mysql] #no-auto-rehash # faster start of mysql but no tab completition [isamchk] key_buffer = 32M # # * IMPORTANT: Additional settings that can override those from this file! # The files must end with '.cnf', otherwise they'll be ignored. # Tom J On 8/17/15, 9:11 AM, "observium on behalf of observium-request(a)observium.org" <observium-bounces(a)observium.org on behalf of observium-request(a)observium.org> wrote: >Re: Alerts not clearing

2 1

Question Allerting
by chott＠praha1.net 17 Aug '15

17 Aug '15

Hello team we have question from our customer, if i can sending Email with alert for interface down status for specific switch and send to specific email only for one customer for example Cisco sw29, port FastEthernet 4/0/3 i can try set ifOperStatus equal down hostname match sw29 FastEthernet4/0/3 doesnt work Tomas [email-header-praha1] Tomas Chott technický ředitel chott(a)praha1.net<mailto:chott@praha1.net> Phone: +420 245 004 005 Mobile: +420 604 930 119 Metropolitní síť Praha 1 z.s.p.o. Jindrisska 18 110 00 Praha 1 Czech Republic www.praha1.net<http://www.praha1.net> [Popis: Facebook]<http://www.facebook.com/praha1net> <http://www.linkedin.com/pub/tomas-chott/49/97a/1aa>

3 15

How to add support of new sensors for new (unknow) device
by Denis Zolotarev 17 Aug '15

17 Aug '15

Hello! I am very interested in adding support of new device series to Observium - NetPing (www.netping.ru) - devices for monitoring server rooms and remote power management. Could you please suggest how can I add support of the sensors for unknown (for Observium) devices? I have access to SMNP MIBs of this divices and can read value of any sensors via SNMP. For example I know the OID to read the temperature from one of the sensons: .1.3.6.1.4.1.25728.8800.1.1.2.1 Could you please explain how can I show this temperature on a graph in Observium? Thank you. -- Best Regards, Denis Zolotarev <http://google.com/+DenisZolotarev>

2 2

Hostname in generated graph image
by Simone Montagnani 17 Aug '15

17 Aug '15

Hi all, I've installed latest Observium community from a couple of months and it's working well. I need to use some graphs in other internal websites for monitoring, so I linked them directly using the URL of my observium server in the remote web server page. So, for example one link can appear like this: http://OBSERVIUM_SERVER_IP/graph.php?device=173&type=device_processor&legen… In this "mode" I can see the graph correctly but it's a simple blank page with the graph and legend but without hostname or any reference on it. Do you know is there is an option to add at graph.php to create hostname in the image? Generally: is there a syntax of all the options that we can pass to graph.php to get custom graphs, Regards, Simone

1 0

Alert for Syslog?
by chott＠praha1.net 17 Aug '15

17 Aug '15

Hello Team can i create Alert for Syslog message? Tomas [email-header-praha1] Tomas Chott technický ředitel chott(a)praha1.net<mailto:chott@praha1.net> Phone: +420 245 004 005 Mobile: +420 604 930 119 Metropolitní síť Praha 1 z.s.p.o. Jindrisska 18 110 00 Praha 1 Czech Republic www.praha1.net<http://www.praha1.net> [Popis: Facebook]<http://www.facebook.com/praha1net> <http://www.linkedin.com/pub/tomas-chott/49/97a/1aa>

3 3

Alerts not clearing
by Robert Williams 17 Aug '15

17 Aug '15

Hi, We seem to have an issue with alerts not clearing (after they are OK) from the Alerts list. Example below shows a checked called “Hardware Fault” which matches Warnings, Alerts and Down status for devices. These items (two output phases) were above a threshold for a period over the weekend, but then went back below it and the event cleared. The device itself shows that the thresholds are OK now but it does list as “Status: Checks Failed” even though the values (and the graph) show it as OK / Green: [cid:image005.jpg@01D0D8D4.84525900] The actual item is here: [cid:image006.jpg@01D0D8D4.84525900] The event in the Main Alerts List is here: [cid:image007.jpg@01D0D8D4.84525900] The Alert Checker configuration is here: [cid:image008.jpg@01D0D8D4.84525900] Sorry for all the images, but it seems the best way to explain this particular issue! This is not the first time this has happened, last week we had 8 items stuck in an alert state, I had to delete the checked and clear the alert table for the so-called “failed” items to make them go away. However, now we have some new alerts they seem to be stuck in the same way. Any ideas? Cheers! Robert Williams Custodian Data Centre Email: Robert(a)CustodianDC.com http://www.CustodianDC.com

2 1

List of latest alert checkers
by Samarasinghe, Sujith 14 Aug '15

14 Aug '15

Hi , Can you please provide list of sample alert checkers? I tried to add OSPF status but didn't work. It would be handy if you have list of standard alert checkers this seems to be good one. But still missing important stuff http://www.maartenmoerman.nl/?p=612 Thanks, Sujith, Confidentiality Note: This e-mail and any attachments are confidential and may be protected by legal privilege. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of this e-mail or any attachment is prohibited. If you have received this e-mail in error, please notify us immediately by returning it to the sender and delete this copy from your system. Thank you for your cooperation.

5 8