- observium - lists.observium.org

SNMP Query AIX Host
by FalkE 23 Dec '15

23 Dec '15

Hello everybody, I'm exploring Observium for a few days now and I really like it! I've added some Linux hosts using SNMP and it works like a charm. However, in conjuntion with IBM AIX, I got some problems: Using SNMP, I only get very basic information about OS level and network interfaces. There is no data about cpu, memory and storage usage. I'm using SNMPv1 for now. Could this be the problem? Is some data only available for v2c and v3? If so, can someone give me a sample configuration for SNMPv2c or SNMPv3 on AIX? Kind regards, Manuel

4 9

Unix Agent and Raspberry Pi
by gt＠gt1.net 22 Dec '15

22 Dec '15

Hello, I set up Observium to monitor a RPi device with Unix Agent and RPi script. I see the hardware sensors from RPi on the Observium interface, however all of them show zero values. When running /usr/bin/observium-agent on the RPi, all sensor data is displayed in the dump, but when I try telnet RPi 36602 from the server, the sensor data in the dump shows 0s. What could be the issue? Gennadiy.

1 0

How to shush alarms for sensors that lie...
by Robert Williams 21 Dec '15

21 Dec '15

Hi, The recent changes to the homepage layout have placed more attention on the summary statistics (alerted ports, alerted sensors etc.) which previously were not as visible. A positive side-effect of this has been the setting of more 'appropriate' manual thresholds for many of the less important sensors, to tidy them up. It has revealed one issue though, which I'm not sure how to work around. Take the following example: As you can see, the (unrealistic) dBm being reported by the Cisco chassis is stuck in a 'warning' state, despite having alarms disabled, the threshold on manual and thresholds set well clear of the 8.1dBm which it is reporting. (This port actually has a copper-converter in it, hence, the dBm is just rubbish spat out by an adapter which doesn't understand copper) So despite my best efforts to silence this warning, it still persists as a 'down' sensor, on the summary page showing up in red. (Not ignored, but actually down). We have quite a few of these adapters as well as a large number of voltage sensors (again, courtesy Cisco entity SNMP crapness) which are being reported as zero volts. These are also set to 'ignore' but continue to show as 'down' on the new summary homepage, some examples below: So - Does anyone know how I can totally and completely ignore/hide the broken sensors like these? Cheers! Robert Williams Custodian Data Centre Email: Robert(a)CustodianDC.com http://www.CustodianDC.com

1 1

Re: [Observium] Layout & Style Changes
by Kent Johannessen 21 Dec '15

21 Dec '15

Hi Adam, I am all for a flat design, which is the modern thing today (apparently:)). Some thoughts from me. Background: Does not make the site look good. Sorry. Have a color as previously, or maybe something like the grid background from before (probably a year ago). Icons: Removal of icons, maybe mostly in the device page makes it hard to quickly identify what you are looking for. (reading is boring). Right panel: I see some use for this. But should also be able to disable. Device page: On some resolutions it seems to create three rows, which make the right side too cramped. Had some more thoughts earlier today, but too late now to remember all :D Are there any plans to move completely to bootstrap 3? Best regards NOTICE: Please immediately e-mail back to sender if you are not the intended recipient. Thereafter delete the e-mail along with any attachments without making copies. The sender reserves all rights of privilege, confidentiality and copyright.

4 6

join ports together
by Simon Smith 18 Dec '15

18 Dec '15

Hi All, this is a bit of a daft question, I actually deleted one of our bridges on our mikrotik switches, and had to recreate them, DOH! the observium, then discovered the new bridge, but deleted the old bridge (marked as deleted)? now i have no graphs with old data in them for the new bridge :( can i join the new bridge and old bridge ports together in observium so i can see the old graphs in the new bridge? regards Simon

4 6

Layout & Style Changes
by Adam Armstrong 18 Dec '15

18 Dec '15

Hi All, Those of you running trunk and updating regularly might have noticed some layout/style changes in the past day or two. We've been running the old "shiny" style for about 3 years and thought it was about time we updated it, and have opted for a more "flat" design. Simplifying the stylistic elements has made it a bit easier for us to do certain things, since the old style was a little clumsy on things like horizontal boxes (check out the docs side bar for proof!). We've also added a wide layout for screens of ~1920 pixels wide which we plan to move some data too. This can already been seen on the /device/ /devices/ and /ports/ page, where some data, graphs and search forms are moved to the left hand pane. If anyone has any suggestions on what should/could go in that pane on various pages, now is the time to suggest it. Similarly any suggestions on the new styling should also be made now, before we move on to something else! :) Thanks, adam.

1 0

Observium and PHP7
by Markus Klock 18 Dec '15

18 Dec '15

Good news everyone! PHP7 is out and promise great performance to all PHP-applications. I tried it out this weekend on my Observium-installation and it did not disappoint! I have a rather large Observium and some of you that runs very large installations may have noticed that the web UI can get a little slow when rendering all the stuff from a large database. In my case the overview-page loads in about 5s and some of the more heavy pages like /devices/ takes about 7s to load. Well after upgrading to PHP7 my page loadtimes are now down to <1.5s for almost any page and atleast <2s for the heavy ones, I got a 2-3x performance boost! If you want to try it out I made a quick guide on how to run Observium on PHP7 here: http://blog.best-practice.se/2015/12/vastly-improve-observium-performance.h… Note that I don't know if everything in Observium is fully compatible with PHP7, I tried as many features as I could think of with no problems, however I have not tried the billing-module. Even if most of you don't have need for a speedup in the web UI, its great to see PHP improve performance like this. This means Observium will be able to scale even further in the future :) /Markus

4 10

grid not centre aligned
by Simon Smith 18 Dec '15

18 Dec '15

Hi All, another bug again, the screen is not centre aligned? its happening in chrome and firefox? also the new layout and style in my view is horrible, I preferred the old version! why u have to update :( regards Simon

3 6

Cisco 887VA - No OSPF Graphs
by Federico Olivieri 18 Dec '15

18 Dec '15

Hi all, I have just enabled OSPF between a Cisco 887VA running c880data-universalk9-mz.154-3.M4 and a Cisco 3750 c3750-ipservicesk9-mz.122-55.SE9. I can see the OSPF process on Observium for Cisco 3750 but nothing for Cisco 887 I tried to get some debug on router and that what I got (not sure if can be useful or not) Dec 16 11:15:09.002: SNMP: Response, reqid 1755104544, errstat 0, erridx 0 ospfGeneralGroup.1.0 = 192.168.0.1 ospfGeneralGroup.2.0 = 1 ospfGeneralGroup.3.0 = 2 ospfGeneralGroup.4.0 = 2 ospfGeneralGroup.5.0 = 1 ospfGeneralGroup.6.0 = 1 ospfGeneralGroup.7.0 = 9505 ospfGeneralGroup.8.0 = 2 ospfGeneralGroup.9.0 = 4 ospfGeneralGroup.10.0 = 3 Dec 16 11:15:09.042: SNMP: Packet sent via UDP to 192.168.0.3 process_mgmt_req_int: UDP packet being de-queued Anyone has experienced something similar? Any suggestion? Thank you Regards, Federico

3 12

Duplicate entry in applications table
by Simon Smith 18 Dec '15

18 Dec '15

Hi All, not sure if ive found a bug or something is wrong on my server that is being monitored in my db.log I’m getting [2015/12/17 17:05:10 +0000] poller.php(6976): Failed dbQuery (#1062 - Duplicate entry '64-apache-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','apache','') [2015/12/17 17:05:10 +0000] poller.php(6976): Failed dbQuery (#1062 - Duplicate entry '64-freeradius-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','freeradius','') [2015/12/17 17:05:10 +0000] poller.php(6976): Failed dbQuery (#1062 - Duplicate entry '64-mysql-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','mysql','') [2015/12/17 17:09:23 +0000] poller.php(12106): Failed dbQuery (#1062 - Duplicate entry '64-apache-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','apache','') [2015/12/17 17:09:23 +0000] poller.php(12106): Failed dbQuery (#1062 - Duplicate entry '64-freeradius-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','freeradius','') [2015/12/17 17:09:24 +0000] poller.php(12106): Failed dbQuery (#1062 - Duplicate entry '64-mysql-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','mysql','') [2015/12/17 17:15:15 +0000] poller.php(17083): Failed dbQuery (#1062 - Duplicate entry '64-apache-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','apache','') [2015/12/17 17:15:15 +0000] poller.php(17083): Failed dbQuery (#1062 - Duplicate entry '64-freeradius-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','freeradius','') [2015/12/17 17:15:15 +0000] poller.php(17083): Failed dbQuery (#1062 - Duplicate entry '64-mysql-' for key 'dev_type_inst'), Query: INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('64','mysql','') currently the machine runs apache, freeradius, mysql, openvpn I’m using the unix agents ? and they are installed correctly in /usr/lib/observium_agent/local i can even execute them correctly and get data out from out observium server whats also weird is I’m getting data for openvpn, just not the other? i have deleted the table entrys, but they just re-appear, and then the logs appear again is the a bug possible? regards Simon

3 5

broken app (apache/mysql) integration
by Nils Podzich 18 Dec '15

18 Dec '15

Hello, I have some problems with the 7274 version and the apps. Especially with the mysql and apache app. Mailgraph seems to work fine, the others are not tested. The app script of mysql/apache seem to run fine, if I telnet to 36602 I get output which seems valid to me - and is similar to a release where apache is working. I have no working version of mysql for comparison at the moment. I think I narrowed to problem down. If I try to run the poller-script manually in debug there is an error ---snip--- SQL[SELECT * FROM `applications` WHERE `device_id` = '40' AND `app_type` = 'mysql'] SQL RUNTIME[0.00032902s] Including: applications/mysql.inc.php mysql SQL[SELECT * FROM `applications` WHERE `device_id` = '40' AND `app_type` = 'mysql' AND `app_instance` IS NULL] SQL RUNTIME[0.00021815s] + SQL[INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('40','mysql','')] SQL RUNTIME[0.00914192s] ERROR[Error in query: (Duplicate entry '40-mysql-' for key 'dev_type_inst') 1062] ---snip--- SQL[SELECT * FROM `applications` WHERE `device_id` = '38' AND `app_type` = 'apache'] SQL RUNTIME[0.00032187s] Including: applications/apache.inc.php apache SQL[SELECT * FROM `applications` WHERE `device_id` = '38' AND `app_type` = 'apache' AND `app_instance` IS NULL] SQL RUNTIME[0.00016117s] + SQL[INSERT INTO `applications` (`device_id`,`app_type`,`app_instance`) VALUES ('38','apache','')] SQL RUNTIME[0.00899100s] ERROR[Error in query: (Duplicate entry '38-apache-' for key 'dev_type_inst') 1062] ---snip--- The hosts are newly added. I also did a restore of the observium machine because I thought I somehow broke it by adding and testing... but the problems return with readding the hosts. The graphs are showing mainly nothing which is not surprising I think The grahics are there but no values.... I noticed that the demo installation shows similar problems or. graphics, at least for the mysql. Apache seems to work there which it doesn't for me. http://demo.observium.org/apps/app=mysql/ Additionally I have problems removing a group definition. When you click "delete" it always shows "edit" which it makes hard to remove the group because of a typo. Can anyone help me? Am I doing something wrong? Thank you, Best regards Nils

2 1

test_email.php
by Elmas, Murat 17 Dec '15

17 Dec '15

Hi, I'm trying to define e-mail alert using config.php file. I looked the page at http://www.observium.org/docs/config_options/ for configuration options. It says here I can try the settings using the test_mail.php but no test-email.php in observium folder. "SMTP specific options To test email settings use test_mail.php script from main observium dirrectory." What should I do ? Thanks in advance ?NL? & Co ve ba?l? ortakl?klar? hakk?nda daha fazla bilgi www.unluco.com adresinde mevcuttur. Kisiye ?zel bu mesaj ve i?eri?indeki bilgiler gizlidir. ?NL? & Co ve ba?l? ortakl?klar? ("?irket"), bu mesajin icerigi ve ekleri ile ilgili olarak hukuksal hi?bir sorumluluk kabul etmez. Yetkili al?c?lardan biri de?ilseniz, bu mesajin herhangi bir ?ekilde if?a edilmesi, kullan?lmas?, kopyalanmas?, yay?lmas? veya mesajda yeralan hususlarla ilgili olarak herhangi bir i?lem yap?lmas?n?n kesinlikle yasak oldu?unu bildiririz. B?yle bir durumda, l?tfen hemen mesaj?n g?ndericisini bilgilendiriniz ve mesaj? sisteminizden siliniz. ?irketimiz, internet ortam?nda g?nderilen e-posta mesajlar?n?n ve bilgilerinin size de?i?ikli?e u?rayarak veya ge? ula?mas?ndan, b?t?nl???n?n ve gizlili?inin korunamamas?ndan, vir?s i?ermesinden ve bilgisayar sisteminize verebilece?i herhangi bir zarardan sorumlu tutulamaz. More information on ?NL? & Co and its subsidiaries is available at www.unluco.com The information contained in this communication may contain confidential or legally privileged information. ?NL? & Co and its subsidiaries ("the Company") do not accept any legal responsibility for the contents and attachments of this message. If you are not the intended recipient you are hereby notified that any disclosure, use, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this communication in error, please notify the sender immediately by responding to this e-mail and then delete it from your system. The Company shall have no liability for any changes or late receiving, loss of integrity and confidentiality, viruses and any damages caused in anyway to your computer system.

5 7

Re: [Observium] update.php fails to run on latest svn release 7273
by Jason Scholl 17 Dec '15

17 Dec '15

That worked, thanks. I also see that update.php got updated so that it doesn't support direct calls, nice touch.

1 0

New alert options
by Anders Johansson 17 Dec '15

17 Dec '15

Hi, After upgrading to the latest Observium (pro) I've noticed a lot of new alerting destination options. Just curios. * Are they all implemented or just in UI? * If any are activated, how do I configure them? We have internal email to SMS gateways, would it be possible to create one that uses a specific SMS template? I'd like to keep my sms messages short and don't mind creating one myself. When I looked at the code last time it didn't seems to be to much trouble, but perhaps it easier know when some of the code might be written? //Anders

3 3

Re: [Observium] update.php fails to run on latest svn release 7273
by Jason Scholl 17 Dec '15

17 Dec '15

Deleting and re-syncing includes didn't work, though I was able to get it to run successfully by swapping these two lines in update.php include_once("includes/definitions.inc.php"); include("includes/functions.inc.php"); get_obs_attrib is defined in 'includes/common.inc.php', but that is only getting included into update.php through 'includes/functions.inc.php'.

2 1

update.php fails to run on latest svn release 7273
by Jason Scholl 16 Dec '15

16 Dec '15

I just attempted to upgrade to release 7273 and update.php fails to run. It gives no output (just return code 255), and logs nothing to update-errors.log or any other log file. My php skills are pretty weak, but a bit of "got here" debugging lead me through the following. includes/update/update.php 21: include_once("includes/definitions.inc.php"); #bailed on this line includes/definitions.inc.php 513: $rev_old = @get_obs_attrib('current_rev'); #bailed on this line I wasn't able to track it down any further than that because I couldn't even seem to get get_obs_attrib to execute. As a last ditch effort, I also tried commenting out all of my config except the absolutely required pieces, but it still failed in the same way. Is anyone else having this problem or have any ideas?

2 1

Contact Destination - Local file
by Spencer Ryan 16 Dec '15

16 Dec '15

Would it be possible to add a local file option to the providers for a contact? There are situations where we would like to manipulate the data with a script of our own based on triggered alerts and recoveries and instead of mucking around the DB by hand having Observium write out the alerts to a file would be the easiest. Maybe just have it take a path and just >> the alert contents to whatever the user enters? *Spencer Ryan* | Senior Systems Administrator | sryan(a)arbor.net *Arbor Networks* +1.734.794.5033 (d) | +1.734.846.2053 (m) www.arbornetworks.com

5 7

Not alerting (probably user fail)
by Robert Williams 16 Dec '15

16 Dec '15

Hi, We've just finished migrating some of our monitoring targets to an additional instance of Observium, everything is polling fine and all the historic data etc. has been moved OK. The only thing which remains broken is that none of the alerts are actually sending their emails. They do show as being in an alert state OK, for example: However, no actual 'Alerted' time is ever recorded - and no email is ever sent. The sendmail element works fine with: sendmail -vt < testmail.txt The test contains the correct FROM and DEFAULT from the config.php in Observium and this delivers fine. Problem is, it was a very long time ago that I originally configured Observium alerting on the first box and I'm probably missing something stupid. Relevant config sections below: Both of these sections are identical to the working system they were copied from, which works fine. The postfix config is also identical to the working server and I'm confident postfix is OK as the test from it are fine: myhostname = OBSERVIUM.x.y alias_maps = hash:/etc/aliases alias_database = hash:/etc/aliases myorigin = /etc/mailname mydestination = OBSERVIUM, OBSERVIUM.x.y, localhost relayhost = 1.2.3.4 mailbox_size_limit = 0 recipient_delimiter = + Can anyone assist by pointing me at the switch I've obviously failed to turn on, or let me know what additional debugs I can provide to help track this? Cheers! Robert Williams Custodian Data Centre Email: Robert(a)CustodianDC.com http://www.CustodianDC.com

2 2

Alerts, metrics and attributes for applications
by Alex Winder ＠ M5i 16 Dec '15

16 Dec '15

Hi everyone, Does anyone know if there are any attributes or metrics for the UNIX agent applications, in particular NGINX, MySQL, Apache, and PowerDNS Recursor. I'm looking to create some alert checkers for them if it's at all possible. The only information I can find about the attributes and metrics is the following: http://www.observium.org/docs/attribs_metrics/ https://github.com/mgmoerman/docs/blob/master/observium-alert-checkers.md Regards, Alex.

2 2

hd-screen goofed up
by Simon Smith 16 Dec '15

16 Dec '15

Hi Adam, oh dear, the HD update in revision 7264, has goofed up my screen :( Ive had a HDPI Macbook Pro 2012 for years now the issue only appears on servers page tho? i goto our mikrotik switches - fine, tp-links - fine, just not linux or windows servers attached is screenshot for you :) Regards Simon

3 4

Re: [Observium] RRD Perms Issue - Error Drawing Graph
by Adam Armstrong 15 Dec '15

15 Dec '15

It seems that someone has modified your cron jobs to no longer be run as root, since your rrds were created by root and svn has no ability to change them. You need to work out where the poller is run from. It should be /etc/cron.d/observium Adam. Sent with AquaMail for Android http://www.aqua-mail.com On 15 December 2015 18:08:08 Robbie Wright <robbie(a)siuslawbroadband.com> wrote: > Not sure who the poller is running as. What's the easy way to check that? > > Yes, svn update has always been run as su. > > /opt/observium/rrd is owned by www-data, not root unlike the other folders > in the main directory. However, digging into the directory, all of the > folders inside for each host are all owned by root. > > > Robbie Wright > Siuslaw Broadband <https://siuslawbroadband.com> > 541-902-5101 > > On Tue, Dec 15, 2015 at 9:24 AM, Adam Armstrong <adama(a)memetic.org> wrote: > >> Are you running your poller observium poller as a non-root user? >> >> Did you svn up as root? >> >> The contents of the rrd directory, and anything else written to by the >> poller, should be owned by the user who runs the poller. >> >> Adam. >> >> Sent with AquaMail for Android >> http://www.aqua-mail.com >> >> On 15 December 2015 17:06:24 Robbie Wright <robbie(a)siuslawbroadband.com> >> wrote: >> >>> Recently upgraded from 69xx to 72xx after we renewed our license and it >>> broke all of our RRD's, resulting in the "Error Drawing Graph" issue. >>> >>> Running this "./poller.php -h <hostname> -m ports -d" gives me two >>> noticeable, but unobjectionable to me things: >>> >>> SNMP_STATUS[TRUE] >>> o Device status Device is reachable by PING (8.28ms) and SNMP >>> (81.63ms) >>> >>> RRD CMD[update /opt/observium/rrd/hostname/status.rrd N:1] >>> RRD RUNTIME[0.0012s] >>> RRD STDOUT[ERROR: opening '/opt/observium/rrd/hostname/status.rrd': >>> Permission denied] >>> RRD_STATUS[FALSE] >>> >>> and this at the end of the results: >>> >>> >>> Log file '/opt/observium/logs/observium.log' is not writable, check file >>> permissions. >>> >>> >>> So clearly some type of permission issue but not sure what happened >>> during the upgrade that would have caused this. Any thoughts on what >>> chmod's need to be set on the directories or what else could have went >>> haywire? >>> >>> >>> >>> Robbie Wright >>> Siuslaw Broadband <https://siuslawbroadband.com> >>> 541-902-5101 >>> _______________________________________________ >>> observium mailing list >>> observium(a)observium.org >>> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium >>> <http://postman.memetic.org/cgi-bin/mailman/listinfo/observium> >>> >>> >> _______________________________________________ >> observium mailing list >> observium(a)observium.org >> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium >> >> > > > > ---------- > _______________________________________________ > observium mailing list > observium(a)observium.org > http://postman.memetic.org/cgi-bin/mailman/listinfo/observium >

3 10

RRD Perms Issue - Error Drawing Graph
by Robbie Wright 15 Dec '15

15 Dec '15

Recently upgraded from 69xx to 72xx after we renewed our license and it broke all of our RRD's, resulting in the "Error Drawing Graph" issue. Running this "./poller.php -h <hostname> -m ports -d" gives me two noticeable, but unobjectionable to me things: SNMP_STATUS[TRUE] o Device status Device is reachable by PING (8.28ms) and SNMP (81.63ms) RRD CMD[update /opt/observium/rrd/hostname/status.rrd N:1] RRD RUNTIME[0.0012s] RRD STDOUT[ERROR: opening '/opt/observium/rrd/hostname/status.rrd': Permission denied] RRD_STATUS[FALSE] and this at the end of the results: Log file '/opt/observium/logs/observium.log' is not writable, check file permissions. So clearly some type of permission issue but not sure what happened during the upgrade that would have caused this. Any thoughts on what chmod's need to be set on the directories or what else could have went haywire? Robbie Wright Siuslaw Broadband <https://siuslawbroadband.com> 541-902-5101

2 2

CBQoS graphs on MetroEthernet switches
by lom＠digitelitalia.com 15 Dec '15

15 Dec '15

Hello to everyone, we are experiencing a problem with CBQoS graphs on Cisco Me3600 devices. We have many service instance in the same bridge-domain on the same port. The CBQoS graphs works only on the first one, it's NaN for the others. Could you help me? Regards. digitel Ing. Lorenzo Mainardi Via della Fortezza 6 - 50129 Firenze <http://www.digitelitalia.com/> www.digitelitalia.com - 800 901 669 Tel +39 055 4624933 Fax +39 055 4624 947 lom(a)digitelitalia.com <mailto:lom@digitelitalia.com>

2 1

Address for billing
by Robbie Wright 15 Dec '15

15 Dec '15

Sorry for the mass email here, but trying to renew our sub to Observium and our CC is getting declined, with the banking tell us the billing address doesn't match what Observium's credit card processor has on file. I don't see a way to update our address in our account on Observium's system or with Paddle or whoever. Thoughts? Aside from using PayPal? Robbie Wright Siuslaw Broadband <https://siuslawbroadband.com> 541-902-5101

2 1

SVN password not working
by Anthony Polselli 14 Dec '15

14 Dec '15

Hi all, Went to update Observium and it's not taking my username & password. Been a while so I might be using the wrong password. Any way to reset the password? Thanks! [cid:image001.jpg@01D135E7.5F2E6A90] __________________________________________ Anthony Polselli, Chief Technology Officer Natural Networks, Inc. 10225 Barnes Canyon Rd. Suite A105 San Diego, CA 92121 anthony(a)naturalnetworks.com<mailto:anthony@naturalnetworks.com> http://www.naturalnetworks.com<http://www.naturalnetworks.com/> (619) 222-3232 office (858) 202-0301 fax

3 3