- observium - lists.observium.org

Optimisations for huge lb_pools
by Pieter De Wit 29 Apr '21

29 Apr '21

Hi Guys, We have some pretty large lb_virtuals (12000 entries), lb_pools (180000 entries) tables. I found that the poller was struggling to keep up with this (understandable IMHO). What I did find was MySQL appeared to be the bottleneck so after some debugging I added the following indexes: create index lb_virtuals_idx_1 on lb_virtuals (device_id,virt_name); create index lb_pools_idx_1 on lb_pools (device_id,pool_name); create index lb_snatpools_idx_1 on lb_snatpools (device_id,snatpool_name); The middle one had the biggest impact, since that is the biggest table. Here is the polling result showing the difference: Time Duration 2021-04-29 17:05:02 56s 2021-04-29 17:00:02 4m 19s Hopefully this can help someone else if they have an issue like this (I hope not for your sanity :D ) or perhaps the devs can advise a better way of doing it :) P.S. - The issue was that polling kept running over each other and that cause it to spiral out of control, data gaps where getting bigger and bigger and MySQL was pinned at 250-300% CPU (4 core box this) Cheers, Pieter

1 0

Probes check_snmp_win
by Jacek.Dabrowski＠selgros.pl 26 Apr '21

26 Apr '21

How to use Probes for check_snmp_win, I can't find it in the documentation, maybe someone will tell [cid:image001.png@01D73852.510E3BC0] [cid:image002.png@01D73852.510E3BC0] Pozdrawiam Jacek Dąbrowski

3 5

New Port Alert Checks Not Working
by Andre Geißler 26 Apr '21

26 Apr '21

Hi all I configured a port alert check and set test condition to "ifOperStatus eq down" and asssociation ruleset to "Port ifAlias match *!!!*". I can see entities (276 ports) are matched correctly but are listed without the device the ports belong to. Status of alert never changes from "0 0 0 0 276" It seems associations works fine but checks aren't executed no matter which association and conditions I try. A much more complex port check I configured years ago is working fine, new ones aren't. I'm on 21.4.11258 Thanks a lot Andre

1 0

bug?
by Eric Sigurdsson 25 Apr '21

25 Apr '21

Is there a bug in the installation script? I tried to use the installation script for a fresh install on Debian 10.9. The script said I had Debian 9 and aborted. I made a fresh install av Debian and tried again. The same result. I have Debian 10.9 and the installation script says Debian 9. Is this a bug or what is the problem? ES

2 4

Add Device API - Option to provide poller id as parameter.
by Midhun Kandoth 20 Apr '21

20 Apr '21

Hi All, I am using observium apis to add devices to observium in a partitioned poller setup. But the current add device api (POST /api/v0/devices/) is not accepting poller_id as a parameter. Currently I am using MySQL Query to add devices to observium with poller_id. I could see that the API is in active development state. So it will be great if you can incorporate this request as well. Best, Midhun Kandoth

1 0

Genexis OLT/ONT Device issues
by Prasun Kumar Mitra (NOC) 20 Apr '21

20 Apr '21

Hi , We are using an OLT/ONT device Brand "Genexis" (http://www.genexis.co.in). Currently we have added Genexis- SOLT33-08P for testing. But it's *not working fully as we are not getting connected ONT information*. We have contacted the device vendor team. The *technical head of vender team is in CC " Mr. Satyam Bharati" *and they also want their devices to be compatible with observium*. *Anything needed from vendors can be made available by their team, In this regard we need support to add this device in observium so that we can monitor those devices. Please guide us what we need to do. Thanks & Regards, Prasun Mitra Alliance NOC Alliance Broadband Services Pvt. Ltd. 1st Floor, P 26/1, Dr Nani Gopal Roy Chowdhuri Ave, Entally Kolkata, West Bengal 700014 Contact No.- 1800 1200 300

2 1

Observium graphs not populated on Cisco
by Thodoris Lakiotis 16 Apr '21

16 Apr '21

*Hello there,* *We have just added a new 1002-X ASR with the following software.* *Cisco IOS Software [Amsterdam], ASR1000 Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 17.3.3* *The device is polled just fine, all Interfaces, included subifs indexed correctly and everything seems ok.* *But observium shows data on only on physical interfaces, but not to Subinterfaces.* *To be more specific, it graphs only physical interfaces, but not routed VLAN interfaces.* *Have you ever seen anything like this?* Thodoris

2 2

linux persitance SNMP indexes
by Edvinas Kairys 15 Apr '21

15 Apr '21

Hello, As i know there're no plans to workaround not persistent SNMP indexes 'feature' in Observium. But maybe there any linux snmp persistence workaround suitable for Observium, and its plugins (for example, weathermap) to leave the linux snmp if indexes unchanged after server reboot, etc ? Thank you

1 0

Changing some devices to only poll every 10 or 15 minutes temporariliy?
by Damien Gardner 12 Apr '21

12 Apr '21

Hi all, I have a bit of an oddball one, hoping it's not horrible to be able to do... We have a few devices which have recently started taking > 5 mins to complete polling. This is leaving large gaps in our logs, and is also effecting discovery (as the polling of the devices are piling up on top of themselves and pushing load on those devices up heavily). For now I've just turned off polling on those devices, but that's not ideal either.. Is there a way to be able to just poll those manually at say 10 or 15 minute intervals? I shoved them into a group and excluded that group from our polls - and then ran poller.php -h deviceid on one device in cron every 15 mins to see how it would go - but we just get no graphs.. Also as a test, tried using rrdtool tune --step 900 to change the step size to 15 mins, but also no go (didn't really entirely expect it to..) Is there a not-horrible (or if it has to be, I'm ok with horrible in the short-term until the vendor can figure out what on earth is going on..) way to get these being polled on a 15-minute interval and also going into rrd's? (We're on the current paid subscription version, if that helps) Thanks, Damien [https://info.serversaustralia.com.au/hubfs/Brand-2018/logo-font-sau.gif] Damien Gardner Jnr Senior Dev Ops P: (02) 8115 8812 4 Amy Close, Wyong, NSW 2259 Need assistance? We are here 24/7 +61 2 8115 8888 [Sent from Front]

5 7

Unable to delete alert checkers
by Luis Londoño 26 Mar '21

26 Mar '21

Cant delete an alert checker. When I click on Delete the confirmation prompt comes up and the checkbox is already selected but the delete alert is disabled. Unchecking the box enabled the button but clicking it doesn't delete the alert. We are on 21.3.11160 (24th March 2021) [cid:image001.png@01D7216C.5095D420] Did find in the HTML to enable the button when the checkbox is pressed was to remove the "disabled=1" [cid:image002.png@01D7216C.8C292410]

4 4

[PATCH] Support kamcmd and kamctl in kamailio local script
by Kevin Riahi 19 Mar '21

19 Mar '21

Adam, What is the outlook on deploying this patch? https://jira.observium.org/browse/OBS-3431 Thank you Kevin Riahi

1 0

Fix for small issue in poller-wrapper.py
by Damien Gardner 16 Mar '21

16 Mar '21

Hi Team, Been pulling my hair out for a large chunk of the day trying to sort out why our Huawei devices stopped polling after I split out polling run into two lots (one excluding the huawei devices group, one including it) Seems that when you enable debug with poller-wrapper.py<http://poller-wrapper.py/> (-d), it's passing a string to substring.check_call rather than a file, so it throws an exception and doesn't run the poller. The diff below is an example that seems to fix this issue (though I'm a php dev, not python, so someone who knows python might have a nicer way to do it..) root@observium:/opt/observium# svn diff poller-wrapper.py<http://poller-wrapper.py> Index: poller-wrapper.py<http://poller-wrapper.py> =================================================================== --- poller-wrapper.py<http://poller-wrapper.py> (revision 11124) +++ poller-wrapper.py<http://poller-wrapper.py> (working copy) @@ -837,7 +837,7 @@ command_args.extend(command_list) command_args.append(device_id) if debug: - command_out = temp_path + '/observium_' + process + '_' + str(device_id) + '.debug' + command_out = open(temp_path + '/observium_' + process + '_' + str(device_id) + '.debug', 'w') #print(command_args) #debug subprocess.check_call(map(str, command_args), stdout=command_out, stderr=subprocess.STDOUT) (This doesn't fix the group being polled but nothing appearing in the DB or RRDs, but I'm still trying to figure out what's going on there, I'm sure it's something borked in our DB or something..) Thanks, DG [https://info.serversaustralia.com.au/hubfs/Brand-2018/logo-font-sau.gif] Damien Gardner Jnr Senior Dev Ops P: (02) 8115 8812 4 Amy Close, Wyong, NSW 2259 Need assistance? We are here 24/7 +61 2 8115 8888 [Sent from Front]

2 1

Limiting eventlog collection
by Michael Kelly 15 Mar '21

15 Mar '21

Hi, is there any way I can fine tune the collection of Informational/Debugging events? We have rather a lot of them. mysql> select count(*) from eventlog where severity in (6,7) and timestamp > '2021-03'; +----------+ | count(*) | +----------+ | 18500339 | +----------+ 1 row in set, 2 warnings (35.82 sec) Regards, Michael.

2 2

No graphs for 64bit network ports on arm
by Simon Smith 08 Mar '21

08 Mar '21

Hi All, Ive spotted a few weird issue with my new setup running on arm? 1. The first 4 ports on our TPLink switches are being detected as 64Bit and then the rest of the ports are 32Bit ? 2. the 64bit graphs are showing 0 for everything, even though the output from the command line shows stats? (See https://pastebin.com/raw/qP4T1Fa9 <https://pastebin.com/raw/qP4T1Fa9>) 3. The graphs are being generated so the RRDs are fine, but the graphs are blank? Regards Simon

2 10

Merge rrds
by Simon Smith 08 Mar '21

08 Mar '21

Hi All, Im just wondering how to merge two rrds together? I have moved our hosting from locally to aws I decided to start a fresh rather than coping the DB and RRDs over (personal reasons) So the id numbers of hosts are different, including dns etc I would like to preserve the rrd graphs if thats possible from the old install Regards Simon - Hestor Ltd

2 2

Problem with the update
by Mario Pascal Necker 06 Mar '21

06 Mar '21

Hello I become this error Message from the update. [cid:image001.png@01D7127F.C5982CB0] Thx mario -- ✓ Geprüft von IKARUS anti.virus http://www.ikarussecurity.com

1 0

what version of php and maria can I use?
by Tony Guadagno 06 Mar '21

06 Mar '21

Hi, I did look at the recommendations and it says 7.2+ so, can I use 7.4? what about 8? Same question for maria, looks like you like 10.3, can I use more current versions? Thanks Tony

3 2

Re: [Observium] what version of php and maria can I use?
by Tony Guadagno 05 Mar '21

05 Mar '21

Ok, great, what about Maria, is there an upper limit? On Mar 5, 2021 2:33 PM, "Joelly, Alexander via observium" <observium(a)observium.org> wrote: Observium on PHP 7.4 works fine - PHP 8 is not supported yet. From: observium <observium-bounces(a)observium.org> On Behalf Of Tony Guadagno via observium Sent: Friday, 5 March 2021 19:50 To: Adam Armstrong via observium <observium(a)observium.org> Cc: Tony Guadagno <tonyg(a)guadagno.org> Subject: [Observium] what version of php and maria can I use? WARNING: This e-mail originated from outside of Magna. Be cautious with links and attachments. ________________________________ Hi, I did look at the recommendations and it says 7.2+ so, can I use 7.4? what about 8? Same question for maria, looks like you like 10.3, can I use more current versions? Thanks Tony

1 0

Need to Add Genexis OLT/ONT Device
by Prasun Kumar Mitra (NOC) 05 Mar '21

05 Mar '21

Hi , We are using an OLT/ONT device Brand "Genexis" (http://www.genexis.co.in). Currently we have added Genexis- SOLT33-08P for testing. But it's not working fully as we are not getting connected ONT information. We have contacted the device vendor. They have provided us MIB of the devices(Link Provided below) but we are unable to make it work. In this regard we need support to add this device so that we can monitor those devices. Please let us know what we need to do . Link : Genexis MIB Link <https://drive.google.com/file/d/1rd7F9cl9sRGAcfAp5ydz3jxGJdHpeZ-f/view?usp=…> Thanks & Regards, Prasun Mitra Alliance NOC Alliance Broadband Services Pvt. Ltd. 1st Floor, P 26/1, Dr Nani Gopal Roy Chowdhuri Ave, Entally Kolkata, West Bengal 700014 Contact No.- 1800 1200 300

1 0

Syslog Integration
by Shawn L 03 Mar '21

03 Mar '21

We recently implemented syslog integration. One thing that we miss however is having the logs in the syslog file. It's great to see them in Observium, but there are times where it's easier to grep the syslog file itself to see what's going on. Is there a way to keep the log entries in the syslog files, and still deliver copies to Observium? Thanks Shawn

2 1

Observium Installation on Raspberry Pi 4 (Raspbian GNU/Linux 10 (buster))
by Polaris Networks Support 03 Mar '21

03 Mar '21

Hi, I'm having trouble installing Observium, from the script, on a Raspberry Pi 4 running: root@raspberrypi:~# lsb_release -a No LSB modules are available. Distributor ID: Raspbian Description: Raspbian GNU/Linux 10 (buster) Release: 10 Codename: buster Does anyone have any ideas on what could be wrong, based on the output below please? root@raspberrypi:~# wget http://www.observium.org/observium_installscript.sh --2021-03-03 11:31:53-- http://www.observium.org/observium_installscript.sh Resolving www.observium.org (www.observium.org)... 185.94.140.56 Connecting to www.observium.org (www.observium.org)|185.94.140.56|:80... connected. HTTP request sent, awaiting response... 301 Moved Permanently Location: https://www.observium.org/observium_installscript.sh [following] --2021-03-03 11:31:53-- https://www.observium.org/observium_installscript.sh Connecting to www.observium.org (www.observium.org)|185.94.140.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 17916 (17K) [text/x-sh] Saving to: ‘observium_installscript.sh’ observium_installsc 100%[===================>] 17.50K --.-KB/s in 0.002s 2021-03-03 11:31:53 (10.1 MB/s) - ‘observium_installscript.sh’ saved [17916/17916] root@raspberrypi:~# chmod +x observium_installscript.sh root@raspberrypi:~# ./observium_installscript.sh WARNING: Apache default config found, this script will overwrite that config and your current config will be lost Continue? 1) Yes 2) No #? 1 Apache config will be overwritten... ___ _ _ / _ \| |__ ___ ___ _ ____ _(_)_ _ _ __ ___ | | | | '_ \/ __|/ _ \ '__\ \ / / | | | | '_ ` _ \ | |_| | |_) \__ \ __/ | \ V /| | |_| | | | | | | \___/|_.__/|___/\___|_| \_/ |_|\__,_|_| |_| |_| Welcome to Observium automatic installscript Please choose which verision of Observium you would like to install 1. Observium Community Edition 2. Observium Pro Edition stable (requires account at https://www.observium.org/subs/) 3. Observium Pro Edition rolling (requires account at https://www.observium.org/subs/) 4. Install the UNIX-Agent 5. Install the SNMPD (snmpd-config will be overwritten) (1-5):1you choose 1 dpkg-query: no packages found matching mysql-server dpkg-query: no packages found matching mariadb-server [*] No MySQL server detected in this server, installing MySQL... Choose a MySQL root password [*] Beginning package installtion, this might take up to 30min [*] We are on Debian 8.x, installing packages... E: Unable to locate package libapache2-mod-php7.0 E: Couldn't find any package by glob 'libapache2-mod-php7.0' E: Couldn't find any package by regex 'libapache2-mod-php7.0' E: Unable to locate package php7.0-cli E: Couldn't find any package by glob 'php7.0-cli' E: Couldn't find any package by regex 'php7.0-cli' E: Unable to locate package php7.0-mysql E: Couldn't find any package by glob 'php7.0-mysql' E: Couldn't find any package by regex 'php7.0-mysql' E: Unable to locate package php7.0-mysqli E: Couldn't find any package by glob 'php7.0-mysqli' E: Couldn't find any package by regex 'php7.0-mysqli' E: Unable to locate package php7.0-gd E: Couldn't find any package by glob 'php7.0-gd' E: Couldn't find any package by regex 'php7.0-gd' E: Unable to locate package php7.0-mcrypt E: Couldn't find any package by glob 'php7.0-mcrypt' E: Couldn't find any package by regex 'php7.0-mcrypt' E: Unable to locate package php7.0-json E: Couldn't find any package by glob 'php7.0-json' E: Couldn't find any package by regex 'php7.0-json' E: Package 'mysql-server' has no installation candidate E: Package 'mysql-client' has no installation candidate root@raspberrypi:~# Thank you, Jon Bennell *Polaris Networks Support* *T: *+44 203 397 3535 *W: *www.polarisnetworks.co.uk *The e-mail and any attachments to it are confidential. Unless you are the intended recipient, you may not use, copy or disclose either the message or any information contained in the message. If you are not the intended recipient, you should delete this e-mail and notify the sender immediately. * *Any views or opinions expressed in this e-mail are those of the sender only, unless otherwise stated. All copyright in any Polaris Networks Limited material in this e-mail is reserved.* *All e-mails, incoming and outgoing, may be recorded by Polaris Networks Limited and monitored for legitimate business purposes.* *Polaris Networks Limited exclude all liability for any loss or damage arising or resulting from the receipt, use or transmission of this e-mail to the fullest extent permitted by law.*

3 9

Disable netstats for device type
by Robert Williams 03 Mar '21

03 Mar '21

Hi! We have a large number of 'Geist' PDU devices, each of which takes around 20-30 seconds to complete the 'netstats' poller element (due to the nasty tiny-brain device, not Observium): There is no data of value to us collected from this, so I'd like to just disable netstat collection for all current and future Geist devices. Is there a way to do this which doesn't involve clicking on each one and disabling that module manually? [cid:image001.png@01D70F52.9DBE2C60] I've trawled the DB as best I can to try to see where I can do this, but unable to identify where module enable/disablement is done. Closest I found is within the devices table, there is device_state and the netstats element is encoded in there in a way I cannot grasp unfortunately. Devices can be easily matched with: select * from devices where vendor like "geist" - so I'm hoping I can make a change globally somehow? Cheers! Robert Williams Custodian Data Centres https://www.CustodianDC.com

3 7

Backup options for the MySQL database
by Michael Kelly 02 Mar '21

02 Mar '21

Hi Everybody, I recently started a new role at a company that uses Observium to monitor a fairly large estate. Observium (Professional edition) was originally installed on an EC2 instance running Debian 8 and MySQL 5.5 by someone who has long since departed the company. My task is to bring it all up to date and document it. I've created a new instance running Ubuntu 20.04 LTS and MySQL 8.0.23 and testing the migration process hasn't thrown up any problems. One of the things my predecessor didn't do was to set up any backup regime for the database. As it happens, /var/lib/mysql is a logical volume and I've been looking at using lvm snapshots as part of a backup process. The basic idea would be to: Connect to the mysql daemon and issue a 'FLUSH TABLES WITH READ LOCK' command. Create the LVM snapshot. Connect to the daemon and issue a 'UNLOCK TABLES' command. Do something with the snapshot. My questions are: Is this a good idea? Will it give me a consistent backup? Is there a better way? Thanks in advance, Michael.

3 2

Port usage monitoring
by Simon Smith 24 Feb '21

24 Feb '21

Hi All, I wondered if anybody has been able to setup alerts for port usage? I would like to monitor a machines network port, and if it goes above say 20GB worth of upload in like 3 weeks then alert me? I think I might need the billing part of observium setup for this but im not sure? Kindest Regards Simon - Hestor Ltd

2 3

Graphs not displaying recent traffic
by Luis Londoño 23 Feb '21

23 Feb '21

Hello, For some reason, none of my graphs are showing any recent information. The last graphs being shown are from a few weeks ago. This is happening on all my devices I have in Observium. I just updated to r 21.2.11038 and still seeing the same thing. I am on rrdtool v1.7.2 [cid:image001.jpg@01D709C5.16A61770] How do I get my graphs to come back?

2 1