We use Solarwinds NPM to monitor around 200 servers. Around 20 of the Windows servers (2008R2 & 2012) have this particular issue. The SNMP service will stop responding to queries after certain period of time. The only temp fix is to reboot the server. But the issue will come back after a while. I checked firewall rules and remove the AV client from those servers, non of those are the causes. Recently I did some further testing and notice the following strange behaviour of the SNMP service. The test tool I use is Paessler SNMP Tester 5.2.

So once the SNMP stop responding to SNMP queries, I restart the SNMP service (I have to kill the SNMP.exe process in order to stop it). SNMP Tests done locally will still fail straight after the restart. But if I wait for overnight and test next morning, the SNMP service will respond normally again. SNMP tests locally or remotely will return positive results no matter how many times I poll it. So it almost feels like the service need time to recover itself. Please note, the server is definitely not rebooted overnight. I then try to add the node into Solarwinds again. During the adding process, the initial test will come back positive. But as soon as I click next Solarwinds Orion tries to poll available resources to monitor, the SNMP service will stop responding immediately! SNMP tests done locally on the target server will fail again!

I have repeated above procedure for 2 days and are experiencing the exact same symptom. It appears the SNMP service does not like something generated from Solarwinds monitoring. Does anyone encounter similar issue before?

Please expand on “Other” and why by adding a comment below.

Hi,

I have registered NPM version 10.5 installed. The license is activated. Now we want to upgrade to latest version but our maintenance agreement is expired.

Can we install latest version on separate machine and use the old license by deactivating it ?

Steps:

1. Create new machine

2. Install latest version of NPM

3. Deactivate license on old NPM machine.

4. Apply license on latest NPM machine.

Is it possible ?

Regards,

Since the release on NPM 11.5 we've been hard at working building the next round of exciting functionality and improvements in existing functionality.  I'm excited to share the following list of items we're working on:

• Updated UI Look and Feel - The UI is receiving some love this release, spanning across NPM, SAM, VMAN, and the other Orion based products.
• Deep Visibility into F5 load balancers - Covering things like connection counts by VIP and server. NPM F5 info  FEATURE REQUEST - F5 Load Balancers - Show Wide IP status, GTM Server List, etc - Case #448234
• Monitoring for Cisco Switch Stacks (3750, 3850, 2960S) - Covering things like stack master, stack ring health, enumerating members, tracking member changes, per member hardware health, and so on. Cisco Stack monitoring
• Syslog / Traps / search improvements - Search Enhancements
• Unmanage behavior improvements - Unmanage reason (like shutdown tracker in Windows 2008)Silence Alerts While Still MonitoringUnmanage reason (like shutdown tracker in Windows 2008)Show 'Unmanaged' durationSilence Alerts While Still Monitoring
• Manage Pollers improvements - map sysoid values to arbitrary text for node details properties. Unknown Devices: admin mapping of sysObjectID to Vendor and MachineType
• Enhancements to view restrictions
• QoE Transport-Layer Metrics

Ongoing Initiatives:

• Increased scalability per SolarWinds instance (target of 250k elements / instance)
• Improved performance and decreased resource load times via analysis with SolarWinds DPA
• Increased number of pollers possible per instance

I am currently on NPM version 10.6.1, IPAM 4.0, IVIM 1.9.0 and I want to upgrade to the latest version of these products.  I found the migration doc, but I believe an upgrade path is much different from just move to a different server or servers.  Can someone give me the steps to upgrade or the link.

Thanks

Ross Jurek

Hi

The image above shows the trap i need to get into the Event list on Orion NPM.

"spSensorValue = 1" should be the Trigger Condition, and "spSensorValue = 0" is the Reset Condition.

I have tried to make a custom sql alert, but can't get it right.

Can someone help me on this one?

Thanks,

Simon

UPDATE:

Case is closed, this is the solution:

Trigger Condition:

INNER JOIN traps a

               ON a.nodeid = nodes.nodeid

INNER JOIN trapvarbinds b

               ON a.trapid = b.trapid

                  AND b.oidname = 'spSensorValue'

WHERE  a.traptype = 'HHMSAGENT-MIB:spUnknownStatus.301'

       AND a.datetime >= Dateadd(second, -15, Getdate())

       AND b.oidvalue = '1'

Reset Condition:

INNER JOIN traps a

               ON a.nodeid = nodes.nodeid

INNER JOIN trapvarbinds b

               ON a.trapid = b.trapid

                  AND b.oidname = 'spSensorValue'

WHERE  a.traptype = 'HHMSAGENT-MIB:spUnknownStatus.301'

       AND a.datetime >= Dateadd(second, -15, Getdate())

       AND b.oidvalue = '0'

Big thanks to RichardLetts.

when developing these I start with a database query that returns the set of nodes that match the criteria:

SELECTnodeid,

       traptype,

       oidvalue

FROM   trapsa

       INNERJOINtrapvarbindsb

               ONa.trapid=b.trapid

                  ANDb.oidname='spSensorValue'

WHERE  a.acknowledged=0

       ANDtraptype='HHMSAGENT-MIB:spUnknownStatus.301'

ORDER BY a.datetime

This is much faster at developing and testing that trying to use the alert manager to do this. Then convert this into the bit I paste into the 'alert' ; I like to put a time-bound on traps and allow then to be 'acknowledged'

       INNERJOIN trapsa

               ONa.nodeid=nodes.nodeid

       INNERJOINtrapvarbindsb

               ONa.trapid=b.trapid

                  ANDb.oidname='spSensorValue'

WHERE  a.acknowledged=0

       AND a.traptype='HHMSAGENT-MIB:spUnknownStatus.301'

       ANDa.datetime>=Dateadd(hour,-4,Getdate())

       ANDb.oidvalue='1'

       INNERJOIN trapsa

               ONa.nodeid=nodes.nodeid

       INNERJOINtrapvarbindsb

               ONa.trapid=b.trapid

                  ANDb.oidname='spSensorValue'

WHERE  a.traptype='HHMSAGENT-MIB:spUnknownStatus.301'

       ANDa.datetime>=Dateadd(hour,-4,Getdate())

       ANDb.oidvalue='0'

Hopefully that is enough to get you started in the right direction

[SOAPBOX]

     I have prefer putting the restrictions into the join criteria because they get evaluated how most people expect them to do when you have an outer join.

     I like putting the table restrictions in the join criteria when it makes sense, because if you ever need an outer join they work more like you expect them to

     Note: the Orion trap receiver incorrectly decoded the trap type. if that ever gets fixed you may have to update your clause.

[/SOAPBOX]

You are going to need some more complex SQL, because you have to check that the last trap received trap for the oidvalue:

       INNERJOINtrapsa

               ONa.nodeid=nodes.nodeid

                  ANDa.traptype='HHMSAGENT-MIB:spUnknownStatus.301'

       INNERJOINtrapvarbindsb

               ONa.trapid=b.trapid

                  ANDb.oidname='spSensorValue'

WHERE  a.acknowledged=0

       ANDa.datetime>=Dateadd(hour,-4,Getdate())

       ANDa.datetime=(SELECTMax(datetime)

                         FROM   trapst

                         WHERE  t.nodeid=a.nodeid

                                ANDT.traptype=

                                    'HHMSAGENT-MIB:spUnknownStatus.301')

       ANDb.oidvalue='1'

Thanks alot, Richard!

I did some customization of your examples, and now it works perfect for our use.

Trigger Condition:

INNER JOIN traps a

               ON a.nodeid = nodes.nodeid

INNER JOIN trapvarbinds b

               ON a.trapid = b.trapid

                  AND b.oidname = 'spSensorValue'

WHERE  a.traptype = 'HHMSAGENT-MIB:spUnknownStatus.301'

       AND a.datetime >= Dateadd(second, -15, Getdate())

       AND b.oidvalue = '1'

Reset Condition:

INNER JOIN traps a

               ON a.nodeid = nodes.nodeid

INNER JOIN trapvarbinds b

               ON a.trapid = b.trapid

                  AND b.oidname = 'spSensorValue'

WHERE  a.traptype = 'HHMSAGENT-MIB:spUnknownStatus.301'

       AND a.datetime >= Dateadd(second, -15, Getdate())

       AND b.oidvalue = '0'

This document was generated from the following discussion: Trap to Event List using Custom SQL Alert

SolarWinds has Product Upgrade Advisor website which helps users to validate compatibility of product versions.https://customerportal.solarwinds.com/support/product-upgrade-advisor

Do you use that prior any product upgrade?

I recently replaced a Cisco 3550 with a 3560. I have basically the same config, IP address, hostname, etc....

NCM will report the interface status, traffic and other port info, but NPM does not show this data. I have the SNMP V2 read string correct. We do not use the read/write string.

When I add new 3560s to the NPM the graphs and charts report correctly, but not when I replace a switch with like ports and config.

Should I delete a switch and add it back when I upgrade a model with a newer like model? Or is there something else I should do? I don't want to lose the historical data, understanding the port speed went from 100meg to 1Gig does that make the difference?

Thanks,

Robin

Hi,

How can I create interface usage table for network devices? This table  should display number of total, available, using ports  for last month.

regards,

Hi I'm new to thwack, npm and solarwinds products in general.

We've got basic monitoring setup for the devices and ports we want to monitor for uptime, utilization, etc, but I have several devices which have higher than average response times and am getting tired of the email alerts I keep getting that they are "exceptionally high" when they are historically normal for the devices.

One is a small remote Juniper SSG 5 netscreen firewall which is behind a T1 circuit that has been just shy of flakey from day one. It constantly has response times from ~250ms to ~1275ms and we've never been able to nail down where the problem is so we've just lived with it for 15 years.

Another is on site where NPM is running with our monitor/threat prevention appliance which is watching all traffic for all vlans and running threat assessment against everything. Its external switches interfaces shows response times are usually from ~500-1750ms. Not what we'd like to see but the vendor tells us it has no impact on actual performance of the unit. We're more interested on getting notifications of failures rather than response times because it is configured for fail-open so if it fails it's not the end of our world but we do need to see a notification.

I've selected the 'Override Orion General Thresholds' and set the Warning & Critical values to what I want, but it continues to blast me with emails for these nodes. Is there somewhere I have to check to even allow overrides or something?

Thanks

I have created a couple of scheduled reports to email the results of the report when they run.  While testing the reports everything works as it should and I am ready to place them on their schedule.  While testing the schedule function, the scheduler appears to be double-firing the email.  I get two identical emails at the same time.  When I manually run the schedule, I only get the single email.  Has anyone had a similar experience when using the report scheduler?  I am running NPM 10.7 Orion Platform 2014.1.0.  TIA for any assistance.

Here is the calculation for the Disk / Volume / RAM /below and example.

What object IDs (OIDs) does Orion NPM poll for volume information? What types of volume information does Orion NPM poll?

http://knowledgebase.solarwinds.com/kb/questions/1194/What+object+IDs+%28OIDs%29+does+Orion+NPM+poll+for+volume+information%3F+What+types+of+volume+information+does+Orion+NPM+poll%3F

You can run the MIB Walk for the Node in Question in order to find out what values been returned by the Node for required OID's as below.

Here is MIB walk tool download Link

http://downloads.solarwinds.com/solarwinds/Release/PreRelease/SolarWindsSnmpWalk.zip

******** MIb Walk Result from the Node **********

.1.3.6.1.2.1.25.2.3.1.3.1 = String: "Physical RAM"

.1.3.6.1.2.1.25.2.3.1.3.2 = String: "Virtual Memory"

.1.3.6.1.2.1.25.2.3.1.3.3 = String: "/"

.1.3.6.1.2.1.25.2.3.1.3.4 = String: "/proc"

.1.3.6.1.2.1.25.2.3.1.3.5 = String: "/dev/pts"

.1.3.6.1.2.1.25.2.3.1.3.6 = String: "/proc/bus/usb"

.1.3.6.1.2.1.25.2.3.1.3.7 = String: "/partB"

.1.3.6.1.2.1.25.2.3.1.3.8 = String: "/common"

.1.3.6.1.2.1.25.2.3.1.3.9 = String: "/grub"

.1.3.6.1.2.1.25.2.3.1.3.10 = String: "/dev/shm"

.1.3.6.1.2.1.25.2.3.1.3.11 = String: "/spare"

.1.3.6.1.2.1.25.2.3.1.3.12 = String: "/proc/sys/fs/binfmt_misc"

.1.3.6.1.2.1.25.2.3.1.4.1 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.2 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.3 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.4 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.5 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.6 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.7 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.8 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.9 = INTEGER: 1024

.1.3.6.1.2.1.25.2.3.1.4.10 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.11 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.4.12 = INTEGER: 4096

.1.3.6.1.2.1.25.2.3.1.5.1 = INTEGER: 1021591

.1.3.6.1.2.1.25.2.3.1.5.2 = INTEGER: 512034

.1.3.6.1.2.1.25.2.3.1.5.3 = INTEGER: 4232703

.1.3.6.1.2.1.25.2.3.1.5.4 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.5.5 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.5.6 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.5.7 = INTEGER: 4232699

.1.3.6.1.2.1.25.2.3.1.5.8 = INTEGER: 17502476

.1.3.6.1.2.1.25.2.3.1.5.9 = INTEGER: 252879

.1.3.6.1.2.1.25.2.3.1.5.10 = INTEGER: 510795

.1.3.6.1.2.1.25.2.3.1.5.11 = INTEGER: 8468466

.1.3.6.1.2.1.25.2.3.1.5.12 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.6.1 = INTEGER: 447260

.1.3.6.1.2.1.25.2.3.1.6.2 = INTEGER: 52

.1.3.6.1.2.1.25.2.3.1.6.3 = INTEGER: 2837178

.1.3.6.1.2.1.25.2.3.1.6.4 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.6.5 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.6.6 = INTEGER: 0

.1.3.6.1.2.1.25.2.3.1.6.7 = INTEGER: 2736606

.1.3.6.1.2.1.25.2.3.1.6.8 = INTEGER: 7646375

.1.3.6.1.2.1.25.2.3.1.6.9 = INTEGER: 4303

.1.3.6.1.2.1.25.2.3.1.6.10 = INTEGER: 5422

.1.3.6.1.2.1.25.2.3.1.6.11 = INTEGER: 8256

****************** Physical Disks ******************

hrStorageDescr = .1.3.6.1.2.1.25.2.3.1.3.3 = String: "/"

hrStorageAllocationUnits=   .1.3.6.1.2.1.25.2.3.1.4.3 = INTEGER: 4096

hrStorageSize .1.3.6.1.2.1.25.2.3.1.5.3 = INTEGER: 4232703

hrStorageUsed = .1.3.6.1.2.1.25.2.3.1.6.3 = INTEGER: 2837178

Calculations :

Volume size       4232703 x 4096  17337151488 Bytes   16.146 GB

Volume used       2837178 x 4096  11621081088 Bytes   10.822 GB

space available   17337151488 - 11621081088 = 5716070400 5.323 GB .

Percentage        10.8/16.14 * 100 65%

****************************************************

hrStorageDescr = .1.3.6.1.2.1.25.2.3.1.3.1 = String: "Physical RAM"

hrStorageAllocationUnits= .1.3.6.1.2.1.25.2.3.1.4.1 = INTEGER: 4096

hrStorageSize    .1.3.6.1.2.1.25.2.3.1.5.1 = INTEGER: 1021591

hrStorageUsed = .1.3.6.1.2.1.25.2.3.1.6.1 = INTEGER: 447260

Calculations : Physical RAM

Volume size       1021591 x 4096  4184436736 Bytes       3.897 GB

Volume used       447260 x 4096   1831976960 Bytes       1.706 GB

space available   1831976960 - 4184436736 = 2352459776     2.1 GB

Percentage        1.706/3.897 * 100 43%

*********************************************************

hrStorageDescr = .1.3.6.1.2.1.25.2.3.1.3.2 = String: "Virtual Memory"

hrStorageAllocationUnits= .1.3.6.1.2.1.25.2.3.1.4.2 = INTEGER: 4096

hrStorageSize    .1.3.6.1.2.1.25.2.3.1.5.2 = INTEGER: 512034

hrStorageUsed = .1.3.6.1.2.1.25.2.3.1.6.2 = INTEGER: 52

Calculations : Virtual Memory

Volume size       512034 x 4096  2097291264 Bytes   1.953 GB

Volume used       52 x 4096 212992 Bytes           0.0001 GB

space available   212992 - 2097291264 = 2097078272  1.953 GB .

Percentage 0.0001/1.953 * 100 0.0%

///////////////////////////////////////////////////////////////

Adding Few more explanation here for Cisco Call Manager Showing 99% Memory Utilization in Orion .( just in case someone having this issue )

The reason you are seeing 99% is due to the Cisco MCS returning back those values.

Why its doing this, you have to Open Cisco TAC.

NPM is returning back the values its being supplied with, in this case showing 99%.

Poller type: Used .

1. N.Memory.SNMP.CpqHostPhysicalMemory =

Memory poller for OpenVMS systems which support proprietary CPQ-Host MIB

Poller utilizes GetSubtree request with two OIDs to gather total and used memory:

            cpqHoPhysicalMemorySize = 1.3.6.1.4.1.232.11.2.13.1.

            cpqHoPhysicalMemoryFree = 1.3.6.1.4.1.232.11.2.13.2.

Total memory is computed using this formula:

            memoryTotal = cpqHoPhysicalMemorySize * 1024

Used memory is computed using this formula:

            memoryUsed = memoryTotal - (cpqHoPhysicalMemoryFree * 1024)

MIB Walk shows:

            .1.3.6.1.4.1.232.11.2.13.1.0 = INTEGER: 3990 = cpqHoPhysicalMemorySize

            .1.3.6.1.4.1.232.11.2.13.2.0 = INTEGER: 60 = cpqHoPhysicalMemoryFree

memoryTotal = 3990 * 1024 = 4085760

memoryUsed = 4085760 - (60 * 1024) = 4085760 – 61440 = 4024320

PercentUsed = 4024320/4085760 = 98.496% = 99%

////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

For Linux Server for Poller assigned N.Memory.SNMP.NetSnmpReal

If poller assigned

N.Memory.SNMP.NetSnmpReal

/// memTotalReal = 1.3.6.1.4.1.2021.4.5.
/// memAvailReal = 1.3.6.1.4.1.2021.4.6.
/// memCached = 1.3.6.1.4.1.2021.4.15.
/// memBuffer = 1.3.6.1.4.1.2021.4.14.
/// UsedMemory = (totalMem - availMem - cachedMem - bufferMem) * 1024

.1.3.6.1.4.1.2021.4.5.0 = INTEGER: 2073620 (Total )

.1.3.6.1.4.1.2021.4.6.0 = INTEGER: 1869968 (Available )

.1.3.6.1.4.1.2021.4.15.0 = INTEGER: 88008 (cachedMemory )

.1.3.6.1.4.1.2021.4.14.0 = INTEGER: 51868 (BufferMemory )

( 2073620– 1869968– 88008– 51868 ) = 63776  

63776 * 1024 = 65306624 bytes

********************

Vmware ESX Memory Calculation

Supported Poller

The "Memory" Usage and the "Physical Memory" Utilization are calculated differently by Orion NPM.

Memory:

The Memory is the sum of the memory used by the processes listed in the HOST-RESOURCES-MIB:hrSWRunPerfTable (1.3.6.1.2.1.25.5.1).

The OID used is the hrSWRunPerfMem (1.3.6.1.2.1.25.5.1.1.2).

Physical Memory:

The Physical Memory is calculated based on the values populated in the HOST-RESOURCES-MIB:hrStorageTable (1.3.6.1.2.1.25.2.2.3).

The OIDs used are hrStorageSize (1.3.6.1.2.1.25.2.3.1.5), hrStorageUsed (1.3.6.1.2.1.25.2.3.1.6) and hrStorageAllocationUnits (1.3.6.1.2.1.25.2.3.1.4) .

Calculation :-

Used: .1.3.6.1.2.1.25.5.1.1.2

Free:  .1.3.6.1.2.1.25.5.1.1.1

Total. 5933728 + 7325457 = 13259185

% Used : 5933728 % 13259185 = 44.751 %

Thanks for the help....

Hello,

I have a question of Cisco UCS monitoring.

Can NPM monitor the following item?

Blabe Chassis

- Power Supply Status

- Network Traffic

- Temperature

- FAN status

Blade Server

- Total Traffic

- VLAN Traffic

- Temperature

Rack-mount Server

- Power Supply Status

- Total Traffic

- VLAN Traffic

- Temperature

- FAN status

Fabric Interconnect

- Power Supply Status

- Total Traffic

- VLAN Traffic

- Temperature

- FAN status

Fabric extender

- Total Traffic

- Temperature

- FAN status

Those can be monitored by Cisco UCS Monitoring Option of MIRACLE ZBX.

Its monitor item seems to acquire information from a UCS Manager.

How do I allow the Report Scheduler the ability to log into Solarwinds?

Currently using a local orion account for the scheduler.

Please expand on “Other” and why by adding a comment below.

Perahps I am missing something obvious ... but where would I look to see when a node went unmanaged and who unmanaged it?  

Hi

is one of the service layer process on the last core release became 64bit ?

/sja

Hi All,

Please help!!

We are having following issues after upgrade to NPM 11.5.2 and SAM 6.2, please let us know how we could fix these,

1. We have one Additional Web Server, Application Pool of Our Webserver stops randomly every 4-5 days.

1. Sometimes when we click on Settings option, following Website error appears ,

  Unexpected Website Error . Object Reference not set to an instance of an object. 

3. While Exporting Custom Properties, Additional (extra)Column get exported with Column heading as,

4. While Creating Alert, the wizard times out after clicking next and does not function properly, one needs to be very quick to make an alert or else it will timeout within one minute. Alert home Screen will appear, it will have following message,

A draft alert was saved at 11:21 AM » Return to editing Draft  » Delete Draft

1. 5. While Creating Report, the wizard times out after clicking next and does not function properly, one needs to be very quick to make an Report or else it will timeout within one minute and Report Home Screen will appear.

1. 6. NETWORK SONAR DISCOVERY does not work for WMI Based Polling. We are able to add nodes in Bulk, only using SNMP and ICMP. Nodes are not getting added in Bulk through Service Account Credentials  (WMI) in Sonar Discovery.

But adding a single node option is working.

1. 7. While Importing Custom Properties, the loading of file to be used for Importing takes lot of time, it never took so long for file to load  in previous version.

1. 8. Console has become Slow.
2. 9. Sometimes repeated pop up comes for authentication to Webserver.
3. 10. While Working Normally on application "Unexpected Website Error" comes randomly after clicking on any option.

Hi everyone,

Trying to upgrade the NPM form 11.0.1 to 11.5.2 failed in the stage of database configuration (configuration wizard) with the error:

Database configuration failed:
•  Error while executing script- There is already an object named 'CcmPhonesDupIDs' in the database.

No other option available except Finish button which let me with no access to Orion website.

Anyone sharing the same issue?

(My installation includes NPM, NTA, NCM, UDT, VNQM)

Already opened a case in technical support, waiting for a solution to be delivered.

Thank you and regards,

Catalin Apostol