"expence" - xPnc
- long NFS - systeam appear to be "idle"... use nfsstat -m; UFS may appear as "busy" when idle
- check fsflush process

====================================================================================
1- config: CPU, mem network cards disk setup, Solaris 5.10, patches
2- what appl
3- what are they doing
4- utilization: CPU usage, sys/usr time, busy disks, which one has the highest load? [virtual_adrian.s]
5- busy disks
6- network name service (/etc/nsswitch.conf /etc/resolv.conf)
7- network activity [paket rate;NFS clent/server;TCP,throughput;retransmission rate  ===nx.se 10]
8- is there enough mem? [scanning->swaps disks are busy - not enough mem]

3====================================================================================

/usr/ucb/ps uaxw |head


USER       PID %CPU %MEM   SZ  RSS TT       S    START  TIME COMMAND
tkramar    405 42.0 30.725227922514736 pts/26   O 17:37:03 20:15 sipconn sipnse 31
tkramar  16036  3.0  0.22663216088 ?        R   Jan 11  3:22 lwd tordev01 31
oracle   15929  1.7  9.4815432767680 ?        S   Dec 23 16:10 ora_arc0_csn31
oracle   15931  1.4  9.1782672743000 ?        R   Dec 23 13:42 ora_arc1_csn31
oracle   29111  0.6  2.8248008226416 ?        S 06:01:16  5:57 oracle+ASM (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
sipdev   22133  0.6  0.22709614240 ?        R   Jan 04 96:21 eanDbWriter dbWriter1 102
root         3  0.5  0.0    0    0 ?        S   Dec 09 744:05 fsflush
oracle   15897  0.4  8.4747776685712 ?        S   Dec 23 28:23 ora_lgwr_csn31
oracle   15919  0.3  2.3247176181512 ?        S   Dec 23  4:45 oracle+ASM (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))


USER       PID %CPU %MEM   SZ  RSS TT       S    START  TIME COMMAND
root         3  0.8  0.0    0    0 ?        S   Dec 09 761:08 fsflush
tkramar   5844  0.4 28.423343842324376 pts/15   S 17:40:17 21:08 sipconn sipnse 31
sipdev   22133  0.3  0.22709614256 ?        S   Jan 04 107:01 eanDbWriter dbWriter1 102
oracle   17647  0.1  8.8739696717536 ?        S 10:13:28  0:11 ora_smon_csn31
sipdev   22127  0.1  0.917385668472 ?        S   Jan 04 59:20 java -Dprocess=JTapiConnector -server -Xmx1024M -classpath /home/sipde
oracle   17651  0.1  8.8738176716320 ?        S 10:13:28  1:04 ora_cjq0_csn31
sipdev   22012  0.1  1.8464048144456 ?        S   Jan 04 37:43 /usr/java/bin/java -Dprocess=Console -Djava.util.logging.manager=org.a
sxie      7202  0.1  1.8277680141400 pts/1    S 18:14:57  0:30 /usr/java/bin/java -Dprocess=Console -Duser.home=/home/sxie -Djava.uti
sipdev   22128  0.1  0.826650464528 ?        S   Jan 04 53:47 java -Dprocess=SubscriberRegistry -server -classpath /home/sipdev/utl/



**** %MEM - RSS as a %% of RAM
**** SZ - size of a virtual mem
5====================================================================================
NVRAM for fast-write RAID
iostat -xn 30 |grep c1t

 extended device statistics
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b device
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d1
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d3
    0.0    0.1    0.0    0.2  0.0  0.0    7.5    8.5   0   0 d4
    0.0    0.2    0.0    3.1  0.0  0.0    7.1    9.8   0   0 d5
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d6
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d10
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d11
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d13
    0.0    0.1    0.0    0.2  0.0  0.0    0.0    8.5   0   0 d14
    0.0    0.2    0.0    3.1  0.0  0.0    0.0    7.2   0   0 d15
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d16
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d20
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d21
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d23
    0.0    0.1    0.0    0.2  0.0  0.0    0.0    6.1   0   0 d24
    0.0    0.2    0.0    3.1  0.0  0.0    0.0    9.8   0   0 d25
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 d26
    0.0    0.1    0.0    0.8  0.0  0.0    8.5   11.6   0   0 d30
    0.0    0.1    0.0    0.8  0.0  0.0    0.0   11.5   0   0 d40
    0.0    0.1    0.0    0.8  0.0  0.0    0.0   11.0   0   0 d50
    0.0    0.3    0.0    3.4  0.0  0.0    0.0    7.5   0   0 c1t0d0
    0.0    0.5    0.0    3.5  0.0  0.0    0.0    8.5   0   0 c1t1d0
   30.2   25.2  483.6  385.8  0.0  0.2    0.0    2.7   0  14 c1t2d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 c0t0d0
   21.8   24.9  232.5  385.7  0.0  0.1    0.0    2.7   0  12 c1t3d0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0 tordev01:vold(pid639)




    *** - disks that >=  5% busy; average response >= 30 msec [svc_t] - 10 msec ok; inode cache;
====================================================================================

iostat -xPnce 30
iostat -xPnce 30
     cpu
 us sy wt id
  8  3  0 89
                            extended device statistics       ---- errors ---
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b s/w h/w trn tot device
    0.6    0.5   10.8    1.4  0.0  0.0    0.0    6.6   0   0   0   0   0   0 c1t0d0s0
    0.2    0.1    1.3    8.7  0.0  0.0    0.0   32.8   0   0   0   0   0   0 c1t0d0s1
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0   0   0   0   0 c1t0d0s2
    0.4    0.4    5.9    3.6  0.0  0.0    0.0    6.9   0   0   0   0   0   0 c1t0d0s3
    0.0    0.3    0.2    2.1  0.0  0.0    0.0    6.4   0   0   0   0   0   0 c1t0d0s4
    0.3    0.5    4.6    0.8  0.0  0.0    0.0    5.4   0   0   0   0   0   0 c1t0d0s5
    0.2    0.1   10.9   12.1  0.0  0.0    0.0   13.6   0   0   0   0   0   0 c1t0d0s6
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    5.1   0   0   0   0   0   0 c1t0d0s7
    0.6    0.5   10.8    1.4  0.0  0.0    0.0    8.5   0   0   0   0   0   0 c1t1d0s0
    0.2    0.1    1.3    8.7  0.0  0.0    0.0   33.4   0   0   0   0   0   0 c1t1d0s1
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0   0   0   0   0 c1t1d0s2
    0.4    0.4    6.0    3.6  0.0  0.0    0.0    7.1   0   0   0   0   0   0 c1t1d0s3
    0.0    0.3    0.2    2.1  0.0  0.0    0.0    6.7   0   0   0   0   0   0 c1t1d0s4
    0.3    0.5    4.7    0.8  0.0  0.0    0.0    7.0   0   0   0   0   0   0 c1t1d0s5
    0.2    0.1   10.9   12.1  0.0  0.0    0.0   14.1   0   0   0   0   0   0 c1t1d0s6
    0.0    0.3    0.0    0.2  0.0  0.0    0.0   15.6   0   1   0   0   0   0 c1t1d0s7
    2.8    4.1   49.4  100.5  0.0  0.2    0.7   24.8   0   2   0   0   0   0 c1t2d0s0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0   0   0   0   0 c1t2d0s2
    1.2    5.4   24.7   62.6  0.0  0.1    0.1   10.5   0   3   0   0   0   0 c1t2d0s3
    0.0    0.7    0.0    0.4  0.0  0.0    0.0   12.1   0   1   0   0   0   0 c1t2d0s7
    2.8    4.1   49.4  100.5  0.0  0.2    0.7   22.9   0   2   0   0   0   0 c1t3d0s0
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    0.0   0   0   0   0   0   0 c1t3d0s2
    0.7    5.4   14.0   62.6  0.0  0.1    0.0   10.8   0   3   0   0   0   0 c1t3d0s3
    0.0    0.4    0.0    0.2  0.0  0.0    0.0   14.7   0   1   0   0   0   0 c1t3d0s7
    0.0    0.0    0.0    0.0  0.0  0.0    0.0    2.8   0   0   0   0   0   0 tordev01:vold(pid639)

    ***data to smooth - use 10 sec interval
df - mounted file sys
df
/                  (/dev/md/dsk/d0    ):25176014 blocks  2186571 files
/devices           (/devices          ):       0 blocks        0 files
/system/contract   (ctfs              ):       0 blocks 2147483566 files
/proc              (proc              ):       0 blocks    29647 files
/etc/mnttab        (mnttab            ):       0 blocks        0 files
/etc/svc/volatile  (swap              ):28793024 blocks  1182556 files
/system/object     (objfs             ):       0 blocks 2147483451 files
/dev/fd            (fd                ):       0 blocks        0 files
/var               (/dev/md/dsk/d4    ):11478316 blocks   708463 files
/tmp               (swap  