Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations Chriss Miller on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

CS1000 7.5 - Report -Logs- how to find out when PBX went down during the night 2

Status
Not open for further replies.

babytech2009

Technical User
Joined
Apr 22, 2009
Messages
315
Location
US
Hello all,

We had our one site PBX go down sometime last night, I ran a VHST and AHST
in the system.

My question is would the AHST file below show when the PBX went down during the night?
If not how do I find out what time it would have gone down? What are the steps to find out the information?

Thank you in advance![ponytails2]


REQ prt
TYPE ahst
% OS_YEL -000
%
% DROL001 DAILY ROUTINE END
% DTIM LD60 END 01:02 31/1/2013
%
% DROL000 DAILY ROUTINE BEGIN
% CCED LD135 BEGIN 01:02 31/1/2013
%
% DROL001 DAILY ROUTINE END
% CCED LD135 END 01:02 31/1/2013
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 02:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 03:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 04:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 05:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 06:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 07:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 08:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 09:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 10:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 11:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 12:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 13:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 14:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 15:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 16:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 17:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 18:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 19:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 20:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 21:00 31/1/2013 CPU 0
%
% TMDI300 0 0 1 FROM: ENBL TO: SYS DSBL - NOT RESPONDING
% TIME: 21:08:51
%
% TMDI300 0 0 2 FROM: ENBL TO: SYS DSBL - NOT RESPONDING
% TIME: 21:08:51
%
% TMDI300 0 0 3 FROM: ENBL TO: SYS DSBL - NOT RESPONDING
% TIME: 21:08:51
%
% CDN003 16 75799 21 08 51
%
% SRPT016 OMM: IP link is DOWN between Call Server and IPMG[0 0]
%
% SRPT257 shutDownServerSession: shutting down ssd server session [0] for IPMG [0 0]
%
% ELAN009 ELAN 0 host IP=10.45.83.11 disabled, write to socket
% fail due to far end disconnect or Ethernet problems
%
% SRPT091 HB: Local side IPL health change from 6 to 4.
%
% SRPT226 Registration has been granted for IP[10.45.83.11] IPMG[0 0]
%
%
% SRPT017 OMM: IP link is UP between Call Server and IPMG[0 0]
%
% CDN002 16 75799 21 14 35
%
% XMI002 0 0 4 XDLC
%
% XMI002 0 0 5 XDLC
%
% XMI002 0 0 6 XDLC
%
% XMI002 0 0 8 XDLC
%
% SRPT016 OMM: IP link is DOWN between Call Server and IPMG[0 0]
%
% CDN003 16 75799 21 14 51
%
% SRPT257 shutDownServerSession: shutting down ssd server session [0] for IPMG [0 0]
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 22:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 23:00 31/1/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 00:00 1/2/2013 CPU 0
%
% AUD040 2 0
%
% AUD000
%
% AUD000
%
% TIM000 00:15 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 01:00 1/2/2013 CPU 0
%
% NPR000 PBXT DONE
%
% DROL001 DAILY ROUTINE END
% NPR LD32 END 01:00 1/2/2013
%
% DROL000 DAILY ROUTINE BEGIN
% TDS LD34 BEGIN 01:00 1/2/2013
%
% DB SEQ NUM = 2086
% CONFIG
% DROL001 DAILY ROUTINE END
% TDS LD34 END 01:00 1/2/2013
%
% DROL000 DAILY ROUTINE BEGIN
% CNF LD38 BEGIN 01:00 1/2/2013
%
% DROL001 DAILY ROUTINE END
% CNF LD38 END 01:00 1/2/2013
%
% DROL000 DAILY ROUTINE BEGIN
% DUMP LD43 BEGIN 01:00 1/2/2013
%
% PHYSICAL MAP
% BCS TEMPLATE
% PBX TEMPLATE
% SUPER
% IPMG
% CUST
% ACUST
% CLID
% ROUTE
% DAPC
% LTN TN
% LTN LNK
% TN
% SCL
% ESN 00
% NCTL
% ACD
% CPK
% IDC TREES
% DIGITAL
% DTI
% ASNCH
% AML / ELAN
% VAS
% TRSH
% BG-TIME
% BG-CAT
% DCH
% PRI
% ARIES
% FDL
% SYSP
% XTDT
% MCAD
% FCAD
% FDCT
% LAPW
% MSDL/MISP BLK
% SOCKET ID BLK
% TIME
% DTI PDCA
% PLUGIN
% STS BLK
% NODE
% CPND NM
% SPECIFIC DATA
% HI
% ALARM_MGT
% ZONE_MGT
% SYSCFG_MGT
% ACCOUNT_MGT
% ERL DB
% SUBNET DB
% ELIN DB
% BANNER_MGT
% NTP_MGT
% ZBD ZONES DB
% ZBD DB
% MSC ZSRN DB
% IPMG_MGT
% SYSTEM_PARAMS
% PORT_STATE_MGT
% DVLA DB
% HSEM DB
% CHECKING
%
% SIZE (KBYTES) = 158
% DATADUMP COMPLETE
%
%
% Backing up reten.bkp
%
% Starting database backup
% to local Removable Media Device
% KEYCODE
% DIRECTORY
% CONFIG
% DATA
% HI
% ZONE
% ESET1
% ESET2
% NODE
% SYSCFG
% SMPCONF
% FORWARDLISTFILE
% PENDINGCPMSGLST
% ACCOUNTS
% ERL
% ZBD
% NZON
% ZSRN
% ELIN
% SUBNET
% NTP
% MGC
% SYSTEM_PARAMS
% PORT_CUSTOM
% PORT_STATE
% EPTFLAG
% DVLA
% HSEM
% Backing up reten.bkp to "/cf2/backup/single"
%
% Database backup Complete!
%
% TEMU207 Backup process to local Removable Media Device ended successfully.
%
% DROL001 DAILY ROUTINE END
% DUMP LD43 END 01:01 1/2/2013
%
% DROL000 DAILY ROUTINE BEGIN
% AUDIT LD44 BEGIN 01:01 1/2/2013
%
% DROL001 DAILY ROUTINE END
% AUDIT LD44 END 01:01 1/2/2013
%
% PRI TRK LOOP 20 ATLP 0
% SLFT NOT DONE
%
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% PRI TRK LOOP 21 ATLP 0
% AUD000
%
% DROL000 DAILY ROUTINE BEGIN
% DTIM LD60 BEGIN 01:01 1/2/2013
%
% DTI013 20
%
% SLFT NO RESP
% DTA024 21
%
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% PRI TRK LOOP 22 ATLP 0
% DTI028 21 1
%
% SLFT NO RESP
% DTA024 22
%
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% DTI028 22 1
%
% DROL001 DAILY ROUTINE END
% DTIM LD60 END 01:03 1/2/2013
%
% DROL000 DAILY ROUTINE BEGIN
% CCED LD135 BEGIN 01:03 1/2/2013
%
% DROL001 DAILY ROUTINE END
% CCED LD135 END 01:03 1/2/2013
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 02:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 03:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 04:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 05:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 06:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 07:00 1/2/2013 CPU 0
%
% SRPT226 Registration has been granted for IP[10.45.83.11] IPMG[0 0]
%
%
% SRPT017 OMM: IP link is UP between Call Server and IPMG[0 0]
%
% CDN002 16 75799 07 06 17
%
% XMI002 0 0 4 XDLC
%
% XMI002 0 0 5 XDLC
%
% XMI002 0 0 6 XDLC
%
% XMI002 0 0 8 XDLC
%
% SRPT091 HB: Local side IPL health change from 4 to 6.
%
% ELAN014 ELAN 0 host IP=10.45.83.11 is enabled
%
% TMDI300 0 0 1 FROM: SYS DSBL - NOT RESPONDING TO: SYS DSBL - SELFTESTS PASSED
% TIME: 07:07:35
%
% TMDI300 0 0 2 FROM: SYS DSBL - NOT RESPONDING TO: SYS DSBL - SELFTESTS PASSED
% TIME: 07:07:35
%
% TMDI300 0 0 3 FROM: SYS DSBL - NOT RESPONDING TO: SYS DSBL - SELFTESTS PASSED
% TIME: 07:07:35
%
% XMI002 0 0 1 TMDI
%
% TMDI300 0 0 1 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 07:07:35
%
% TMDI300 0 0 2 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 07:07:35
%
% TMDI300 0 0 3 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 07:07:35
%
% XMI002 0 0 2 TMDI
%
% XMI002 0 0 3 TMDI
%
% DTA003 20
%
% PRI000 20 5
%
% DTA003 21
%
% PRI000 21 5
%
% DTA015 20
%
% DTA003 22
%
% PRI000 22 5
%
% DTA021 21
%
% DTA023 20
%
% DTA023 22
%
% DCH054 DCH: 11 EST CONFIRM TIME: 7:07:51 1/02/2013
%
% DCH054 DCH: 13 EST CONFIRM TIME: 7:07:51 1/02/2013
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 08:00 1/2/2013 CPU 0
%
% AUD000
%
% AUD000
%
% TTY #15 LOGGED OUT ADMIN 08:37 1/2/2013
% SESSION DURATION: 91:48
%
% TTY #15 LD 022 ADMIN 08:37:14 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:37 1/2/2013
% SESSION DURATION: 91:48
%
% TTY #15 LD 022 ADMIN 08:37:14 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:37 1/2/2013
% SESSION DURATION: 91:48
%
% TTY #15 LD 022 ADMIN 08:37:46 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:37 1/2/2013
% SESSION DURATION: 91:49
%
% TTY #15 LD 043 ADMIN 08:39:14 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:39 1/2/2013
% SESSION DURATION: 91:50
%
% TTY #15 LD 117 ADMIN 08:39:22 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:39 1/2/2013
% SESSION DURATION: 91:50
%
% TTY #15 LD 043 ADMIN 08:39:32 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:39 1/2/2013
% SESSION DURATION: 91:50
%
% TTY #15 LD 043 ADMIN 08:39:36 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:40 1/2/2013
% SESSION DURATION: 91:52
%
% TTY #15 LD 043 ADMIN 08:41:06 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:41 1/2/2013
% SESSION DURATION: 91:52
%
% TTY #15 LOGGED IN ADMIN 08:41 1/2/2013
%
% TTY #15 LD 096 ADMIN 08:41:44 1/2/2013
%
% TTY #15 LD 060 ADMIN 08:41:50 1/2/2013
%
% TTY #15 LD 043 ADMIN 08:45:51 1/2/2013
%
% TEMU207 Backup process to local Removable Media Device ended successfully.
%
% TTY #15 LOGGED OUT ADMIN 08:47 1/2/2013
% SESSION DURATION: 00:06
%
% AUD000
%
% TTY #15 LOGGED OUT ADMIN 08:52 1/2/2013
% SESSION DURATION: 00:11
%
% TTY #15 LD 022 ADMIN 08:52:49 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:52 1/2/2013
% SESSION DURATION: 00:11
%
% TTY #15 LD 022 ADMIN 08:52:49 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:52 1/2/2013
% SESSION DURATION: 00:11
%
% TTY #15 LD 022 ADMIN 08:53:13 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 08:53 1/2/2013
% SESSION DURATION: 00:12
%
% TTY #15 LOGGED IN ADMIN 08:53 1/2/2013
%
% TTY #15 LD 060 ADMIN 08:53:47 1/2/2013
%
% TTY #15 LD 096 ADMIN 08:54:03 1/2/2013
%
% TTY #15 LD 043 ADMIN 08:55:17 1/2/2013
%
% TEMU207 Backup process to local Removable Media Device ended successfully.
%
% TIM000 09:00 1/2/2013 CPU 0
%
% TTY #15 LD 020 ADMIN 09:06:38 1/2/2013
%
% AUD000
%
% TTY #15 LOGGED OUT ADMIN 09:13 1/2/2013
% SESSION DURATION: 00:20
%
% AUD000
%
% TTY #15 LD 043 ADMIN 09:21:09 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 09:21 1/2/2013
% SESSION DURATION: 00:28
%
% TTY #15 LD 117 ADMIN 09:21:13 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 09:21 1/2/2013
% SESSION DURATION: 00:28
%
% TTY #15 LD 043 ADMIN 09:21:21 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 09:21 1/2/2013
% SESSION DURATION: 00:28
%
% TTY #15 LD 043 ADMIN 09:21:25 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 09:22 1/2/2013
% SESSION DURATION: 00:29
%
% TTY #15 LD 043 ADMIN 09:22:53 1/2/2013
%
% TTY #15 LOGGED OUT ADMIN 09:22 1/2/2013
% SESSION DURATION: 00:29
%
% TTY #15 LOGGED IN ADMIN 09:24 1/2/2013
%
% TTY #15 LD 020 ADMIN 09:24:19 1/2/2013
%
% TTY #15 LD 022 ADMIN 09:24:27 1/2/2013
%
% TTY #15 LD 002 ADMIN 09:24:33 1/2/2013
%
% TTY #15 LD 002 ADMIN 09:24:37 1/2/2013
%
% TTY #15 LD 043 ADMIN 09:29:42 1/2/2013
%
% TEMU207 Backup process to local Removable Media Device ended successfully.
%
% TTY #15 LD 022 ADMIN 09:31:00 1/2/2013
%
% TTY #15 LD 022 ADMIN 09:35:36 1/2/2013

 
You won't be able to tell when it went down, only when it came back up. The history file is cleaned out on a sysload.
 
See examples below of looking for time stamps in various messages.

I'd say you lost a IPMG cabinet at 21:08:51:

% TIM000 21:00 31/1/2013 CPU 0
%
% TMDI300 0 0 1 FROM: ENBL TO: SYS DSBL - NOT RESPONDING
% TIME: 21:08:51

Guessinig your Call Pilot is in this cabinet, too:

% CDN003 16 75799 21 08 51

Loss of a MGC for some reason - MGC reboot, power fail, network failure

% SRPT016 OMM: IP link is DOWN between Call Server and IPMG[0 0]
%
% SRPT257 shutDownServerSession: shutting down ssd server session [0] for IPMG [0 0]
%
% ELAN009 ELAN 0 host IP=10.45.83.11 disabled, write to socket
% fail due to far end disconnect or Ethernet problems
%
% SRPT091 HB: Local side IPL health change from 6 to 4.

It came back up at 21:14:35:

% SRPT226 Registration has been granted for IP[10.45.83.11] IPMG[0 0]
%
%
% SRPT017 OMM: IP link is UP between Call Server and IPMG[0 0]
%
% CDN002 16 75799 21 14 35

Then connection was lost a few seconds later:

% SRPT016 OMM: IP link is DOWN between Call Server and IPMG[0 0]
%
% CDN003 16 75799 21 14 51
%
% SRPT257 shutDownServerSession: shutting down ssd server session [0] for IPMG [0 0]


Came back up at 07:06:17

% SRPT226 Registration has been granted for IP[10.45.83.11] IPMG[0 0]
%
%
% SRPT017 OMM: IP link is UP between Call Server and IPMG[0 0]
%
% CDN002 16 75799 07 06 17
%


 
I don't think your system INIed because your AUD000 and TIM messages are consistent throughout the period shown. More like you only lost connection the MGC located at 0 0. Check your network switch.
 
curtismo is correct, if your system went completely down you would see an INI message in the history file as well as a sys message. It appears that MGC 0 0 is the only thing that went down.
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top