Below issues can be seen: INFO 09/16 10:23:02 Agent [ISExecutor-100] 860005 PKG_OPS_CMDS_ACK message Sent Successfully to AC [messageId PA-0-10141-1631751759-11] INFO 09/16 10:23:02 Agent [ISExecutor-96] 860005 PKG_OPS_CMDS_ACK message Sent Successfully to AC [messageId PA-0-10141-1631751759-11] INFO 09/16 10:23:02 Agent [ISExecutor-96] 860005 PKG_OPS_CMDS_ACK message Sent Successfully to AC [messageId PA-0-10141-1631751759-11] and an OutOfMemory error may also be seen:
INFO 09/16 10:24:55 Agent [ISExecutor-96] 860002 Unable to complete job.
INFO 09/16 10:24:55 Agent [ISExecutor-96] 860002 {0}
java.lang.OutOfMemoryError: Java heap space
Agent [SyncConnectionHandler (BMC-IMC810402I Connection dropped.)] 860005 Waiting for AC connection ... and following messages may also be seen: INFO 07/19 21:49:06 Agent [AC_Listener] 102456 Agent received a connection request from /xx.xx.xx.xx WARN 07/19 21:49:06 Agent [AC_Listener] 102736 Agent denied the connection attempt from /xx.xx.xx.xx as it is already connected to another server ( /xx.xx.xx.xx ). ERROR 07/19 21:49:17 Library [ISExecutor-105] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Library [SessionHandler(DspMsg-AgentCntl] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Agent [SessionHandler(DspMsg-AgentCntl] 102070 Exception: java.net.SocketException: Software caused connection abort: socket write error at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111) at java.net.SocketOutputStream.write(SocketOutputStream.java:155) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) at java.io.DataOutputStream.flush(DataOutputStream.java:123) at com.proactivenet.ipc.TCPMessageWriter.writeMessage(TCPMessageWriter.java:76) at com.proactivenet.agent.SessionHandler.writeToDB(SessionHandler.java:2324) at com.proactivenet.agent.SessionHandler.sendInitialAgentStatusMsg(SessionHandler.java:334) at com.proactivenet.agent.SessionHandler.run(SessionHandler.java:642) ERROR 07/19 21:49:17 Library [ISExecutor-104] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Library [ISExecutor-106] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Library [ISExecutor-108] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Library [ISExecutor-109] 102660 Unable to write TCP message. ERROR 07/19 21:49:17 Invalid [ISExecutor-105] Software caused connection abort: socket write error Missing Resource String INFO 07/19 21:49:17 Agent [ISExecutor-105] 860005 PKG_OPS_CMDS_ACK message Sent Successfully to AC [messageId PA-0-10931-1658260045-11] ERROR 07/19 21:49:17 Library [ISExecutor-105] 102660 Unable to write TCP message.
a) For TSIM with Sybase DB, below exception can be seen in the TrueSight.log:
INFO 08/17 17:10:54 Invalid [PatrolPerfDataBolt_2] 611139:SQL Exception occurred while executing SQL Statement:::Statement:::executeQuery():::Query::::INSERT INTO "PATROLNT_MEMORY_STATS" (ITEMID,TIMERECORDED,"MEMmemVMOverhead","MEMmemVMMapped","MEMmemVMShared","MEMmemVMReservation","MEMmemVMActive","MEMmemVMLimit","MEMmemVMBallooned","MEMmemVMSwapped","MEMmemVMSharedSaved","MEMmemVMUsed") VALUES (?,?,?,?,?,?,?,?,?,?,?,?):::
Exception Message -->SQL Anywhere Error -193: Primary key for table '_PATROLNT_MEMORY_STATS' is not unique: Primary key value ('54,1629216620')java.sql.SQLException: SQL Anywhere Error -193: Primary key for table '_PATROLNT_MEMORY_STATS' is not unique: Primary key value ('54,1629216620')INFO 08/17 17:10:54 Invalid [PatrolPerfDataBolt_2] 611139:SQL Exception occurred while executing SQL Statement:::Statement:::executeQuery():::Query::::INSERT INTO "_PATROLNT_MEMORY_STATS"
b) For TSIM with Oracle DB, below exceptions can be seen in the TrueSight.log: ERROR 06/11 20:20:46 NGPStatsMsgHandler [NGPStatsMsgHandler] Max L2Stats Q limit exceeded for motypeId [ 501034 ]. Refer Troubleshooting guide. Missing Resource String INFO 06/11 20:20:46 Invalid [PatrolPerfDataBolt_10] 611139:SQL Exception occurred while executing SQL Statement:::Statement:::executeQuery():::Query::::INSERT INTO "_PATROL__NT__15_STATS" (ITEMID,TIMERECORDED,"CPUPRCRPROCESSORTIMEPER_0","CPUPRCRUSERTIMEPERCENT","CPUPRCRINTERRUPTSPERSEC","CPUPRCRIDLETIMEPERCENT","CPUPRCRPRIVTIMEPERCENT") VALUES (?,?,?,?,?,?,?)::: Exception Message -->ORA-00001: unique constraint (PROACT_TSIM_A.SYS_C0014157) violated java.sql.SQLIntegrityConstraintViolationException: ORA-00001: unique constraint (PROACT_TSIM_A.SYS_C0014157) violated As per customer Oracle trace and TrueSight logs, the below mapping messages show that Oracle receives deadlock while updating transactions on TSIM DB tables. From TrueSight.log: INFO 09/24 01:29:57 Invalid [PatrolPerfDataBolt_3] 611139:SQL Exception occurred while executing SQL Statement:::Statement:::StatsDataDBInsertDelegate[sql:INSERT INTO "_PATROL__NUK_13_STATS" (ITEMID,TIMERECORDED,"USERSPAWNEDAVGPROCESSES","_COLLECTIONSTATUS","USERSPAWNEDPROCESSES","ZOMBIEPROCESSESCOUNT","TOTALNUMBEROFPROCESSES") VALUES (?,?,?,?,?,?,?)]:::Exception Message -->ORA-00060: deadlock detected while waiting for resource java.sql.SQLException: ORA-00060: deadlock detected while waiting for resource INFO 09/24 01:29:57 Invalid [PatrolPerfDataBolt_5] 611139:SQL Exception occurred while executing SQL Statement:::Statement:::StatsDataDBInsertDelegate[sql:INSERT INTO "_PATROL__NUK_17_STATS" (ITEMID,TIMERECORDED,"USED","ACTIVEVIRTUALPAGES","_COLLECTIONSTATUS","COMMITEDMEMORY","FREE","KERNELSLABMEMORY","ACTUALUSED","USEDPERCENT","USEDBYBUFFERSANDCACHE","TOTAL") VALUES (?,?,?,?,?,?,?,?,?,?,?,?)]:::Exception Message -->ORA-00060: deadlock detected while waiting for resource java.sql.SQLException: ORA-00060: deadlock detected while waiting for resource 3) In the TrueSight Console there may be a flood of events with message: Self-Monitoring: PATROL Agent on <hostname>:3181 is disconnected. |
User can perform one of the following:
|