Note: The information in this KA is now available in the online documentation at: https://docs.bmc.com/docs/ars2002/best-practices-for-improving-the-overall-remedy-performance-to-optimum-level-1122328671.html
This knowledge article is left here to help you locate the documentation, which is the preferred location for this information.
Introduction
This document is a configuration checklist for the AR platform install configuration for Remedy 9.1, 18xx, 19xx, and 20xx releases.
All recommendations should be taken as a starting point.
BMC encourages customers to conduct their own testing based on their own workload and adjust the settings as necessary.
For more information on Performance Tuning for Remedy, check this link
For Email Engine Best Practice Configuration Guide, check this link
For Approval Server Best Practice Configuration Guide, check this link
For the DWP Configuration Checklist, check this link
For the FTS Best Practice Configuration Guide, check this link
For information on Hardware Requirements, check this link
For the Remedy on-premises Solution Architecture, check this link
This configuration is specific to small, medium and large models defined as follows:
Environment | BMC Remedy ITSM (concurrent users) | BMC Remedy Smart Reporting (concurrent users) | Number of managed devices |
Small | 800 | 50 | 2,000 or fewer |
Medium | 2,000 | 100 | 10,000 or fewer |
Large | 5,000 | 250 | 30,000 or fewer |
This checklist is for the configurations in the Midtier, RSSO, AR Server, Smart Reporting and database server.
There’s also a section for the web-infrastructure (web proxy, tomcat, JVM parameters), the Midtier, and ITSM application stack.
Web Proxy or Load-Balancer for The Remedy SSO Service
There are 2 network segments: From the browser proxy (or from the actual client if there’s no proxy) to the F5; from the F5 to the SSO service.
Since the interaction between the browser and the SSO service is brief, there is no need to activate HTTP keep-alive for either of the network segments.
For the F5, the recommended load-balancing scheme is round-robin no session binding.
Notes:
1- The client HTTP protocol version for HTTP monitoring must be set to HTTP 1.1. The return HTTP code for alive is HTTP 200.
2- For performance testing, the granularity of ping interval was 5 seconds with 3 consecutive non-HTTP 200 indicating the node is down.
For deployment, you may configure this to a lower threshold as required.
JVM Options in tomcat/bin/setenv.sh for Remedy SSO
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy SSO | One Server 2 CPU core 8 GB RAM 200 GB disk space | Two Servers 2 CPU core 8 GB RAM 200 GB disk space | Four Servers 2 CPU core 8 GB RAM 200 GB disk space |
Java Settings: Java 1.8 (Using CMS GC) | -Xms4096m -Xmx4096m | -Xms8192m -Xmx8192m | -Xms12288m -Xmx12288m |
Use the following on all 3 environment sizes: -XX:MaxMetaspaceSize=512m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings: Java 11 or higher (Using G1GC) | -Xms4096m -Xmx4096m | -Xms8192m -Xmx8192m | -Xms12288m -Xmx12288m |
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 |
Tomcat/conf/server.xml | maxThreads="1600" | maxThreads="3000" | maxThreads="3000" |
Tomcat/conf/logging.properties | Change all log level from INFO to SEVERE |
Web Proxy or Load-Balancer for Midtier
There are 2 network segments:
- From the client browser proxy to the F5
- From the F5 to the Midtier Tomcat cluster
1. For both network segments, HTTP keep-alive must be turned on.
If the keep-alive feature supports the optional values as in tomcat, the recommended values are given by the following table:
Keep Alive Property | Value |
Keep-alive count | 5,000 |
Keep-alive timeout | 60 seconds |
2. For the F5, the recommended load-balancing scheme is round-robin with HTTP session binding cookie insert.
3. For detection whether a node is alive, use HTTP monitoring and issue a GET on the following URL: /arsys/shared/images/bkgd_image.gif
Notes:
a) The client HTTP protocol version for HTTP monitoring must be set to HTTP 1.1. The return HTTP code for alive is HTTP 200
b) For performance testing, the granularity of ping interval was 15 seconds with 3 consecutive non-HTTP 200 indicating the node is down.
For deployment, you may configure this to a lower threshold as required
JVM Options in tomcat/bin/startup.sh For The Midtier Tomcat
Important: The following settings assume that each tomcat instance in the cluster hosts only the Midtier and the RSSO agent.
BMC AR Mid-Tier Server configuration settings
Note: For Windows, use the “Configure Tomcat’ tool and select the ‘Java’ tab to set these options:
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy AR System mid tier servers | Two servers: 2 CPU core 8 GB RAM 120 GB disk space | Two servers: 4 CPU core 12 GB RAM 120 GB disk space | Five servers: 4 CPU core 16 GB RAM 120 GB disk space |
Java Settings: Java 1.8 (Using CMS GC) | -Xms4096m -Xmx4096m | -Xms8192m -Xmx8192m | -Xms12288m -Xmx12288m |
Use the following on all 3 environment sizes: -XX:MaxMetaspaceSize=512m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings: Java 11 or higher (Using G1GC) | -Xms4096m -Xmx4096m | -Xms8192m -Xmx8192m | -Xms12288m -Xmx12288m |
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 Note: If using Tomcat 7, do not use the -XX:G1NewSizePercent option |
Tomcat/conf/server.xml (connector configuration)
| acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="1200" minSpareThreads="50" | acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="2000" minSpareThreads="50" | acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="2000" minSpareThreads="50" |
Tomcat/conf/logging.properties | Change all log level from INFO and FINE to SEVERE |
MIDTIER/WEB-INF/classes/config.properties
(changes can be done on config.jsp page Connection settings section)
| arsystem.pooling_max_connections_per_server=150 arsystem.log_category=INTERNAL arsystem.use_loadbalanceinterval=true arsystem.use_loadbalanceinterval_limit=15 | arsystem.pooling_max_connections_per_server=350 arsystem.log_category=INTERNAL arsystem.use_loadbalanceinterval=true arsystem.use_loadbalanceinterval_limit=15 | arsystem.pooling_max_connections_per_server=350 arsystem.log_category=INTERNAL arsystem.use_loadbalanceinterval=true arsystem.use_loadbalanceinterval_limit=15 |
JVM Options in tomcat/bin/startup.sh For The Midtier+RSSO Tomcat
Important: The following settings assume that each tomcat instance in the cluster hosts both the Midtier (with the RSSO agent) and the RSSO web app.
All of the settings in the previous section (where tomcat hosts only the Midtier and the RSSO agent) applies.
There’s only 1 change given by the following:
Component | Small Env. | Medium Env. | Large Env. |
Tomcat/conf/server.xml (connector configuration) | maxThreads="1600" | maxThreads="3000" | maxThreads="3000" |
BMC Remedy AR System Server (user facing) configuration settings
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy AR System servers | Two servers: 2 CPU core 12 GB RAM 120 GB disk space | Two servers: 4 CPU core 16 GB RAM 120 GB disk space | Three servers: 8 CPU core 32 GB RAM 120 GB disk space |
Java Settings (arserver.config): Java 1.8 (Using CMS GC) |
jvm.minimum.heap.size=6442450944 jvm.maximum.heap.size=6442450944
|
jvm.minimum.heap.size=8589934592 jvm.maximum.heap.size=8589934592
|
jvm.minimum.heap.size=21474836480 jvm.maximum.heap.size=21474836480
|
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings (arserver.config): Java 11 or higher (Using G1GC) |
jvm.minimum.heap.size=6442450944 jvm.maximum.heap.size=6442450944
|
jvm.minimum.heap.size=8589934592 jvm.maximum.heap.size=8589934592
|
jvm.minimum.heap.size=21474836480 jvm.maximum.heap.size=21474836480
|
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 |
Fast queue | Private-RPC-Socket: 390620 4 6 | Private-RPC-Socket: 390620 8 12 | Private-RPC-Socket: 390620 16 24 |
Loop back or private socket queue | Private-RPC-Socket: 390626 5 5 | Private-RPC-Socket: 390626 5 7 | Private-RPC-Socket: 390626 5 9 |
List queue | Private-RPC-Socket: 390635 6 10 | Private-RPC-Socket: 390635 12 20 | Private-RPC-Socket: 390635 24 40 |
| CMDB-Inline-Normalization: T | CMDB-Inline-Normalization: T | CMDB-Inline-Normalization: T |
BMC Remedy AR System Server (Backend Integration) configuration settings
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy AR System servers | Two servers: 4 CPU core 12 GB RAM (24 GB RAM for FTS Indexer servers) 120 GB disk space | Two servers: 4 CPU core 16 GB RAM (32 GB RAM for FTS Indexer servers) 120 GB disk space | Two to Four servers**: 8 CPU core 32 GB RAM (64 GB RAM for FTS Indexer servers) 120 GB disk space |
Java Settings (arserver.config): Java 1.8 (Using CMS GC) |
jvm.minimum.heap.size=6442450944 jvm.maximum.heap.size=6442450944 (10737418240 for FTS Indexer servers
|
jvm.minimum.heap.size=8589934592 jvm.maximum.heap.size=8589934592 (15032385536 for FTS Indexer servers)
|
jvm.minimum.heap.size=21474836480 jvm.maximum.heap.size=21474836480 (34359738368 for FTS Indexer servers)
|
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings (arserver.config): Java 11 or higher (Using G1GC) |
jvm.minimum.heap.size=6442450944 jvm.maximum.heap.size=6442450944 (10737418240 for FTS Indexer servers)
|
jvm.minimum.heap.size=8589934592 jvm.maximum.heap.size=8589934592 (15032385536 for FTS Indexer servers)
|
jvm.minimum.heap.size=21474836480 jvm.maximum.heap.size=21474836480 (34359738368 for FTS Indexer servers)
|
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 |
FTS Queue (FTS Indexer servers) | Private-RPC-Socket: 390602 3 3 | Private-RPC-Socket: 390602 5 5 | Private-RPC-Socket: 390602 7 7 |
Reconciliation Queue | Private-RPC-Socket: 390698 2 4 | Private-RPC-Socket: 390698 2 4 | Private-RPC-Socket: 390698 2 8 |
CMDB RPC Normalization Queue | Private-RPC-Socket: 390699 2 4 | Private-RPC-Socket: 390699 2 4 | Private-RPC-Socket: 390699 2 8 |
AR RPC Normalization Queue | Private-RPC-Socket: 390681 2 2 | Private-RPC-Socket: 390681 2 2 | Private-RPC-Socket: 390681 2 2 |
List queue | Private-RPC-Socket: 390635 12 20 | Private-RPC-Socket: 390635 12 20 | Private-RPC-Socket: 390635 24 40 |
Fast queue | Private-RPC-Socket: 390620 8 12 | Private-RPC-Socket: 390620 8 12* | Private-RPC-Socket: 390620 16 24 |
Loop back or private socket queue | Private-RPC-Socket: 390626 5 5 | Private-RPC-Socket: 390626 5 7* | Private-RPC-Socket: 390626 5 9 |
| CMDB-Inline-Normalization: T | CMDB-Inline-Normalization: T | CMDB-Inline-Normalization: T |
Alert queue | Private-RPC-Socket: 390601 1 1 | Private-RPC-Socket: 390601 1 1 | Private-RPC-Socket: 390601 1 1 |
Escalation queue | Private-RPC-Socket: 390603 3 3 | Private-RPC-Socket: 390603 6 6 | Private-RPC-Socket: 390603 9 9 |
Approval | Private-RPC-Socket: 390680 2 2 | Private-RPC-Socket: 390680 3 3 | Private-RPC-Socket: 390680 4 4 |
| Plugin-ARDBC-Threads: 4 12 | Plugin-ARDBC-Threads: 4 12 | Plugin-ARDBC-Threads: 4 12 |
| Plugin-AREA-Threads: 4 12 | Plugin-AREA-Threads: 4 12 | Plugin-AREA-Threads: 4 12 |
| Plugin-Filter-API-Threads: 4 12 | Plugin-Filter-API-Threads: 4 12 | Plugin-Filter-API-Threads: 4 12 |
* Denotes new default value in 9.1 SP2. If this value is unset, the new default is used.
** The number of backend servers may vary by customer needs. Customers with higher backend server requirements may consider using 4 or more servers.
See article 000142769 for information about assigning operations to servers
Note: BMC Recommends that you start with fast threads set to a minimum of 2 times and a maximum of 3 times the number of CPU cores and list threads set to a minimum of 3 times and a maximum of 5 times the number of CPU cores.
BMC Remedy AR System Server – Common configuration settings for User facing and backend server
Small/Medium/Large Env. |
Max-Entries-Per-Query: 2000* |
Next-ID-Block-Size: 100 |
Server-Side-Table-Chunk-Size: 1000 |
Allow-Unqual-Queries: F* |
Cache-Mode: 0* |
Submitter-Mode: 1* |
Authentication-Chaining-Mode: 1* |
Server-Plugin-Default-Timeout: 120* |
External-Authentication-Return-Data-Capabilities: 31* |
RE-RPC-Socket: 390698 |
Debug-mode: 131120 |
Max-Log-History: 8 |
Max-Log-File-Size: 134217728 |
Plugin-Log-Level: 1000 |
VersionControl-Object-Modification-Log-Mode: 10 |
VersionControl-Object-Modification-Log-Save-Definition-Files: 0 |
* Denotes new default value in 9.1 SP2. If this value is unset, the new default is used.
Plugin Servers
Note: Plugin servers can run with default GC settings unless they act primarily as a server and are configured for >= 4GB heap. Only the FTS plugin server requires the additional GC settings as specified below.
<ar install dir>/pluginsvr/pluginsvr_config.xml
Add or alter this file to:
<numCoreThreads>30</numCoreThreads>
<atrium core install dir>/cmdb/plugins/shared/pluginsvr_config.xml
Add or alter this file to
<numCoreThreads>10</numCoreThreads>
AR Dir/pluginsvr/fts/secondary/pluginsvr_config.xml
Plugin Server Settings:
|
Small Env.
|
Medium Env.
|
Large Env.
|
Number of Users
|
800
|
2,000
|
5,000
|
Plugin Server Heap Size
|
4 GB
|
6 GB
|
10 GB
|
numCoreThreads**
|
10
|
12
|
16
|
GC settings
BMC recommends using these GC parameters with Plugin Server for FTS when using Java 1.8
.................................................
-XX:+DisableExplicitGC
-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC
-XX:NewRatio=2
-XX:+UseCompressedOops
.................................................
For Java 11 and higher, use the following parameters
.................................................
-XX:+DisableExplicitGC
-XX:MaxMetaspaceSize=512m
-XX:MetaspaceSize=384m
-XX:+UseCompressedOops
-XX:+UseG1GC
-XX:+UseStringDeduplication
-XX:G1NewSizePercent=40
-XX:+UnlockExperimentalVMOptions
-XX:MaxGCPauseMillis=200
.................................................
More information about configuring Java Plugin server options.
Database Server
Please consult your DBA when making changes to your Database environment.
All recommendations are based on testing and customer feedback.
But the specific settings may vary depending on each specific environment properties.
Whenever possible, test in lower environments before applying to production.
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy AR Database server | 8 CPU core 16 GB RAM 200 GB disk space (10 GB used by RSSO) | 16 CPU core 32 GB RAM 200 GB disk space (10 GB used by RSSO) | 32 CPU core 64 GB RAM 200 GB disk space (10 GB used by RSSO) |
Oracle Database | | | |
memory_target (>11g) | 8 | 16 | 32 |
sga_target (10g) | 5 | 10 | 20 |
Db_cache_size | 3 | 7 | 15 |
Shared_pool_size | 2 | 3 | 5 |
Pga_aggregate_target | 3 | 6 | 12 |
Cursor_sharing | EXACT | EXACT | EXACT |
_b_tree_bitmap_plans | False | False | False |
SQL Server Database | | | |
PARAMETERIZATION | Simple | Simple | Simple |
READ_COMMITTED_SNAPSHOT | On | On | On |
Max Degrees of Parallelism | 1 to 8 | 1 to 8 | 1 to 8 |
Cost Threshold for Parallelism | 50 | 50 | 50 |
PostgreSQL Database | | | |
max_connections | 200 | 300 | 700 |
shared_buffers | 4GB | 8GB | 16GB |
effective_cache_size | 12GB | 24GB | 48GB |
maintenance_work_mem | 1GB | 2GB | 2GB |
checkpoint_completion_target | 0.9 | 0.9 | 0.9 |
wal_buffers | 16MB | 16MB | 16MB |
default_statistics_target | 100 | 100 | 100 |
random_page_cost | 1.1 | 1.1 | 1.1 |
effective_io_concurrency | 200 | 200 | 200 |
work_mem | 5242kB | 6990kB | 5991kB |
min_wal_size | 2GB | 2GB | 2GB |
max_wal_size | 8GB | 8GB | 8GB |
max_worker_processes | 8 | 16 | 32 |
max_parallel_workers_per_gather | 4 | 4 | 4 |
max_parallel_workers | 8 | 16 | 32 |
NOTE: If you choose to work with PostgreSQL Databases, please work with your DBA to schedule and configure the auto-vacuum feature based on your business needs and usage patterns. Additionally, BMC recommends after doing any upgrades to run a “VACUUM FULL ANALYZE” command from pgAdmin for every AR-related database. Keeping pgSQL vacuumed is required to reclaim unused disk space as well as keeping your statistics up to date. To learn more about the vacuum feature, please see Routine Vacuuming in the PostgreSQL documentation.
Tomcat/conf/server.xml for smart reporting
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy Smart Reporting Server | One Server 4 CPU core 12 GB RAM 200 GB disk space | Two Servers 4 CPU core 16 GB RAM 200 GB disk space | Two Servers 8 CPU core 32 GB RAM 200 GB disk space |
Concurrent users supported | 50 | 100 | 250 |
Java Settings (arserver.config): Java 1.8 (Using CMS GC) | -Xms6144m -Xmx6144m | -Xms8192m -Xmx8192m | -Xms16384m -Xmx16384m |
Use the following on all 3 environment sizes: -XX:MaxMetaspaceSize=512m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings (arserver.config): Java11 or higher (Using G1GC) | -Xms6144m -Xmx6144m | -Xms8192m -Xmx8192m | -Xms16384m -Xmx16384m |
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 |
acceptCount | 100 | 200 | 500 |
maxThreads | 600 | 1200 | 2400 |
connectionTimeout | 90000 |
maxHttpHeaderSize | 8192 |
compression | ON |
compressionMinSize | 2048 |
compressibleMimeType |
text/html,text/xml,text/plain,text/css*,text/javascript*, text/json*,application/x-javascript*,application/javascript*,application/json*
|
noCompressionUserAgents | gozilla, traviata | gozilla, traviata | gozilla, traviata |
disableUploadTimeout | true | true | true |
enableLookups | false | false | false |
minSpareThreads | 25 | 25 | 25 |
* SP4 and above only.
Dedicated AR Server for Smart Reporting
It is recommended for high-volume reporting environments to setup a dedicated AR Server for the Smart Reporting server to connect to.
This server can initially be setup similar to a Small-size User Facing server and then adjust memory and CPU based on Report and Data volume.
Connection Pool
Log on to Remedy home page, navigate to:
> Smart Reporting home page->Administration->Admin Console->Data Sources->AR System
Small Env. | Medium Env. | Large Env. |
Min Connections 50 | Min Connections 50 | Min Connections 50 |
Max Connections 100 | Max Connections 200 | Max Connections 300 |
Refresh Time 3 hrs | Refresh Time 3 hrs | Refresh Time 3 hrs |
Timeout 6400 seconds | Timeout 6400 seconds | Timeout 6400 seconds |
<Smart-Reporting-Dir>/BMCReporting/SmartReporting/appserver/webapps/ROOT/WEB-INF/
File: web.xml
Settings:
Small Env. | Medium Env. | Large Env. |
JDBCMinCount 50 | JDBCMinCount 50 | JDBCMinCount 50 |
JDBCMaxCount 100 | JDBCMaxCount 200 | JDBCMaxCount 300 |
JDBCTimeout 1800 | JDBCTimeout 1800 | JDBCTimeout 1800 |
Smart-IT
Component | Small Env. | Medium Env. | Large Env. |
BMC Remedy Smart IT | One Server 4 CPU core 12 GB RAM 200 GB disk space | Two Servers 4 CPU core 16 GB RAM 200 GB disk space | Three Servers 8 CPU core 16 GB RAM 200 GB disk space |
Java Settings (arserver.config): Java 1.8 (Using CMS GC) | -Xms6144m -Xmx6144m | -Xms8192m -Xmx8192m | -Xms8192m -Xmx8192m |
Use the following on all 3 environment sizes: -XX:MaxMetaspaceSize=512m -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewRatio=2 |
Java Settings (arserver.config): Java 11 or higher (Using G1GC) | -Xms6144m -Xmx6144m | -Xms8192m -Xmx8192m | -Xms8192m -Xmx8192m |
Use the following on all 3 environment sizes: -XX:+DisableExplicitGC -XX:MaxMetaspaceSize=512m -XX:MetaspaceSize=384m -XX:+UseCompressedOops -XX:+UseG1GC -XX:+UseStringDeduplication -XX:G1NewSizePercent=40 -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=200 |
ulimit (Linux only) | ulimit -n 21000 | ulimit -n 21000 | ulimit -n 21000 |
Tomcat/conf/server.xml | acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="1200" minSpareThreads="50" | acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="2000" minSpareThreads="50" | acceptCount="250" connectionTimeout="60000" maxKeepAliveRequests="5000" maxThreads="2000" minSpareThreads="50" |
General Virtual Chat / Agent File Level Configuration Checklist:
Port checks |
Ensure ports 6225 and 6226 are open. Telnet Test Attempt a telnet session from the AR Server(s) to the MT Server(s) via ports 6225 and 6226. - If the session connects, the port is open. - If the telnet session will not connect, the port is probably not open. |
Mid Tier File Level checks (this applies to ALL MT servers in the environment) |
1- Verify the file size and dates of the ACTIVE following files located in the ...\webapps directory: eschat.war programd.war |
2- If this is a Virtual Chat installation with NO HOTFIXES, then the ACTIVE file should exactly match the file in the location shown below: .....\BMC Software\BMCVirtualAgent\VirtualAgentComponents\midtier (Linux locations will vary) |
3- If there have been HOTFIXES applied to this version, review the hotfix manifest and see if there was an eschat.war file or programd.war file included in the hotfix. If so, the ACTIVE war files should exactly match the file in the hotfix. Note: You can determine if there were hotfixes applied to the environment by checking the “Update History” tab of the Chat Administration Console |
4- Check the following parameters in the eschat_config.properties file located in: …/webapps/eschat/Web-Inf/classes: <cnslb> [For Virtual Chat 9.1.02] After installing,check in the eschat_config.properties file, whether the cnslb parameter contains a value. If it contains a value, then delete it so that the configuration is <cnslb></cnslb> [For Virtual Chat 9.1.01] This value should contain the server name of ALL the OTHER MT servers in this environment and upon which Virtual Chat is installed, but not’s itself. For the following example we will assume a 3 MT server System. The eschat_config.properties file being reviewed herein resides on “this_servers_name1”. The other two servers in this system are: “this_servers_name2” and “this_servers_name3” Example: <cnslb> this_servers_name2;this_servers_name3</cnslb> Note: In a single server system, this parameter will be blank <cns> This value should contain the server name of the MT server on which it resides, and use the format shown below Example: <cns>https://this_servers-name1.bmc.com:8080/eschat/rest/cns</cns> Note: In a single server system, this parameter may be blank <ar_tcp> The tcp port number for the AR server(s) <ar_p> User password. This password will be encrypted the first time the eschat_config.properties file is accessed by tomcat <ar_user> Must be a Remedy admin account and must be an account dedicated to this tool <ar_server> (in a multi-server environment this should be the name of the AR Server Group or AR Load Balancer VIP) Check ESDVFBase.jar file: - Compare the file size and timestamp of the ESDVFBase.jar files in the following locations (in the same server): …midtier/LocalPlugins/ESDVFBase/ (This is the ACTIVE file being used by the application. Make sure it matches the version that should be there) If this is a Virtual Chat installation with NO HOTFIXES, then the ACTIVE file should exactly match the file in the location shown below: …\Program Files\BMC Software\BMCVirtualAgent\VirtualAgentComponents\ESDVFBase (Linux locations will vary) If there have been HOTFIXES applied to this version, review the hotfix manifest and see if there was an ESDVFBase.jar file included in the hotfix. If so, the ACTIVE ESDVFBase.jar file should exactly match the file in the hotfix Note:You can determine if there were hotfixes applied to the environment by checking the “Update History” tab of the Chat Administration Console |
AR Server File Level checks (this applies to ALL AR Servers in the environment):
|
1- Compare the file sizes and dates of the following jar files: SupportBotPlugin.jar ESChatToolsPlugin.jar ESChatNotificationServerPlugin.jar ESTranslatePlugin.jar |
The ACTIVE jar files will be located in the following directory: …/BMCSoftware\BMCARSystem\pluginsvr\BMCVirtualAgentPlugin If this is a Virtual Chat installation with NO HOTFIXES, then the ACTIVE file should exactly match the file in the location shown below: …\Program Files\BMC Software\BMCVirtualAgent\VirtualAgentComponents\plugins (Linux locations will vary). If there have been HOTFIXES applied to this version, review the hotfix manifest and see if ANY of the jar files shown above were included in the hotfix If so, the ACTIVE jar file should exactly match the file in the hotfix Note: You can determine if there were hotfixes applied to the environment by checking the “Update History” tab of the Chat Administration Console |
2- Check pluginsvr_config.xml file in the pluginsvr directory - Check the timestamp of the file - It should have been updated during the installation of Virtual Chat - Specifically, check the accuracy of each of the 4 sections that refer to the 4 jar files above |
3- Check ar.conf/ar.cfg file and ensure the accuracy of the 4 entries for the 4 relevant jar files above |
General Virtual Agent Administration Console Configuration Checklist
In the Chat Admin Console verify the accuracy of the following configuration items |
Chat Server Settings | - Verify the server name configured in the “HTTP Resource Server” field. - Note the Chat Application Status. - Ensure the Chat Server Status -> Current Status field is set to “Production”. |
Live Chat Hours | IF the Chat Application Status above included Live Agent: Ensure that there is at least one schedule which lists the Chat Application Status as “Available”. |
Language Translation | Check to see if the Automatic Language Translation is set to On or OFF. If it is set to ON: - Ensure the there is a valid value entered in the “Google API Translation Key” field. To test this you can do the following: https://www.googleapis.com/language/translate/v2?key=INSERT CUSTOMER GOOGLE TRANSLATION KEY HERE&q=hello%20world&source=en&target=es |
Notification Settings | Verify the correct configuration of the “Server Base URL” field. Note: The format of this configuration will vary between load balanced and non load balanced systems. Example of non load balanced configuration: http://MidtierServer:8080/eschat/rest/cns Example of load balanced configuration: [https://Loadbalancer;http://MT1:8080;http://MT2:8080;http://MT3:8080]/eschat/rest/cns |
Support Queues | Check to see if the Topics and Support Queues boxes are checked. IF SO: Ensure all Topics, Support Queues and Assigned Support Agents have been properly setup and assigned. (These are always manually configured. The installer does not setup Topics or Queues). |
See also:
Best FAQ on AR System and BMC Helix ITSM Performance Issues