{"id":1790,"date":"2025-12-22T10:45:52","date_gmt":"2025-12-22T10:45:52","guid":{"rendered":"https:\/\/marketaylor.synology.me\/?p=1790"},"modified":"2025-12-22T10:45:54","modified_gmt":"2025-12-22T10:45:54","slug":"queue-manager-statistics-events","status":"publish","type":"post","link":"https:\/\/marketaylor.synology.me\/?p=1790","title":{"rendered":"MQ Monitoring: using queue manager STATISTICS events"},"content":{"rendered":"\n

The sample monitoring packages here<\/a> use a variety of techniques to collect metrics from the queue manager. The most recent release (v5.7.0) adds a further alternative approach.<\/p>\n\n\n\n\n\n\n\n

These packages began by just using the published resource metrics<\/a>. These gave information about the queue manager and queues. Over time, I’ve added operations that use the DISPLAY xxSTATUS commands for all object types, and some other queries where appropriate (for example DISPLAY USAGE on z\/OS).<\/p>\n\n\n\n

One drawback to using the published metrics for queues comes from the need to subscribe to topics for each separate monitored queue. The TUNING<\/a> document in the repository gives some ways to reduce the impact of this – both in terms of the discovery of which queues should be monitored and the actual subscription handles. But I’ve now added a new configuration option that some people might prefer to explore.<\/p>\n\n\n\n

The Distributed queue managers can emit STATISTICS events that provide similar metrics for queues and the queue manager as the published metrics. They are not identical; one is not even a proper subset of the other. But there is a large overlap. Although the queue manager can also generate events for channels, these are ignored here as the CHSTATUS information that we can already process is essentially equivalent.<\/p>\n\n\n\n

Configuring the queue manager<\/strong><\/h2>\n\n\n\n

The events are enabled by setting the STATMQI<\/code> attribute for the queue manager to ON<\/code>. To configure which queues are monitored, either set the queue manager’s STATQ<\/code> option to ON<\/code> and the queue’s STATQ<\/code> option to QMGR<\/code>, or set the queue’s STATQ<\/code> option to ON<\/code>. <\/p>\n\n\n\n

Also set the queue manager’s STATINT<\/code> value to something appropriate to your metrics collection interval. The default value of 1800 seconds (30 minutes) is probably far too high; something like 15 seconds is more like the interval that you want to see reflected in dashboards. The STATCHL<\/code> setting is ignored; any generated channel statistics events are discarded.<\/p>\n\n\n\n

The events are sent by default to the SYSTEM.ADMIN.STATISTICS.QUEUE<\/code> although some administrators redefine the queue manager configuration using aliases and administered subscriptions so that the events can be consumed by multiple monitoring applications. Make sure that the maximum depth of this queue is sufficient for the number of events created; the queue manager writes to the error logs if this queue becomes full so that it cannot write new events.<\/p>\n\n\n\n

Note that we are NOT processing the similarly-named, and similarly-configured Accounting events that report on individual application operation.<\/p>\n\n\n\n

Configuring the collectors<\/strong><\/h2>\n\n\n\n

Setting the global.useStatistics<\/code> option for the collection programs to true<\/code> turns on this mode of operation. The default value of this option is false<\/code>. You can also set which queue to read, if it is not the default admin queue.<\/p>\n\n\n\n

You will probably still want the global.usePublications<\/code> option set to true<\/code>, along with the useObjectStatus<\/code> option. Between them, these give the fullest set of metrics.<\/p>\n\n\n\n

Enabled collectors<\/strong><\/h3>\n\n\n\n

Recognising and processing the statistics events is available only in the OTel, Prometheus and JSON collectors in this repository.<\/p>\n\n\n\n

As the DEPRECATIONS<\/a> file says, my plan is to remove the other collectors at some future point. Probably coinciding with the next LTS version of MQ. That’s because OTel makes it possible to get to so many different backends that database-specific collectors are becoming less interesting and less relevant.<\/p>\n\n\n\n

The collected metrics<\/strong><\/h2>\n\n\n\n

Once the useStatistics<\/code> option is set, then this overrides some – but not all – of the topic-based metric collection.<\/p>\n\n\n\n

In particular, we no longer collect the STATQ<\/code> and STATMQI<\/code> published metric classes. But we do still want to subscribe to other queue manager level metrics, such as the LOG information and reports coming from the NativeHA components. That’s why it is still useful to have the usePublications<\/code> option turned on.<\/p>\n\n\n\n

There is no need for the monitoredQueues<\/code> setting. Using statistics events means that we can effectively derive the list of queues to report on based on their STATQ attribute.<\/p>\n\n\n\n

The names for the event-based metrics are not necessarily the same as those used for equivalent topic-based metrics. There was enough difference between the sets of metrics, that I did not think it worthwhile attempting to maintain the same names. Any dashboards you create to report on these events would have always been likely to need rework anyway.<\/p>\n\n\n\n

If you look at the full definition of the statistics event messages, you can see that the queue manager reports some metrics as arrays of values. For example, the number of messages put to a queue has two values. The array holds separate values for persistent and non-persistent messages. Reports for many of the MQI operations split by object type, unlike the published metrics which just give a total of, say, the MQOPEN verbs. While you could design dashboards that add up all of the individual MQOPENs, I’ve simplified things by creating a new metric, not directly part of the real event message, that gives the sum across these arrays. <\/p>\n\n\n\n

Look at the metrics.txt<\/a> file to see all of the metrics available through this mechanism. And the product samples amsqmon<\/code> and amqsevt<\/code> are able to format these events so you can see the contents more directly.<\/p>\n\n\n\n

Prometheus<\/h3>\n\n\n\n

For the Prometheus collector, setting the useStatistics<\/code> option will also force the overrideCType<\/code> option to true. This correctly distinguishes between Counters and Gauges, something that is not the default behaviour today for the topic-based metrics. I’m planning on having that override option become the default in a future version anyway, but it would be a breaking change for existing dashboards. As the event-based option requires new dashboards anyway, I’ve decided to impose that change earlier here.<\/p>\n\n\n\n

Summary<\/strong><\/h2>\n\n\n\n

This alternative collection mechanism may simplify configurations. It may also (though not definitely) improve performance of metrics collections. <\/p>\n\n\n\n

Let me know what you think.<\/p>\n","protected":false},"excerpt":{"rendered":"

The sample monitoring packages here use a variety of techniques to collect metrics from the queue manager. The most recent release (v5.7.0) adds a further alternative approach.<\/p>\n","protected":false},"author":1,"featured_media":1268,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[5],"tags":[43,35,20,131,135,42],"class_list":["post-1790","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-mq","tag-grafana","tag-ibmmq","tag-mqseries","tag-opentelemetry","tag-otel","tag-prometheus"],"yoast_head":"\nMQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog<\/title>\n<meta name=\"description\" content=\"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/marketaylor.synology.me\/?p=1790\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"MQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog\" \/>\n<meta property=\"og:description\" content=\"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/marketaylor.synology.me\/?p=1790\" \/>\n<meta property=\"og:site_name\" content=\"Mark Taylor's Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-12-22T10:45:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-22T10:45:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png\" \/>\n\t<meta property=\"og:image:width\" content=\"394\" \/>\n\t<meta property=\"og:image:height\" content=\"217\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Mark\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@marketaylor\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mark\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790\"},\"author\":{\"name\":\"Mark\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/#\\\/schema\\\/person\\\/2d6f4113ff54187023e20c20186bbb3c\"},\"headline\":\"MQ Monitoring: using queue manager STATISTICS events\",\"datePublished\":\"2025-12-22T10:45:52+00:00\",\"dateModified\":\"2025-12-22T10:45:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790\"},\"wordCount\":943,\"commentCount\":2,\"image\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/marketaylor.synology.me\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/grafana_small-e1656570279789.png\",\"keywords\":[\"grafana\",\"ibmmq\",\"mqseries\",\"opentelemetry\",\"otel\",\"prometheus\"],\"articleSection\":[\"IBM MQ\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790\",\"url\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790\",\"name\":\"MQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/marketaylor.synology.me\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/grafana_small-e1656570279789.png\",\"datePublished\":\"2025-12-22T10:45:52+00:00\",\"dateModified\":\"2025-12-22T10:45:54+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/#\\\/schema\\\/person\\\/2d6f4113ff54187023e20c20186bbb3c\"},\"description\":\"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#primaryimage\",\"url\":\"https:\\\/\\\/marketaylor.synology.me\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/grafana_small-e1656570279789.png\",\"contentUrl\":\"https:\\\/\\\/marketaylor.synology.me\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/grafana_small-e1656570279789.png\",\"width\":394,\"height\":217,\"caption\":\"MQ monitoring\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/?p=1790#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/marketaylor.synology.me\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"MQ Monitoring: using queue manager STATISTICS events\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/#website\",\"url\":\"https:\\\/\\\/marketaylor.synology.me\\\/\",\"name\":\"Mark Taylor's Blog\",\"description\":\"Messaging, Music and Moving Around\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/marketaylor.synology.me\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/marketaylor.synology.me\\\/#\\\/schema\\\/person\\\/2d6f4113ff54187023e20c20186bbb3c\",\"name\":\"Mark\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g\",\"caption\":\"Mark\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/marketaylor\"],\"url\":\"https:\\\/\\\/marketaylor.synology.me\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"MQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog","description":"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/marketaylor.synology.me\/?p=1790","og_locale":"en_GB","og_type":"article","og_title":"MQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog","og_description":"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.","og_url":"https:\/\/marketaylor.synology.me\/?p=1790","og_site_name":"Mark Taylor's Blog","article_published_time":"2025-12-22T10:45:52+00:00","article_modified_time":"2025-12-22T10:45:54+00:00","og_image":[{"width":394,"height":217,"url":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","type":"image\/png"}],"author":"Mark","twitter_card":"summary_large_image","twitter_creator":"@marketaylor","twitter_misc":{"Written by":"Mark","Estimated reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/marketaylor.synology.me\/?p=1790#article","isPartOf":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790"},"author":{"name":"Mark","@id":"https:\/\/marketaylor.synology.me\/#\/schema\/person\/2d6f4113ff54187023e20c20186bbb3c"},"headline":"MQ Monitoring: using queue manager STATISTICS events","datePublished":"2025-12-22T10:45:52+00:00","dateModified":"2025-12-22T10:45:54+00:00","mainEntityOfPage":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790"},"wordCount":943,"commentCount":2,"image":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790#primaryimage"},"thumbnailUrl":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","keywords":["grafana","ibmmq","mqseries","opentelemetry","otel","prometheus"],"articleSection":["IBM MQ"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/marketaylor.synology.me\/?p=1790#respond"]}]},{"@type":"WebPage","@id":"https:\/\/marketaylor.synology.me\/?p=1790","url":"https:\/\/marketaylor.synology.me\/?p=1790","name":"MQ Monitoring: using queue manager STATISTICS events - Mark Taylor's Blog","isPartOf":{"@id":"https:\/\/marketaylor.synology.me\/#website"},"primaryImageOfPage":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790#primaryimage"},"image":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790#primaryimage"},"thumbnailUrl":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","datePublished":"2025-12-22T10:45:52+00:00","dateModified":"2025-12-22T10:45:54+00:00","author":{"@id":"https:\/\/marketaylor.synology.me\/#\/schema\/person\/2d6f4113ff54187023e20c20186bbb3c"},"description":"Metrics collection using queue manager statistics events as an alternative to the published resource metrics.","breadcrumb":{"@id":"https:\/\/marketaylor.synology.me\/?p=1790#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/marketaylor.synology.me\/?p=1790"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/marketaylor.synology.me\/?p=1790#primaryimage","url":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","contentUrl":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","width":394,"height":217,"caption":"MQ monitoring"},{"@type":"BreadcrumbList","@id":"https:\/\/marketaylor.synology.me\/?p=1790#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/marketaylor.synology.me\/"},{"@type":"ListItem","position":2,"name":"MQ Monitoring: using queue manager STATISTICS events"}]},{"@type":"WebSite","@id":"https:\/\/marketaylor.synology.me\/#website","url":"https:\/\/marketaylor.synology.me\/","name":"Mark Taylor's Blog","description":"Messaging, Music and Moving Around","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/marketaylor.synology.me\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/marketaylor.synology.me\/#\/schema\/person\/2d6f4113ff54187023e20c20186bbb3c","name":"Mark","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9a5ae091c43730194cba7cabb5d65c1dc3f48d05caaddec6ff2319a1ce66376f?s=96&d=mm&r=g","caption":"Mark"},"sameAs":["https:\/\/x.com\/marketaylor"],"url":"https:\/\/marketaylor.synology.me\/?author=1"}]}},"jetpack_featured_media_url":"https:\/\/marketaylor.synology.me\/wp-content\/uploads\/2022\/05\/grafana_small-e1656570279789.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/posts\/1790","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1790"}],"version-history":[{"count":2,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/posts\/1790\/revisions"}],"predecessor-version":[{"id":1792,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/posts\/1790\/revisions\/1792"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=\/wp\/v2\/media\/1268"}],"wp:attachment":[{"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1790"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1790"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marketaylor.synology.me\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1790"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}