A/B Testing Roadmap & Current Initiatives

Research & AnalysisAdded by Jessica Dunbar - PortlandLabsAugust 16, 2024
Measure_What_Matters..png

The A/B Testing roadmap is shaped by collaboration between PortlandLabs, the G9 Team, and the CAT (Content Access Team). The G9 Team provides strategic direction and ensures alignment with Army MWR objectives. Ideas from PortlandLabs and the CAT team are prioritized based on impact and feasibility. The CAT manages content and navigation updates, using testing insights to implement changes. This agile process ensures continuous improvement driven by user feedback and data analysis.

Table 1: Roadmap and Testing Ideas

Experiment Name Experiment Description Difficulty Start Date End Date Status
Community Support Menu Name ArmyMWR Test the effectiveness of different menu names in driving user engagement for community support pages. Medium 08/01/2018 08/31/2018 Complete
Test "Home Life" vs. Base Life Test impact of replacing "Home Life" in navigation with "Base Life" Easy 08/15/2024 09/15/2024 Active
Test Old Nav vs. New Nav Test impact of the new navigation structure compared to the old structure Medium/Hard TBD   Planned
Reorder Navigation Items Based on User Priority To test if reordering the navigation items based on user priority (e.g., moving most-clicked items to the left) improves user engagement and reduces time to find information. Easy      
Relocation of "Partner with Us" and "Eligible Patrons" to Utility Navigation To determine the impact on user engagement and navigation efficiency when moving "Partner with Us" and "Eligible Patrons" links from the main navigation bar to the utility navigation bar. Medium      
Persistent Search Bar in Utility Navigation To assess the impact of making the search bar persistent and visible at all times in the utility navigation. Medium      
Personalized Navigation Based on User Type To test a personalized navigation experience where the order and visibility of navigation items change based on the user’s profile (e.g., Soldiers, Family, Civilians, Retirees). Medium      
Alphabetizing the Menus in Navigation To determine if alphabetizing the navigation menu items enhances user experience by making it easier for users to locate specific sections, thereby improving navigation efficiency and user satisfaction. Easy      

Latest News

U.S._Army_MWR_Fourth_Quarter_FY24_Insights.jpg

2024 Fourth Quarter Analytics
Added by Jess - PortlandLabsOctober 29, 2024

How many new pages of content did installations create last quarter? Web managers created a total of 291  new pages on EPW in the last quarter. It's important to note that the total excludes data from, calendar events, and directory...

Metrics_Glossary_3.jpg

Reports Glossary
September 27, 2024

This guide provides an easy-to-understand summary of various Matomo Analytics reports and what they reveal about your website’s performance.

Metrics_Glossary.jpg
September 27, 2024

Metrics Glossary

This page serves as a glossary of key Matomo Analytics terms. It provides clear, concise definitions for a variety of metrics and...

Segments.jpg
September 26, 2024

Segments

This page provides all the essential labels and definitions related to segments in Matomo.You’ll find explanations of key terms like segment...

Visitor.jpg
September 25, 2024

Visitor Reports

Whether you’re new to Matomo or looking to enhance your analytics skills, this tutorial will help you leverage Matomo’s powerful...

Empower_Your_Mission.png
September 25, 2024

Behavior Reports

This tutorial will help you leverage Matomo’s powerful Behavior Reports. This report offers detailed insights into how...

Acquisition_Reports.jpg
September 25, 2024

Acquisition Reports

Whether you’re new to Matomo or looking to enhance your analytics skills, this tutorial will help you leverage the Acquisition...

Dashboard.jpg
September 25, 2024

Dashboard Overview

By leveraging the Main Dashboard and its charting capabilities, you can easily identify performance trends, detect anomalies, and gain actionable...

Accessing_Matomo.jpg
September 24, 2024

Accessing Matomo

By following this guide, users will be able to: Successfully log in to the Matomo system for the first time using their CAC. Understand...

SB_2024_-_Enterprise_Web_Promo_750x421_.jpg
September 12, 2024

FY24 STRONG B.A.N.D.S.

BLUF: The STRONG B.A.N.D.S.  program pages have experienced mixed trends in site traffic and user engagement. Total users for the...