Why do audits happen?
Web Analytics Audits often happen because of mistrust of, or confusion in, the report data. Often organizations invest considerable resources in their web analytics system, only to find out that there are problems with the numbers. Numbers may not make sense, or can be awkward to justify. Let’s review what should happen for an audit to be effective and handle all problems.
What happens in an audit?
On the technical side:
- A review of tags are done
- All pages are reviewed to ensure that each page contains a tag and that intermediary or third-party pages are tagged with their template.
- Verification is done to ensure that the tags are correctly configured so that JavaScript errors or other situational problems do no cause problems with tracking.
- Session tracking verification
- We first determine that cross domain tracking is working and not breaking valid sessions. Attribution tracking is reviewed and verified for all entry points.
- We check the results across other web analytics tools which may be installed to ensure that the session data matches up.
- Verification of first/third-party cookie tracking is then done to ensure that data is not being lost or incorrectly categorized. We also check that tags are writing cookies properly both individually and on aggregate.
- If multiple analytics tools are installed, we will verify the magnitude of metrics across multiple tools. This includes systematic review of certain key dimensions across their associated metrics between the two tools.
- Of the analytics tool, we review the following details
- Verify table limits – is data being cut off or discarded?
- Verify Query parameters – are we rebuilding the correct parameters to best describe our dimensional data?
- Custom reporting configurations – Are the custom reports setup correctly and answering the correct question?
- Segmentation and filter review – Are the filters correct and do they represent the correct segments? Review the content and configuration of the segments to determine that the filters are not contradicting or breaking expectations.
- Tool specific customizations – based on the selected analytics tool, we will review the advanced configuration to ensure that each of the items are configured to support goals and expectations.
On the business side:
- Are all critical metrics being reported on?
- How are new reporting requirements managed?
- Is the information organized and accessible to decision makers?
- Does the data allow decisions to be made?
- Can the impact of those decisions be measured?
What are the results?
Once the audit is completed, we compile a list of our findings, completed configuration changes, future configuration changes, code changes, and other expectations. The results of the audit set the stage for next step recommendations, governance updates and overall strategy for future initiatives.
