Quality Assurance Guide

Ask yourself the questions below to conduct a quality assurance check on your Metrics for News app. Ideal for those who just finished onboarding, but great any time if you simply want to do a quick check. 

If you find discrepancies, review the knowledge base articles and review your settings. Note that not all scenarios mentioned may apply to your setup.  

> Content Import
> Analytics Import
> Engagement Scores & Baseline
> Authors & Users
> Dashboards

Content Import

• Do my RSS feeds and/or custom import files contain the stories I expect? 

• Do my RSS feeds contain, at minimum, the most recent seven (7) days worth of content? 

• Is my content importing as expected?

  • Review a random selection of stories from: 1) The most recent three days; 2) The past three months; and 3) My historical content import. 

• Have I set the rules for content that should be ignored or excluded when importing (e.g., bylines, keywords, html elements, sections, etc.)?

  • Go to Settings > Publications > select Edit for the publication > scroll down to Exclude content > add rules here. 

• For the stories that have been imported, do they appear as expected? 

  • Do stories with multiple authors display all of their names? 

  • Do names with special characters appear correctly? 

• Are the page scraper settings working as expected?

  • Are author names captured with no other text (e.g., the name should appear as "Jane Smith" and not "By Jane Smith")? 

  • Go to Settings > Publication > Edit > Page scraper settings > adjust the settings. Use “Preview page scraping” to see the results. 

Back to top

Analytics Import

• Are my analytics importing as expected?

  • Review a random selection of stories from: 1) The most recent three days; 2) The past three months; and 3) My historical content import.

  • Are the analytics correct? Remember that pageviews in MFN represent a cumulative total since the story’s publication.

  • Consider running a custom report to inspect your data from another viewpoint.

• Are my custom metrics importing as expected? 
  

Engagement Scores & Baseline

• Have I selected all the individual metrics for my engagement scores?

• Have I set the weights for each metric in my engagement scores?

• Have I set the engagement score scale? 

• Are the engagement scores for my stories accurate? 

• Does my baseline cover a time frame that has content on most days? 

Back to top

Authors & Users

• Have I set up my users with their intended permission levels?

  • Authors are connected to their user accounts?

  • Author types are created and authors assigned?

  • Teams created and authors assigned?

  • Team leaders have access to their team dashboards?

  • Assigned at least two (2) users with admin access?

• Are my authors’ "My Stories" page displaying data as expected?

  • Ask a few authors to check their personal dashboards. Are all of their stories present in the dashboard? Are the analytics accurate?

Back to top

Dashboards 

• Are my content categories set up to help me find the stories that spark engagement?

• Is data in my dashboards appearing as expected? Go through each dashboard (e.g., Stories, Topics, Teams, etc.) and review the groupings, content, and analytics. 

• Have I set my featured metrics (i.e., the blue boxes)? Go to Settings > under Admin settings, select General app settings > set the “Featured metrics” and “Featured story metrics.” Remember to save your changes!

  • If, upon saving, you receive the “duplicate metrics” error, please be sure to select a unique option for each metric, including the default ones.

Back to top