Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This is a template that can be copied and duplicated for all following builds. Simply Plug in the information and check off the list as you go.

Build Validated for Release Candidate?

  •  Validated by QA Lead
  •  Released Live

Summary:

This is a checklist for the QA lead to run through the tests of the app and make sure they don’t miss any important steps

...

ONBOARDING / BLUETOOTH / LOCATION

Goal: a user can download the app and make it to the core features.

#

Instruction

Check (iOS)

Check (Android)

1

Install App

  •  No Errors
  •  No Errors

2

Proceed through onboarding wizard (5 screens)

  •  Text displays and is readable
  •  Text displays and is readable

3

Open "How we protect your privacy"

  •  Text displays and is readable
  •  Text displays and is readable

4

Try to Activate Exposure Notifications

  •  Should prompt to open settings
    Click “No thanks” button
  •  Should prompt to open settings
    Click “No thanks” button

6

Enable Notifications

  •  Screen “App Setup Incomplete” is shown
  •  Screen “App Setup Incomplete” is shown

7

Access Home Page

  •  Exposure Detection is red - shows OFF
  •  Exposure Detection is red - shows OFF

8

*Enable Location (*only necessary on older Android OS's)

  •  “Location” shows ON

9

Verify Exposure Detection is ON

  •  Card on Home screen shows as green and ON
  •  All three fields show as green and ON

...

MANUALLY DETECT EXPOSURES

Goal: a user can manually prompt the app to check for exposures

#

Instruction

Check (iOS)

Check (Android)

1

Select the "Exposures" tab from the bottom menu

  •  Button will select correct page
  •  Button will select correct page

2

Click the "Check for exposures" button

  •  "Success" banner shown, after "last 14 days" text is updated to reflect latest check
  •  "Success" banner shown, after "last 14 days" text is updated to reflect latest check

--

EXPOSURE HISTORY

Goal: a user can access their exposure history populated with exposures

#

Instruction

Check (iOS)

Check (Android)

1

In Settings, Use the EN Debug menu to simulate 1 or more exposures

  •  EN is generated & success message shows
  •  EN is generated & success message shows

2

Navigate to Exposure History

  •  Exposure History shows expected number of exposures
  •  Exposure History shows expected number of exposures

3

Tap on an exposure

  •  Relevant Next Steps info is shown
  •  Relevant Next Steps info is shown

...

GAEN (Google Apple Exposure Notifications) Permissions

Goal: an onboarded user can enable required permissions as expected.

#

Instruction

Check (iOS)

Check (Android)

*

Disable Exposure Notifications (device OS), Enable

  •  Exposure Notifications changes from red X to green check
  •  Exposure Notifications changes from red X to green check

*

Disable Location (if applicable*) on device / Re-enable

  •  Location changes from red X to green check

...

VERIFICATION CODE & KEY SUBMISSION

Goal: an onboarded user can submit a verification code as expected.

#

Instruction

Check (iOS)

Check (Android)

1

Generate verification code*
On Health Authority’s “Issue Code” page, input required data for positive results and click “Create Verification Code”

  •  Code is provided from HA server
  •  Code is provided from HA server

2

Access App, select Report Result area

  •  Graphic / Text show
  •  Graphic / Text show

3

Enter verification code

 

 

4

"Next" > "Share" > "I understand and consent"

  •  No errors after selecting any of the buttons
  •  No errors after selecting any of the buttons

*

Offline: disable devices network connectivity and execute above test

  •  Error should appear after "Next" and prevent code submission
  •  Error should appear after "Next" and prevent code submission

*

Invalid Code: Submit a non-valid verification code

  •  Error should appear after "Next" and prevent code submission
  •  Error should appear after "Next" and prevent code submission

...

--

MANUALLY DELETE APP DATA

Goal: a user can manually delete their data stored by the app

#

Instruction

Check (iOS)

Check (Android)

1

Access the Settings page

  •  Page shows with no issues
  •  Page shows with no issues

2

Press "Delete My Data"

  •  Page "Delete My Data" shows, text is shown with no issue
  •  Page "Delete My Data" shows, text is shown with no issue

3

Press "Delete My Data" red banner

  •  Pop-up confirmation is shown
  •  Pop-up confirmation is shown

4

Press “Confirm” on pop-up

  •  Intro onboarding page is shown - no previous data is shown in main pages
  •  Intro onboarding page is shown - no previous data is shown in main pages

--

APP UPDATE

Goal: a user can update the app and verify that simulated exposure is still shown

#

Instruction

Check (iOS)

Check (Android)

1

Install build 1.0.x (older) from AppCenter

  •  Older build installs without issue
  •  Older build installs without issue

2

Navigate to debug menu and tap "simulate exposure"

  •  exposure simulation occurs
  •  exposure simulation occurs

3

Navigate to Exposure history screen and view exposure

  •  Exposure is shown in Exposure History
  •  Exposure is shown in Exposure History

4

Download Staging build 1.0.y (newer) from AppCenter

  •  Newer build installs without issue
  •  Newer build installs without issue

5

Return to updated app’s “Exposure History” Tab

  •  Previous Exposure is still shown in Exposure History
  •  Previous Exposure is still shown in Exposure History

...

GAEN EXPOSURE NOTIFICATION (END-TO-END VERIFICATION)

Goal: a user can receive an exposure notification and see it on the exposure history.

NOTE: Two (or more) phones running app w/ Exposure Notifications ON required.

...