Verification General Test

NOTE: Because of the differences with each Health Authority (HA) and iteration of the app, these tests are meant to cover non-specific user interaction and are not meant to cover exact functionality and interface items.

--

ONBOARDING / BLUETOOTH / LOCATION

Goal: a user can download the app and make it to the core features.

#

Instruction

Check

1

Install App

No errors

2

Open Phone Settings, Disable Bluetooth

 

3

Proceed through onboarding wizard (5 screens)

Text displays and is readable

4

Open "How we protect your privacy"

Text displays and is readable

5

Try to Activate Exposure Notifications

Should prompt to open settings
Click “No thanks” button

6

Try to Activate Bluetooth

Should prompt to open settings
Click “Maybe Later” button

7

Enable Notification

Screen “App Setup Incomplete” is shown

8

Access Home Page

Exposure Detection is red - shows OFF

9

Open Settings > Enable Bluetooth (on phone), Return to App

Bluetooth shows as ON

9b

*Enable Location (*only necessary on older Android OS's)

“Location” shows ON

10

Verify Exposure Detection is ON

All three fields show as green and ON

--

MANUALLY DETECT EXPOSURES

Goal: a user can manually prompt the app to check for exposures

#

Instruction

Check

1

Select the "Exposures" tab from the bottom menu

Button will select correct page

2

Click the "Check for exposures" button

"Success" banner shown, after "last 14 days" text is updated to reflect latest check

--

EXPOSURE HISTORY

Goal: a user can access their exposure history populated with exposures

#

Instruction

Check

1

In Settings, Use the EN Debug menu to simulate 1 or more exposures

EN is generated & success message shows

2

Navigate to Exposure History

Exposure History shows expected number of exposures

3

Tap on an exposure

Relevant Next Steps info is shown

--

GAEN (Google Apple Exposure Notifications) Permissions

Goal: an onboarded user can enable required permissions as expected.

#

Instruction

Check

*

Disable Exposure Notifications (device OS), Enable

Exposure Notifications changes from red X to green check

*

Disable Bluetooth on device / Re-enable Bluetooth

Bluetooth changes from red X to green check

*

Disable Location (if applicable*) on device / Re-enable

Location changes from red X to green check

*There are significant differences between Android and iOS and the different versions of the GAEN api, some (non-exhaustive) are noted below:

  • iOS: Bluetooth and EN

  • Android 10 or below: Bluetooth, EN, and Location

  • Android 11: Bluetooth and EN

--

VERIFICATION CODE & KEY SUBMISSION

Goal: an onboarded user can submit a verification code as expected.

#

Instruction

Check

1

Generate verification code*
On Health Authority’s “Issue Code” page, input required data for positive results and click “Create Verification Code”

Code is provided from HA server

2

Access App, select Report Result area

Graphic / Text show

3

Enter verification code

 

4

"Next" > "Share" > "I understand and consent"

No errors after selecting any of the buttons

*

Offline: disable devices network connectivity and execute above test

Error should appear after "Next" and prevent code submission

*

Invalid Code: Submit a non-valid verification code

Error should appear after "Next" and prevent code submission

*Code provided from verification server, if you do not have access and are an internal QA please contact @Arthur Gibson

 

--

MANUALLY DELETE APP DATA

Goal: a user can manually delete their data stored by the app

#

Instruction

Check

1

Access the Settings page

Page shows with no issues

2

Press "Delete My Data"

Page "Delete My Data" shows, text is shown with no issue

3

Press "Delete My Data" red banner

Pop-up confirmation is shown

4

Press “Confirm” on pop-up

Intro onboarding page is shown - no previous data is shown in main pages

--

APP UPDATE

Goal: a user can update the app and verify that simulated exposure is still shown

#

Instruction

Check

1

Install build 1.0.x (older) from AppCenter

Older build installs without issue

2

Navigate to debug menu and tap "simulate exposure"

exposure simulation occurs

3

Navigate to Exposure history screen and view exposure

Exposure is shown in Exposure History

4

Download Staging build 1.0.y (newer) from AppCenter

Newer build installs without issue

5

Return to updated app’s “Exposure History” Tab

Previous Exposure is still shown in Exposure History

--

GAEN EXPOSURE NOTIFICATION (END-TO-END VERIFICATION)

Goal: a user can receive an exposure notification and see it on the exposure history.

NOTE: Two (or more) phones running app w/ Exposure Notifications ON required.

#

Instruction

Check

1

Let phone sit for AT LEAST 1 hour (app in background)

Debug menu > Show Local Diagnosis Keys has keys

2

Move phone to within 6 ft of another testing phone (at least 15 minutes)

 

3

"Report positive test result" > "Start" > enter code > share keys

No errors

4

Wait (up to 24 hours)

Exposure Notification appears on second testing phone

5

(On 2nd phone) Open Exposure History

Possible exposure is listed, Next Steps button leads to relevant HA website (if applicable)