NOTE: Because of the differences with each Health Authority (HA) and iteration of the app, these tests are meant to cover non-specific user interaction and are not meant to cover exact functionality and interface items.
--
ONBOARDING / BLUETOOTH / LOCATION
Goal: a user can download the app and make it to the core features.
# | Instruction | Check |
1 | Install App | No errors |
2 | Open Phone Settings, Disable Bluetooth | |
3 | Proceed through onboarding wizard (5 screens) | Text displays and is readable |
4 | Open "How we protect your privacy" | Text displays and is readable |
5 | Try to Activate Exposure Notifications | Should prompt to open settings |
6 | Try to Activate Bluetooth | Should prompt to open settings |
7 | Enable Notification | Screen “App Setup Incomplete” is shown |
8 | Access Home Page | Exposure Detection is red - shows OFF |
9 | Open Settings > Enable Bluetooth (on phone), Return to App | Bluetooth shows as ON |
9b | *Enable Location (*only necessary on older Android OS's) | “Location” shows ON |
10 | Verify Exposure Detection is ON | All three fields show as green and ON |
--
MANUALLY DETECT EXPOSURES
Goal: a user can manually prompt the app to check for exposures
# | Instruction | Check |
1 | Select the "Exposures" tab from the bottom menu | Button will select correct page |
2 | Click the "Check for exposures" button | "Success" banner shown, after "last 14 days" text is updated to reflect latest check |
--
EXPOSURE HISTORY
Goal: a user can access their exposure history populated with exposures
# | Instruction | Check |
1 | In Settings, Use the EN Debug menu to simulate 1 or more exposures | EN is generated & success message shows |
2 | Navigate to Exposure History | Exposure History shows expected number of exposures |
3 | Tap on an exposure | Relevant Next Steps info is shown |
--
GAEN (Google Apple Exposure Notifications) Permissions
Goal: an onboarded user can enable required permissions as expected.
# | Instruction | Check |
* | Disable Exposure Notifications (device OS), Enable | Exposure Notifications changes from red X to green check |
* | Disable Bluetooth on device / Re-enable Bluetooth | Bluetooth changes from red X to green check |
* | Disable Location (if applicable*) on device / Re-enable | Location changes from red X to green check |
*There are significant differences between Android and iOS and the different versions of the GAEN api, some (non-exhaustive) are noted below:
iOS: Bluetooth and EN
Android 10 or below: Bluetooth, EN, and Location
Android 11: Bluetooth and EN
--
VERIFICATION CODE & KEY SUBMISSION
Goal: an onboarded user can submit a verification code as expected.
# | Instruction | Check |
1 | Generate verification code* | Code is provided from HA server |
2 | Access App, select Report Result area | Graphic / Text show |
3 | Enter verification code | |
4 | "Next" > "Share" > "I understand and consent" | No errors after selecting any of the buttons |
* | Offline: disable devices network connectivity and execute above test | Error should appear after "Next" and prevent code submission |
* | Invalid Code: Submit a non-valid verification code | Error should appear after "Next" and prevent code submission |
*Code provided from verification server, if you do not have access and are an internal QA please contact Arthur Gibson |
--
MANUALLY DELETE APP DATA
Goal: a user can manually delete their data stored by the app
# | Instruction | Check |
1 | Access the Settings page | Page shows with no issues |
2 | Press "Delete My Data" | Page "Delete My Data" shows, text is shown with no issue |
3 | Press "Delete My Data" red banner | Pop-up confirmation is shown |
4 | Press “Confirm” on pop-up | Intro onboarding page is shown - no previous data is shown in main pages |
--
APP UPDATE
Goal: a user can update the app and simulate an exposure
# | Instruction | Check |
1 | Install build 1.0.x (older) from AppCenter | Older build installs without issue |
2 | Navigate to debug menu and tap "simulate exposure" | exposure simulation occurs without issue |
3 | *Navigate to "My Health" Tab and add a Checkin (*LA only) | Checkin occurs without issue |
4 | Navigate to Exposure history screen and view exposure | Exposure is shown in Exposure History |
5 | Download Staging build 1.0.y (newer) from AppCenter | Newer build installs without issue |
6 | Repeat steps 2-4 | Exposure is still shown in Exposure History |
--
GAEN EXPOSURE NOTIFICATION (END-TO-END VERIFICATION)
Goal: a user can receive an exposure notification and see it on the exposure history.
NOTE: Two (or more) phones running app w/ Exposure Notifications ON required.
# | Instruction | Check |
1 | Let phone sit for AT LEAST 1 hour (app in background) | Debug menu > Show Local Diagnosis Keys has keys |
2 | Move phone to within 6 ft of another testing phone (at least 15 minutes) | |
3 | "Report positive test result" > "Start" > enter code > share keys | No errors |
4 | Wait (up to 24 hours) | Exposure Notification appears on second testing phone |
5 | (On 2nd phone) Open Exposure History | Possible exposure is listed, Next Steps button leads to relevant HA website (if applicable) |