Page Comparison

This is a template that can be copied and duplicated for all following builds. Simply Plug in the information and check off the list as you go.

...

ONBOARDING / BLUETOOTH / LOCATION

Goal: a user can download the app and make it to the core features.

#	Instruction	Check (iOS)	Check (Android)
1	Install App	No Errors	No Errors
2	Proceed through onboarding wizard (5 screens)	Text displays and is readable	Text displays and is readable
3	Open "How we protect your privacy"	Text displays and is readable	Text displays and is readable
4	Try to Activate Exposure Notifications	Should prompt to open settings Click “No thanks” button	Should prompt to open settings Click “No thanks” button
6	Enable Notifications	Screen “App Setup Incomplete” is shown	Screen “App Setup Incomplete” is shown
7	Access Home Page	Exposure Detection is red - shows OFF	Exposure Detection is red - shows OFF
8	Enable Location (only necessary on older Android OS's)**		“Location” shows ON
9	Verify Exposure Detection is ON	Card on Home screen shows as green and ON	All three fields show as green and ON

...

MANUALLY DETECT EXPOSURES

Goal: a user can manually prompt the app to check for exposures

#	Instruction	Check (iOS)	Check (Android)
1	Select the "Exposures" tab from the bottom menu	Button will select correct page	Button will select correct page
2	Click the "Check for exposures" button	"Success" banner shown, after "last 14 days" text is updated to reflect latest check	"Success" banner shown, after "last 14 days" text is updated to reflect latest check

--

EXPOSURE HISTORY

Goal: a user can access their exposure history populated with exposures

#	Instruction	Check (iOS)	Check (Android)
1	In Settings, Use the EN Debug menu to simulate 1 or more exposures	EN is generated & success message shows	EN is generated & success message shows
2	Navigate to Exposure History	Exposure History shows expected number of exposures	Exposure History shows expected number of exposures
3	Tap on an exposure	Relevant Next Steps info is shown	Relevant Next Steps info is shown

...

GAEN (Google Apple Exposure Notifications) Permissions

Goal: an onboarded user can enable required permissions as expected.

#	Instruction	Check (iOS)	Check (Android)
*	Disable Exposure Notifications (device OS), Enable	Exposure Notifications changes from red X to green check	Exposure Notifications changes from red X to green check
*	Disable Location *(if applicable)** on device / Re-enable		Location changes from red X to green check

...

VERIFICATION CODE & KEY SUBMISSION

Goal: an onboarded user can submit a verification code as expected.

#	Instruction	Check (iOS)	Check (Android)
1	Generate verification code* On Health Authority’s “Issue Code” page, input required data for positive results and click “Create Verification Code”	Code is provided from HA server	Code is provided from HA server
2	Access App, select Report Result area	Graphic / Text show	Graphic / Text show
3	Enter verification code
4	"Next" > "Share" > "I understand and consent"	No errors after selecting any of the buttons	No errors after selecting any of the buttons
*	Offline: disable devices network connectivity and execute above test	Error should appear after "Next" and prevent code submission	Error should appear after "Next" and prevent code submission
*	Invalid Code: Submit a non-valid verification code	Error should appear after "Next" and prevent code submission	Error should appear after "Next" and prevent code submission

...

--

MANUALLY DELETE APP DATA

Goal: a user can manually delete their data stored by the app

#	Instruction	Check (iOS)	Check (Android)
1	Access the Settings page	Page shows with no issues	Page shows with no issues
2	Press "Delete My Data"	Page "Delete My Data" shows, text is shown with no issue	Page "Delete My Data" shows, text is shown with no issue
3	Press "Delete My Data" red banner	Pop-up confirmation is shown	Pop-up confirmation is shown
4	Press “Confirm” on pop-up	Intro onboarding page is shown - no previous data is shown in main pages	Intro onboarding page is shown - no previous data is shown in main pages

--

APP UPDATE

Goal: a user can update the app and verify that simulated exposure is still shown

#	Instruction	Check (iOS)	Check (Android)
1	Install build 1.0.x (older) from AppCenter	Older build installs without issue	Older build installs without issue
2	Navigate to debug menu and tap "simulate exposure"	exposure simulation occurs	exposure simulation occurs
3	Navigate to Exposure history screen and view exposure	Exposure is shown in Exposure History	Exposure is shown in Exposure History
4	Download Staging build 1.0.y (newer) from AppCenter	Newer build installs without issue	Newer build installs without issue
5	Return to updated app’s “Exposure History” Tab	Previous Exposure is still shown in Exposure History	Previous Exposure is still shown in Exposure History

...

GAEN EXPOSURE NOTIFICATION (END-TO-END VERIFICATION)

Goal: a user can receive an exposure notification and see it on the exposure history.

NOTE: Two (or more) phones running app w/ Exposure Notifications ON required.

For testing purposes, we will use an iOS and an Android device to run this test (provides a full end-to-end experience). The Android device will be device #1 (this is the one that a positive test case will be reported on) and the iOS device will be device #2 (the device that an exposure notification should appear on).

Info
HA Used for End-To-End:

#	Instruction	Check Device #2 (iOS)	Check Device #1 (Android)
1	Let phone sit for AT LEAST 1 hour (app in background)	Debug menu > Show Local Diagnosis Keys has keys	Debug menu > Show Local Diagnosis Keys has keys
2	Move phone to within 6 ft of another testing phone (at least 15 minutes)
3	"Report positive test result" > "Start" > enter code > share keys	No errors	No errors
4	Wait (up to 24 hours)	Exposure Notification appears on second testing phone	Exposure Notification appears on second testing phone
5	(On 2nd phone) Open Exposure History	Possible exposure is listed, Next Steps button leads to relevant HA website (if applicable)	Possible exposure is listed, Next Steps button leads to relevant HA website (if applicable)

...

Versions Compared

Old Version 9

New Version 10

Key