This testing was performed after SAF-731, SAF-738 and SAF-759 had been fixed - to test those fixes and cover the space looking for further bugs.
Test Space
iPhone model - we stripe, but assume irrelevant
Location Services disabled on device - not tested for now
iOS version - 12 & 13 - we assume we can ignore sub-versions
Notifications: Enable / Maybe Later. When Enabled: Yes / No
Location: Allow / Maybe Later. When Allowed: Always / When App is Open / Once Only / No
...
I’m not able to test closing app (at which point it should ask to uplift permissions to “Always” due to latency issues with Perfecto, meaning I can’t access the App Switcher on iOSfrom “Allow while using App” to “Always” on Perfecto) - users of real devices like Jacob Jaffe (Deactivated) and Jeri Levine may be able to do some testing here.
TC# | iOS version | Notifications | Location | Notification Choice | Location Choice | Device | Notes | On closing app | ||
|---|---|---|---|---|---|---|---|---|---|---|
1 | 12 | Enable | Allow | Allow | Allow while using App | iPhone 7+ | Looks good. | Closing app usign Perfecto controls did not trigger a pop-up askign for better location permissions. But I don’t know if this faithfully replicates closing an app via iOS. | ||
2 | 12 | ML | ML | Allow | Allow while using App | iPhone 7+ | All good. | Not Tested | ||
3 | 12 | Enable | ML | Allow | Allow while using App | iPhone | 7+XS | Seem to have hit a bug. When I finally get to enable location settings, I choose “Only when using the App”. I am then taken into the Settings screen. I have no idea why - all permissions look to be set correctly. SAF-760 | Not Tested | |
4 | 12 | ML | Allow | Allow | Allow while using App | iPhone | 7+XS | All good. | Not Tested | |
5 | 13 | Enable | Allow | Allow | Allow while using App | iPhone 7 | All good. | Not Tested | ||
6 | 13 | ML | ML | Allow | Allow while using App | iPhone 7 | Once onboarded, asks for location first, then Notifications. | Not Tested | ||
7 | 13 | Enable | ML | Allow | Allow while using App | iPhone 7 Plus | Seem to have hit a bug. When I finally get to enable location settings, I choose “Only when using the App”. I am then taken into the Settings screen. I have no idea why - all permissions look to be set correctly. SAF-760 | |||
8 | 13 | ML | Allow | Allow | Allow while using App | iPhone 7 | All good | Not Tested | ||
9 | 12 | Enable | Allow | No | Never | iPhone 6 | All good | Settings: | ||
10 | 12 | ML | Allow | No | Only Once | iPhone 6 | All good | Settings: Re-open the app and choose no to allow notifications -- now the settings option for notifications appears. If I open the app and allow notifications, it takes me to the iOS settings. If I then allow notifications, I am fully onboarded. | ||
11 | 12 | Enable | ML | No | Only When All is openAlways | iPhone 6 | All good | Settings: | ||
12 | 12 | ML | ML | No | Never | iPhone 6 | All good | Settings: Re-open the app and allow location sharing while using the app. It asks whether I'd like to allow notifications. Choose "Don't Allow" and you are taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. | ||
13 | 13 | Enable | Allow | No | Only OnceiPhone 11 PRO | iPad mini 4 | All good | Settings: Re-open the app and allow location sharing while using the app. It asks whether I'd like to allow notifications. If I hit "Allow Notifications", I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. | ||
14 | 13 | ML | Allow | No | Only When App is OpeniPhone 11 PRO | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Notifications". I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. | ||
15 | 13 | Enable | ML | No | NeveriPhone 11 PRO | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Location Access". A pop-up asks if I'd like to allow location access, so I clicked "Allow Once". I am taken to the Settings page, which shows Location: Ask which is correct. If I go back to the app and click "Allow Location Access" and set it to "While Using The App" and turn on notifications, the app shows that I am fully onboarded. | ||
16 | 13 | ML | ML | No | Only once | iPhone 11 PRO | Always | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Notifications". I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. |