iOS Permissions Testing
This testing was performed after SAF-731, SAF-738 and SAF-759 had been fixed - to test those fixes and cover the space looking for further bugs.
Test Space
iPhone model - we stripe, but assume irrelevant
Location Services disabled on device - not tested for now
iOS version - 12 & 13 - we assume we can ignore sub-versions
Notifications: Enable / Maybe Later. When Enabled: Yes / No
Location: Allow / Maybe Later. When Allowed: Always / When App is Open / Once Only / No
2 x 4 x 8 = 64 possibilities - we won’t test them all.
We'll cover all mainlines (i.e. permissions granted) on both iOS versions - 8 cases
Then a selection of rejection case - 8 more
I’m not able to test closing app (at which point it should ask to uplift permissions from “Allow while using App” to “Always” on Perfecto) - users of real devices like @Jacob Jaffe (Deactivated) and @Jeri Levine may be able to do some testing here.
TC# | iOS version | Notifications | Location | Notification Choice | Location Choice | Device | Notes | On closing app |
---|---|---|---|---|---|---|---|---|
1 | 12 | Enable | Allow | Allow | Allow while using App | iPhone 7+ | Looks good. | Closing app usign Perfecto controls did not trigger a pop-up askign for better location permissions. But I don’t know if this faithfully replicates closing an app via iOS. |
2 | 12 | ML | ML | Allow | Allow while using App | iPhone 7+ | All good. | Not Tested |
3 | 12 | Enable | ML | Allow | Allow while using App | iPhone XS | Seem to have hit a bug. When I finally get to enable location settings, I choose “Only when using the App”. I am then taken into the Settings screen. I have no idea why - all permissions look to be set correctly. SAF-760 | Not Tested |
4 | 12 | ML | Allow | Allow | Allow while using App | iPhone XS | All good. | Not Tested |
5 | 13 | Enable | Allow | Allow | Allow while using App | iPhone 7 | All good. | Not Tested |
6 | 13 | ML | ML | Allow | Allow while using App | iPhone 7 | Once onboarded, asks for location first, then Notifications. | Not Tested |
7 | 13 | Enable | ML | Allow | Allow while using App | iPhone 7 Plus | Seem to have hit a bug. When I finally get to enable location settings, I choose “Only when using the App”. I am then taken into the Settings screen. I have no idea why - all permissions look to be set correctly. SAF-760 |
|
8 | 13 | ML | Allow | Allow | Allow while using App | iPhone 7 | All good | Not Tested |
9 | 12 | Enable | Allow | No | Never | iPhone 6 | All good | Settings: |
10 | 12 | ML | Allow | No | Only Once | iPhone 6 | All good | Settings: Re-open the app and choose no to allow notifications -- now the settings option for notifications appears. If I open the app and allow notifications, it takes me to the iOS settings. If I then allow notifications, I am fully onboarded. |
11 | 12 | Enable | ML | No | Always | iPhone 6 | All good | Settings: |
12 | 12 | ML | ML | No | Never | iPhone 6 | All good | Settings: Re-open the app and allow location sharing while using the app. It asks whether I'd like to allow notifications. Choose "Don't Allow" and you are taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. |
13 | 13 | Enable | Allow | No | Only Once | iPad mini 4 | All good | Settings: Re-open the app and allow location sharing while using the app. It asks whether I'd like to allow notifications. If I hit "Allow Notifications", I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. |
14 | 13 | ML | Allow | No | Only When App is Open | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Notifications". I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. |
15 | 13 | Enable | ML | No | Never | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Location Access". A pop-up asks if I'd like to allow location access, so I clicked "Allow Once". I am taken to the Settings page, which shows Location: Ask which is correct. If I go back to the app and click "Allow Location Access" and set it to "While Using The App" and turn on notifications, the app shows that I am fully onboarded. |
16 | 13 | ML | ML | No | Always | iPad mini 4 | All good | Settings: Re-open the app and click "Allow Notifications". I am taken to the Settings page, which shows that notifications are off. This seems appropriate. Turn on notifications in Settings, and the app shows that I am fully onboarded. |