Sample App Test Plan
The test plan executed to validate the sample app and the obtained result are provided here as an additional reference. It can be used as an example when developing your own app.
This test plan is divided into four main sections:
i. Environments: List of devices and their operating system versions used in the tests.
ii. Test cases: Table of individual tests with steps and acceptance criteria. These tests make up the test cycles.
iii. Test cycles: Table with executed test cycles. Each test cycle comprises of a group of test cases that must be executed to achieve a certain behavior.
For example, the Test Cycle #1 (Successful Login/Register with Google) includes Test Case #1 (Open Application), Test Case #2 (Register - Authentication with Google) and Test Case #3 (Register - Successful authentication with Google). In this test cycle, the tests #1, #2 and #3 must be executed to test a Successful Login/Register with Google.
iv. Results: Result obtained when executing each test cycle in each of the environments.
Environments
Android Devices
| Device Name | Device Operating System | |
| 1 | Google Pixel 3a | Android version 11 (Beta) |
| 2 | Google Pixel 5 | Android version 11 and higher |
| 3 | Google Pixel 6 | Android version 12 and higher |
| 4 | Motorola G6 Plus | Android version 9 |
| 5 | Samsung S10 | Android version 10 or higher |
| 6 | Samsung S22 | Android vesion 13 and higher |
iOS Devices
| Device Name | Device Operating System | |
| 1 | iPhone 7 | iOS version 13.5 |
| 2 | iPhone 11 | iOS version 13.7 |
| 3 | iPhone 13 | iOS version 16 |
| Device Name | Device Operating System | |
| 1 | Samsung S10 | Android version 10 or higher |
| 2 | Motorola G6 Plus | Android version 9 |
| 3 | Google Pixel 3a | Android version 11 (Beta) |
| 4 | Samsung S22 | Android vesion 13 and higher |
| 5 | Google Pixel 5 | Android version 11 and higher |
| 6 | Google Pixel 6 | Android version 12 and higher |
| 7 | iPhone 7 | iOS version 13.5 |
| 8 | iPhone 11 | iOS version 13.7 |
| 9 | iPhone 13 | iOS version 16 |
Test cases
For each test case, the following information is provided:
- Test Case: The name of the test case, which gives a brief introduction of what the test is about
- Preparation: Prerequisites to be met before executing the test case
- Execution: The steps involved in executing the test case
- Acceptance Criteria: Expected result if the test case is successful
- Image: Wherever applicable, a screenshot illustrating the expected final result
Test Cycles
| Cycle | Tests | |
| 1 | Cycle - Successful and Unsuccessful Login/Register with Google | #1 Open Application #2 Register - Authentication with Google #3 Register - Successful authentication with Google #4 Register - Unsuccessful authentication with Google |
| 2 | Cycle - Successful and Unsuccessful Login/Register with Apple | #1 Open Application #5 Register - Authentication with Apple #6 Register - Successful authentication with Apple #7 Register - Authentication with Apple failed |
| 3 | Cycle - Successful and Unsuccessful Register with Loyalty Program | #1 Open Application #13 Register - Go to Loyalty Program screen #14 Register - Filling register form with valid data #15 Register - Filling form with invalid data #16 Register - Try to submit without filling data |
| 4 | Cycle - Successful and Unsuccessful Register with OAuth Token | #1 Open Application #8 Register - Go to OAuth Token screen #9 Register - Successfully authenticate with Google authentication token #10 Register - Successfully authenticate with Apple authentication token #11 Register - Unsuccessfully OAuth Token authentication because of invalid information #12 Register - Unsuccessfully OAuth Token authentication because of required data not informed |
| 5 | Cycle - Uncheck and check Privacy Settings | #17 User - Go to Account screen #18 User - Uncheck Privacy Settings switch #19 User - Check Privacy Settings switch |
| 6 | Cycle - Uncheck and check Push Notification | #17 User - Go to Account screen #20 User - Uncheck Push Notification switch #21 User - Check Push Notification switch |
| 7 | Cycle - Successfully and unsuccessfully update user | #17 User - Go to Account screen #22 User - Go to update user screen #23 User - Successfully update user #24 User - Unsuccessfully update user because of invalid data #25 User - Unsuccessfully update user because of required data not informed |
| 8 | Cycle - Delete account with success | #17 User - Go to Account screen #26 Account - Delete account #27 Account - Delete account with success |
| 9 | Cycle - Go to Usage Statistics screen | #17 User - Go to Account screen #28 Usage Statistics - Go to Usage Statistics screen |
| 10 | Cycle - Connect and disconnect from network | #29 Network - Connect to the network #30 Network - Disconnect on the network |
| 11 | Cycle - Last Push Notifications | #31 Last Notifications - Go to Last Push Notifications Screen #32 Last Notifications - Back to Account screen |
Results
Test Type | Environment | Test Case | Status | Evidence |
|---|---|---|---|---|
Authentication | Samsung S10 | #1 Cycle - Successful Login/Register with Google | OK | S10 Google Authentication.mov |
#2 Cycle - Successful and Unsuccessful Login/Register with Apple | OK | No video available | ||
#3 Cycle - Successful and Unsuccessful Register with Loyalty Program | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #3 Executed on Samsung S10 - Loyalty Program email | ||
#4 Cycle - Successful and Unsuccessful Register with OAuth Token | OK | S10 oath token update account delete profile delete account .movCycle #4 Executed on Samsung S10 - OAuth Token Authentication | ||
Motorola G6 Plus | #1 Cycle - Successful Login/Register with Google | OK | G6 authentication with google update user delete account.mov G6 authentication with google update user delete account.mov G6 authentication with google update user delete account.mov Cycle #1 Executed on Motorola G6 Plus - Google Authentication | |
#2 Cycle - Successful and Unsuccessful Login/Register with Apple | OK | No video available | ||
#3 Cycle - Successful and Unsuccessful Register with Loyalty Program | OK | G6 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #3 Executed on Motorola G6 Plus - Loyalty Program email | ||
#4 Cycle - Successful and Unsuccessful Register with OAuth Token | OK | G6 Oauth token e last push notification.movCycle #4 Executed on Motorola G6 Plus - OAuth Token Authentication | ||
iPhone 7 | #1 Cycle - Successful Login/Register with Google | OK | iOs - Google Authentication.movCycle #1 Executed on iPhone 7 - Authentication with Google | |
#2 Cycle - Successful and Unsuccessful Login/Register with Apple | OK | No video available | ||
#3 Cycle - Successful and Unsuccessful Register with Loyalty Program | OK | iOs Update User Usage Statistics Delete Account.movCycle #3 Executed on iPhone 7 - Loyalty Program email | ||
#4 Cycle - Successful and Unsuccessful Register with OAuth Token | OK | OAuth token iPhone 7.movCycle #4 Executed on iPhone 7 - Authentication with OAuth token | ||
iPhone 11 | #1 Cycle - Successful Login/Register with Google | OK | iOs 11 - Google, Uncheck check, Update User e Delete Account.movCycle #1 Executed on iPhone 11 - Authentication with Google | |
#2 Cycle - Successful and Unsuccessful Login/Register with Apple | OK | No video available | ||
#3 Cycle - Successful and Unsuccessful Register with Loyalty Program | OK | iOs - Loyalty Program Authentication Email, Check uncheck, Update User, Delete Account.movCycle #3 Executed on iPhone 11 - Authentication Loyalty Program Email | ||
#4 Cycle - Successful and Unsuccessful Register with OAuth Token | OK | iOs - OAuth Token Authentication, Check uncheck, Update user.movCycle #4 Executed on iPhone 11 - Authentication with OAuth Token | ||
Google Pixel 3a | #1 Cycle - Successful Login/Register with Google | OK | Cycle #1 - Rotated.movCycle #1 Executed on Google Pixel 3a - Authentication with Google | |
#2 Cycle - Successful and Unsuccessful Login/Register with Apple | OK | Cycle #2.mp4Cycle #2 Executed on Google Pixel 3a - Authentication with Apple | ||
#3 Cycle - Successful and Unsuccessful Register with Loyalty Program | OK | Cycle #3 - No data filled.mp4Cycle #3 Executed on Google Pixel 3a - Loyalty Program with Empty ValuesCycle #3 - Email.mp4Cycle #3 Executed on Google Pixel 3a - Loyalty Program with Invalid and Valid emailCycle #3 - Opaque id.mp4Cycle #3 Executed on Google Pixel 3a - Loyalty Program with Opaque IdCycle #3 - Phone.mp4Cycle #3 Executed on Google Pixel 3a - Loyalty Program with Valid and Invalid Phone | ||
#4 Cycle - Successful and Unsuccessful Register with OAuth Token | OK | Cycle #4.mp4Cycle #4 Executed on Google Pixel 3a - Authentication with Google OAuth token | ||
Privacy Settings | #5 Cycle - Uncheck and check Privacy Settings | Samsung S10 | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #5 Executed on Samsung S10 |
#5 Cycle - Uncheck and check Privacy Settings | Motorola G6 Plus | OK | G6 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #5 Executed on Motorola G6 Plus | |
#5 Cycle - Uncheck and check Privacy Settings | iPhone 7 | OK | iOs Update User Usage Statistics Delete Account.movCycle #5 Executed on iPhone 7 | |
#5 Cycle - Uncheck and check Privacy Settings | iPhone 11 | OK | iOs 11 - Google, Uncheck check, Update User e Delete Account.movCycle #5 Executed on iPhone 11 - Uncheck and Check Privacy Settings | |
#5 Cycle - Uncheck and check Privacy Settings | Google Pixel 3a | OK | Cycle #5 and #6 - Push Notification and Privacy Settings switches - Rotated.movCycle #5 and #6 Executed on Google Pixel 3a | |
Push Notification | #6 Cycle - Uncheck and check Push Notification | Samsung S10 | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #6 Executed on Samsung S10 |
#6 Cycle - Uncheck and check Push Notification | Motorola G6 Plus | OK | G6 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #6 Executed on Motorola G6 Plus | |
#6 Cycle - Uncheck and check Push Notification | iPhone 7 | OK | iOs Update User Usage Statistics Delete Account.movCycle #6 Executed on iPhone 7 | |
#6 Cycle - Uncheck and check Push Notification | iPhone 11 | OK | iOs 11 - Google, Uncheck check, Update User e Delete Account.movCycle #6 Executed on iPhone 11 - Uncheck and Check Push Notification | |
#6 Cycle - Uncheck and check Push Notification | Google Pixel 3a | OK | Cycle #5 and #6 - Push Notification and Privacy Settings switches - Rotated.movCycle #5 and #6 Executed on Google Pixel 3a | |
User | #7 Cycle - Successfully and unsuccessfully update user | Samsung S10 | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #7 Executed on Samsung S10 |
#7 Cycle - Successfully and unsuccessfully update user | Motorola G6 Plus | OK | G6 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #7 Executed on Motorola G6 Plus | |
#7 Cycle - Successfully and unsuccessfully update user | iPhone 7 | OK | iOs Update User Usage Statistics Delete Account.movCycle #7 Executed on iPhone 7 | |
#7 Cycle - Successfully and unsuccessfully update user | iPhone 11 | OK | iOs 11 - Google, Uncheck check, Update User e Delete Account.movCycle #7 Executed on iPhone 11 - Update User | |
#7 Cycle - Successfully and unsuccessfully update user | Google Pixel 3a | OK | Cycle #7 - Update User Details Rotated.movCycle #7 Executed on Google Pixel 3aUpdate User Details - Loyalty Program with PHONE.mp4A demonstration (Google Pixel 3a) of what occurs when updating user with empty email (Authenticating with Loyalty Program Phone) | |
Account |
Samsung S10 | #8 Cycle - Delete account with success | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #8 Executed on Samsung S10 - With Loyalty Program AuthenticationS10 oath token update account delete profile delete account .movCycle #8 Executed on Samsung S10 - With OAuth Token Authentication |
Motorola G6 Plus | #8 Cycle - Delete account with success | OK | G6 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #8 Executed on Motorola G6 Plus - With Loyalty Program AuthenticationG6 authentication with google update user delete account.movG6 authentication with google update user delete account.mov G6 authentication with google update user delete account.mov G6 authentication with google update user delete account.mov> Cycle #8 Executed on Motorola G6 Plus - With Google Authentication | |
iPhone 7 | #8 Cycle - Delete account with success | OK | iOs Update User Usage Statistics Delete Account.movCycle #8 Executed on iPhone 7 | |
iPhone 11 | #8 Cycle - Delete account with success | OK | iOs 11 - Google, Uncheck check, Update User e Delete Account.movCycle #8 Executed on iPhone 11 - Delete Account | |
Google Pixel 3a | #8 Cycle - Delete account with success | OK | Cycle #8 - Apple Authentication.mp4Delete Profile and Delete Account execution (Apple Authentication) on Google Pixel 3aCycle #8 - Google Authentication.mp4Delete Profile and Delete Account execution (Google Authentication) on Google Pixel 3aCycle #8 - Loyalty Program (Email).mp4Delete Profile and Delete Account execution (Loyalty Program via Email) on Google Pixel 3aCycle #8 - OAuth Authentication.mp4Delete Profile and Delete Account execution (OAuth Token Authentication) on Google Pixel 3a | |
Usage Statistics |
Samsung S10 | #9 Cycle - Go to Usage Statistics screen | OK | S10 loyalty program usage statistics check uncheck os 2 update account delete profile delete account.movCycle #9 Executed on Samsung S10 (with mocked data) |
Motorola G6 Plus | #9 Cycle - Go to Usage Statistics screen | OK | G6 Oauth token e last push notification.movCycle #9 Executed on Motorola G6 Plus (with mocked data) | |
iPhone 7 | #9 Cycle - Go to Usage Statistics screen | OK | iOs Update User Usage Statistics Delete Account.movCycle #9 Executed on iPhone 7 (with mocked data) | |
iPhone 11 | #9 Cycle - Go to Usage Statistics screen | OK | No video available | |
Google Pixel 3a | #9 Cycle - Go to Usage Statistics screen | OK | Cycle #9 - Usage Statistics Rotated.movCycle #9 Executed on Google Pixel 3a | |
Network |
Samsung S10 | #10 Cycle - Connect and disconnect from network | NOT TESTED | --- |
Motorola G6 Plus | #10 Cycle - Connect and disconnect from network | NOT TESTED | G6 Oauth token e last push notification.movCycle #10 Demonstration on Motorola G6 Plus | |
iPhone 7 | #10 Cycle - Connect and disconnect from network | OK | iphone 7 network.movCycle #10 Executed on iPhone 7 | |
iPhone 11 | #10 Cycle - Connect and disconnect from network | OK | iphone 11 network.movCycle #10 Executed on iPhone 11 | |
Google Pixel 3a | #10 Cycle - Connect and disconnect from network | NOT TESTED | Cycle #10 - Network Rotated.movCycle #10 Demonstration on Google Pixel 3a | |
Last Notifications |
Samsung S10 | #11 Cycle - Last Push Notifications | OK | S10 Last Push Notification.movCycle #11 Executed on Samsung S10 - Last Push Notifications screen |
Motorola G6 Plus | #11 Cycle - Last Push Notifications | OK | G6 Oauth token e last push notification.movCycle #11 Executed on Motorola G6 Plus - Last Push Notifications screen | |
iPhone 7 | #11 Cycle - Last Push Notifications | OK | No video available | |
iPhone 11 | #11 Cycle - Last Push Notifications | OK | No video available | |
Google Pixel 3a | #11 Cycle - Last Push Notifications | OK | Cycle #11 - Last Push Notification Rotated.movCycle #11 Executed on Google Pixel 3a |
















