MOBILE TESTING CHECKLIST

Source: https://hackpad.com/MOBILE-TESTING-CHECKLIST-xmKUV3boruR

Setting up a mobile test lab

• What mobile devices will you use to test?
• What devices are officially supported?
• make a decision based on user stats
• When to use simulators
• When not to use simulators?
• How to charge the devices
• Where to store the devices
• How will you load apps onto multiple devices?

What makes a mobile app or website accessible?

• Does it work with text to speech apps?
• How large can the font be?
• How large can on-screen buttons and navigation be?
• Is there voice activation / control?
• Does it work with text speech apps

What makes a mobile app or website social?

• How easy is to register, log in and remain in the app / site?
• Has the app / website social authentication method support?
• How easy is to share media content, links, or files as well as comments / notes?

What makes a mobile app or website a powerful experience?

• It’s intuitive and easy to learn?
• Can the user increase her/his ability to operate the app / site?
• How easy is to perform a complex flow?
• How simple is a simple flow?

What makes a mobile app secure?

• Can the app be decompiled?
• How secure is the connection to the cloud server, if used? Can the data in transit be intercepted and decoded?
• Is any data and temporary data that the app uses stored securely on the device?
• Is all app data removed when the app is uninstalled?
• Is the app is obfuscated using ProGuard/DexGuard (Android only)
• Does the app authenticate? How?

                    

About The Product 

• Can I download the app?
• Can I download an update?
• Can I update the app when there are multiple updates? What happens if I don’t update?
• What happens when the OS is updated?
• What should it work with? OS. Platforms. Browsers.
• Can I uninstall the app?
• Can I re-install the app?
• After I update, is my data safe?
• Can I downgrade? Should I be able to downgrade?

How is data saved? 

• Does the app write to the SD card?
• What happens if it is filled/full? What happens if it is removed?
• What happens if it is changed?
• Is data saved online (in the cloud)?
• Is the data saved securely?

Functional Testing – What Does It Do? 

• Does the app perform the designed tasks?
• Does the app perform non-designed tasks?
• Is prevention of actions adequate?
• Does the app ask me to turn on services? Location specific. Wifi. Social media.
• Is the user redirected? To full site. From app to web. From web to app. What do errors look like?
• UI – does the UI and design work as intended? Is there room for misunderstanding or error? Is the UI appropriate for the form factor (phone vs tablet, screen size, resolution, existence of hardware buttons / keyboard)
• Is it accessible?
• Does it comply with any standards, good practice or guidelines?
• Is the mobile app consistent with a desktop version if it exists?
• There are a lot of devices available on the market. How we’re choosing the right devices used in our testing process?

Data – Testing What It Processes 

• How does time apply to the app? Based on phone time? Server time? Consider different time zones.
• What does it track and update? Reward points? Friends. Purchases. Check-ins
• Does it sync?
• Web Services calls made in mobile app (how to debug the requests)
• Does it update?
• What happens when it can’t sync or update?
• Is there consistency between web and mobile?
• What clues can analytics provide?
• History – how are things saved? User details? Data?
• Data input / output – what goes in and out. Locations. Preferences. Friends. Contacts. Languages. Files. Size. Media.

• Offline

• Connected but with no Internet connectivity (e.g. have WiFi connection to router, but Internet connection is down)

• Connecting through a paywall and haven’t yet authenticated e.g. Wifi in Starbucks, local pub etc

• Web filtering rejected the request

Platform – What Does It Depend On?

• Device settings. Default settings and non-default settings.
• What permissions does the app need? Are they appropriate? On platforms that prompt for some permissions (e.g. Contacts on iOS), does the app handle rejection well?
• What tablet device is being used? What version of hardware or software?
• On app store – Submission requirements. User guides. Development specs 3G / Wifi – Reliability. Strength. Availability. Hotspots. Dead spots.
• Content – Text size. Content adjustment. Responsive design.
• UI – Touchscreen gestures – Swipe. Zoom. Pinch. Multi touch. Shake. Orientation.
• Peripherals – Keyboards. Mifi devices. BT peripherals, iBeacon, Syncing Peripherals
• Software – GPS (Location Services). Email. Standard /pre-installed Software? Multi-tasking / Switching between apps
• NFC
• Use of camera
• Long usage tests
• Affect on battery life
• Running when the device is locked

Operations – How is it used?

• Connectivity
• Moving about
• None
• Wifi
• 3G
• 4G
• Intermittent
• Airplane mode
• NFC
• Through a proxy

Interruptions 

• Phone calls
• Text messages
• App notifications
• Battery
• Forced updates
• Voicemail
• Locking and unlocking the screen
• Music playing while using the app
• MAM/MDM solution running on the device
• Out of memory (general performance interruptions)

Rumors / Social Proof

• What are people saying about it?
• App reviews
• App ratings / comments
• Comments on the (social) web
• Similar applications