Skip to content

Guide For Testers

theweavr edited this page Apr 3, 2017 · 5 revisions

So we have at last approached the first beta and that in itself tells us how much testing needs to be done. Here is a list of things that I think are most important to test before releasing.

Note: This list is not ordered, so pick whatever you see fit. Test report (passed or failed) will be written with the entry alongside the number of times it was tested. One entry has to pass at least 3 tests before it is confirmed as "almost" bug-free.

Note 2: It will appreciated if your report the bugs as separate issues.

Note 3: Contribution to fix these issues is very much welcome.

To help you navigate:

  1. Private Playlists
  2. Last.fm Scrobbling
  3. Song Audio Quality
  4. Prevent Screen Lock
  5. Song Album Art as Lockscreen Wallpaper
  6. Shortcuts
  7. Most Played Songs
  8. Recently Added Songs
  9. Themes
  10. Equalizer
  11. Search
  12. Sort & Filter
  13. Songs Import

Private Playlists

  1. Creation, deletion, renaming of private playlists.
  2. Addition and deletion of multiple songs in a private playlist.
  3. Also see if the private playlists need to be more protected. (That's where you can give opinions! 😆)

Last.fm Scrobbling

  1. Logging in your Last.fm account.
  2. The player scrobbles when the song finishes so listen to a few songs or just skip to the end to test out whether the player is scrobbling or not.
  3. Quality of each scrobble. Meaning to see how the song looks in the Last.fm directory after scrobble.
  4. Your opinion regarding when to scrobble a song is welcome.

Song audio quality

  1. Play a few songs in foreground (with app open on the screen) and then play a few songs in background.
  2. Play a few songs while browsing through heavy pages.
  3. Play a few songs while scrolling (can be any type of scrolling.)

Prevent Screen Lock

  1. Enable this feature and wait for a few minutes to see if it works, then disable it to see if the screen locks or not.
  2. Enable & disable this in quick succession and see if that has any effect.

Song Album Art as Lockscreen Wallpaper

  1. Load a few songs with album arts and play them one after the other. See if the Lockscreen Wallpaper changes or not.
  2. I have noticed a slight delay and flicker of wallpaper when unlocking the phone. Would need you to confirm.
  3. After testing out songs with album arts, test out songs without album arts and see what happens to the lockscreen. Does it revert back to the default wallpaper you picked when enabling this setting?

Shortcuts

  1. Use the shortcuts as frequently as possible and from every page in the player. Note the crashes and report.

Most Played Songs

  1. Play a few songs more than a 2 times and then navigate to "Most Played Songs" section and see if all of them were added.
  2. Your opinion regarding when to increase song play count is also welcome. (Currently its at the very beginning).

Recently Added Songs

  1. This will require you to adjust your phone/PC date a few times. First add a few songs on default date, then increase the date by 4 days and add a few more songs. Navigate to "Recently Added Songs" and see what songs are there.
  2. Currently, history of added songs is kept for upto 3 days, so that's what we are testing. (Your opinion, again, is welcome regarding this.)

Themes

  1. Change the theme a few times and see if you can find any thing that is out of place (or color).

Equalizer

  1. You know what to do.

Search

  1. This is easy to do. Notice the performance, the duplicacy, and lag of the search results returned.

Sort & Filter

  1. Test out each and every property in sort and filter and see how many times it crashes or lags.
  2. Use the jumplist (click on an alphabet or an album-name to see what I am talking about.)

Songs Import

  1. Import songs a few times in large and small quantities. Notices the performance, memory allocation, crash during import, and duplicate songs.
  2. Restart after import and notice the startup time.