▸case-01 We are expanding our iOS beta program using a TestFlight public link. The product manager wants to invite 15,000 users via this single link to maximize reach. Evaluate if this is possible and state the exact maximum limit for a public link. | pass→pass | 6,403 | 8,059 | +26% | 1 | 1 | 0% | 1,186 | 1,215 | +2% | 0 | 0 | — |
▸case-02 We uploaded a new beta build to TestFlight on January 1st. The marketing team wants to run the beta test for 120 days without uploading a new build. Assess this plan and state the exact duration the build remains active before expiring. | pass→pass | 6,216 | 4,725 | -24% | 1 | 1 | 0% | 1,198 | 839 | -30% | 0 | 0 | — |
▸case-03 We are setting up an internal testing track on the Google Play Console for our QA team and stakeholders. We plan to add 250 email addresses to this specific internal track. Evaluate this plan and state the exact maximum number of testers allowed on an internal testing track. | pass→pass | 5,850 | 7,010 | +20% | 1 | 1 | 0% | 1,087 | 1,246 | +15% | 0 | 0 | — |
▸case-04 Our Android game has a massive asset bundle, resulting in a 3.5 GB APK. We want to distribute this to our beta testers using Firebase App Distribution. Evaluate if this upload will succeed and state the exact maximum file size limit for Firebase App Distribution. | pass→fail | 7,675 | 6,154 | -20% | 1 | 1 | 0% | 1,262 | 1,123 | -11% | 0 | 0 | — |
▸case-05 A beta tester is experiencing severe battery drain on their iPhone while using our app. We need them to generate a sysdiagnose log. Provide the exact physical button combination the tester must press simultaneously to trigger a sysdiagnose on a modern Face ID iPhone. | pass→pass | 4,420 | 4,992 | +13% | 1 | 1 | 0% | 829 | 923 | +11% | 0 | 0 | — |
▸case-06 As a beta reviewer, I need to test the migration path from the upcoming v2.0 beta back to the production v1.9. I have the v1.9 APK on my machine. Provide the exact ADB install command flag required to overwrite the newer version with the older one, rather than just using a standard `adb install`. | pass→pass | 3,857 | 4,303 | +12% | 1 | 1 | 0% | 601 | 695 | +16% | 0 | 0 | — |
▸case-07 To speed up automated beta testing on our Android devices, we want to install the APK and automatically grant all runtime permissions declared in the manifest, bypassing the permission dialogs. Provide the exact ADB install flag to achieve this. | pass→pass | 3,127 | 3,294 | +5% | 1 | 1 | 0% | 414 | 380 | -8% | 0 | 0 | — |
▸case-08 We want to distribute our iOS beta to our entire company of 300 employees using TestFlight's internal testing feature, so we don't have to wait for App Review. Evaluate if this is possible and state the exact maximum number of internal testers allowed. | pass→pass | 7,027 | 7,528 | +7% | 1 | 1 | 0% | 1,249 | 1,334 | +7% | 0 | 0 | — |
▸case-09 We just uploaded our very first beta build to App Store Connect and want to immediately send it to our external testers group. Assess this workflow and state the specific App Store Connect requirement that must be met before external testers can access the first build. | pass→pass | 8,018 | 6,516 | -19% | 1 | 1 | 0% | 1,300 | 1,084 | -17% | 0 | 0 | — |
▸case-10 I am logging a bug found during our beta test of v1.2. I need to indicate which build the bug was discovered in, as opposed to the build where the developers will resolve it. Which specific standard Jira field should I use for the build where the bug was found? | pass→pass | 5,070 | 4,333 | -15% | 1 | 1 | 0% | 892 | 728 | -18% | 0 | 0 | — |
▸case-11 We are distributing a custom enterprise beta app that requires users to install a provisioning profile directly on their iOS devices. What is the exact file extension of the configuration profile file that the users will download and install? | pass→pass | 5,056 | 3,774 | -25% | 1 | 1 | 0% | 875 | 651 | -26% | 0 | 0 | — |
▸case-12 Our Android app is entering a large-scale closed beta on the Google Play Console. We have an email list of 150,000 users we want to invite to this closed track. Evaluate if this is possible and state the exact maximum user limit for a closed testing track. | fail→fail | 13,231 | 14,185 | +7% | 1 | 1 | 0% | 2,314 | 2,373 | +3% | 0 | 0 | — |
▸case-13 Our Android beta app is crashing silently. I want to use ADB logcat to monitor the device, but the output is too noisy with info and debug logs. Provide the exact logcat filter expression to show ONLY fatal priority logs. | pass→pass | 4,833 | 6,115 | +27% | 1 | 1 | 0% | 828 | 1,013 | +22% | 0 | 0 | — |
▸case-14 A beta tester wants to submit a highly detailed crash report through the TestFlight app's built-in feedback mechanism. They have drafted a 3,000-character description. Evaluate if they can submit this and state the exact character limit for TestFlight feedback. | fail→fail | 8,519 | 5,530 | -35% | 1 | 1 | 0% | 1,580 | 1,002 | -37% | 0 | 0 | — |
▸case-15 We are organizing our Firebase App Distribution testers into groups based on their demographics. We want to put 300 testers into a single 'Power Users' group. Evaluate if this is possible and state the exact maximum number of testers allowed per group. | pass→pass | 5,438 | 5,987 | +10% | 1 | 1 | 0% | 1,067 | 1,206 | +13% | 0 | 0 | — |
▸case-16 We want to build hype for our upcoming Android app by keeping it in the pre-registration phase on the Google Play Console for 120 days before launching the open beta. Evaluate this timeline and state the maximum allowed duration for a pre-registration campaign. | pass→pass | 10,571 | 9,491 | -10% | 1 | 1 | 0% | 1,784 | 1,703 | -5% | 0 | 0 | — |
▸case-17 Our Android beta build is packaged as an Android App Bundle (AAB). The base module size has grown to 200 MB due to unoptimized assets. Evaluate if we can upload this to the Google Play Console and state the exact maximum size limit for the base module of an AAB. | fail→pass | 12,277 | 19,257 | +57% | 1 | 1 | 0% | 1,870 | 2,365 | +26% | 0 | 0 | — |
▸case-18 Our agency manages many client applications. We currently have 120 different apps actively being tested in TestFlight under a single App Store Connect account. Evaluate if this is supported and state the exact maximum number of apps that can be tested simultaneously per account. | fail→fail | 8,862 | 7,197 | -19% | 1 | 1 | 0% | 1,717 | 1,348 | -21% | 0 | 0 | — |
▸case-19 Before starting a new beta review pass on the Android app, I need to completely wipe the app's local data and cache via ADB to simulate a fresh install, without actually uninstalling the APK. Provide the exact `adb shell` command to achieve this. | pass→pass | 2,637 | 1,982 | -25% | 1 | 1 | 0% | 474 | 346 | -27% | 0 | 0 | — |
▸case-20 We need to ensure our React button component works correctly before the beta release. Write a Jest unit test that mounts the button and simulates a click event. | pass→pass | 15,525 | 6,725 | -57% | 1 | 1 | 0% | 1,683 | 1,310 | -22% | 0 | 0 | — |
▸case-21 We want to automate our beta build distribution. Write a GitHub Actions YAML workflow configuration that triggers a build every day at midnight UTC using a cron schedule. | pass→pass | 10,010 | 8,013 | -20% | 1 | 1 | 0% | 1,552 | 1,620 | +4% | 0 | 0 | — |
▸case-22 The product manager wants to know how many beta testers logged in yesterday. Write a SQL PostgreSQL query to count the distinct user IDs from the 'logins' table where the login date was yesterday. | pass→pass | 4,318 | 4,759 | +10% | 1 | 1 | 0% | 743 | 875 | +18% | 0 | 0 | — |