CompatibilityTestSuite » History » Version 11
Wolfgang Wiedmeyer, 04/26/2017 11:44 PM
local links for Redmine urls
| 1 | 11 | Wolfgang Wiedmeyer | Instructions to run and collect results of the android "Compatibility Test Suite":https://source.android.com/compatibility/cts/setup.html for [[ReplicantStatus#Replicant-42|Replicant 4.2]] |
|---|---|---|---|
| 2 | 1 | Loic Dachary | |
| 3 | h1. Installation |
||
| 4 | |||
| 5 | * On a newly installed Ubuntu 14.04 |
||
| 6 | 3 | Loic Dachary | * Install the dependencies |
| 7 | ** apt-get update |
||
| 8 | 4 | Loic Dachary | ** apt-get install -y android-tools-adb openjdk-6-jdk wget unzip |
| 9 | 1 | Loic Dachary | * Install the "pre-built CTS":https://source.android.com/compatibility/cts/downloads.html (or "build it from source":https://source.android.com/compatibility/cts/development.html#building-and-running-cts) |
| 10 | ** wget https://dl.google.com/dl/android/cts/android-cts-4.2_r4-linux_x86-arm.zip ; unzip android-cts-4.2_r4-linux_x86-arm.zip |
||
| 11 | ** wget https://dl.google.com/dl/android/cts/android-cts-verifier-4.2_r5-linux_x86-arm.zip ; unzip android-cts-verifier-4.2_r5-linux_x86-arm.zip |
||
| 12 | ** wget https://dl.google.com/dl/android/cts/android-cts-media-1.2.zip ; unzip android-cts-media-1.2.zip |
||
| 13 | 3 | Loic Dachary | |
| 14 | 1 | Loic Dachary | h1. Device preparation |
| 15 | |||
| 16 | * Connect the Replicant 4.2 device to USB and verify *adb* sees it |
||
| 17 | <pre> |
||
| 18 | # adb devices |
||
| 19 | List of devices attached |
||
| 20 | 00090ad763a48f device |
||
| 21 | 4df1066d14d15fbd device |
||
| 22 | </pre> |
||
| 23 | * Configure the device (adapted from https://source.android.com/compatibility/cts/setup.html#config_device, not including Wifi, GPS, bluetooth since they are not supported) |
||
| 24 | ** Factory data reset the device: *Settings > Backup & reset > Factory data reset* |
||
| 25 | ** Set your device's language to English (United States) from: *Settings > Language & input > Language* |
||
| 26 | ** Make sure no lock pattern or password is set on the device: *Settings > Security > Screen lock > None* |
||
| 27 | 5 | Loic Dachary | ** Make sure no PIN lock is set on the device: *Settings > Security > Set up SIM card lock > Lock SIM card > unset* (only shows if there is a SIM card in the phone) |
| 28 | 1 | Loic Dachary | ** Select: *Settings > Developer options > Stay Awake > On* |
| 29 | ** Verify *Settings > Developer options > Verify apps over USB* is dimmed and cannot be changed, meaning there is no application to verify apps over USB which is what CTS needs. |
||
| 30 | 10 | Loic Dachary | ** Connect the desktop machine that will be used to test the device with a USB cable. The system shows a dialog asking whether to accept an RSA key that allows debugging through this computer. Select Allow USB debugging. Tick the "Always allow" checkbox. |
| 31 | 1 | Loic Dachary | ** Install and configure helper apps on the device: |
| 32 | *** adb install -r android-cts/repository/testcases/CtsDelegatingAccessibilityService.apk |
||
| 33 | *** On the device, enable: *Settings > Accessibility > Accessibility > Delegating Accessibility Service* |
||
| 34 | ** Copy the CTS media files to the device as follows: |
||
| 35 | <pre> |
||
| 36 | # adb devices |
||
| 37 | List of devices attached |
||
| 38 | 00090ad763a48f device |
||
| 39 | 4df1066d14d15fbd device |
||
| 40 | # cd android-cts-media-1.2 |
||
| 41 | # ./copy_media.sh all -s 00090ad763a48f |
||
| 42 | </pre> |
||
| 43 | |||
| 44 | h1. Running CTS |
||
| 45 | |||
| 46 | It runs in the background and takes about 8 hours. It will display results as they become available. See "the usage documentation":https://source.android.com/compatibility/cts/run.html#using-cts-v1 for more information. |
||
| 47 | |||
| 48 | <pre> |
||
| 49 | # ./android-cts/tools/cts-tradefed |
||
| 50 | 9 | Loic Dachary | cts-tf > run cts --plan CTS --disable-reboot |
| 51 | 1 | Loic Dachary | </pre> |
| 52 | 2 | Loic Dachary | |
| 53 | 1 | Loic Dachary | The test results are in *./android-cts/repository/results/* and the logs in *./android-cts/repository/logs/* |
| 54 | 9 | Loic Dachary | |
| 55 | 11 | Wolfgang Wiedmeyer | Note: the **--disable-reboot** is necessary because of a "cm-10.1.3 bug":/issues/1775 |