CTS 17 release notes

This page includes the key CTS changes introduced in CTS 17 R1.

Infrastructure improvements

Test result aggregation and reporting

The CTS-V reporting structure, including CameraITS, has been refactored to support granular subtest results. This enhancement enables parallel execution of subtests to reduce total runtime, and focused reruns of failed subtests rather than the full module.

Token sharding

  • Fixed an issue with the enable-token-sharding feature, which sometimes fails to recognize samples with SIM cards, causing tests to run incorrectly.

Efficiency improvements

CTS 17 includes the following efficiency improvements.

Biometrics test optimization

The biometrics test suite in CTS-V has been restructured to combine multiple time-based key tests and the authentication prompts have decreased from 120 to 72.

Connectivity and ranging modernization

The manual Presence test, which requires a standardized 1 m device setup for accurate validation, has been replaced by a fully automated Ranging module.

Wi-Fi test modernization

Updates to the Wi-Fi test suite include the introduction of Unsynchronized Service Discovery (USD) tests, migration of existing Permission tests into a modernized framework, and the removal of legacy manual Connection tests.

Multimedia and telecom enhancements

The Secure Playback test is introduced to validate secure playback capabilities, ensuring correct video display and frame rate consistency Secure Playback Test Setup. This is a CTS Verifier test and requires a Peripheral Playback analysis tool.

Telecom test automation

Manual Telecom tests are replaced by the CtsTelecomTests automated module in CTS-V-HOST.

CTS modules

The number of test modules and test cases are as follows:

  • Approximately 1,244 modules depending on the device type
  • Approximately 3.1 million test cases for single ABI

185 new modules

  • CtsAActivityManagerTest
  • CtsAlarmAtomHostTestCases
  • CtsAlarmAtomHostTestCases[instant]
  • CtsAllowlistTestCases
  • CtsAllowlistTestCases[instant]
  • CtsAngleEnd2EndTestCases
  • CtsAnomalyDetectorTests
  • CtsAppcompatStateAtomHostTestCases
  • CtsAppcompatStateAtomHostTestCases[instant]
  • CtsAppExitAtomHostTestCases
  • CtsAppExitAtomHostTestCases[instant]
  • CtsAppFunctionNoQueryAllPackagesTestCases
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
  • CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
  • CtsAppFunctionsAtomHostTestCases
  • CtsAppFunctionsAtomHostTestCases[instant]
  • CtsAppHibernationAtomHostTestCases
  • CtsAppHibernationAtomHostTestCases[instant]
  • CtsAppInteractionTestCases
  • CtsAppInteractionTestCases[run-on-clone-profile]
  • CtsAppInteractionTestCases[run-on-private-profile]
  • CtsAppInteractionTestCases[run-on-secondary-user]
  • CtsAppInteractionTestCases[run-on-work-profile]
  • CtsAppOpsAtomHostTestCases
  • CtsAppOpsAtomHostTestCases[instant]
  • CtsAppStartAtomHostTestCases
  • CtsAppStartAtomHostTestCases[instant]
  • CtsBackportedFixesAtomHostTestCases
  • CtsBackportedFixesAtomHostTestCases[instant]
  • CtsBatteryCycleAtomHostTestCases
  • CtsBatteryCycleAtomHostTestCases[instant]
  • CtsBatteryStatsAtomHostTestCases
  • CtsBatteryStatsAtomHostTestCases[instant]
  • CtsBinderStatsAtomHostTestCases
  • CtsBinderStatsAtomHostTestCases[instant]
  • CtsBluetoothAtomHostTestCases
  • CtsBluetoothAtomHostTestCases[instant]
  • CtsConscryptTestCases
  • CtsContactsPickerCoreTestCases
  • CtsContactsPickerCoreTestCases[run-on-clone-profile]
  • CtsContactsPickerCoreTestCases[run-on-private-profile]
  • CtsContactsPickerCoreTestCases[run-on-work-profile]
  • CtsContactsPickerCoreTestCasesSdk36
  • CtsContactsProviderHostTestCases
  • CtsContactsProviderSessionTestCases
  • CtsContactsProviderTestsStrictSqlCheckSdk37
  • CtsContentPccTestCases
  • CtsContentRestrictionTestCases
  • CtsContentSafetyServiceTestCases
  • CtsContextualModeManagerTestCases
  • CtsContextualModeManagerTestCases[run-on-clone-profile]
  • CtsContextualModeManagerTestCases[run-on-private-profile]
  • CtsContextualModeManagerTestCases[run-on-secondary-user]
  • CtsContextualModeManagerTestCases[run-on-work-profile]
  • CtsCoreGraphicsAtomHostTestCases
  • CtsCoreGraphicsAtomHostTestCases[instant]
  • CtsCpuAtomHostTestCases
  • CtsCpuAtomHostTestCases[instant]
  • CtsCredentialsAtomHostTestCases
  • CtsCredentialsAtomHostTestCases[instant]
  • CtsDevicePowerAtomHostTestCases
  • CtsDevicePowerAtomHostTestCases[instant]
  • CtsDeviceStateAtomHostTestCases
  • CtsDeviceStateAtomHostTestCases[instant]
  • CtsDisplayAtomHostTestCases
  • CtsDisplayAtomHostTestCases[instant]
  • CtsDisplayStaticDeviceStateTestCases
  • CtsDisplayStaticDeviceStateTestCases[instant]
  • CtsGameManagerAtomHostTestCases
  • CtsGameManagerAtomHostTestCases[instant]
  • CtsGnssAtomHostTestCases
  • CtsGnssAtomHostTestCases[instant]
  • CtsGpuTestCases
  • CtsGpuTestCases[instant]
  • CtsHardwareHealthAtomHostTestCases
  • CtsHardwareHealthAtomHostTestCases[instant]
  • CtsJobSchedulerAtomHostTestCases
  • CtsJobSchedulerAtomHostTestCases[instant]
  • CtsLogcatHostTestCases
  • CtsMediaAtomHostTestCases
  • CtsMediaAtomHostTestCases[instant]
  • CtsMediaRouterHostTestCases
  • CtsMediaRouterHostTestCases[instant]
  • CtsMemoryAtomHostTestCases
  • CtsMemoryAtomHostTestCases[instant]
  • CtsMemorySafetyAtomHostTestCases
  • CtsMemorySafetyAtomHostTestCases[instant]
  • CtsMotionCuesTestCases
  • CtsMotionCuesTestCases[instant]
  • CtsMultisensoryTestCases
  • CtsMultisensoryTestCases[instant]
  • CtsMultisensoryTestCases[run-on-clone-profile]
  • CtsMultisensoryTestCases[run-on-private-profile]
  • CtsMultisensoryTestCases[run-on-secondary-user]
  • CtsMultisensoryTestCases[run-on-work-profile]
  • CtsNativeNdkAllowlistTest
  • CtsNativeServiceTest
  • CtsNetAtomHostTestCases
  • CtsNetAtomHostTestCases[instant]
  • CtsNetSecConfigCustomTrustManagerTestCases
  • CtsNetSecConfigCustomTrustManagerTestCases[instant]
  • CtsNetSecConfigEncryptedClientHelloTestCases
  • CtsNetSecConfigEncryptedClientHelloTestCases[instant]
  • CtsNetSecEncryptedClientHelloTestCases
  • CtsNetSecEncryptedClientHelloTestCases[instant]
  • CtsNetTestCasesLocalNetNoPermissions
  • CtsNetTestCasesLocalNetNoPermissions[instant]
  • CtsNotificationAtomHostTestCases
  • CtsNotificationAtomHostTestCases[instant]
  • CtsNpuManagerMoblyTestCases
  • CtsNpuManagerTestCases
  • CtsPackageManagerIsolatedSplitHostTestCases
  • CtsPackageManagerSplitHostTestCases
  • CtsPccFeatureTests
  • CtsPccFeatureTests[run-on-clone-profile]
  • CtsPccFeatureTests[run-on-private-profile]
  • CtsPccFeatureTests[run-on-secondary-user]
  • CtsPccFeatureTests[run-on-work-profile]
  • CtsPccProcessTests
  • CtsPccSandboxManagerNativeTest
  • CtsPccSecurityTestCases
  • CtsPerfAtomHostTestCases
  • CtsPerfAtomHostTestCases[instant]
  • CtsPerfettoAtomHostTestCases
  • CtsPerfettoAtomHostTestCases[instant]
  • CtsPerformanceHintManagerAtomHostTestCases
  • CtsPerformanceHintManagerAtomHostTestCases[instant]
  • CtsPermissionStateAtomHostTestCases
  • CtsPermissionStateAtomHostTestCases[instant]
  • CtsPersonalContextTestCases
  • CtsPersonalContextTestCases[run-on-clone-profile]
  • CtsPersonalContextTestCases[run-on-private-profile]
  • CtsPersonalContextTestCases[run-on-secondary-user]
  • CtsPersonalContextTestCases[run-on-work-profile]
  • CtsPowerAtomHostTestCases
  • CtsPowerAtomHostTestCases[instant]
  • CtsPowerManagerAtomHostTestCases
  • CtsPowerManagerAtomHostTestCases[instant]
  • CtsPowerManagerPccTestCases
  • CtsPowerManagerPccTestCases[instant]
  • CtsPowerManagerPccTestCases[run-on-work-profile]
  • CtsSerialTestCases
  • CtsSettingsStatsAtomHostTestCases
  • CtsSettingsStatsAtomHostTestCases[instant]
  • CtsSharesheetAppLockTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases
  • CtsSizeCompatRestartButtonAtomHostTestCases[instant]
  • CtsSoundTriggerPccTestCases
  • CtsStatsdAtomHostRebootTestCases
  • CtsStatsdAtomHostRebootTestCases[instant]
  • CtsStopAndKillHostTest
  • CtsTelecomModuleTests
  • CtsTelephonyAtomHostTestCases
  • CtsTelephonyAtomHostTestCases[instant]
  • CtsTelephonySatelliteTestCases
  • CtsTextClassifierPccTestCases
  • CtsTlsAtomHostTestCases
  • CtsTlsAtomHostTestCases[instant]
  • CtsTrustTokenServiceTestCases
  • CtsTrustTokenServiceTestCases[instant]
  • CtsUprobeStatsTest
  • CtsUsageEventsPccTestCases
  • CtsUsbAtomHostTestCases
  • CtsUsbAtomHostTestCases[instant]
  • CtsUsbManagerTestCases[run-on-clone-profile]
  • CtsUsbManagerTestCases[run-on-private-profile]
  • CtsUsbManagerTestCases[run-on-secondary-user]
  • CtsUsbManagerTestCases[run-on-work-profile]
  • CtsUsersAtomHostTestCases
  • CtsUsersAtomHostTestCases[instant]
  • CtsVibratorAtomHostTestCases
  • CtsVibratorAtomHostTestCases[instant]
  • CtsVirtualDevicesComputerControlTests
  • CtsVoiceInteractionAtomHostTestCases
  • CtsVoiceInteractionAtomHostTestCases[instant]
  • CtsWifiAtomHostTestCases
  • CtsWifiAtomHostTestCases[instant]
  • CtsWindowManagerHostTestCases
  • MctsVideoTestCases
  • MtsWebAppTestCases
  • PccServiceNonPccClientTest
  • PccServicePccClientTest
  • VmMultiTenancyTests.CTS

16 removed modules

  • AdsPersonalizationStatusTest
  • CtsAppFgsTestCases[instant]
  • CtsCameraHeadlessSystemUserTestCases
  • CtsCarBuiltinApiHostTestCases
  • CtsFgsTimeoutTestCases[instant]
  • CtsHealthConnectHostSideDeviceTestCases
  • CtsHealthConnectHostTestCases
  • CtsInstalledLoadingProgressHostTests
  • CtsSandboxedAdIdManagerTests
  • CtsSandboxedAppSetIdManagerTests
  • CtsSandboxedFledgeManagerTests
  • CtsSandboxedMeasurementManagerTests
  • CtsSandboxedTopicsManagerTests
  • CtsShortFgsTestCases[instant]
  • CtsVideoEncodingQualityHostTestCases[instant]
  • MctsTextClassifierTestCases

CTS Verifier 17 new tests

36 new CTS-V-HOST test cases have been added including interactive tests, Host-based verifier test cases

36 tests added from 7 modules

Module name Added test cases list
CtsNotificationSizeVerifierHostTest
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapUnderLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriOverLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriUnderLimit_ChangeEnabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testBitmapOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriOverLimit_ChangeDisabled
  • android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest #testUriUnderLimit_ChangeDisabled
    		•
    CtsPermissionInteractiveTestCases
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonColorCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonSupportsRtlLayout
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonPaddingCustomization
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonIconOnly
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonShapeMorphsOnPress
  • android.permissioninteractive.cts.LocationButtonInteractiveTest# verifyButtonShapeCustomization
    		•
    CtsSysuiInteractiveTestCases
  • android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenu
  • android.sysui.cts.ShowPowerMenuInteractiveTest# showPowerMenu_alreadyShowing
  • android.sysui.cts.ShowPowerMenuInteractiveTest# showPowerMenu_multipleCallsInShortTime
    		•
    CtsUsbTypecTestCases
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdp
  • com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases# testPowerProfileSourceFixed
    		•
    CtsTelecomTest
  • CtsTelecomTest#test_call_audio_for_voice_and_voip_calls
  • CtsTelecomTest#test_incall_ui_shows_when_screen_locked
    		•
    CtsWifiConnectionTests
  • NetworkRequestTests#test_with_a_specific_ssid_and_bssid
  • NetworkRequestTests#test_with_invalid_credential_in_network_specifier
  • NetworkRequestTests#test_with_pattern_network_specifier
  • NetworkRequestTests#test_with_unavailable_network_specifier
  • NetworkSuggestionTests#test_that_suggestion_modification_in_place
  • NetworkSuggestionTests#test_with_connection_failure
  • NetworkSuggestionTests#test_with_ssid_and_bssid_specified
  • NetworkSuggestionTests#test_with_ssid_and_post_connect_broadcast
  • NetworkSuggestionTests#test_with_ssid_specified
    		•
    CtsWifiUsdTests
  • WifiUsdTest#test_active_subscriber_exchange
  • WifiUsdTest#test_bidirectional_large_message_exchange
  • WifiUsdTest#test_bidirectional_message_exchange
  • WifiUsdTest#test_passive_subscriber_exchange
    		•

    Total 10 new tests added for other 5 verifier sections

    Section Added test cases list
    AUDIO
  • Audio Communication Latency test
  • Audio Datapaths USB Multichannel test
  • Audio MMAP PCM Offload test
  • Audio Playback Parameters test
  • Audio Workload test
    		•
    CAMERA
  • Camera ITS Feature Combination Test
    		•
    FEATURES
  • EyeDropper Test
    		•
    MEDIA
  • Secure Playback Test
    		•
    SYSUI
  • Pinned Windowing Layer Test
  • Self Movable Tasks Test
    		•