本页包含 CTS 17 R1 中引入的 CTS 重要变更。
基础架构改进
测试结果聚合和报告
CTS-V 报告结构(包括 CameraITS)已重构,以支持精细的子测试结果。此增强功能支持并行执行子测试,以缩短总运行时,并支持有针对性地重新运行失败的子测试,而不是重新运行整个模块。
令牌分片
- 修复了启用令牌分片功能的问题,该功能有时无法识别带有 SIM 卡的样本,导致测试运行不正确。
效率提升
CTS 17 包含以下效率改进。
生物识别测试优化
CTS-V 中的生物识别测试套件已重新构建,以合并多个基于时间的密钥测试,并将身份验证提示从 120 个减少到 72 个。
连接和测距现代化
需要标准化 1 米设备设置才能进行准确验证的手动 Presence 测试已替换为完全自动化的测距模块。
WLAN 测试现代化改造
对 WLAN 测试套件的更新包括引入了非同步服务发现 (USD) 测试、将现有权限测试迁移到现代化框架,以及移除了旧版手动连接测试。
多媒体和电信增强功能
引入了安全播放测试,用于验证安全播放功能,确保视频显示正确且帧速率一致安全播放测试设置。这是一项 CTS 验证程序测试,需要使用外围设备播放分析工具。
电信测试自动化
手动电信测试已替换为 CTS-V-HOST 中的 CtsTelecomTests 自动化模块。
CTS 模块
测试模块和测试用例的数量如下:
- 约 1,244 个模块,具体取决于设备类型
- 大约 310 万个测试用例(适用于单个 ABI)
185 个新模块
- CtsAActivityManagerTest
- CtsAlarmAtomHostTestCases
- CtsAlarmAtomHostTestCases[instant]
- CtsAllowlistTestCases
- CtsAllowlistTestCases[instant]
- CtsAngleEnd2EndTestCases
- CtsAnomalyDetectorTests
- CtsAppcompatStateAtomHostTestCases
- CtsAppcompatStateAtomHostTestCases[instant]
- CtsAppExitAtomHostTestCases
- CtsAppExitAtomHostTestCases[instant]
- CtsAppFunctionNoQueryAllPackagesTestCases
- CtsAppFunctionNoQueryAllPackagesTestCases[run-on-clone-profile]
- CtsAppFunctionNoQueryAllPackagesTestCases[run-on-private-profile]
- CtsAppFunctionNoQueryAllPackagesTestCases[run-on-secondary-user]
- CtsAppFunctionNoQueryAllPackagesTestCases[run-on-work-profile]
- CtsAppFunctionsAtomHostTestCases
- CtsAppFunctionsAtomHostTestCases[instant]
- CtsAppHibernationAtomHostTestCases
- CtsAppHibernationAtomHostTestCases[instant]
- CtsAppInteractionTestCases
- CtsAppInteractionTestCases[run-on-clone-profile]
- CtsAppInteractionTestCases[run-on-private-profile]
- CtsAppInteractionTestCases[run-on-secondary-user]
- CtsAppInteractionTestCases[run-on-work-profile]
- CtsAppOpsAtomHostTestCases
- CtsAppOpsAtomHostTestCases[instant]
- CtsAppStartAtomHostTestCases
- CtsAppStartAtomHostTestCases[instant]
- CtsBackportedFixesAtomHostTestCases
- CtsBackportedFixesAtomHostTestCases[instant]
- CtsBatteryCycleAtomHostTestCases
- CtsBatteryCycleAtomHostTestCases[instant]
- CtsBatteryStatsAtomHostTestCases
- CtsBatteryStatsAtomHostTestCases[instant]
- CtsBinderStatsAtomHostTestCases
- CtsBinderStatsAtomHostTestCases[instant]
- CtsBluetoothAtomHostTestCases
- CtsBluetoothAtomHostTestCases[instant]
- CtsConscryptTestCases
- CtsContactsPickerCoreTestCases
- CtsContactsPickerCoreTestCases[run-on-clone-profile]
- CtsContactsPickerCoreTestCases[run-on-private-profile]
- CtsContactsPickerCoreTestCases[run-on-work-profile]
- CtsContactsPickerCoreTestCasesSdk36
- CtsContactsProviderHostTestCases
- CtsContactsProviderSessionTestCases
- CtsContactsProviderTestsStrictSqlCheckSdk37
- CtsContentPccTestCases
- CtsContentRestrictionTestCases
- CtsContentSafetyServiceTestCases
- CtsContextualModeManagerTestCases
- CtsContextualModeManagerTestCases[run-on-clone-profile]
- CtsContextualModeManagerTestCases[run-on-private-profile]
- CtsContextualModeManagerTestCases[run-on-secondary-user]
- CtsContextualModeManagerTestCases[run-on-work-profile]
- CtsCoreGraphicsAtomHostTestCases
- CtsCoreGraphicsAtomHostTestCases[instant]
- CtsCpuAtomHostTestCases
- CtsCpuAtomHostTestCases[instant]
- CtsCredentialsAtomHostTestCases
- CtsCredentialsAtomHostTestCases[instant]
- CtsDevicePowerAtomHostTestCases
- CtsDevicePowerAtomHostTestCases[instant]
- CtsDeviceStateAtomHostTestCases
- CtsDeviceStateAtomHostTestCases[instant]
- CtsDisplayAtomHostTestCases
- CtsDisplayAtomHostTestCases[instant]
- CtsDisplayStaticDeviceStateTestCases
- CtsDisplayStaticDeviceStateTestCases[instant]
- CtsGameManagerAtomHostTestCases
- CtsGameManagerAtomHostTestCases[instant]
- CtsGnssAtomHostTestCases
- CtsGnssAtomHostTestCases[instant]
- CtsGpuTestCases
- CtsGpuTestCases[instant]
- CtsHardwareHealthAtomHostTestCases
- CtsHardwareHealthAtomHostTestCases[instant]
- CtsJobSchedulerAtomHostTestCases
- CtsJobSchedulerAtomHostTestCases[instant]
- CtsLogcatHostTestCases
- CtsMediaAtomHostTestCases
- CtsMediaAtomHostTestCases[instant]
- CtsMediaRouterHostTestCases
- CtsMediaRouterHostTestCases[instant]
- CtsMemoryAtomHostTestCases
- CtsMemoryAtomHostTestCases[instant]
- CtsMemorySafetyAtomHostTestCases
- CtsMemorySafetyAtomHostTestCases[instant]
- CtsMotionCuesTestCases
- CtsMotionCuesTestCases[instant]
- CtsMultisensoryTestCases
- CtsMultisensoryTestCases[instant]
- CtsMultisensoryTestCases[run-on-clone-profile]
- CtsMultisensoryTestCases[run-on-private-profile]
- CtsMultisensoryTestCases[run-on-secondary-user]
- CtsMultisensoryTestCases[run-on-work-profile]
- CtsNativeNdkAllowlistTest
- CtsNativeServiceTest
- CtsNetAtomHostTestCases
- CtsNetAtomHostTestCases[instant]
- CtsNetSecConfigCustomTrustManagerTestCases
- CtsNetSecConfigCustomTrustManagerTestCases[instant]
- CtsNetSecConfigEncryptedClientHelloTestCases
- CtsNetSecConfigEncryptedClientHelloTestCases[instant]
- CtsNetSecEncryptedClientHelloTestCases
- CtsNetSecEncryptedClientHelloTestCases[instant]
- CtsNetTestCasesLocalNetNoPermissions
- CtsNetTestCasesLocalNetNoPermissions[instant]
- CtsNotificationAtomHostTestCases
- CtsNotificationAtomHostTestCases[instant]
- CtsNpuManagerMoblyTestCases
- CtsNpuManagerTestCases
- CtsPackageManagerIsolatedSplitHostTestCases
- CtsPackageManagerSplitHostTestCases
- CtsPccFeatureTests
- CtsPccFeatureTests[run-on-clone-profile]
- CtsPccFeatureTests[run-on-private-profile]
- CtsPccFeatureTests[run-on-secondary-user]
- CtsPccFeatureTests[run-on-work-profile]
- CtsPccProcessTests
- CtsPccSandboxManagerNativeTest
- CtsPccSecurityTestCases
- CtsPerfAtomHostTestCases
- CtsPerfAtomHostTestCases[instant]
- CtsPerfettoAtomHostTestCases
- CtsPerfettoAtomHostTestCases[instant]
- CtsPerformanceHintManagerAtomHostTestCases
- CtsPerformanceHintManagerAtomHostTestCases[instant]
- CtsPermissionStateAtomHostTestCases
- CtsPermissionStateAtomHostTestCases[instant]
- CtsPersonalContextTestCases
- CtsPersonalContextTestCases[run-on-clone-profile]
- CtsPersonalContextTestCases[run-on-private-profile]
- CtsPersonalContextTestCases[run-on-secondary-user]
- CtsPersonalContextTestCases[run-on-work-profile]
- CtsPowerAtomHostTestCases
- CtsPowerAtomHostTestCases[instant]
- CtsPowerManagerAtomHostTestCases
- CtsPowerManagerAtomHostTestCases[instant]
- CtsPowerManagerPccTestCases
- CtsPowerManagerPccTestCases[instant]
- CtsPowerManagerPccTestCases[run-on-work-profile]
- CtsSerialTestCases
- CtsSettingsStatsAtomHostTestCases
- CtsSettingsStatsAtomHostTestCases[instant]
- CtsSharesheetAppLockTestCases
- CtsSizeCompatRestartButtonAtomHostTestCases
- CtsSizeCompatRestartButtonAtomHostTestCases[instant]
- CtsSoundTriggerPccTestCases
- CtsStatsdAtomHostRebootTestCases
- CtsStatsdAtomHostRebootTestCases[instant]
- CtsStopAndKillHostTest
- CtsTelecomModuleTests
- CtsTelephonyAtomHostTestCases
- CtsTelephonyAtomHostTestCases[instant]
- CtsTelephonySatelliteTestCases
- CtsTextClassifierPccTestCases
- CtsTlsAtomHostTestCases
- CtsTlsAtomHostTestCases[instant]
- CtsTrustTokenServiceTestCases
- CtsTrustTokenServiceTestCases[instant]
- CtsUprobeStatsTest
- CtsUsageEventsPccTestCases
- CtsUsbAtomHostTestCases
- CtsUsbAtomHostTestCases[instant]
- CtsUsbManagerTestCases[run-on-clone-profile]
- CtsUsbManagerTestCases[run-on-private-profile]
- CtsUsbManagerTestCases[run-on-secondary-user]
- CtsUsbManagerTestCases[run-on-work-profile]
- CtsUsersAtomHostTestCases
- CtsUsersAtomHostTestCases[instant]
- CtsVibratorAtomHostTestCases
- CtsVibratorAtomHostTestCases[instant]
- CtsVirtualDevicesComputerControlTests
- CtsVoiceInteractionAtomHostTestCases
- CtsVoiceInteractionAtomHostTestCases[instant]
- CtsWifiAtomHostTestCases
- CtsWifiAtomHostTestCases[instant]
- CtsWindowManagerHostTestCases
- MctsVideoTestCases
- MtsWebAppTestCases
- PccServiceNonPccClientTest
- PccServicePccClientTest
- VmMultiTenancyTests.CTS
16 个已移除的模块
- AdsPersonalizationStatusTest
- CtsAppFgsTestCases[instant]
- CtsCameraHeadlessSystemUserTestCases
- CtsCarBuiltinApiHostTestCases
- CtsFgsTimeoutTestCases[instant]
- CtsHealthConnectHostSideDeviceTestCases
- CtsHealthConnectHostTestCases
- CtsInstalledLoadingProgressHostTests
- CtsSandboxedAdIdManagerTests
- CtsSandboxedAppSetIdManagerTests
- CtsSandboxedFledgeManagerTests
- CtsSandboxedMeasurementManagerTests
- CtsSandboxedTopicsManagerTests
- CtsShortFgsTestCases[instant]
- CtsVideoEncodingQualityHostTestCases[instant]
- MctsTextClassifierTestCases
CTS 验证程序 17 项新测试
添加了 36 个新的 CTS-V-HOST 测试用例,包括交互式测试、基于主机的验证程序测试用例
从 7 个模块中添加了 36 项测试
| 模块名称 | 添加了测试用例列表 |
|---|---|
CtsNotificationSizeVerifierHostTest
|
android.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testBitmapUnderLimit_ChangeDisabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testBitmapOverLimit_ChangeEnabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testBitmapUnderLimit_ChangeEnabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testUriOverLimit_ChangeEnabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testUriUnderLimit_ChangeEnabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testBitmapOverLimit_ChangeDisabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testUriOverLimit_ChangeDisabledandroid.app.notificationsizeverifier.cts.NotificationSizeVerifierHostTest
#testUriUnderLimit_ChangeDisabled |
| CtsPermissionInteractiveTestCases |
android.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonColorCustomizationandroid.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonSupportsRtlLayoutandroid.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonPaddingCustomizationandroid.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonIconOnlyandroid.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonShapeMorphsOnPressandroid.permissioninteractive.cts.LocationButtonInteractiveTest#
verifyButtonShapeCustomization |
| CtsSysuiInteractiveTestCases |
android.sysui.cts.ShowPowerMenuInteractiveTest#showPowerMenuandroid.sysui.cts.ShowPowerMenuInteractiveTest#
showPowerMenu_alreadyShowingandroid.sysui.cts.ShowPowerMenuInteractiveTest#
showPowerMenu_multipleCallsInShortTime |
| CtsUsbTypecTestCases |
com.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Cdpcom.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Dcpcom.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#testBc12Sdpcom.google.cts.interactive.usb.typec.CtsUsbTypecTestCases#
testPowerProfileSourceFixed |
| CtsTelecomTest |
CtsTelecomTest#test_call_audio_for_voice_and_voip_callsCtsTelecomTest#test_incall_ui_shows_when_screen_locked |
| CtsWifiConnectionTests |
NetworkRequestTests#test_with_a_specific_ssid_and_bssidNetworkRequestTests#test_with_invalid_credential_in_network_specifierNetworkRequestTests#test_with_pattern_network_specifierNetworkRequestTests#test_with_unavailable_network_specifierNetworkSuggestionTests#test_that_suggestion_modification_in_placeNetworkSuggestionTests#test_with_connection_failureNetworkSuggestionTests#test_with_ssid_and_bssid_specifiedNetworkSuggestionTests#test_with_ssid_and_post_connect_broadcastNetworkSuggestionTests#test_with_ssid_specified |
| CtsWifiUsdTests |
WifiUsdTest#test_active_subscriber_exchangeWifiUsdTest#test_bidirectional_large_message_exchangeWifiUsdTest#test_bidirectional_message_exchangeWifiUsdTest#test_passive_subscriber_exchange |
其他 5 个验证程序部分总共新增了 10 个测试
| 部分 | 添加了测试用例列表 |
|---|---|
AUDIO |
|
CAMERA |
|
FEATURES |
|
MEDIA |
|
SYSUI |
|