Skip to content

test(oauth2): Assert audit records of token grants - #1420

Merged
gtema merged 1 commit into
mainfrom
claude/audit-1325-tests
Oct 6, 2026
Merged

test(oauth2): Assert audit records of token grants#1420
gtema merged 1 commit into
mainfrom
claude/audit-1325-tests

Conversation

@gtema

@gtema gtema commented Oct 5, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Summary

The client_credentials and refresh_token handler tests did not check the audit records the handlers emit. They now assert:

  • client_credentials success: one perimeter authenticate record with outcome success.
  • client_credentials wrong secret: one perimeter authenticate record with outcome failure and an unknown initiator.
  • refresh_token reuse: one critical-channel oauth2/refresh_reuse_detected record with outcome failure.

Part of #1325

@gtema
test(oauth2): Assert audit records of token grants
e6644d0 
The client_credentials and refresh_token handler tests did not check
the audit records the handlers emit. Assert the perimeter success and
failure records of client_credentials, and the critical record written
when a refresh token reuse is detected.

Refs #1325

Signed-off-by: Artem Goncharov <artem.goncharov@gmail.com>
@gtema gtema self-assigned this Oct 5, 2026
@gtema gtema mentioned this pull request Oct 5, 2026
Closed
@github-actions

github-actions Bot commented Oct 5, 2026

Copy link
Copy Markdown

🦢 Load Test Results

Goose Attack Report

Plan Overview

Action Started Stopped Elapsed Users
Increasing 26-10-05 19:06:23 26-10-05 19:06:45 00:00:22 0 → 45
Maintaining 26-10-05 19:06:45 26-10-05 19:07:15 00:00:30 45
Decreasing 26-10-05 19:07:15 26-10-05 19:07:16 00:00:01 0 ← 45

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE DELETE /v3/auth/tokens 42 0 585.93 395 749 1.40 0.00
DELETE DELETE /v3/projects/:id (teardown) 1 0 108.00 108 108 0.03 0.00
DELETE DELETE /v3/roles/:id (teardown) 1 0 249.00 249 249 0.03 0.00
DELETE DELETE /v3/users/:id (teardown) 2 0 166.00 142 190 0.07 0.00
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 1 0 143.00 143 143 0.03 0.00
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 1 0 61.00 61 61 0.03 0.00
GET 565 0 620.76 239 859 18.83 0.00
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 2032 2032 14.42 1 779 67.73 67.73
GET GET /v3/auth/tokens (validate new) 42 0 571.48 443 707 1.40 0.00
GET GET /v3/auth/tokens (validate revoked) 42 0 534.60 94 690 1.40 0.00
GET GET /v3/projects/:id 53 0 582.38 447 678 1.77 0.00
GET GET /v3/projects/:id (catalog) 77 0 587.39 359 732 2.57 0.00
GET GET /v3/role_assignments 39 0 600.54 494 720 1.30 0.00
GET GET /v3/role_assignments?role.id 40 0 588.72 464 719 1.33 0.00
GET GET /v3/role_assignments?scope.domain.id 40 0 536.97 379 657 1.33 0.00
GET GET /v3/role_assignments?user.id 40 0 564.30 409 716 1.33 0.00
GET GET /v3/roles 104 0 583.11 422 717 3.47 0.00
GET GET /v3/roles/:id 52 0 585.46 442 727 1.73 0.00
GET GET /v3/users/:id 100 0 611.95 360 833 3.33 0.00
GET GET /v3/users/:id (catalog) 99 0 612.34 291 755 3.30 0.00
GET GET /v4/api-keys 25 0 569.84 485 732 0.83 0.00
GET GET /v4/api-keys/:client_id 25 0 649.48 495 778 0.83 0.00
GET GET /v4/mappings/rulesets 26 0 579.00 492 704 0.87 0.00
GET GET /v4/mappings/rulesets/:mapping_id 27 0 570.89 455 699 0.90 0.00
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 851 0 52.81 9 206 28.37 0.00
GET GET /v4/oauth2/:domain_id/clients 27 0 580.89 439 737 0.90 0.00
GET GET /v4/oauth2/:domain_id/clients/:provider_id 26 0 567.88 405 688 0.87 0.00
GET GET /v4/oauth2/:domain_id/jwks 852 0 52.39 8 171 28.40 0.00
GET GET /v4/scim_realms 17 0 574.12 461 644 0.57 0.00
GET GET /v4/scim_realms/:domain_id/:provider_id 17 0 577.65 486 737 0.57 0.00
POST POST /v3/auth/tokens 39 0 540.18 415 628 1.30 0.00
POST POST /v3/auth/tokens (password, invalid) 36 0 874.22 541 1187 1.20 0.00
POST POST /v3/auth/tokens (password, project-scoped) 56 0 1178.70 731 1804 1.87 0.00
POST POST /v3/auth/tokens (password, unscoped) 57 0 1007.74 538 1548 1.90 0.00
POST POST /v3/auth/tokens (rescope to system) 93 0 656.37 383 829 3.10 0.00
POST POST /v3/auth/tokens (rescope, invalid project) 56 0 547.14 429 691 1.87 0.00
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 51 0 1225.76 748 1801 1.70 0.00
POST POST /v4/api-keys/:client_id/revoke (teardown) 1 0 179.00 179 179 0.03 0.00
PUT PUT /v4/scim_realms/:domain_id/:provider_id 17 0 633.18 539 803 0.57 0.00
Aggregated 5672 2032 242.19 1 1804 189.07 67.73

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE DELETE /v3/auth/tokens 600 600 600 700 700 700 700 700
DELETE DELETE /v3/projects/:id (teardown) 108 108 108 108 108 108 108 108
DELETE DELETE /v3/roles/:id (teardown) 249 249 249 249 249 249 249 249
DELETE DELETE /v3/users/:id (teardown) 142 142 142 190 190 190 190 190
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 143 143 143 143 143 143 143 143
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 61 61 61 61 61 61 61 61
GET 600 600 700 700 700 800 800 859
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 7 8 10 12 17 23 360 779
GET GET /v3/auth/tokens (validate new) 600 600 600 600 700 700 700 700
GET GET /v3/auth/tokens (validate revoked) 600 600 600 600 690 690 690 690
GET GET /v3/projects/:id 600 600 600 600 678 678 678 678
GET GET /v3/projects/:id (catalog) 600 600 600 600 700 700 700 700
GET GET /v3/role_assignments 600 600 600 600 700 700 700 700
GET GET /v3/role_assignments?role.id 600 600 600 700 700 700 700 700
GET GET /v3/role_assignments?scope.domain.id 500 600 600 600 600 600 657 657
GET GET /v3/role_assignments?user.id 600 600 600 600 700 700 700 700
GET GET /v3/roles 600 600 600 600 700 700 700 700
GET GET /v3/roles/:id 600 600 600 600 700 700 700 700
GET GET /v3/users/:id 600 600 700 700 700 700 800 800
GET GET /v3/users/:id (catalog) 600 600 700 700 700 700 700 755
GET GET /v4/api-keys 600 600 600 600 600 700 700 700
GET GET /v4/api-keys/:client_id 600 700 700 700 700 778 778 778
GET GET /v4/mappings/rulesets 600 600 600 600 600 700 700 700
GET GET /v4/mappings/rulesets/:mapping_id 600 600 600 600 600 699 699 699
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 46 53 64 75 89 110 140 206
GET GET /v4/oauth2/:domain_id/clients 600 600 600 600 700 700 700 700
GET GET /v4/oauth2/:domain_id/clients/:provider_id 600 600 600 600 688 688 688 688
GET GET /v4/oauth2/:domain_id/jwks 45 53 63 73 91 100 130 170
GET GET /v4/scim_realms 600 600 600 600 600 600 600 600
GET GET /v4/scim_realms/:domain_id/:provider_id 600 600 600 600 700 700 700 700
POST POST /v3/auth/tokens 500 600 600 600 600 600 600 600
POST POST /v3/auth/tokens (password, invalid) 900 900 1,000 1,000 1,000 1,000 1,000 1,000
POST POST /v3/auth/tokens (password, project-scoped) 1,000 1,000 1,000 1,000 1,000 1,804 1,804 1,804
POST POST /v3/auth/tokens (password, unscoped) 1,000 1,000 1,000 1,000 1,000 1,000 1,000 1,548
POST POST /v3/auth/tokens (rescope to system) 700 700 700 700 800 800 800 800
POST POST /v3/auth/tokens (rescope, invalid project) 500 600 600 600 600 691 691 691
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 1,000 1,000 1,000 1,000 1,000 1,801 1,801 1,801
POST POST /v4/api-keys/:client_id/revoke (teardown) 179 179 179 179 179 179 179 179
PUT PUT /v4/scim_realms/:domain_id/:provider_id 600 600 700 700 700 700 800 800
Aggregated 45 77 500 600 700 700 1,000 1,804

Status Code Metrics

Method Name Status Codes
DELETE DELETE /v3/auth/tokens 42 [204]
DELETE DELETE /v3/projects/:id (teardown) 1 [204]
DELETE DELETE /v3/roles/:id (teardown) 1 [204]
DELETE DELETE /v3/users/:id (teardown) 2 [204]
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 1 [204]
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 1 [204]
GET 565 [200]
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 31 [401], 2,001 [429]
GET GET /v3/auth/tokens (validate new) 42 [200]
GET GET /v3/auth/tokens (validate revoked) 42 [404]
GET GET /v3/projects/:id 53 [200]
GET GET /v3/projects/:id (catalog) 77 [200]
GET GET /v3/role_assignments 39 [200]
GET GET /v3/role_assignments?role.id 40 [200]
GET GET /v3/role_assignments?scope.domain.id 40 [200]
GET GET /v3/role_assignments?user.id 40 [200]
GET GET /v3/roles 104 [200]
GET GET /v3/roles/:id 52 [200]
GET GET /v3/users/:id 100 [200]
GET GET /v3/users/:id (catalog) 99 [200]
GET GET /v4/api-keys 25 [200]
GET GET /v4/api-keys/:client_id 25 [200]
GET GET /v4/mappings/rulesets 26 [200]
GET GET /v4/mappings/rulesets/:mapping_id 27 [200]
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 851 [200]
GET GET /v4/oauth2/:domain_id/clients 27 [200]
GET GET /v4/oauth2/:domain_id/clients/:provider_id 26 [200]
GET GET /v4/oauth2/:domain_id/jwks 852 [200]
GET GET /v4/scim_realms 17 [200]
GET GET /v4/scim_realms/:domain_id/:provider_id 17 [200]
POST POST /v3/auth/tokens 39 [201]
POST POST /v3/auth/tokens (password, invalid) 36 [401]
POST POST /v3/auth/tokens (password, project-scoped) 56 [201]
POST POST /v3/auth/tokens (password, unscoped) 57 [201]
POST POST /v3/auth/tokens (rescope to system) 93 [201]
POST POST /v3/auth/tokens (rescope, invalid project) 56 [401]
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 51 [201]
POST POST /v4/api-keys/:client_id/revoke (teardown) 1 [200]
PUT PUT /v4/scim_realms/:domain_id/:provider_id 17 [200]
Aggregated 2,001 [429], 3,162 [200], 42 [404], 123 [401], 296 [201], 48 [204]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
ReadHeavy
0.0 0 0 0.00 0 0 0.00 0.00
0.1 101 0 631.10 448 829 3.37 0.00
0.2 101 0 590.92 379 753 3.37 0.00
0.3 100 0 585.89 239 739 3.33 0.00
TokenLifecycle
1.0 0 0 0.00 0 0 0.00 0.00
1.1 42 0 2239.43 1703 2510 1.40 0.00
ValidateToken
2.0 0 0 0.00 0 0 0.00 0.00
2.1 87 0 706.24 533 859 2.90 0.00
UserCRUD
3.0 0 0 0.00 0 0 0.00 0.00
3.1 0 0 0.00 0 0 0.00 0.00
3.2 100 0 612.02 360 833 3.33 0.00
3.3 2 0 166.00 142 190 0.07 0.00
ProjectCRUD
4.0 0 0 0.00 0 0 0.00 0.00
4.1 0 0 0.00 0 0 0.00 0.00
4.2 53 0 582.42 447 678 1.77 0.00
4.3 1 0 108.00 108 108 0.03 0.00
RoleCRUD
5.0 0 0 0.00 0 0 0.00 0.00
5.1 0 0 0.00 0 0 0.00 0.00
5.2 52 0 585.52 442 727 1.73 0.00
5.3 1 0 249.00 249 249 0.03 0.00
RoleList
6.0 0 0 0.00 0 0 0.00 0.00
6.1 104 0 583.15 422 717 3.47 0.00
RoleAssignmentList
7.0 0 0 0.00 0 0 0.00 0.00
7.1 39 0 600.62 494 720 1.30 0.00
7.2 40 0 564.35 409 716 1.33 0.00
7.3 40 0 537.03 379 657 1.33 0.00
7.4 40 0 588.72 464 719 1.33 0.00
UserRead
8.0 0 0 0.00 0 0 0.00 0.00
8.1 99 0 622.45 380 819 3.30 0.00
8.2 99 0 612.37 291 755 3.30 0.00
ProjectRead
9.0 0 0 0.00 0 0 0.00 0.00
9.1 77 0 593.13 396 754 2.57 0.00
9.2 77 0 587.43 360 732 2.57 0.00
PasswordAuth
10.0 57 0 1007.82 538 1548 1.90 0.00
10.1 56 0 1178.80 731 1805 1.87 0.00
PasswordAuthNegative
11.0 36 0 874.28 541 1187 1.20 0.00
Rescope
12.0 0 0 0.00 0 0 0.00 0.00
12.1 93 0 656.40 383 829 3.10 0.00
RescopeNegative
13.0 0 0 0.00 0 0 0.00 0.00
13.1 56 0 547.16 429 691 1.87 0.00
SystemScopeAuth
14.0 51 0 1225.88 748 1802 1.70 0.00
ApiKeyCRUD
15.0 0 0 0.00 0 0 0.00 0.00
15.1 0 0 0.00 0 0 0.00 0.00
15.2 25 0 649.64 495 778 0.83 0.00
15.3 25 0 569.88 485 732 0.83 0.00
15.4 1 0 179.00 179 179 0.03 0.00
MappingCRUD
16.0 0 0 0.00 0 0 0.00 0.00
16.1 0 0 0.00 0 0 0.00 0.00
16.2 27 0 570.96 455 699 0.90 0.00
16.3 26 0 579.04 492 704 0.87 0.00
16.4 1 0 143.00 143 143 0.03 0.00
OAuth2ClientCRUD
17.0 0 0 0.00 0 0 0.00 0.00
17.1 0 0 0.00 0 0 0.00 0.00
17.2 26 0 567.92 405 688 0.87 0.00
17.3 27 0 580.89 439 737 0.90 0.00
17.4 1 0 85.00 85 85 0.03 0.00
OAuth2Discovery
18.0 852 0 52.42 8 171 28.40 0.00
18.1 851 0 52.83 9 206 28.37 0.00
ScimRealmRead
19.0 0 0 0.00 0 0 0.00 0.00
19.1 17 0 577.65 486 737 0.57 0.00
19.2 17 0 574.18 461 644 0.57 0.00
19.3 17 0 633.18 539 803 0.57 0.00
ScimSync
20.0 0 0 0.00 0 0 0.00 0.00
20.1 0 0 0.00 0 0 0.00 0.00
20.2 0 0 0.00 0 0 0.00 0.00
20.3 2032 0 14.44 1 780 67.73 0.00
20.4 2031 0 0.00 0 2 67.70 0.00
20.5 2031 0 0.00 0 0 67.70 0.00
20.6 1 0 0.00 0 0 0.03 0.00
Aggregated 9612 0 142.91 1 2510 320.40 0.00

Scenario Metrics

Transaction # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
ReadHeavy 6 98 1817.79 1524 2143 3.27 16.33
TokenLifecycle 3 39 2266.72 1995 2510 1.30 13.00
ValidateToken 2 85 707.78 533 859 2.83 42.50
UserCRUD 2 98 616.05 470 833 3.27 49.00
ProjectCRUD 1 52 584.75 447 678 1.73 52.00
RoleCRUD 1 51 586.20 442 727 1.70 51.00
RoleList 2 102 584.84 422 717 3.40 51.00
RoleAssignmentList 3 39 2300.64 2031 2548 1.30 13.00
UserRead 4 97 1245.80 1014 1487 3.23 24.25
ProjectRead 3 76 1182.43 928 1380 2.53 25.33
PasswordAuth 4 54 2185.44 1455 2903 1.80 13.50
PasswordAuthNegative 1 35 882.06 541 1187 1.17 35.00
Rescope 2 91 661.48 498 829 3.03 45.50
RescopeNegative 1 55 549.31 436 691 1.83 55.00
SystemScopeAuth 2 49 1239.08 799 1802 1.63 24.50
ApiKeyCRUD 1 25 1222.96 1103 1409 0.83 25.00
MappingCRUD 1 26 1154.46 1008 1309 0.87 26.00
OAuth2ClientCRUD 1 26 1154.42 913 1294 0.87 26.00
OAuth2Discovery 3 850 105.68 31 285 28.33 283.33
ScimRealmRead 1 17 1800.65 1567 1944 0.57 17.00
ScimSync 1 2031 14.26 1 780 67.70 2031.00
Aggregated 45 3996 337.21 1 2903 133.20 2919.25

Error Metrics

Method Name # Error
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 49 401 Unauthorized: GET /SCIM/v2/:domain_id/Users (sync reconcile list)
POST POST /SCIM/v2/:domain_id/Users (sync provision) 1 401 Unauthorized: POST /SCIM/v2/:domain_id/Users (sync provision)
POST POST /v3/auth/tokens (password, invalid) 82 401 Unauthorized: POST /v3/auth/tokens (password, invalid)
POST POST /v3/auth/tokens (rescope, invalid project) 142 401 Unauthorized: POST /v3/auth/tokens (rescope, invalid project)
GET GET /v3/auth/tokens (validate revoked) 144 404 Not Found: GET /v3/auth/tokens (validate revoked)
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 2194 429 Too Many Requests: GET /SCIM/v2/:domain_id/Users (sync reconcile list)

View full report

@github-actions

github-actions Bot commented Oct 5, 2026

Copy link
Copy Markdown

🧪 Tempest Identity Compatibility Results (advisory, non-blocking)

rust

Totals
======
Ran: 103 tests in 19.5931 sec.
 - Passed: 41
 - Skipped: 2
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 60
Sum of execute time for each test: 8.6698 sec.
Failed test IDs 
===== FAILED TESTS (target=rust) =====
tempest.api.identity.admin.v3.test_application_credentials.ApplicationCredentialsV3AdminTest.test_create_application_credential_with_roles[id-3b3dd48f-3388-406a-a9e6-4d078a552d0e]
tempest.api.identity.admin.v3.test_domains_negative.DomainsNegativeTestJSON.test_create_domain_with_name_length_over_64[id-37b1bbf2-d664-4785-9a11-333438586eae,negative]
tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete[id-7cd59bf9-bda4-4c72-9467-d21cab278355,smoke]
tempest.api.identity.admin.v3.test_domains_negative.DomainsNegativeTestJSON.test_delete_active_domain[gate,id-1f3fbff5-4e44-400d-9ca1-d953f05f609b,negative]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_domain_without_description[id-2abf8764-309a-4fa9-bc58-201b799817ad]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain[id-f2f5b44a-82e8-4dad-8084-0661ea3b18cf,smoke]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_domain_delete_cascades_content[id-d8d318b7-d1b3-4c37-94c5-3c5ba0b121ea]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_list_domains_filter_by_enabled[id-3fd19840-65c1-43f8-b48c-51bdd066dff9]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_create_domain_config_and_show_config_groups_and_options[id-9e3ff13c-f597-4f01-9377-d6c06c2a1477]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_create_update_and_delete_domain_config_groups_and_opts[id-c7510fa2-6661-4170-9c6b-4783a80651e9]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_show_default_group_config_and_options[id-11a02bf0-6f94-4380-b3b0-c8dc18fc0d22]
tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete[id-1598521a-2f36-4606-8df9-30772bd51339,smoke]
tempest.api.identity.admin.v3.test_default_project_id.TestDefaultProjectId.test_default_project_id[id-d6110661-6a71-49a7-a453-b5e26640ff6d]
setUpClass (tempest.api.identity.admin.v3.test_endpoint_groups.EndPointGroupsTest)
tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_list_user_groups[id-64573281-d26a-4a52-b899-503cb0f4e4ec]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsStaticTestJSON.test_list_projects[id-1d830662-22ad-427c-8c3e-4ec854b0af44]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsTestJSON.test_list_projects_with_enabled[id-0fe7a334-675a-4509-b00e-1c4b95d5dae8]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsTestJSON.test_list_projects_with_parent[id-6edc66f5-2941-4a17-9526-4073311c1fac]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_check_revoke_roles_on_projects_group[id-26021436-d5a4-4256-943c-ded01e0d4b45]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_check_revoke_roles_on_projects_user[id-18b70e45-7687-4b72-8277-b8f1a47d7591]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_check_revoke_roles_on_domains_group[id-c7a8dda2-be50-4fb4-9a9c-e830771078b1]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_check_revoke_roles_on_domains_user[id-4e6f0366-97c8-423c-b2be-41eae6ac91c8]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_revoke_user_roles_on_domain[id-3acf666e-5354-42ac-8e17-8b68893bcd36]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_revoke_user_roles_on_project_tree[id-9f02ccd9-9b57-46b4-8f77-dd5a736f3a06]
tempest.api.identity.admin.v3.test_projects_negative.ProjectsNegativeStaticTestJSON.test_create_projects_name_length_over_64[id-502b6ceb-b0c8-4422-bf53-f08fdb21e2f0,negative]
tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON.test_list_users_with_not_enabled[id-bff8bf2f-9408-4ef5-b63a-753c8c2124eb]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_assignments_for_domain_roles[id-3859df7e-5b78-4e4d-b10e-214c8953842a]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_create_and_show_consumer[id-c8307ea6-a86c-47fd-ae7b-5b3b2caca76d]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_delete_consumer[id-fdfa1b7f-2a31-4354-b2c7-f6ae20554f93]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_list_consumers[id-09ca50de-78f2-4ffb-ac71-f2254036b2b8]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_assignments_for_implied_roles_create_delete[id-c8828027-df48-4021-95df-b65b92c7429e]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_update_consumer[id-080a9b1a-c009-47c0-9979-5305bf72e3dc]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_domain[id-4bf8a70b-e785-413a-ad53-9f91ce02faa7]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_project[id-cbf11737-1904-4690-9613-97bcbb3df1c4]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_system[id-c888fe4f-8018-48db-b959-542225c1b4b6]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_user_on_domain[id-6c9a2940-3625-43a3-ac02-5dcec62ef3bd]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_domain_roles[id-eb1e1c24-1bc4-4d47-9748-e127a1852c82]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_roles_create_check_show_delete[id-c90c316c-d706-4728-bcba-eb1912081b69]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list[id-18afc6c0-46cf-4911-824e-9989cc056c3a,smoke]
setUpClass (tempest.api.identity.admin.v3.test_project_tags.IdentityV3ProjectTagsTest)
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_get_available_domain_scopes[id-ec5ecb05-af64-4c04-ac86-4d9f6f12f185]
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_get_available_project_scopes[id-08ed85ce-2ba8-4864-b442-bcc61f16ae89]
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token[id-565fa210-1da1-4563-999b-f7b5b67cf112]
setUpClass (tempest.api.identity.admin.v3.test_projects.ProjectsTestJSON)
setUpClass (tempest.api.identity.admin.v3.test_services.ServicesTestJSON)
setUpClass (tempest.api.identity.admin.v3.test_users_negative.UsersNegativeTest)
setUpClass (tempest.api.identity.v3.test_domains.DefaultDomainTestJSON)
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all[id-4773ebd5-ecbf-4255-b8d8-b63e6f72b65d,smoke]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_query[id-6268b345-87ca-47c0-9ce3-37792b43403a]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_expire[id-0ed14b66-cefd-4b5c-a964-65759453e292]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_expire_invalid[id-3e48f95d-e660-4fa9-85e0-5a3d85594384]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_impersonate[id-5a0a91a4-baef-4a14-baba-59bf4d7fcace]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_noimpersonate[id-ed2a8779-a7ac-49dc-afd7-30f32f936ed2]
setUpClass (tempest.api.identity.v3.test_tokens.TokensV3Test)
setUpClass (tempest.api.identity.v3.test_api_discovery.TestApiDiscovery)
setUpClass (tempest.api.identity.admin.v3.test_users.UsersV3TestJSON)
setUpClass (tempest.api.identity.v3.test_ec2_credentials.EC2CredentialsTest)
setUpClass (tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test)
setUpClass (tempest.api.identity.v3.test_projects.IdentityV3ProjectsTest)
setUpClass (tempest.api.identity.v3.test_catalog.IdentityCatalogTest)
===== END FAILED TESTS (target=rust) =====

View full run

@github-actions

github-actions Bot commented Oct 5, 2026

Copy link
Copy Markdown

🐰 Bencher Report

Projectkeystone
Branchclaude/audit-1325-tests
Testbedubuntu-latest
Click to view all benchmark results
BenchmarkLatencyBenchmark Result
nanoseconds (ns)
(Result Δ%)		Upper Boundary
nanoseconds (ns)
(Limit %)
Command_Serde/apply/remove📈 view plot
🚷 view threshold		114,260.00 ns
(-55.35%)Baseline: 255,905.83 ns
1,347,691.62 ns
(8.48%)
Command_Serde/apply/set📈 view plot
🚷 view threshold		124,650.00 ns
(-59.30%)Baseline: 306,231.89 ns
1,849,649.84 ns
(6.74%)
Command_Serde/pack/delete📈 view plot
🚷 view threshold		138.23 ns
(+17.93%)Baseline: 117.22 ns
166.96 ns
(82.79%)
Command_Serde/pack/delete_index📈 view plot
🚷 view threshold		122.11 ns
(+16.86%)Baseline: 104.49 ns
144.81 ns
(84.32%)
Command_Serde/pack/set📈 view plot
🚷 view threshold		217.55 ns
(+13.28%)Baseline: 192.04 ns
271.13 ns
(80.24%)
Command_Serde/pack/set_index📈 view plot
🚷 view threshold		118.82 ns
(+13.70%)Baseline: 104.51 ns
144.85 ns
(82.03%)
Command_Serde/unpack/delete📈 view plot
🚷 view threshold		165.02 ns
(+0.45%)Baseline: 164.28 ns
256.92 ns
(64.23%)
Command_Serde/unpack/delete_index📈 view plot
🚷 view threshold		139.43 ns
(+0.65%)Baseline: 138.54 ns
212.34 ns
(65.66%)
Command_Serde/unpack/set📈 view plot
🚷 view threshold		268.24 ns
(+8.07%)Baseline: 248.21 ns
378.04 ns
(70.96%)
Command_Serde/unpack/set_index📈 view plot
🚷 view threshold		142.87 ns
(+3.94%)Baseline: 137.45 ns
209.32 ns
(68.25%)
Payload_encryption/pack/remove_cmd📈 view plot
🚷 view threshold		128.78 ns
(+17.36%)Baseline: 109.73 ns
160.33 ns
(80.32%)
Payload_encryption/pack/set_cmd📈 view plot
🚷 view threshold		213.58 ns
(+7.33%)Baseline: 199.00 ns
297.14 ns
(71.88%)
Payload_encryption/unpack/remove_cmd📈 view plot
🚷 view threshold		166.77 ns
(-1.90%)Baseline: 170.01 ns
270.33 ns
(61.69%)
Payload_encryption/unpack/set_cmd📈 view plot
🚷 view threshold		274.13 ns
(+6.91%)Baseline: 256.40 ns
393.13 ns
(69.73%)
Raft_1Node_Latency/prefix/1node📈 view plot
🚷 view threshold		3,367,500.00 ns
(+9.21%)Baseline: 3,083,520.47 ns
7,481,166.91 ns
(45.01%)
Raft_1Node_Latency/read/1node📈 view plot
🚷 view threshold		44,158.00 ns
(+20.83%)Baseline: 36,544.38 ns
52,754.70 ns
(83.70%)
Raft_1Node_Latency/remove/1node📈 view plot
🚷 view threshold		331,450.00 ns
(-37.80%)Baseline: 532,849.53 ns
1,797,396.16 ns
(18.44%)
Raft_1Node_Latency/write/1node📈 view plot
🚷 view threshold		354,030.00 ns
(-40.08%)Baseline: 590,802.97 ns
2,651,429.89 ns
(13.35%)
build_snapshot/default📈 view plot
🚷 view threshold		2,030.40 ns
(-98.68%)Baseline: 153,473.99 ns
997,205.05 ns
(0.20%)
fernet token/project📈 view plot
🚷 view threshold		1,418.70 ns
(+5.04%)Baseline: 1,350.68 ns
1,840.86 ns
(77.07%)
get_data_keyspace📈 view plot
🚷 view threshold		0.31 ns
(+2.93%)Baseline: 0.30 ns
0.39 ns
(80.96%)
get_db📈 view plot
🚷 view threshold		0.31 ns
(+3.14%)Baseline: 0.30 ns
0.39 ns
(81.13%)
get_fernet_token_timestamp/project📈 view plot
🚷 view threshold		147.58 ns
(+9.53%)Baseline: 134.74 ns
180.20 ns
(81.90%)
get_keyspace📈 view plot
🚷 view threshold		4.18 ns
(-34.70%)Baseline: 6.40 ns
14.43 ns
(28.96%)
🐰 View full continuous benchmarking report in Bencher

@gtema
gtema added this pull request to the merge queue Oct 5, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 5, 2026
@gtema
gtema added this pull request to the merge queue Oct 5, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 5, 2026
@gtema
gtema added this pull request to the merge queue Oct 6, 2026
Merged via the queue into main with commit 40a1bd3 Oct 6, 2026
36 checks passed
@gtema
gtema deleted the claude/audit-1325-tests branch October 6, 2026 07:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@gtema gtema

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@gtema