Commit b51f15b
Add automated Claude failure analysis for Prow CI
Integrates Claude Code via Vertex AI to automatically analyze E2E test
failures in Prow CI and generate comprehensive failure reports.
Changes:
- build/ci-Dockerfile: Install Node.js 20.x and Claude CLI with multi-arch support
- tests/e2e/scripts/analyze_failures.sh: New analysis script with:
- Vertex AI integration via Claude Code CLI headless mode (--print flag)
- Comprehensive secret redaction (AWS keys, GCP keys, tokens, passwords)
- Graceful degradation when credentials unavailable
- 10-minute timeout with partial analysis on timeout
- Makefile: Set GOOGLE_APPLICATION_CREDENTIALS and ANTHROPIC_VERTEX_PROJECT_ID
from vault files before running analysis script
- docs/design/claude-prow-failure-analysis_design.md: Complete design document
- tests/e2e/claude_test_failure_test.go: Simple failing test for verification
- tests/e2e/backup_restore_suite_test.go: Realistic failing test that triggers
must-gather collection
The analysis runs post-suite and does not affect test execution or results.
Output is saved to ${ARTIFACT_DIR}/claude-failure-analysis.md with automatic
secret redaction to prevent credential leakage.
Requires Vertex AI credentials in vault collection files:
- /var/run/oadp-credentials/gcp-claude-code-credentials
- /var/run/oadp-credentials/gcp-claude-code-project-id
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>1 parent 5d074fc commit b51f15b
File tree
6 files changed
+1335
-3
lines changed- build
- docs/design
- tests/e2e
- scripts
6 files changed
+1335
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
865 | 865 | | |
866 | 866 | | |
867 | 867 | | |
868 | | - | |
| 868 | + | |
| 869 | + | |
| 870 | + | |
| 871 | + | |
| 872 | + | |
| 873 | + | |
| 874 | + | |
| 875 | + | |
| 876 | + | |
| 877 | + | |
| 878 | + | |
| 879 | + | |
869 | 880 | | |
870 | 881 | | |
871 | 882 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
9 | | - | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
10 | 11 | | |
11 | 12 | | |
12 | 13 | | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
13 | 21 | | |
14 | 22 | | |
15 | 23 | | |
0 commit comments