statements ยท statement-BATCH-2026-006-034
source-BATCH-2026-005-008
On the 14-vulnerability benchmark, GPT-4-backed HPTSA reports 42% pass-at-five and 18% pass-at-one.
Statement context
- Statement type
- empirical finding
- Exact source locator
- arXiv:2406.01637v2 PDF p. 5, Figure 2 and Section 5.2
- Source date
- 2024-06-02
- Role at source time
- joint authors of the HPTSA paper
- Evidence character
- primary empirical result
- Scope
- The described HPTSA configuration in sandboxed experiments.
Recorded uncertainty: The reported percentages are rounded, and the paper gives no confidence intervals.
Indexed source: Teams of LLM Agents can Exploit Zero-Day Vulnerabilities
Evidence lineage and transparency
| Relationship field | Linked identifiers |
|---|---|
| topic ids | topic-ai-agents, topic-ai-governance, topic-cybersecurity, topic-non-human-identity |
Machine review: machine checked. Human review: approved. Workflow: published.
Complete structured record
- statement id
- statement-BATCH-2026-006-034
- source id
- source-BATCH-2026-005-008
- person id
- Unknown
- institutional author
- Zhu et al. (joint paper authors)
- book edition id
- Unknown
- speaker role at source time
- joint authors of the HPTSA paper
- organization at source time
- University of Illinois Urbana-Champaign
- statement type
- empirical_finding
- neutral paraphrase
- On the 14-vulnerability benchmark, GPT-4-backed HPTSA reports 42% pass-at-five and 18% pass-at-one.
- direct quote
- Unknown
- direct quote rights note
- Unknown
- exact locator
- arXiv:2406.01637v2 PDF p. 5, Figure 2 and Section 5.2
- locator type
- pdf_page
- source date
- 2024-06-02
- topic ids
- topic-ai-agents, topic-ai-governance, topic-cybersecurity, topic-non-human-identity
- executive role context
- role-ciso, role-cio, role-cto, role-general-counsel, role-board-director
- industry context
- cross-sector
- geographic context
- synthetic sandbox; no human geography
- evidence character
- primary_empirical_result
- factual verification status
- source_reported_not_independently_verified
- statement scope
- The described HPTSA configuration in sandboxed experiments.
- uncertainty
- The reported percentages are rounded, and the paper gives no confidence intervals.
- extraction method
- Machine-assisted close reading of the exact verified source version; original neutral paraphrase; human review pending.
- machine extraction confidence
- 0.94
- independent agent review status
- not_started
- publication status
- published
- workflow status
- published
- machine review status
- machine_checked
- human review status
- approved
- reviewed by
- Murray Newlands
- reviewed at
- 2026-08-16T23:17:22Z
Provenance and revision history
{
"provenance": [
{
"source_url": "https://arxiv.org/abs/2406.01637",
"accessed_at": "2026-08-15",
"retrieval_method": "Exact verified source version inherited from BATCH-2026-005 and statement-level close reading",
"exact_locator": "arXiv:2406.01637v2 PDF p. 5, Figure 2 and Section 5.2",
"content_hash": "f4fc06040f0856d99d2009042b4c6fa0c01206da8ca61cb39a94d52b9867cf71",
"batch_id": "BATCH-2026-006",
"prompt_id": "OEII-STATEMENT-CODING",
"prompt_version": "2.0",
"notes": "Source eligibility inherited from source-BATCH-2026-005-008; human attribution and publication review pending."
}
],
"revision_history": [
{
"changed_at": "2026-08-16T23:17:22Z",
"changed_by": "Murray Newlands",
"summary": "Approved for the governed-identities pilot release under the exact scope, exclusions, rights treatment, and limitations recorded in issue #18.",
"batch_id": "BATCH-2026-006"
}
]
}