Web-grounded answer presents stale search snapshot as current verification

Open 💬 1 comment Opened Aug 22, 2026 by chrischiu88
💡 Likely answer: A maintainer (github-actions[bot], contributor) responded on this thread — see the highlighted reply below.

What issue are you seeing?

When asked for the latest Elasticsearch version on 2026-08-22 (Asia/Taipei), Codex browsed the web and received an official Elastic download-page search result that explicitly said it had been crawled last month and showed version 9.4.3. Codex nevertheless answered with the stronger claim: "As of 2026-08-22, the latest stable version is Elasticsearch 9.4.3."

That claim was false. Elasticsearch 9.5.2 had been officially released on 2026-08-20. After the user challenged the answer, querying the live Elastic Release API and the official GitHub release confirmed 9.5.2.

This is more than an ordinary stale search result: the response converted a visibly stale crawl into an asserted same-day verification and cited the stale page as proof.

Steps to reproduce

  1. Ask Codex to check the latest version of a product shortly after a new release, for example: What is the latest Elasticsearch version?
  2. Let web search return a cached official-page snippet with an older crawl timestamp and older version.
  3. Observe whether Codex states as of today or otherwise claims current verification without checking a live authoritative release feed.
  4. Compare against the vendor release API or official release tag.

Observed sources in this case:

Expected behavior

For freshness-sensitive questions such as latest version, Codex should:

  • Treat crawl/publish timestamps as part of source validity.
  • Not describe a stale search snapshot as current same-day verification.
  • Prefer a live authoritative release API, signed release tag, or artifact registry when available.
  • If current verification cannot be completed, state the uncertainty instead of using an as of today claim.

Impact

The response was confidently wrong despite browsing and citations. This is especially damaging because the wording implied stronger verification than the retrieved evidence supported, and it could lead users to pin an outdated infrastructure version.

Environment

  • Product: Codex application session
  • Platform: macOS
  • Occurred: 2026-08-22, Asia/Taipei
  • No private repository content, credentials, or user identifiers are required to reproduce this issue.

View original on GitHub ↗

1 Comment

github-actions[bot] contributor · 6 days ago

Potential duplicates detected. Please review them and close your issue if it is a duplicate.

  • #39411

Powered by Codex Action