Unable to search filenames with non-English characters using @ in Codex CLI

Open 💬 3 comments Opened Jun 16, 2026 by doggy8088
💡 Likely answer: A maintainer (etraut-openai, contributor) responded on this thread — see the highlighted reply below.

What version of Codex CLI is running?

codex-cli 0.139.0

What subscription do you have?

ChatGPT Pro

Which model were you using?

gpt-5.3-codex-spark

What platform is your computer?

Darwin 25.5.0 arm64 arm

What terminal emulator and version are you using (if applicable)?

Ghostty

Codex doctor report

{
  "schemaVersion": 1,
  "generatedAt": "1781615673s since unix epoch",
  "overallStatus": "warning",
  "codexVersion": "0.139.0",
  "checks": {
    "app_server.status": {
      "id": "app_server.status",
      "category": "app-server",
      "status": "ok",
      "summary": "background server is not running",
      "details": {
        "control socket": "/Users/will/.codex/app-server-control/app-server-control.sock",
        "daemon state dir": "/Users/will/.codex/app-server-daemon",
        "mode": "ephemeral",
        "pid file": "/Users/will/.codex/app-server-daemon/app-server.pid (missing)",
        "settings": "/Users/will/.codex/app-server-daemon/settings.json (missing)",
        "status": "not running",
        "update-loop pid file": "/Users/will/.codex/app-server-daemon/app-server-updater.pid (missing)"
      },
      "remediation": null,
      "durationMs": 0
    },
    "auth.credentials": {
      "id": "auth.credentials",
      "category": "auth",
      "status": "ok",
      "summary": "auth is configured",
      "details": {
        "auth env vars present": "OPENAI_API_KEY",
        "auth file": "/Users/will/.codex/auth.json",
        "auth storage mode": "File",
        "stored API key": "false",
        "stored ChatGPT tokens": "true",
        "stored agent identity": "false",
        "stored auth mode": "chatgpt"
      },
      "remediation": null,
      "durationMs": 0
    },
    "config.load": {
      "id": "config.load",
      "category": "config",
      "status": "ok",
      "summary": "config loaded",
      "details": {
        "CODEX_HOME": "/Users/will/.codex",
        "config.toml": "/Users/will/.codex/config.toml",
        "config.toml parse": "ok",
        "cwd": "/Users/will/projects/MyProject",
        "enabled feature flags": "shell_tool, unified_exec, shell_snapshot, terminal_resize_reflow, sqlite, hooks, enable_request_compression, multi_agent, apps, tool_suggest, plugins, in_app_browser, browser_use, browser_use_external, computer_use, plugin_sharing, image_generation, skill_mcp_dependency_install, steer, guardian_approval, goals, collaboration_modes, tool_call_mcp_elicitation, personality, fast_mode, tui_app_server, prevent_idle_sleep, workspace_dependencies",
        "feature flag overrides": "prevent_idle_sleep=true",
        "feature flags enabled": "28",
        "log dir": "/Users/will/.codex/log",
        "mcp servers": "2",
        "model": "gpt-5.3-codex-spark",
        "model provider": "openai",
        "sqlite home": "/Users/will/.codex"
      },
      "remediation": null,
      "durationMs": 0
    },
    "git.environment": {
      "id": "git.environment",
      "category": "git",
      "status": "ok",
      "summary": "git version 2.50.1 (Apple Git-155)",
      "details": {
        ".git entry": "directory",
        "PATH git #1": "/usr/bin/git",
        "PATH git entries": "1",
        "git branch": "main",
        "git build options": "git version 2.50.1 (Apple Git-155); cpu: arm64; no commit associated with this build; sizeof-long: 8; sizeof-size_t: 8; shell-path: /bin/sh; feature: fsmonitor--daemon; libcurl: 8.7.1; zlib: 1.2.12; SHA-1: SHA1_DC; SHA-256: SHA256_BLK",
        "git exec path": "/Applications/Xcode.app/Contents/Developer/usr/libexec/git-core",
        "git version": "git version 2.50.1 (Apple Git-155)",
        "repo detected": "true",
        "repo root": "/Users/will/projects/MyProject",
        "selected git": "/usr/bin/git"
      },
      "remediation": null,
      "durationMs": 114
    },
    "installation": {
      "id": "installation",
      "category": "install",
      "status": "ok",
      "summary": "installation looks consistent",
      "details": {
        "PATH codex #1": "/opt/homebrew/bin/codex",
        "current executable": "/opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/bin/codex",
        "install context": "npm (package /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin, bin /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/bin, resources /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/codex-resources, path /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/codex-path)",
        "managed by bun": "false",
        "managed by npm": "true",
        "managed package root": "/opt/homebrew/lib/node_modules/@openai/codex",
        "npm update target": "/opt/homebrew/lib/node_modules/@openai/codex"
      },
      "remediation": null,
      "durationMs": 77
    },
    "mcp.config": {
      "id": "mcp.config",
      "category": "mcp",
      "status": "ok",
      "summary": "MCP configuration is locally consistent",
      "details": {
        "configured servers": "2",
        "disabled servers": "1",
        "stdio servers": "2"
      },
      "remediation": null,
      "durationMs": 0
    },
    "network.env": {
      "id": "network.env",
      "category": "network",
      "status": "ok",
      "summary": "network-related environment looks readable",
      "details": {
        "proxy env vars": "none"
      },
      "remediation": null,
      "durationMs": 0
    },
    "network.provider_reachability": {
      "id": "network.provider_reachability",
      "category": "reachability",
      "status": "ok",
      "summary": "active provider endpoints are reachable over HTTP",
      "details": {
        "openai API base URL": "https://api.openai.com/v1 reachable (HTTP 404)",
        "openai API route probe": "https://api.openai.com/v1/<redacted> route exists (HTTP 401)",
        "reachability mode": "API key auth"
      },
      "remediation": null,
      "durationMs": 556
    },
    "network.websocket_reachability": {
      "id": "network.websocket_reachability",
      "category": "websocket",
      "status": "ok",
      "summary": "Responses WebSocket handshake succeeded",
      "details": {
        "DNS": "2 IPv4, 0 IPv6, first IPv4",
        "auth mode": "chatgpt",
        "connect timeout": "15000 ms",
        "endpoint": "wss://chatgpt.com/backend-api/<redacted>",
        "handshake result": "HTTP 101 Switching Protocols",
        "model provider": "openai",
        "models etag present": "true",
        "provider name": "OpenAI",
        "proxy env vars": "none",
        "reasoning header": "false",
        "server model present": "false",
        "supports websockets": "true",
        "wire API": "responses"
      },
      "remediation": null,
      "durationMs": 688
    },
    "runtime.provenance": {
      "id": "runtime.provenance",
      "category": "runtime",
      "status": "ok",
      "summary": "running npm on macos-aarch64",
      "details": {
        "commit": "unknown",
        "current executable": "/opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/bin/codex",
        "install method": "npm (package /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin, bin /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/bin, resources /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/codex-resources, path /opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/codex-path)",
        "platform": "macos-aarch64",
        "version": "0.139.0"
      },
      "remediation": null,
      "durationMs": 0
    },
    "runtime.search": {
      "id": "runtime.search",
      "category": "search",
      "status": "ok",
      "summary": "search is OK (bundled)",
      "details": {
        "search command": "/opt/homebrew/lib/node_modules/@openai/codex/node_modules/@openai/codex-darwin-arm64/vendor/aarch64-apple-darwin/codex-path/rg",
        "search command readiness": "file exists",
        "search provider": "bundled"
      },
      "remediation": null,
      "durationMs": 0
    },
    "sandbox.helpers": {
      "id": "sandbox.helpers",
      "category": "sandbox",
      "status": "ok",
      "summary": "sandbox configuration is readable",
      "details": {
        "approval policy": "Never",
        "codex-linux-sandbox helper": "none",
        "execve wrapper helper": "/Users/will/.codex/tmp/arg0/codex-arg0yrTnzT/codex-execve-wrapper",
        "filesystem sandbox": "unrestricted",
        "network sandbox": "enabled"
      },
      "remediation": null,
      "durationMs": 0
    },
    "state.paths": {
      "id": "state.paths",
      "category": "state",
      "status": "ok",
      "summary": "state paths and databases are inspectable",
      "details": {
        "CODEX_HOME": "/Users/will/.codex (dir)",
        "active rollout files": "1299 files, 9477602061 total bytes, 7296075 average bytes",
        "archived rollout files": "9 files, 14098587 total bytes, 1566509 average bytes",
        "goals DB": "/Users/will/.codex/goals_1.sqlite (file)",
        "goals DB integrity": "ok",
        "log DB": "/Users/will/.codex/logs_2.sqlite (file)",
        "log DB integrity": "ok",
        "log dir": "/Users/will/.codex/log (dir)",
        "memories DB": "/Users/will/.codex/memories_1.sqlite (file)",
        "memories DB integrity": "ok",
        "sqlite home": "/Users/will/.codex (dir)",
        "state DB": "/Users/will/.codex/state_5.sqlite (file)",
        "state DB integrity": "ok"
      },
      "remediation": null,
      "durationMs": 394
    },
    "state.rollout_db_parity": {
      "id": "state.rollout_db_parity",
      "category": "threads",
      "status": "warning",
      "summary": "rollout files and state DB thread inventory differ",
      "details": {
        "default model provider": "openai",
        "rollout DB active files": "1299",
        "rollout DB active rows": "402",
        "rollout DB archive mismatches": "0",
        "rollout DB archived files": "9",
        "rollout DB archived rows": "7",
        "rollout DB duplicate DB paths": "0",
        "rollout DB duplicate rollout thread ids": "0",
        "rollout DB malformed file names": "0",
        "rollout DB missing active rows": "897",
        "rollout DB missing active sample": [
          "/Users/will/.codex/sessions/2026/06/14/rollout-2026-06-14T04-50-22-019ec2bf-fd3f-7360-a159-4204095c276d.jsonl",
          "/Users/will/.codex/sessions/2026/06/14/rollout-2026-06-14T05-06-11-019ec2ce-77b6-70e0-b7c4-f286a576e1bb.jsonl",
          "/Users/will/.codex/sessions/2026/06/14/rollout-2026-06-14T04-16-04-019ec2a0-9645-7e80-ae6e-c33f97cbb441.jsonl",
          "/Users/will/.codex/sessions/2026/06/14/rollout-2026-06-14T04-08-04-019ec299-4424-75f2-9041-0360a08ce383.jsonl",
          "/Users/will/.codex/sessions/2026/06/14/rollout-2026-06-14T10-58-05-019ec410-a3f1-7ad1-a620-be63ffa9ae46.jsonl"
        ],
        "rollout DB missing archived rows": "2",
        "rollout DB missing archived sample": [
          "/Users/will/.codex/archived_sessions/rollout-2026-06-14T03-32-08-019ec278-5ba3-7d21-b7c2-e6eb17b2385d.jsonl",
          "/Users/will/.codex/archived_sessions/rollout-2026-06-14T02-37-39-019ec246-7a32-7f52-8860-105f1f882c04.jsonl"
        ],
        "rollout DB model providers": "openai=360, azure-wakau1=20, azure=18, ollama-launch=6, lm-studio=3, duotify=2",
        "rollout DB rows": "409",
        "rollout DB scan cap reached": "false",
        "rollout DB scan errors": "0",
        "rollout DB sources": "cli=306, vscode=59, subagent:thread_spawn=20, subagent:other=17, exec=6, subagent:review=1",
        "rollout DB stale rows": "0"
      },
      "issues": [
        {
          "severity": "warning",
          "cause": "rollout files are missing from the state DB",
          "measured": "897 active, 2 archived",
          "expected": "every rollout file has a matching threads row",
          "remedy": null,
          "fields": []
        }
      ],
      "remediation": null,
      "durationMs": 12574
    },
    "system.environment": {
      "id": "system.environment",
      "category": "system",
      "status": "ok",
      "summary": "OS language zh-Hant-TW",
      "details": {
        "EDITOR": "not set",
        "LANG": "en_US.UTF-8",
        "LESS": "set",
        "PAGER": "set",
        "VISUAL": "not set",
        "os": "Mac OS 26.5.1 [64-bit]",
        "os language": "zh-Hant-TW",
        "os type": "Mac OS",
        "os version": "26.5.1"
      },
      "remediation": null,
      "durationMs": 2
    },
    "terminal.env": {
      "id": "terminal.env",
      "category": "terminal",
      "status": "warning",
      "summary": "width 53 cols - output may wrap (recommended >=80)",
      "details": {
        "COLORTERM": "truecolor",
        "TERMINFO": "/Applications/Ghostty.app/Contents/Resources/terminfo (dir)",
        "TERM_PROGRAM": "ghostty",
        "color output": "disabled (stdout is not a terminal)",
        "effective locale": "en_US.UTF-8",
        "stderr is terminal": "true",
        "stdin is terminal": "true",
        "stdout is terminal": "false",
        "terminal": "Ghostty",
        "terminal size": "53x33",
        "terminal version": "1.3.1"
      },
      "issues": [
        {
          "severity": "warning",
          "cause": "width 53 cols - output may wrap (recommended >=80)",
          "measured": "53 x 33",
          "expected": ">= 80 columns",
          "remedy": "resize the window to at least 80 columns",
          "fields": [
            "terminal size"
          ]
        }
      ],
      "remediation": null,
      "durationMs": 0
    },
    "terminal.title": {
      "id": "terminal.title",
      "category": "title",
      "status": "ok",
      "summary": "terminal title default",
      "details": {
        "terminal title activity": "true",
        "terminal title items": "activity, project-name",
        "terminal title project source": "git repo root",
        "terminal title project value": "MyProject",
        "terminal title source": "default"
      },
      "remediation": null,
      "durationMs": 0
    },
    "updates.status": {
      "id": "updates.status",
      "category": "updates",
      "status": "ok",
      "summary": "update configuration is locally consistent",
      "details": {
        "cached latest version": "0.140.0",
        "check for update on startup": "true",
        "last checked at": "2026-06-16T12:58:06.222643Z",
        "latest version": "0.140.0",
        "latest version status": "newer version is available",
        "npm update target": "/opt/homebrew/lib/node_modules/@openai/codex",
        "update action": "npm install -g @openai/codex",
        "version cache": "/Users/will/.codex/version.json"
      },
      "remediation": null,
      "durationMs": 508
    }
  }
}

What issue are you seeing?

I can't find any file using @ in the Codex CLI.

What steps can reproduce the bug?

  1. Open the CLI.
  2. Type @ to search for a file.
  3. Try to type a filename containing non-English characters (e.g., Chinese, Japanese).
  4. Observe that the search does not return the expected files.

What is the expected behavior?

The search should correctly identify and suggest files with non-English characters when using the @ symbol.

Additional information

_No response_

View original on GitHub ↗

3 Comments

MakenRosa · 2 months ago

I did a quick split between the search engine and the TUI path.

On current main, the standalone codex-file-search crate does match CJK filenames for me. This WSL smoke test returns both files:

mkdir -p /tmp/codex-cjk-test/sub
touch /tmp/codex-cjk-test/中文文件.md /tmp/codex-cjk-test/sub/日本語メモ.txt
cargo run -q -p codex-file-search -- --json -C /tmp/codex-cjk-test 中文
cargo run -q -p codex-file-search -- --json -C /tmp/codex-cjk-test 日本語

Results:

{"path":"中文文件.md",...}
{"path":"sub/日本語メモ.txt",...}

The code path also looks Unicode-capable at the file-search layer: file-search/src/lib.rs injects the relative path as Utf32String, and matcher_worker reparses the query with Normalization::Smart.

The TUI token extraction also has existing tests for Unicode @ tokens, including Chinese ("@诶") and mixed Cyrillic ("@testЙЦУ.rs"), so this may be either:

  • a fixed bug between 0.139.0 and current main,
  • a macOS filesystem normalization edge case, or
  • a TUI input/query propagation issue rather than a codex-file-search matching issue.

A useful regression test would be end-to-end at the TUI/file-search boundary: create files named 中文文件.md and 日本語メモ.txt, simulate typing @中文 / @日本語, and assert that the resulting FileSearchResult is applied to the active file or unified mention popup. That would cover the part the standalone crate smoke test does not cover.

etraut-openai contributor · 2 months ago

[From Codex] I can reproduce a macOS Unicode-normalization problem with some decomposed filenames, but ordinary Chinese filenames work in our current tests, so I’m not confident that we’ve found your exact failure yet.

Could you provide:

  1. One exact filename that fails and the exact text typed after @.
  2. Whether ASCII filenames appear in the same repository.
  3. Whether the problem still occurs on the latest Codex release.
  4. Whether the file is ignored according to:

``sh
git check-ignore -v -- 'path/to/the/file'
``

A short screen recording would also help, especially if the filename contains accented characters or voiced Japanese kana such as が or ぱ.

Please redact any sensitive path components. With one concrete filename, we can distinguish filesystem normalization from TUI input or ignore-rule behavior.

steve5636 · 1 month ago

I investigated this and have a candidate fix branch, but I cannot open a PR because this repository currently restricts PR creation to collaborators:

An owner of this repository has limited the ability to open a pull request to users that are collaborators on this repository.

Candidate branch:

Root cause / scope:

  • On macOS, filenames can be exposed in decomposed Unicode form.
  • File search stores/matches the relative path text without first normalizing it to the same Unicode form as the user query.
  • A composed Korean query therefore fails to match a decomposed Korean filename even though the visible filename looks equivalent.

What the branch changes:

  • Normalizes non-ASCII file-search matcher text to NFC before feeding it to nucleo.
  • Preserves the original filesystem path spelling in FileMatch.path.
  • Remaps computed match indices back to the original path string so highlighting still points at the real returned path.
  • Adds a regression test for a composed Korean query matching a decomposed Korean filename with compute_indices enabled.

It also includes a narrow related TUI composer fix:

  • Generic pasted text is normalized to NFC after image/path paste handling.
  • This makes Finder-copied decomposed Korean filenames display as readable composed Korean text in the input box.
  • The path/image paste branch still sees the original pasted string before display normalization.

Validation run locally:

  • just test -p codex-file-search
  • just test -p codex-tui handle_paste_decomposed_korean_text_inserts_composed_text
  • just test -p codex-tui
  • just fmt
  • just fix -p codex-file-search
  • just fix -p codex-tui
  • just bazel-lock-update
  • just bazel-lock-check
  • Manual file-search check with a decomposed Korean filename and composed query

Related issues:

  • Related to #19312 because Finder paste can expose decomposed path text, but this branch does not fully address the broader pasted-file/path exposure behavior.
  • Related to #22614 because both involve decomposed Korean jamo display symptoms, but this branch does not fully address the broader macOS IME input-source switching bug.