Codex not working with OSS running on VLLM

Resolved 💬 4 comments Opened Aug 13, 2025 by jayteaftw Closed Sep 22, 2025

What version of Codex is running?

codex-cli 0.21.0

Which model were you using?

oss-gpt-120B

What platform is your computer?

Darwin 24.5.0 arm64 arm

What steps can reproduce the bug?

Setup config.toml with

[model_providers.oss]
base_url = "https://vllm.example.com/v1"
env_key = "OPENAI_API_KEY"

[profiles.genai]
model_provider="oss"
model = "openai/gpt-oss-120b"
name = "Vllm"

What is the expected behavior?

I expect prompt "2+2" should respond with "4"

What do you see instead?

I get the output "🖐 error sending request for url (http://localhost:11434/v1/chat/completions)"; however, I set the base_url to not be localhost?

Additional information

Whats the proper way to integrate with VLLM?

View original on GitHub ↗

This issue has 4 comments on GitHub. Read the full discussion on GitHub ↗