[Feature Request] Enable local llm mode for offline use.
Resolved 💬 4 comments Opened Apr 17, 2025 by vulnerablecodes Closed Apr 17, 2025
💡 Likely answer: A maintainer (tibo-openai, collaborator)
responded on this thread — see the highlighted reply below.
It would be great to have the option to run local llm models via ollama or llm studio for an offline mode when internet is not available or not an option etc.
Showing cached comments. Read the full discussion on GitHub ↗
3 Comments
Additionally, it would be great to have support for directly loading and generating with Hugging Face models using the transformers library. In some environments (e.g., secure or restricted setups), tools like Ollama or LLM Studio aren’t permitted or feasible to use.
Adding support for native transformers loading would make the tool more flexible and accessible.
you may lack of real world experience!!
Love the energy, but dupe of https://github.com/openai/codex/issues/26, come and discuss it there!