
Guides 4 min read· Aug 6, 2026· By Guides
LlamaIndex + TokenRex — setup
Point LlamaIndex's OpenAI class at TokenRex and keep every downstream RAG pattern.
Same story as LangChain — LlamaIndex accepts a base_url on its OpenAI LLM class.
python
from llama_index.llms.openai import OpenAI
llm = OpenAI(
model="openai/gpt-5.4-mini",
api_key="sk-tb-...",
api_base="https://tokenrex.ai/api/public",
)