Skip to main content
To use LlamaIndex with abliteration.ai, instantiate OpenAILike with api_base="https://api.abliteration.ai/v1" and your ak_... key.

​
Install

pip install llama-index llama-index-llms-openai-like

​
Usage

from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(
    model="abliterated-model",
    api_base="https://api.abliteration.ai/v1",
    api_key=os.environ["ABLIT_KEY"],
    is_chat_model=True,
)

print(llm.complete("Hello").text)
See the compatibility matrix for what’s supported.
Last modified on May 3, 2026