muna

Compiled inference.
Your OpenAI client.

This is Muna's OpenAI-compatible inference gateway. Point the official OpenAI SDK at https://inference.muna.ai/v1 and call any compiled model below.

Live models

@qwen/qwen-3.8-27b

Quick start

from openai import OpenAI

# 💥 Create a client with the Muna URL
client = OpenAI(
    base_url="https://inference.muna.ai/v1",
    api_key="<your Muna API key>"
)

# 🔥 Create a chat completion
completion = client.chat.completions.create(
    model="@qwen/qwen-3.8-27b",
    messages=[{ "role": "user", "content": "What is a GPU?" }]
)

# 🚀 Print the output
print(completion.choices[0].message.content)
Get an API key