AionLabs: Aion-RP 1.0 (8B)

aion-labs/aion-rp-llama-3.1-8b

Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard-Auto, where LLMs evaluate each other’s responses. It is a fine-tuned base model...

Modalities: text->text
In / out price: $0.8 / $1.6per 1M
Context: 33K
Released: Feb 4, 2025
Knowledge cutoff: 2023-12-31

Providers

Every request enters through InfAPI. One key calls every model in the catalog. Upstream groups, ratios, and tiers are not shown.

Endpoint	Input	Output	Context	Status
InfAPI	$0.8	$1.6	33K	Available

Input: Text
Output: Text
Tokenizer: Other
Max output: 29,491
Endpoint: Chat

Pricing

Listed price for this model on this gateway. Token prices are per 1M tokens.

Item	Price	Unit
Inputprompt	$0.8	per 1M tokens
Outputcompletion	$1.6	per 1M tokens

API

The gateway speaks the OpenAI Chat Completions API. Point any compatible SDK at https://infapi.cc/v1 and send the model slug below.

Get your API key

Create a key on the keys page and set it as an environment variable: Keys

shell

export INFAPI_API_KEY=sk-...

Make your first request

Use aion-labs/aion-rp-llama-3.1-8b

Python

import requests

response = requests.post(
    "https://infapi.cc/v1/chat/completions",
    headers={
        "Authorization": "Bearer $INFAPI_API_KEY",
        "Content-Type": "application/json",
    },
    json={
        "model": "aion-labs/aion-rp-llama-3.1-8b",
        "messages": [
            {
                "role": "user",
                "content": "Introduce yourself in three sentences."
            }
        ],
        "temperature": 0.7,
        "max_tokens": 512
    },
)
response.raise_for_status()
print(response.json()["choices"][0]["message"]["content"])

Endpoint

POST https://infapi.cc/v1/chat/completions

Authorization: Bearer $INFAPI_API_KEY

Using third-party SDKs

Point the OpenAI SDK at https://infapi.cc/v1 with $INFAPI_API_KEY. The HTTP samples above are the request shape this gateway accepts.

Python (OpenAI)

from openai import OpenAI

client = OpenAI(
    base_url="https://infapi.cc/v1",
    api_key="$INFAPI_API_KEY",
)

response = client.chat.completions.create(
    model="aion-labs/aion-rp-llama-3.1-8b",
    messages=[{"role": "user", "content": "Introduce yourself in three sentences."}],
    temperature=0.7,
    max_tokens=512,
)
print(response.choices[0].message.content)

TypeScript (OpenAI)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://infapi.cc/v1",
  apiKey: "$INFAPI_API_KEY",
});

const response = await client.chat.completions.create({
  "model": "aion-labs/aion-rp-llama-3.1-8b",
  "messages": [
    {
      "role": "user",
      "content": "Introduce yourself in three sentences."
    }
  ],
  "temperature": 0.7
});

console.log(response.choices[0]?.message?.content);

Supported parameters

max_tokens
Max tokens
Upper bound on generated tokens. Output stops at the limit.
temperature
Temperature
Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.
top_p
Top-p
Sample only from tokens whose cumulative probability reaches top_p.

FAQ

What is this model?

Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard…

How much does it cost?

$0.8 / $1.6

What inputs and outputs does it support?

text->text

When was it released?

Feb 4, 2025

Try this model