Tencent: Hy-MT2-30B-A3B

Get your API key

Create a key on the keys page and set it as an environment variable: Keys

export INFAPI_API_KEY=sk-...

Make your first request

Use tencent/hy-mt2-30b-a3b

import requests

response = requests.post(
    "https://infapi.cc/v1/chat/completions",
    headers={
        "Authorization": "Bearer $INFAPI_API_KEY",
        "Content-Type": "application/json",
    },
    json={
        "model": "tencent/hy-mt2-30b-a3b",
        "messages": [
            {
                "role": "user",
                "content": "Introduce yourself in three sentences."
            }
        ],
        "temperature": 0.7,
        "max_tokens": 512
    },
)
response.raise_for_status()
print(response.json()["choices"][0]["message"]["content"])

Using third-party SDKs

Point the OpenAI SDK at https://infapi.cc/v1 with $INFAPI_API_KEY. The HTTP samples above are the request shape this gateway accepts.

from openai import OpenAI

client = OpenAI(
    base_url="https://infapi.cc/v1",
    api_key="$INFAPI_API_KEY",
)

response = client.chat.completions.create(
    model="tencent/hy-mt2-30b-a3b",
    messages=[{"role": "user", "content": "Introduce yourself in three sentences."}],
    temperature=0.7,
    max_tokens=512,
)
print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://infapi.cc/v1",
  apiKey: "$INFAPI_API_KEY",
});

const response = await client.chat.completions.create({
  "model": "tencent/hy-mt2-30b-a3b",
  "messages": [
    {
      "role": "user",
      "content": "Introduce yourself in three sentences."
    }
  ],
  "temperature": 0.7
});

console.log(response.choices[0]?.message?.content);

Supported parameters

• max_completion_tokens

  Max completion tokens

  Same idea as max_tokens. Some newer models use this field instead.

• max_tokens

  Max tokens

  Upper bound on generated tokens. Output stops at the limit.

• response_format

  Response format

  For example json_object or json_schema, to constrain the shape.

• stop

  Stop

  Stop when these strings are produced. A string or an array of strings.

• structured_outputs

  Structured outputs

  Generate a parseable structure that follows a JSON Schema.

• temperature

  Temperature

  Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.