Python SDK Guide

The Frosty AI Python SDK allows you to connect to your AI router and interact with LLM providers like OpenAI, Anthropic, Mistral, and Meta—without managing each provider directly.

---

📦 Installation

Install from PyPI:

Copypip install frosty-ai

---

🚀 Getting Started

Copyfrom frosty import Frosty

frosty = Frosty(
    router_id="your-router-id",
    router_key="your-router-key"
)

response = frosty.chat([
    {"role": "user", "content": "What is Frosty AI?"}
])

print(response['response'])  # ➜ "Only the best LLM router and observability tool ever. ❄️"

---

⚙️ Initialization

Copyfrosty = Frosty(router_id="...", router_key="...")

• router_id: Your router's unique ID from the Frosty console.

• router_key: Your router's secret API key.

This triggers an automatic connection and fetches your default, cost, and performance models for both text generation and embeddings.

---

💬 chat() Method

Copyfrosty.chat(prompt, rule=None, thinking=None)

✅ Handles fallback automatically if the primary model fails.

---

📌 embeddings() Method

Copyfrosty.embeddings(prompt, rule=None)

Returns a dictionary including tokens used, time, model, and result.

---

🧠 Routing Logic

• If auto_route is enabled, the SDK selects the best model based on real-time weights.

• If rule="cost" or rule="performance", it uses those respective models.

• If no rule is given, it uses your primary model.

• If any call fails, Frosty will fallback to the configured backup provider.

---

✅ Supported Providers

• OpenAI

• Anthropic

• Mistral

• Meta (via Bedrock proxy)

---

🧪 Logging + Metrics

All requests are logged automatically. You can:

Frosty also tracks token usage, model latency, and performance—feeding this data back to improve routing over time.

---

🔄 Auto-Routing Controls

Call this to let Frosty dynamically select the best model based on your weights:

Copyfrosty.set_best_model()

Or fetch the current best model chosen by the auto-router:

Copymodel = frosty.choose_best_model()

---

🧯 Error Handling

Frosty may raise custom exceptions: