--- title: "LLM-TEST.com — Hosted LLM" url: /hosted-llm/ canonical_url: https://llm-test.com/hosted-llm/ language: en type: directory summary: "Third-party providers that run open-weight models and sell access per token." last_updated: "2026-11-05" --- # Hosted LLM Third-party providers that run open-weight models and sell access per token — no hardware to own. The same open model is sold by many hosts at different prices and speeds. See the price calculator for model costs, or Run Your LLM to self-host instead. ## Router & aggregator - **OpenRouter** — Model router / aggregator. Pricing: Per token — provider prices passed through, one unified bill. Known for: One API & bill for every model; auto routing & fallback. (#openrouter) ## Speed specialists - **Groq** — Fast-inference specialist. Pricing: Per token (pay-as-you-go). Known for: Extreme tokens/sec on custom LPU chips. (#groq) - **Cerebras** — Fast-inference specialist. Pricing: Per token. Known for: Record inference speed on wafer-scale chips. (#cerebras) - **SambaNova** — Fast-inference specialist. Pricing: Per token. Known for: High-speed inference on RDU hardware, incl. huge models. (#sambanova) - **Fireworks AI** — Serverless + fast inference. Pricing: Per token, or per GPU-second (dedicated). Known for: Fast serving (FireAttention) + fine-tuning. (#fireworks) ## Serverless open-model APIs - **Together AI** — Serverless + dedicated inference. Pricing: Per token, or per GPU-hour (dedicated / training). Known for: Broad open-model catalog + training/fine-tuning. (#together) - **DeepInfra** — Serverless open-model API. Pricing: Per token — among the lowest. Known for: Among the cheapest per-token open-model prices. (#deepinfra) - **Replicate** — Run-any-model API. Pricing: By compute time (per second), or per token. Known for: Run almost any open model; strong for image/video too. (#replicate) - **Novita AI** — Serverless API + GPU rental. Pricing: Per token (low), plus on-demand GPUs. Known for: Low-cost open-model API and GPU rental. (#novita) - **Baseten** — Model deployment platform. Pricing: Per GPU-minute (deploys), or per token (Model APIs). Known for: Production deployment of open & custom models. (#baseten) - **Hugging Face** — Hub + inference providers. Pricing: Per token (routed to partner providers). Known for: The open-model hub; routes inference to partners. (#hf) ## Edge / cloud - **Cloudflare Workers AI** — Edge / serverless inference. Pricing: Per token (metered in “neurons”). Known for: Open models at the network edge, close to users. (#cloudflare) Full detail per provider (about, backing, latest highlight, links) is on the HTML page: https://llm-test.com/hosted-llm/ — hash-routed, e.g. https://llm-test.com/hosted-llm/#openrouter. ## Frequently asked questions ### What is a hosted open-weight LLM? A hosted open-weight LLM is an open model, such as Llama, Qwen, DeepSeek or Mistral, that a third-party company runs on its own GPUs and sells to you per token through an API. You get the flexibility of open models without buying hardware or managing servers. Providers such as Groq, Together AI, Fireworks AI, DeepInfra, Cerebras and SambaNova compete on price, speed and reliability, so the same model can cost very different amounts depending on the host. Most expose an OpenAI-compatible API, which means switching often needs only a changed base URL and API key. This page lists the main hosts so you can compare them and pick one that fits your workload. ### How is hosted LLM pricing different from OpenAI or Anthropic? The billing model is the same, because you pay per million input tokens and per million output tokens, but the rates are often much lower. Since an open model can be served by many companies, they compete, and prices for a given model are frequently a fraction of what the closed frontier models cost. Some hosts also offer a free tier, batch discounts or cheaper cached input. Prices differ between hosts for the identical model, so it pays to compare. Quality is not identical either: open models trail the very best proprietary ones on the hardest tasks. Use the price comparison (/) to see how a hosted model stacks up against closed models for your own typical prompt. ### Which hosted provider is the fastest or cheapest for open models? There is no single winner, because it depends on the model and the metric. Companies with custom inference chips, such as Groq, Cerebras and SambaNova, are known for very high tokens-per-second speeds, which suits real-time and agent workloads. General GPU clouds such as Together AI, Fireworks AI, DeepInfra and Novita AI often compete hardest on price per million tokens and offer large model catalogs. Aggregators such as OpenRouter route requests across several hosts for you. Speed, price, context length, quantization level and rate limits all vary by model, and they change often. Compare the cards on this page, then test your own prompt on two providers before you commit. ### Is it safe to send my data to a hosted LLM provider? Safety depends on the provider's terms, so read them before you send anything sensitive. Check whether prompts are stored, for how long, and whether they are used for training. Reputable hosts state a no-training policy for API traffic, offer data processing agreements and publish security certifications, and some offer zero data retention or region choices. Because these companies are smaller and more varied than the big labs, the differences are larger, so verify instead of assuming. If your data is highly confidential, the stricter alternative is running the same open model yourself; see Run Your LLM (/run-your-llm/). For ordinary public or low-risk content, a hosted API is typically a reasonable trade-off. ### Can I switch between hosted providers without rewriting my code? Usually yes. Most hosted providers implement an OpenAI-compatible chat completions API, so in many cases you only change the base URL, the API key and the model name. Model names differ between hosts, and features such as tool calling, JSON mode, vision and prompt caching are not supported equally everywhere, so test the features you rely on. To avoid lock-in entirely, put an AI gateway or router in front, which gives you a single endpoint and lets you move traffic or add automatic fallback if a host goes down. The AI Gateways (/gateways/) page compares those options, including OpenRouter, LiteLLM and Portkey. ## Other pages on this site - Price comparison (home): /index.md - Model directory: /models.md - Company profiles: /companies.md - Run your LLM: /run-your-llm.md - Hosted LLM: /hosted-llm.md - AI gateways: /gateways.md - LLM updates: /updates.md - Blog: /blog.md - Contact: /contact.md - Privacy: /privacy.md - Terms: /terms.md - Imprint: /imprint.md