I questioned OP's "there is an answer online" claim so I checked and the only source found for the original question was a 5th grade Russian school for mathematics.
If your math does not involve multiplying 20 digit numbers, modern LLMs can "do" math even without a Python tool despite the counterintuition of next token prediction.
As someone who uses OpenRouter extensively (and wrote an unintentional adjacent PR piece a few days ago: https://news.ycombinator.com/item?id=48317294 ), it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late.
That said, I don't understand the people who use something a full agentic backbone with expensive models like Claude Opus with OpenRouter because that 5% surcharge is meaningful at that level of cost instead of going with the source API providers. But people are clearly doing it, and it's pure revenue.
IDK, but that sounds like something that would be better implemented with an open-source library to which providers supply support patches. Why do I need a company to act as a proxy and not just run a relatively simple shim layer on my machine?
I'm just a stupid systems programmer working in the bowels of AI and I understand there is a lot of seemingly pointless software which exists solely to provide a slight boost to convenience in exchange for money. Is OpenRouter just that? Do they actually host models themselves or centralize billing amongst various providers?
A library with a bunch of different providers doesn’t solve the payment/billing problem (which is one of the main openrouter benefits). IMO being able to buy credits and not have them locked to one provider is worth the 5% to me.
There is a lot of dumb token spend right now - tokenmaxing and such. Economic cost of token is not being evaluated carefully because there is fomo and no one wants to be left behind. But folks are waking up to it, and dumb token spending is not sustainable and will revert.
>> it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late
Cursor only supports a single model (Kimi K2.5) not made by the Big 4 labs (OpenAI, Anthropic, Google, xAI). Cursor is actually extremely bad at wide model support.
I use Cursor with OpenRouter for some projects and it's great. Most of the time I just use Auto and let Cursor use its model or choose. If I run out of quota, or I'm not getting what I want, I switch off Auto and use OpenRouter to pick Opus, Codex, or whoever(all are available). Can continue the same context if you want, type "please continue" in the agent prompt, and on you go.
Cursor has limits even when using your own key. I was even cut off using a local model. I guess they use some sort of harness that requires non-local resources? I'm not sure I've actually tried to use Cursor in a fully-offline scenario yet. Cline works well enough and doesn't require any sign-up.
One idea I had was to count # of distinct API keys that have spent atleast $100 (number's flexible), which would be enough to provide guidance on if the traffic is from a single power-user.
In the Cursor case which is BYOK, that would count as distinct API keys.
https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%...
reply