Gregory's Server
@simon Now that you mention it, I'm curious how different each platform is with tokens and how that might affect pricing (or just be a wash)
|
3 comments
 @dbreunig running a benchmark that processes a long essay and records the input token count for different models could be interesting though |
@dbreunig yeah it's frustratingly difficult to compare tokenizers, which sure make price per million less directly comparable