Gregory's ServerCalling LLMs from client-side JavaScript, converting PDFs to HTML + weeknotes
https://simonwillison.net/2024/Sep/6/weeknotes/
 10 comments
@webology sadly I think it still only provides access to their documented API, not the fun stuff @simon love that you found again > Within six hours of posting it my Pipe Syntax in SQL conversion was ranked third on Google for the title of the paper, [β¦]. Yet more evidence that HTML is better than PDF!  @simon no, wllama is the WASM binding for llama.cpp & can Inference the gguf files of the models within the browser itself. It is an alternative to Transformers.js (onnx files) and WebLLM (bin shards). @prem_k oh fantastic! Iβve played with https://github.com/mlc-ai/web-llm but I didnβt know about the llama.cpp port, thatβs awesome @simon #WASM is such an interesting development for web apps that can run locally in the browser, even when offline. π Slightly related note, Motherduck's 1.5 tier architecture powered by WASM is pretty cool too, especially when are able to join between tables on your browser and in your cloud in a single SQL query. Wonder what else will WASM bring. π€πΌ @prem_k I love how easy WASM makes it to run tools like Tesseract - I built this OCR tool using Tesseract.js and PDF.js and it works really well https://tools.simonwillison.net/ocr @simon wow! Didn't know about tesseract.js. This could potentially remove the need for RPA π |
@simon TIL anthropic-dangerous-direct-browser-access - Would that make it possible to access Projects and Artifacts?