Some notes on NuExtract, a family of small LLMs fine-tuned for structured data extraction https://simonwillison.net/2024/Nov/16/nuextract-15/
Some notes on NuExtract, a family of small LLMs fine-tuned for structured data extraction https://simonwillison.net/2024/Nov/16/nuextract-15/ 3 comments
@jamwil I've not had success running it yet - just got a tip (added to my post) that temperature 0 helps |
@simon Did you have much luck with this? I played around with the GGUF quant but it seemed to falter and miss fields once I deviated from the published json templates even slightly.