Gregory's Server@simon Did you have much luck with this? I played around with the GGUF quant but it seemed to falter and miss fields once I deviated from the published json templates even slightly.
|
2 comments
|
|
Top-level
@simon Did you have much luck with this? I played around with the GGUF quant but it seemed to falter and miss fields once I deviated from the published json templates even slightly. 2 comments
|
@jamwil I've not had success running it yet - just got a tip (added to my post) that temperature 0 helps