@fishidwardrobe could you elaborate on that, why do you say that GPT is incapable of learning the way a human child does?
Top-level
@fishidwardrobe could you elaborate on that, why do you say that GPT is incapable of learning the way a human child does? 3 comments
@johnstonphilip @fishidwardrobe I meant in a sense of building a predictive model of the environment through interaction. @yogthos @johnstonphilip Well, it doesn't do that. It's really not much better in that respect than ELIZA – the difference is, instead of just the prompt, it has gigabytes of text to work with and does so in a cleverer way. But it still has zero understanding. It's a "Chinese Room", broadly speaking. There's plenty of information out there about how LLMs work. You might start by searching for a paper called "Stochastic Parrots". |
@yogthos @fishidwardrobe what does “learning the way a human child does” mean? That statement could literally mean millions of different things depending on subtle context differences.