Gregory's Server@yogthos That would be the completely different approach I was talking about, then, because the current approach is incapable of "learning like a child".
|
4 comments
@yogthos @fishidwardrobe what does “learning the way a human child does” mean? That statement could literally mean millions of different things depending on subtle context differences.  @johnstonphilip @fishidwardrobe I meant in a sense of building a predictive model of the environment through interaction.  @yogthos @johnstonphilip Well, it doesn't do that. It's really not much better in that respect than ELIZA – the difference is, instead of just the prompt, it has gigabytes of text to work with and does so in a cleverer way. But it still has zero understanding. It's a "Chinese Room", broadly speaking. There's plenty of information out there about how LLMs work. You might start by searching for a paper called "Stochastic Parrots". |
@fishidwardrobe could you elaborate on that, why do you say that GPT is incapable of learning the way a human child does?