Email or username:

Password:

Forgot your password?
David Chisnall (*Now with 50% more sarcasm!*)'s posts Post Back to profile
Top-level
naught101

@ErikJonker @resuna @david_chisnall

Huh? Perfectly?

There have been multiple instances of people showing LLMs getting answers wrong to the most basic arithmetic problems. That's not a bug, it's an inherent feature of the model, which draws meaning from language only and has no concept of maths.

That incorrectness can only get more likely as math problems get more complex. And the more complex it gets, the harder it is for humans to detect the errors.

How is that perfect for education?

1 January at 21:24 | Wall-to-wall | Open on mastodon.social
7 comments
Erik Jonker

@naught101 @resuna @david_chisnall as a support tooll during homework, where it can give additional explanation, I see a bright future for the current best models (for highschool level assignments) , for text based tasks they are even better (not strange for LLMs) . Ofcourse people have to learn to check and not fully trust, at the same time there is a lot of added value. It's my personal/micro observation but i see it confirmed in various papers

1 January at 21:35 | Open on mastodon.social
RAOF

@ErikJonker @naught101 @resuna @david_chisnall

Of course people have to learn to check and not fully trust,

This is what makes them particularly ill-suited for educational tasks. A large part of education on a subject is developing the ability to check, to have an intuition for what is plausible.

1 January at 22:13 | Open on toot.cat
Erik Jonker

@RAOF @naught101 @resuna @david_chisnall true, but you can adapt and fine tune models for that purpose

1 January at 22:15 | Open on mastodon.social
RAOF replied to Erik

@ErikJonker @naught101 @resuna @david_chisnall can you? How? Is there an example of this that you have in mind, or is this more a “surely things will improve” belief?

What is the mechanism that bridges “output the token statistically most-likely to follow the preceding tokens” and “output the answer to the student's question”?

1 January at 22:43 | Open on toot.cat
RAOF replied to RAOF

@ErikJonker @naught101 @resuna @david_chisnall also, isn't the task you're suggesting is possible just equivalent to “make an LLM you don't need to check the results of”?

1 January at 22:46 | Open on toot.cat
Dmitri Ravinoff

@ErikJonker
I read this a lot (help in learning context) but it doesn't gel with my learning experience: Someone or something that "gives explanation" but at the same time "can't be trusted" (not to tell bullshit) is totally useless in this context. Or not?
@naught101 @resuna @david_chisnall

2 January at 1:17 | Open on social.tchncs.de
violetmadder

@ErikJonker @naught101 @resuna @david_chisnall

The support students need for their work, is A HUMAN BEING WHO IS GOOD AT UNDERSTANDING AND EXPLAINING THINGS.

A good teacher/tutor/sibling/etc can break down an explanation and present it in different ways tailored to the student's understanding. They can look at a student's work and even if it's incorrect, see what the student's train of thought was and understand what they were trying to do.

Our society already drastically undervalues that crucial, mind-accelerating work-- arguably the most important of all human endeavors, as everything else relies on it.

Glorified stochastic parrots spewing botshit are no damned substitute.

@ErikJonker @naught101 @resuna @david_chisnall

The support students need for their work, is A HUMAN BEING WHO IS GOOD AT UNDERSTANDING AND EXPLAINING THINGS.

A good teacher/tutor/sibling/etc can break down an explanation and present it in different ways tailored to the student's understanding. They can look at a student's work and even if it's incorrect, see what the student's train of thought was and understand what they were trying to do.

2 January at 3:56 | Open on kolektiva.social
Go Up