Email or username:

Password:

Forgot your password?
3 posts total
Josh Collinsworth

It occurs to me that LLMs ("AI," if you like) are used pretty much exclusively in areas where quality is difficult to define.

Art, service, design, communication, writing...arenas full of ambiguity, where it's hard to quantify success or failure.

It strikes me that LLMs are deployed mainly here, rather than in less equivocal places, at least in part because this masks the terminal flaw of LLMs:

They are designed for generation, not for accuracy.

They are not at all truthful or reliable.

mattg

@collinsworth and the reliability cannot be fixed without breaking the generation. Writhing that realm LLMs are also deployed where "not very good" is considered "good enough." That is, "it's better than i can do and it's irrelevant that it's not as good as the human i can't afford to hire." Art and design are also faster to verify and avoid the worst mistakes.

Arthur Clune

@collinsworth is that true though? There’s a lot of us of LLMs as coding assistants

Josh Collinsworth

I think we're focused on the wrong thing when we look at what tech works for a company like Amazon or Facebook or Netflix.

We should be looking at what tech works when you *don't* have a small army of staff engineers optimizing it. I want to know what I can scale *without* paying someone a half million dollar salary to do it.

There should be more case studies on things that don't have a billion-dollar company propping them up, humming along quietly on a cheap-ass VPS somewhere.

Show previous comments
Suran

@collinsworth

But who would pay for that case study then?

@atkelar

Daniel Hardy

@collinsworth “100 amazing technologies you can setup in a day and then never worry about again”.

Ivan Sagalaev :flag_wbw:

@collinsworth after hearing this reasonable take being ignored through my entire professional career, I gave up. Excited engineers will always follow "industry leaders" without criticism. Dissent is confused with ignorance.

Josh Collinsworth

I took this photo of my kid playing with his blocks the other day, and when I realized it reminded me of something, well...I had to make this.

A precariously stacked tower of wooden blocks nearly four feet high. The tower itself is labeled "all modern digital infrastructure."

The entire structure is clearly held up by one thin pillar on the bottom of the left side, which, if removed, would cause the entire tower to collapse. This pillar is labeled "a project some random person from Nebraska has been thanklessly maintaining since 2003."
Show previous comments
Håkon Alstadheim 🇪🇺 🇳🇴🇺🇦

@collinsworth You should put a credit to xkcd.com/2347/ there, but thanks for letting me feel I'm in the "in"-group :)

Warren Currie 🦠🦐

@collinsworth please add the original Randall Munroe xkcd comic link "Dependency" to the alt-text.
xkcd.com/2347/

image
Go Up