Gregory's ServerBest take on Arc Search that I’ve read so far: https://werd.io/2024/stripping-the-web-of-its-humanity
Jon Henshaw :coywolf:
10 comments
*your're
@jon My take as an average user: In an ideal web where large sites prioritized the sharing of knowledge and put profit second, this review would resonate a lot more with me. However, the web today is a mess. So much of traffic goes to sites riddled with artificial SEO boosts, invasive ads and trackers, and clickbait. I use a metasearch engine, and it’s STILL affected by manipulated result sorting. Is throwing AI at the web the solution though? No, probably not.
i am root
@jon I agree with many of the points in the article -- I tried Arc Search and didn't like its approach -- so this is mostly a tangent. I have had multiple conversations with friends and family about LLMs that start with the same anecdote: "I searched for myself and everything is wrong!" (Almost everyone is talking about ChatGPT, specifically GPT-3.5 because they don't want to pay for GPT-4). While I get the urge to perform this "test", it's actually a pretty terrible one for LLMs. 
JacksonBates
@null @jon the trouble with this thinking though is that while it was a test in this instance, it's also a perfectly reasonable thing for a normal person to do. Looking up people in search engines has many legitimate use cases beyond vanity and novelty. It's reasonable to insist these tools better show their sources plainly, with as much context as possible so as to not mislead.
i am root
@JacksonBates @jon It's a reasonable thing for people to do only because they think ChatGPT is a traditional search engine. It is not. (This is a failure of marketing though, not a failure of the end user.) Expecting LLMs to cite sources is another common misunderstanding of LLMs. They simply cannot do so in many cases. It's something that hopefully can be improved upon.
i am root
The unfortunate truth is that ChatGPT's success led to an AI goldrush. Every tech company is trying to cash in. They're wedging LLMs into places they don't belong, and are generally incentivized to lie instead of accurately describing strengths and weaknesses. The hype will calm over time and we'll see what shakes out. In the mean time, let's face it, most of us aren't famous enough to generate enough "tokens" in the corpus of human knowledge to be understood by an LLM. 
Christian Niklas
@jon "It undoubtedly has a lens through which it sees the world. That’s fine in itself — everyone does — but by removing context, you remove the clues that help you figure out what it is."
Alastair Temple
@jon it is good, and the takes shouldn't be limited to Arc Search, they stand up for gen AI in general.
Metafrastis
@jon @Gargron worst take. His beef is with the search engines Arc uses. For many, many users Arc will make the web more accessible. And the best part of it: no more ads, the plague of the modern web. |
@jon right up to the point!
The short blog post is a fantastic representation why we should stop putting trust and reliable functions in these #llm s. They are tools and should be presented as such transparently or not exist.