Email or username:

Password:

Forgot your password?
Rod Hilton

Right now if you search for "country in Africa that starts with the letter K":

- DuckDuckGo will link to an alphabetical list of countries in Africa which includes Kenya.

- Google, as the first hit, links to a ChatGPT transcript where it claims that there are none, and summarizes to say the same.

This is because ChatGPT at some point ingested this popular joke:

"There are no countries in Africa that start with K."
"What about Kenya?"
"Kenya suck deez nuts?"

Google Search is over.

279 comments
Mix

@noondlyt @JStatePost @rodhilton I'm here to help and provide a positive experience. If you're feeling frustrated, let's try to work through it together. Is there something specific that's bothering you?

NotHelpfulUntilIAm๐Ÿฅค ๐ŸŒ› ๐Ÿ—„๏ธ

@noondlyt @rodhilton That's how they get ya: You want to punch the scamming tool, yet there are human scammers behind it.

Chuck

@rodhilton It also looks like none of the results that Google displays provides the answer. The ones that look like they might are scam sites.

It does provide the answer under the "People also ask" section, but since those are hardly relevant to me the majority of the time, I tend to ignore that section.

Chuck

@rodhilton Also, my Google Home gave the exact same answer as the ChatGPT one. I need to get rid of that thing.

LAUREN

@chuck @rodhilton naturallllly! this is the exact reason you only use them to turn your lights on and off and play music! ๐Ÿ˜ƒ

CaryJM

@rodhilton Not that this contradicts the main point (that Google Search is over, which I agree with) but this same query in Google for me provides the correct result. Incredibly low bar but it does come back correct.

Rod Hilton

@Caryjm the fact that Google was doing this went viral on a lot of socials and I believe there was a frontpage HN post about it as well, so Google has patched the query to fix this. It's working for me now as well.

CaryJM

@rodhilton that was what I was assuming as well - so egregious and with enough visibility that a manual fix was required. 100% agree with your thesis - if youโ€™re looking for a fact which is known, Google no longer useful as a way to get it

kaup

@Caryjm @rodhilton I just did it, and exactly wrong. Not patched.

skelric

@Caryjm @rodhilton
Looks like AI was the weak link in the chain.

DELETED

@rodhilton @Caryjm

I checked just now and it is still showing the wrong information.

ClickyMcTicker

@rodhilton @Caryjm It still produces the incorrect result as of this post. The suggested search query omits โ€œthe letterโ€ from the query (see my other comment) which produces a correct result.

Bornach

@rodhilton @Caryjm
Asking Google Home mini still fails for me

Crows Labyrinth

@Caryjm

Not for me. I get the wrong answer from Google.

@rodhilton

le Pรฉtomane Ancien

@Caryjm @rodhilton I couldn't believe that this was anything but an urban legend so I queried Google. Sure enough, it give me the bogus chatGPT answer.

#DuckDuckGo gave me a reasonable and accurate list of websites with the right answer.

Google, you are dead to me.

ClickyMcTicker

@Caryjm @rodhilton Did you type โ€œcountry in Africa that starts with the letter kโ€ or โ€œcountry in Africa that starts with kโ€? The former produces the result seen above, and the latter produces the result you received (albeit that same result is the second on the list behind the correct answer)

Isho'ye

@rodhilton This is the snippet that I get, but the first link below that, and the "people also ask" section is the wildly incorrect AI-generated one.

Rod Hilton

@wuffish yeah they fixed it after news of this search went viral

David Nash

@elin @kaup @rodhilton @wuffish Just tried it.

The following queries (in separate Firefox container tabs) still give the ChatGPT garbage:

"what is a country in africa that starts with k"
"countries in africa that start with k"

Konchog Tenzen Sangpo

@rodhilton uh... Wtf!
But well, it's always been (and what the majority maybe never learned in the first) that Google ain't a fact finding machine, same as (academic) Wikipedia often is years behind actualities

DELETED

@rodhilton The Age of Google Search is over

That last line reminded me of #LOTR so I made this heh heh:

Da Nobs

@rodhilton
works for me...
but probably because I use the "german" google

Artemis

@nobs
It may also vary person to person. What with search histories and all, we aren't all given the same results anyway. Which is possibly more insidious because some people will be given bullshit answers and others won't even see that happening.
@rodhilton

RolloTreadway

@nobs @rodhilton I get the same as that. But read it carefully. Tanzania to the north? Ethiopia southwest? Somalia on the southern border?

Ed Maste

@rodhilton I see lots of replies that report it was fixed, but I got the bogus result just now. Incredible.

Dweebish

@rodhilton Might want to check the alt text on these images

wendinaokland

@rodhilton And we're, well, someone, is worried about AI becoming SUPER INTELLIGENT? ๐Ÿ‘€

Import Antigravity

@wendinoakland @rodhilton I'm not convinced humanity is even intelligent so I don't even know if we'd realize if we ever made a super intelligent AI.

adaddinsane (Steve Turnbull)

@wendinoakland @rodhilton

These glorified autocomplete systems have zero chance of becoming intelligent because that's not what they're programmed for.

Nobody knows how to make something that's intelligent.

The "open letter warning about AIs being dangerous" was a deliberate distraction and PR stunt:

"Don't look at how we're screwing up all knowledge, look over here at this pretend threat. See how we're good people to be worried about something that we're pretending could harm you."

Prasenjeet Dutta

@rodhilton they appear to have fixed it now, but absolutely agree itโ€™s no longer as relatively great as it used to be.

Michiel Zandbelt โš•๏ธ

@ErikJonker @rodhilton that might be but the Google algorithm is definitely broken (that is the algorithm it serves for me), given the first two nonsense hits that show up. Google once used to be of higher quality search results....a pity.

Michiel Zandbelt โš•๏ธ

@ErikJonker @rodhilton I still use Google though...(and sometimes DuckDuckGo but should perhaps be the other way around) I am open for suggestion for better search engines ! Not fully convinced re: Qwant (don't know why)

Erik Jonker

@zandbelt
Google is still great in my opinion, regardless it makes mistakes
@rodhilton

Erik Jonker

@zandbelt @rodhilton ... I like perplexity.ai , in addition to Google, yes it's an LLM and can't be trusted, you have to check results, but it provides sources to make that easier

adaddinsane (Steve Turnbull)

@ErikJonker @zandbelt @rodhilton

If you have enough knowledge to check the result, fine.

But (a) people are lazy (proofs already exist of people who know but didn't check); and (b) what about the people who don't know any better?

And when these systems start eating their own garbage it will just escalate into utter insanity.

Erik Jonker

@adaddinsane @zandbelt @rodhilton ...the assumption is I think (which might be correct) that these tools will get better, ofcourse mistakes will remain but that's also possible with traditional search

Michiel Zandbelt โš•๏ธ

@ErikJonker @rodhilton more or less the same that applies to ChatGPT, luckily you are still required to think and judge for yourself on top what is generated and presented faster then you can manage (but it is also a bit scary when you start thinking whether others will judge the results with care or just take things for granted...am I to cynical here? or in other person's view the guy that feels he is the genius and elite while others are just "stupid" idiots? Hope not...it IS quite scary?!)

adaddinsane (Steve Turnbull)

@ErikJonker @rodhilton @zandbelt

Try asking it what weighs more: a ton of iron, or two tons of feathers.

miawgogo :class800:
@ErikJonker @rodhilton @zandbelt so if you ask it the prompt that gave that response that Googles quoting, it still gets it wrong
DELETED

@rodhilton AI: spreading misinformation faster

Hugh Young

@WahbAllat @rodhilton

No, AI actually _generates_ misinformation.

NecroBelch

@rodhilton tbf you searched with a lower case โ€œkโ€

Servelan

@NecroBelch @rodhilton If you used the quotes, you were telling Google to be precise. The quotes make it look like Google search is busted, but if you leave off the quotes, you get Kenya and you can use upper or lower case k.

Tasin :linux: :vivaldi_red:

@rodhilton Idk, but it feels like duckduckgo shows better results than google. Surly Google shows more info but most of them useless. While ddgo shows legitimate results.

Edelruth

@rodhilton

Which is why I am using #DuckDuckGo to track down a replacement gasket for my dryer door. No thank you Google, I do not want to purchase a new dryer.

ahimsa

@rodhilton I tried it and got similar bad results from Google. That bogus Emergent Mind result was the second link listed, not the first one. The 5th resultwas a reddit post from 2021 claiming there are no countries in Africa that start with K.

DuckDuckGo returned a different list of countries (countries-ofthe-world.com/coun) as the first link.

Dizz

@ahimsa_pdx @rodhilton That's very similar to what I got too. After the Reddit one there was also an IFunny which had the same stuff as the reddit post. The other things in the list were kind of random sites with lists of countries - not in Africa - starting with K.

Jan :rust: :ferris:

@rodhilton I've just tried it myself and I am actually speechless.๐Ÿค

ChatGPT: "Being speechless is actually a symptom of..."

Bruce Mirken

@rodhilton Amazingly, the bogus result is STILL at the top of #Google's results page. #AI

Ian Hecht

@rodhilton Argh! My students will inevitably use the first result that pops up on Google because they assume it's authoritative. I guess I'll be teaching them all to use an alternate search engine this year...

DELETED

@rodhilton The first step after installing a browser is making sure you pick a search engine thatโ€™s not an advertising platform masquerading as a search engine.

Reinout van Schouwen

@thelazywriter
That's where it goes wrong. People get a browser pre installed on their phone or PC. Installing another one is just too much trouble, if they even know you can do so.
@rodhilton

DELETED

@reinouts @rodhilton Microsoft got in trouble for IE back in the day, but I guess nothing really changed. In fact, it got worse. Now they are pushing Edge. For example, on a Mac, web-based MS Teams only lists Chrome and Edge as compatible browsers, though it does work in Safari thankfully.

Christian Mutig ๐Ÿ‘ป๐Ÿšซ

@rodhilton Often times DuckDuckGo's search results leave a lot to be desired, at least from my own experience. That's why I switched back.

Wolf

@rodhilton

I get the correct result, but the 3rd link down is the wrong result. So it's partially fixed.

AnnieBuddy

@rodhilton

I had to do it. This is what I got...

"While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound. It's always interesting to learn new trivia facts like this."

WTF?!?

Ashi Helvetica

@rodhilton jesus hercules christ itโ€™s still doing it on my end

Tamitha

@rodhilton I wonder why I get a different result?

Maybe Google "fixed" it? Or maybe I'm not opted into AI search results?

Is this a thing Google is trialing?

Noah Cook

@rodhilton Google search has been going downhill for some time. It thinks Medicare and Medicaid are the same program, likely because there is a federal agency called the Center for Medicare and Medicaid Services, and so it sees the two names connected very often.

For some reason Google also believes that "hyper" and "hypo" are synonyms.

It has been a long time since I have been able to use Google for anything work-related. It's quicker and easier to email a colleague for a link.

MarkusL

@rodhilton Companies are so busy racing each other to include "AI" in their products that they haven't noticed it doesn't actually work.

Search engines are now life-critical infrastructure. "Move fast and break things" is grossly irresponsible.

marthasterias

@rodhilton had to try it, hoping maybe it's a regional thing or got fixed, but no. Absolutely amazing.

Edit: even bing manages to bring up an alphabetical list of African countries.

Kevin Karhan :verified:

@rodhilton *nodds in agreement*

As much as one can criticize #duckDuckGo for a lot of their search results being bad [don't use them for anything re: #trans #healthcare cuz they'll vomit up #transmisogynist #hate #propaganda] they at least know how to make their #InstantAnswers work and spit out the correct result to something from #StackOverflow / #ServerFault 97,5% of the time...

Andrei Kucharavy

@rodhilton

If that can help the issue predates ChatGPT, and by quite a lot. Just a couple of examples I have myself confirmed:

-- Google top blurb used to cite @malwaretech as the creator of NotPetya

- Google top blurb used to cite half-life of Cs-137 at 6 days, not 30 years (while linking to the correct wikipedia page)

- Google list of greatest scientists used to include Didier Raoult, becuase they once in early 2020 Macron referred to him as such and reputable sources reported about it

ryan harg :antifa:

@rodhilton i get a different result, but equally shitty: 'While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound.'

C.S.Strowbridge

@rodhilton
I had heard about this issue. I didn't realize it was based on a Deez Nuts joke.

Tofu Golem

@rodhilton
Google is now useless as a search engine. Is that a good thing or a bad thing?

๐Ÿต holly ๐ŸŒฟ

@rodhilton I just tried it and.. wow. Yep. I havenโ€™t used Google for search in years and Iโ€™m feeling very smug about that at the moment ๐Ÿ˜…

John C Dvorak

@rodhilton I just tried this now and got the same wrong results by Google. Wow. Here is my screen capture:

Heidelberg
I just did it. Got the same stupid result.
Krรณl Julian

@rodhilton It's not chatGPT - it's the first site with article about African's country starts with K

RolloTreadway

@rodhilton I now get this. Google does recognise Kenya again. Phew!

But read the description of Kenya. Then look at a map if you need to. This is not great.

RolloTreadway

@rodhilton It has been wisely pointed out to me that I wrote 'countries'. If I put 'country', I get the 'Kenya isn't spelt with K but K' one, 'countries' gives the list of wrong information.

Not sure which is worse?

PeachMcD

@rodhilton

Been using DDG for over a year now. No regrets whatsoever

tom4okstate

@rodhilton starting to thank the odds of human labor being replaced by machines in the short term is overstated.

Jacob Ras

@rodhilton those fake questions in Google Search are incredibly annoying. I keep opening them when I use Google and they never contain the actual answer to the question. Usually if you click open the site there's a completely different question.

But for me Google Search already died when they started randomly moving the Images tab around.

Geo

@rodhilton I tested #Ecosia (which gives the same results like #Bing) and these are the same like #DuckDuckGo. I hope Bing doesn't start to follow #Google with these types of ideas.

Commander KEEN ๐Ÿ‘พ

@rodhilton

Startpage.com works also and find the List of African countries

Emo Vulcan

@rodhilton can confirm this: just tried in a couple private browsers:

Lyle Solla-Yates

@rodhilton i could not believe this so I had to test it. Yes, Google is broken.

MichaelleMagnum

@rodhilton We should be careful about the extent to which we rely on technology.

Niedliche Nacktschnecke

@rodhilton @tante funnily, doing the same google search in german gives a decent answer. Appears different languages are silos in llm (wasnt obvious to me untili typed this)

Suzka

@rodhilton @JamesGleick I had been reporting bad search results w screenshots to Google using their Feedback mechanism, but I stopped after my fifth report when I realized that the feedback wasnโ€™t going anywhere. Just moved on to DDG

Mikey B

@rodhilton Bing also responds correctly.

Iโ€™m actually kinda glad that the "King" (Google) fails here.

Womp womp

not sam

@mikeyb @rodhilton as of my timestamp, Google web on mobile is still wrong

Mattstamatic

@rodhilton

This is actually hilarious ๐Ÿคฃ๐Ÿคฃ

bun

@rodhilton kenya suck deez nuts is funny what can I say

prozacchiwawa

@rodhilton alternate timeline in which all humanity lives in kenya because google never fixed this and it was the only country the AIs couldn't figure out how to find in the google maps api.

prozacchiwawa

@rodhilton "google secures naming rights to the country known as kenya for $60b in bid to solve AI discrepancy"

MigMit

@rodhilton Feels strange defending the old Googy, but... Google Search was never meant to be the source of truth. It is what it is: a search. If you create a text file somewhere on your computer with "2x2=5" in it, and then do a search for "2x2", there is a good chance the top result would say "5".

Of course, they still feel pressured to correct this result (and they did), but maybe it would be better if they didn't. Providing somewhat accurate information is Wikipedia's job.

Pete Alex Harris๐Ÿฆก๐Ÿ•ธ๏ธ๐ŸŒฒ/โˆž๐Ÿชโˆซ

@rodhilton
Back when I first started using the internet, I got into the habit of guessing which set of key words would probably occur on a page with the info I wanted, and was bewildered that people would just naively type a question into the search box as if asking a person. That couldn't possibly work!

I never got out of the habit of computer-programmer-brained keyword search, which is good, because if typing a natural language question ever did briefly work well, those days are gone.

@rodhilton
Back when I first started using the internet, I got into the habit of guessing which set of key words would probably occur on a page with the info I wanted, and was bewildered that people would just naively type a question into the search box as if asking a person. That couldn't possibly work!

levampyre

@rodhilton I wonder if we will return to paper book catalogues one day because of this. Libraries are still curated by humans. ๐Ÿค”

Servelan

@rodhilton I get this as the first result if I remove the quotes, and I wouldn't search with the quotes by default for that kind of query:

**Kenya** is located on the eastern coast of Africa and borders Somalia to the northeast

mori_au ๐Ÿ‡ฆ๐Ÿ‡บ

@rodhilton Yay - this is what you get when you chase dollars instead of sense.

Ralf Stockmann

@rodhilton chatGPT4 like thisโ€ฆ People (and obviously Google) should REALLY stop using chatGPT 3.5 itโ€™s utter crap compared to 4

Dr. Heather Etchevers

@rodhilton When I am signed in, I get only partly more accurate answers than when I am not. Even more cynical.

Ivar Abrahamsen ๐Ÿ‘จโ€๐Ÿ”ง

@rodhilton I have used DuckDuckGo for years but used to follow up with a further !g search on Google maybe 1/3 or 1/2 of the time. Lately not so much as the result on Google are often worse. Quite a few times this week Google even stated there are no results whilst DDG returns lots.

KingDead

@rodhilton This led me down a rabbit hole of how to block crap sites from Google search results and discovering uBlacklist. It works with multiple search engines, including DDG if you need to fine-tune things to avoid junk sites. You can even have subscription lists for maintained blocklists so you're not doing it all on your own.

github.com/iorate/ublacklist

RubenKelevra

@rodhilton Try asking ChatGPT how heavy a black hole is.

It will claim that it's infinity heavy or has infinite mass.

Then asks how stuff can rotate around it, if the mass is infinite, as everything would just be pulled in with infinite gravitational pull.

Then it will be confused and claim it's not infinite, but just very large.

The ask something related to the weight of the black hole and it will claim again that their mass is infinite.

It ingested *way* too much bullshit in this regard.

devolute

@rodhilton Things are even worse than this suggests. Lots of the changes to Google's SERP hints that more and more queries will be answered without any context/sources, so your detective work - regarding how it got things wrong in this case - will not be possible.

kinyutaka

@rodhilton

What I love about it is that it says that Kenya doesn't start with a letter K. It is spelled with a K sound.

Spellbind0127

@rodhilton seems to have been fixed when I google that I get a list of countries that start with the letter k

David McLain

@rodhilton I would not recommend selling your Google stock based on this post.

Jeltron

@rodhilton At this rate chat GPT couldnt even win a beauty pageant

Ahmed Zeidan :mastodon:

@rodhilton I asked my own OpenAI API #GPT 3.5 and got the right answer.

#ai

Jonathan Emmesedi

@rodhilton
I have now switched my default search engine to DuckDuckGo.

Bonkers

@rodhilton Kenya is in East Africa, not Africa, you silly dumdum

Tushar Chauhan

@rodhilton Absolutely love this! Now that it has been roasted in the limelight a while, Google can release a state-of-the-art edge-case hack for this particular problem.

ๅฝ้‡Œๅ’•ๅ™œ

@rodhilton ๆœ‰ไบ† AI ไน‹ๅŽ๏ผŒ่ฟ™็งๅžƒๅœพๅ†…ๅฎนๅ†œๅœบๅชไผš่ถŠๆฅ่ถŠๅคš๏ผŒๆœ็ดขๅผ•ๆ“Žๅบ”่ฏฅ่ฏ†ๅˆซๅนถไธ”ๅฑ่”ฝๆŽ‰ๆ‰่กŒ

Mungus

@rodhilton okay, hear me out: Ecosia gives you "Alphabetical list of African countries - ThoughtCo"

rateexportpilot

@rodhilton it's like no one stopped to ask what you get out when you put garbage in.

๐Ÿ’ก๐š‚๐—†๐–บ๐—‹๐—๐—†๐–บ๐—‡ ๐™ฐ๐—‰๐—‰๐—Œ๐Ÿ“ฑ

@rodhilton
As a Maths teacher I have known this for a long time. It arbitrarily adds brackets to 8/2, elevating it's precedence from "division" to "brackets", thus returning a wrong answer. As a programmer it embarrasses me to hear some of them say "you don't need to know Maths to be a programmer!" - well, look where that's got us.

Re the later comments that the Kenya issue has been fixed (still wrong for me), Google have been told multiple times they're doing the Maths wrong - still broken.

@rodhilton
As a Maths teacher I have known this for a long time. It arbitrarily adds brackets to 8/2, elevating it's precedence from "division" to "brackets", thus returning a wrong answer. As a programmer it embarrasses me to hear some of them say "you don't need to know Maths to be a programmer!" - well, look where that's got us.

Cain

@rodhilton Why I've been using duckduckgo unless I want crap results with google ads and worse for a few years. Started because of the search bubble, though thankfully I avoided their app.

David Nash

@rodhilton @ncweaver Of *course* thereโ€™s a Deez Nuts joke in this mess somewhere.

Another early #ChatGPT session of mine was astronomy-themed and eventually I asked it to tell me more about the Pleiades cluster, the Hyades cluster, and โ€ฆ the Bophades cluster.

At first, it wrote back whether I meant the Boรถtes cluster (a real thing), but I told it no, I wanted to know about Bophades.

It walked right up to the point where I could deliver the punchline, but I decided against it.

penguin

@rodhilton Decided to test some other AIs:

- Brave Search fails horribly and says there aren't any and then mentions Kenya
- Llama 2 (running locally, offline) provides detailed and accurate information

Though Llama 2 still hallucinates sometimes and should not be trusted. DuckDuckGo had an AI feature called DuckAssist that was pretty good, but it was removed.

m
@rodhilton thank you for the explanation as to how the bot could even fuck this specific thing up, it seemed like such an odd error even for a mindless word aggregator to make
Go Up