Email or username:

Password:

Forgot your password?
Yogthos's posts Post Back to profile
Yogthos

Baidu to launch bilingual chatbot ERNIE, with 260 billion parameters compared to ChatGPT’s 175 billion.

theregister.com/2023/02/07/bai

7 Feb 2023 at 20:55 | Open on mas.to
4 comments
Cykonot

@yogthos "They have such a huge dataset" i mumble to myself
My galaxy buds pick up the thought, and google whirs into action. Soon, the next unskippable ad comes on, promoting commercially available datasets

7 Feb 2023 at 21:21 | Open on mas.to
凉拌茶叶

@yogthos any sources of ChatGPT actually has 175B parameters? The paper of InstructGPT shows that it gets better result for only 1B parameters. Also they published the model as a service, I can not imagine how can they run the service with 175B parameters.

arxiv.org/abs/2203.02155
8 Feb 2023 at 0:30 | Open on mastodon.social
Yogthos

@leo_song I took the title from the Lemmy post, but haven't actually followed up to investigate lemmy.ml/post/747098

8 Feb 2023 at 1:42 | Open on mas.to
Yogthos

@leo_song it could be that 175B parameters are used during training but not during actual usage

8 Feb 2023 at 1:43 | Open on mas.to
Go Up