Email or username:

Password:

Forgot your password?
All posts Thomas's posts Post Back to profile
Top-level
tuban_muzuru

@thomasfuchs

We're in a lull just now. I believe the New Hot Thing will arise from technologies such as Apple's Neural Engine.

All this hoopla over LLMs - their limitations are coming into focus - they're very good for what they do. But there's a new neural network model, the Attention model: I started looking at this and my jaw dropped.

arxiv.org/abs/1706.03762

13 January at 10:24 | Wall-to-wall | Open on ohai.social
2 comments
datarama

@tuban_muzuru @thomasfuchs The attention mechanism *is* what LLMs are built on. That paper you cited is what started LLM research.

13 January at 16:51 | Open on hachyderm.io
tuban_muzuru

@datarama @thomasfuchs

I'll be the first to say I don't know much. I worked with vision systems and QC/QA and I'm just now coming to terms with what it means.

So I'm reading.

13 January at 18:20 | Open on ohai.social
Go Up