Email or username:

Password:

Forgot your password?
Simon Willison

Google released a new LLM today - gemini-exp-1121, hot on the heels of last week's gemini-exp-1114

It's currently at the top of the Chatbot Arena. I've updated my llm-gemini plugin to support it and used that to run my pelican on a bicycle SVG benchmark

My notes: simonwillison.net/2024/Nov/22/

llm -m gemini-exp-1121 'Generate an SVG of a pelican riding a bicycle'

Since Gemini is a multi-modal vision model, I had it describe the image it had created back to me (by feeding it a PNG render):

llm -m gemini-exp-1121 describe -a pelican.png

And got this description, which is pretty great:

    The image shows a simple, stylized drawing of an insect, possibly a bee or an ant, on a vehicle. The insect is composed of a large yellow circle for the body and a smaller yellow circle for the head. It has a black dot for an eye, a small orange oval for a beak or mouth, and thin black lines for antennae and legs. The insect is positioned on top of a simple black and white vehicle with two black wheels. The drawing is abstract and geometric, using basic shapes and a limited color palette of black, white, yellow, and orange.
3 comments
Leon Brocard

@simon Why do you think these companies fail to put the year in the model name?

Simon Willison

@orangeacme I guess they don't (yet) expect to keep the same model serving for more than twelve months

Go Up