Email or username:

Password:

Forgot your password?
Chris Trottier

Good point from @mistercharlie. If there’s any argument for A.I. doing social good, it’s in image-to-text capabilities—as demonstrated by Midjourney.

This could be a game changer for accessibility, and getting detailed alt text descriptions.

The Fediverse could be on the cutting edge of this tech since it’s easier here than anywhere else to add alt text descriptions.

lifewire.com/why-midjourneys-n

@fediversenews

8 comments
Resting Facebitch

@atomicpoet @mistercharlie @fediversenews 100%

Simulated intelligence is such a good grunt work servant. It's already making mind numbing but necessary tasks easier.

Just a pity people are hyping it up to more than it actually is.

alice

@atomicpoet @mistercharlie @fediversenews lol, i was just trying to use clip interrogator to see how well itd work for automatic alt texting, tl;dr not well, but its also made more so for ai art not image description and i also dont think it can read text

David Erik Nelson🪬

@atomicpoet @mistercharlie @fediversenews I’m also seeing really promising stuff with AI transcription. All sorts of stuff more accessible to hearing impaired folks, language learners, folks with sensory processing issues, etc. is a solid win, in my humble.

Tokyo Outsider (337ppm)

@atomicpoet @mistercharlie @fediversenews I feel like "AI" is too vague a term to be used as liberally as it is. OCR has existed for a long time. It's not that intelligent an activity — although it is very useful as you say and should be used more.

It would help the debate if we described algorithms in a more granular way. Right now it's like people are trying to decide whether fire is good or bad when fire can burn down a house or cook your dinner.

Jupiter Rowland
I myself wouldn't trust any AI with writing alt-texts for the pictures I use in my posts. These are almost exclusively pictures taken in virtual worlds.

First of all, an AI may be halfway capable of recognising virtual objects with exist in the real world just the same, but not perfectly so. As for objects which are exclusive to this kind of virtual worlds or even this particular world, objects which do not exist in real life, an AI won't be able to identify them.

Also, sometimes it matters where a picture was taken. An AI may be able to recognise well-known real-life places, but obscure virtual places, not so much, even less so if there are several such places which look almost or completely identical.

Lastly, even if an AI appeared that is fully capable of correctly describing what can be seen in pictures from virtual worlds, and by that I mean down to even automatically and accurately recognising the creators of objects in case this should matter, even then, the AI would not necessarily be able to know the context and thus decide what is important to mention, what is essential and what is unnecessary. Depending on the context, the very same picture can require different alt-texts, that is, unless people come and demand fully-detailed descriptions of everything that can be seen in a picture, for maybe it could matter to someone.

In case you've got enough patience to read a 6,000+-word rant, I've written a post about alt-text on pictures from within virtual worlds just recently. You can read it here.
I myself wouldn't trust any AI with writing alt-texts for the pictures I use in my posts. These are almost exclusively pictures taken in virtual worlds.

First of all, an AI may be halfway capable of recognising virtual objects with exist in the real world just the same, but not perfectly so. As for objects which are exclusive to this kind of virtual worlds or even this particular world, objects which...
FeralRobots

@atomicpoet
It would be TERRIBLE for accessibility.
Good alt-text is not strictly about describing the image - it's about SITUATING the image.
@mistercharlie @fediversenews

Olav

@atomicpoet
@mistercharlie @fediversenews as a prompt maybe. Anyone that lets LLMs write descriptions w/o editing is a fool.

Eric Jennings

@atomicpoet @mistercharlie @fediversenews

i let AI generate alt text for an image. this is what i got:

g/i« : L : 2t . = G = Z H i A ;i P e o x‘ i o . = = – AET 2 b 35 – . o S Y Z Z \ S 3 “A e e G e T TaE i & b T ‘ 2 Gl 0 > / b o g ko {1/ 3 B % e 2 o T biistie e ST R S f.‘fi::% (! S A e A m 3 2 i e g v g R . At ,t‘ o et il R S B e T ; e s %‘ A 7 . Sty T j E NS . s = – o / By e i i = Ee ¢/ ! i . e S 4 £ 0 i 3 T s ey & v N i T E o : o b i : e e, 000 Lo o = L oo e s i (i B W e 7 7 1 kB v‘/ e R L v i G L LN e e . s . e % s S B G s o o oA ¢ i . A e e e i & GRS i 2% s SRR B N

the image can be seen here:
frightenthehorses.com/somebody

@atomicpoet @mistercharlie @fediversenews

i let AI generate alt text for an image. this is what i got:

g/i« : L : 2t . = G = Z H i A ;i P e o x‘ i o . = = – AET 2 b 35 – . o S Y Z Z \ S 3 “A e e G e T TaE i & b T ‘ 2 Gl 0 > / b o g ko {1/ 3 B % e 2 o T biistie e ST R S f.‘fi::% (! S A e A m 3 2 i e g v g R . At ,t‘ o et il R S B e T ; e s %‘ A 7 . Sty T j E NS . s = – o / By e i i = Ee ¢/ ! i . e S 4 £ 0 i 3 T s ey & v N i T E o : o b i : e e, 000 Lo o = L oo e s i (i B W e 7 7 1 kB v‘/ e R L v i...

Go Up