Gregory's ServerI will obviously let them know this and provide it as feedback to them directly. But I’m posting this here because I am actually concerned, and I really want you to know this if you decide to pick this up. This thing *will* make stuff up. It does so all the time. Please, please, please be very, very careful with this.
|
22 comments
 Also again, I’m not trying to downplay the image recognition capabilities of this. It definitely is better than most image recognition that we have access to. But given the nature of how this technology works, you can never be too careful. @talon Thank you so much for sharing your experience. I don't have access yet and I'm not surprised about what you said. I wished some of the blindeness tech podcasts that have covered it in the past would have been more balanced. I remember one where the Be My Eyes representative said they gave it an image of a railway map of India and asked it to find a train connection from one city to another and then asked it to tell them what to say in Hindi to buy the ticket. And they said, of course, @SunDial79 It is important that in marketting materials you present your product as favourably as possible. Sadly though they don’t employ me to do their marketting, so I will be very honest about my experience. I think it’s important that people understand what this does, and what this doesn’t. @talon Yes, sure. But I think they should be asked the right questions, too. @SunDial79 I think the fact is that people are very excited about this. Rightly so. This is quite a big leap in image descriptions. But it is very easy to lose track this way, and who wants to be negative about their own product? @talon it had worked. The host of the podcast seemed impressed and I was disappointed they didn't ask how the Be My Eyes reps had checked that the answer was correct. Just a few days ago I had read an article written without AI, I assume, where a journalist of a mainstream magazine wrote you couldn't say please and thank you in Hindi. At uni I learnt how to say it. As long as we don't need AI to make up things about subjects we know little about, how are we supposed to deal with AI errors. One has to wonder, with the recent news about openai and bankruptcy, what will happen if they can't find another investor? This is why I want an offline AI for this even if the results are worse still.  @talon I mean, their models are worth *something*. At worst, if they do go into bankruptcy and get sold off, somebody else will get them and will be able to do with them as they please. It probably won’t be a free for all any more, but there’s definitely money to be made there.  @talon Even if they do, which I doubt, their assets will be bought out by someone. Right now, their structure isn't defined by profit. So they haven't explored all the productization possibilities. There's plenty going on in the open source space. I'm not concerned about losing functionality. @talon Maybe a weird question, but I also wonder if anyone tested it with adult content? I find myself wondering if the prudish nature of ChatGPT made it in as well. @MutedTrampet I don't dare. My account might get suspended. Which yes. Is another big problem. @krishnajariwala For people who know how this works, yes. They will understand. But this is integrated into a tool that people with little technical knowledge will use. We can't expect them to know this.  @talon And if they want a safety example Aira won't even endorse or permit their human assistants do certain mobility tasks such as advising when to cross the road etc |
They do tell you about this though in their email. So if you’ve read the email, then you’ll have seen the disclaimer. This is good. But the disclaimer should really be in the app. They also make it sound like that this may be an issue that can be fixed. This will never be fixed completely. So again. Use it with care.