A new paper from Apple's artificial intelligence scientists has found that engines based on large language models, such as those from Meta and OpenAI, still lack basic reasoning skills.
Last I checked (which was a while ago) “AI” still can’t pass the most basic of tasks such as “show me a blank image”/“show me a pure white image”. the LLM will output the most intense fever dream possible but never a simple rectangle filled with #fff coded pixels. I’m willing to debate the potentials of AI again once they manage to do that without those “benchmarks” getting special attention in the training data.
Problem is, AI companies think they could solve all the current problems with LLMs if they just had more data, so they buy or scrape it from everywhere they can.
That’s why you hear every day about yet more and more social media companies penning deals with OpenAI. That, and greed, is why Reddit started charging out the ass for API access and killed off third-party apps, because those same APIs could also be used to easily scrape data for LLMs. Why give that data away for free when you can charge a premium for it? Forcing more users onto the official, ad-monetized apps was just a bonus.
Yep. In cryptography there was a moment when cryptographers realized that the key must be secret, the message should be secret, but the rest of the system can not be secret. For the social purpose of refining said system. EDIT: And that these must be separate entities.
These guys basically use lots of data instead of algorithms. Like buying something with oil money instead of money made on construction.
I just want to see the moment when it all bursts. I’ll be so gleeful. I’ll go and buy an IPA and will laugh in every place in the Internet I’ll see this discussed.
Last I checked (which was a while ago) “AI” still can’t pass the most basic of tasks such as “show me a blank image”/“show me a pure white image”. the LLM will output the most intense fever dream possible but never a simple rectangle filled with #fff coded pixels. I’m willing to debate the potentials of AI again once they manage to do that without those “benchmarks” getting special attention in the training data.
Because it’s not AI, it’s sophisticated pattern separation, recognition, lossy compression and extrapolation systems.
Artificial intelligence, like any intelligence, has goals and priorities. It has positive and negative reinforcements from real inputs.
Their AI will be possible when it’ll be able to want something and decide something, with that moment based on entropy and not extrapolation.
Lol it do be that way
I will say the next attempt was interesting, but even less of a good try.
Problem is, AI companies think they could solve all the current problems with LLMs if they just had more data, so they buy or scrape it from everywhere they can.
That’s why you hear every day about yet more and more social media companies penning deals with OpenAI. That, and greed, is why Reddit started charging out the ass for API access and killed off third-party apps, because those same APIs could also be used to easily scrape data for LLMs. Why give that data away for free when you can charge a premium for it? Forcing more users onto the official, ad-monetized apps was just a bonus.
Yep. In cryptography there was a moment when cryptographers realized that the key must be secret, the message should be secret, but the rest of the system can not be secret. For the social purpose of refining said system. EDIT: And that these must be separate entities.
These guys basically use lots of data instead of algorithms. Like buying something with oil money instead of money made on construction.
I just want to see the moment when it all bursts. I’ll be so gleeful. I’ll go and buy an IPA and will laugh in every place in the Internet I’ll see this discussed.
I tested chatgpt, it needed some nagging but it could do it. Needed the size, blank and white keywords.
Obviously a lot harder than it should be, but not impossible.