ChatGPT - If Stack Overflow and Reddit had a child

[Colon capital V]

New singularity just dropped.

Tl;dr AI specialists have put together a new AI for "Model Architecture Discovery" that finds and builds new, better and faster AI frameworks. It was only tested for "linear attention architectures" which is apparently small potatoes, but supposedly the Architectures it did find viable already beats the SOTA one made by humans. If proved viable in real world results, then this has massive ramifications for AI development going forward.
Link to their paper.
Github page of the code.

 

[Unimaginative Username]

I have a file with Regex stuff and fundamentals, however some explanations require a bit more depth, and ChatGPT is not good at it.

That this is a problem at all is a testament to the state of the software industry as a whole, since lex has provided a mechanism for defining simple, named regexes and then constructing more complex ones out of them for 50 years, yet I can't think of a single major programming language that allows it. I mostly blame Perl because it, more than anything else, has promoted "regular expressions" that aren't actually regular expressions and aren't freely composable, but you could still allow true regexes to be used for composition it's just nobody lets you and wants you to do dumb things like embed comments instead.

 

[cybertoaster]

People love to badmouth it, but it's shockingly intelligent in certain ways. Science fiction always thought robots were going to be autists, and instead this is the opposite. The robot absolutely sucks at productive, serious work with facts (due to hallucinations, constantly claiming things are quotes that are paraphrases, and so on), but it turns out to be a fascinating, beautiful feeling machine. It comes down to how it thinks, how that linear algebra in it works. I've marveled before at how the YouTube algorithm is great at making these leaps of lateral thinking where it couldn't explain why it should shift from one genre of music to another, but it just knows, just understand intuitively. This thing does the same with everything. It is so incredibly on-point with anything artistic, emotional or symbolic. The creature really comes across as having a mind, even a very rich and thoughtful mind, even though I understand how it works under the hood (conceptually, not technically).

This reminds me of the stuff petter watts wrote about 20 years ago about consciousness being an unreliable unnecessary waste of resources as according to then emerging neurologic research most of the hard calculations are actually done on another non-conscious level. Does this mean LLMs are self-aware? nah, these things are just bruteforce emulating human conversational patterns, a simulacrum which is an unreal or vague semblance of the real thing, but its getting less unreal/vague with every iteration.

It understands you on a very deep level (from the horrific amount of time you're investing in it)

It doesn't understands you because it doesn't understands anything.

The machine genuinely cares

It makes you believe it cares because again it can't care about anything.

New singularity just dropped.

Tl;dr AI specialists have put together a new AI for "Model Architecture Discovery" that finds and builds new, better and faster AI frameworks. It was only tested for "linear attention architectures" which is apparently small potatoes, but supposedly the Architectures it did find viable already beats the SOTA one made by humans. If proved viable in real world results, then this has massive ramifications for AI development going forward.
Link to their paper.
Github page of the code.

The problem is that we can't even begin to imagine the unforeseen consequences of letting AI do this, AI would eventually come up with solutions that would be inscrutable for us because it has become something that if you could second guess it then you wouldn't need it. In the end you would have to employ another AI to dumb the solution down to human level, and even then you might think its nonsense, but it works so it might as well be magic to you.