What Is ChatGPT Doing … and Why Does It Work?

this isn’t the right conclusion to draw. Computationally irreducible processes are still computationally irreducible, and are still fundamentally hard for computers—even if computers can readily compute their individual steps. And instead what we should conclude is that tasks—like writing essays—that we humans could do, but we didn’t think computers could do, are actually in some sense computationally easier than we thought.

I finally sat down to read this. If you have the curiosity and patience I believe it is worth the effort to complete.

It is both a tribute of wonder to the complexity and design of human language and a (to me) reassuring voice that AGI is much further off than some may claim.

What Is ChatGPT Doing … and Why Does It Work?—Stephen Wolfram Writings - writings.stephenwolfram.com