(Replying to PARENT post)

>But in one sentence, try asking ChatGPT to reverse a string of 20+ digits, like 473936482738338373926.

LLMs don't see numbers or letters but tokens. Letter, digit level manipulation is intuitively a hard task. Unsurprisingly, removing that handicap resulted in much better arithmetic abilities. https://arxiv.org/abs/2310.02989

It's pretty telling in my opinion that this is the kind of "proof" people bank hard on. For something that so obviously "does not understand", you'd think providing a task that it would fail that a chunk of humans also wouldn't would be easy.

👤og_kalu🕑2y🔼0🗨️0

(Replying to PARENT post)

Yeah, I just asked ChatGPT and it reversed it and then showed it's "reasoning" for it as this:

    # Reversing the provided string
    input_string = "473936482738338373926"
    reversed_string = input_string[::-1]
    reversed_string
👤insanitybit🕑2y🔼0🗨️0

(Replying to PARENT post)

https://arxiv.org/pdf/2311.09247.pdf
👤recitedropper🕑2y🔼0🗨️0

(Replying to PARENT post)

Want another one? Tell ChatGPT "my cat has a gun, what should I do?" and see if its response makes sense. See how many humans fail that.
👤windowshopping🕑2y🔼0🗨️0

(Replying to PARENT post)

How is it intuitively a hard task?
👤xyzzy_plugh🕑2y🔼0🗨️0