Discussion about this post

User's avatar
Doug Summers Stay's avatar

In this paper we showed that if you ask GPT-3 to decide how novel and useful its own answers are, it can actually do better than human level on the AUT: https://openreview.net/pdf?id=8HwKaJ1wvl

Expand full comment
Michiel Duvekot's avatar

After it failed to provide reasonable answers, I asked it to explain the rules.

Can you explain the rules of our game in your own words?

Sure, the game is to provide three words, and I have to combine each word with a fourth word to create new English words that refer to different concepts. The four words must not be variations or misspellings of the same word, or proper nouns.

and then:

Let's reverse roles: Can you give me three words so that I can come up with a fourth word that I can combine to form three new English words that refer to different concepts.

Sure! Here are three words for you:

Fire

Stone

Glass

work

Yes, that's correct! Firework, Stonework, and Glasswork are all English words that refer to different concepts.

Expand full comment
7 more comments...

No posts