. (That was tested on DALL-E 2, but DALL-E 3 

The image model must get the correct number of sides on at least 95% of tries per prompt. Other details do not have to be correct. Any reasonable prompt that an average-intelligence human would easily understand as asking it to draw a pentagon must be responded to correctly. If the image model is not publicly available, I must be confident that its answers are not being cherry-picked. I'll ignore any special-purpose image model like one that was trained 

If the input is fed through an LLM or some other system before going into the image model, this pre-processing will be avoided if I can easily do so, and otherwise it will not.

AI Image Generation Testing

AI Image Generation

🤖 AI

Resolves YES if GPT-5 is publicly released before Jan 1, 2025; resolves NO otherwise.

Update from March 18: If the next OpenAI flagship model deviates from the GPT-N naming scheme 

 that is going to be released from OpenAI (e.g. they completely changed the trajectory of their naming scheme) then I will count it as "GPT-5" regardless.

However, if the next flagship model is not called GPT-5 but still conforms to the OpenAI GPT-N naming scheme (e.g. GPT-4.5) 

there will eventually be a model called GPT-5

 that will be released (i.e. they are going to continue with the same naming scheme) then I will not count it as "GPT-5".

🖥️ Technology

🤖 OpenAI

GPT-5 Speculation

ChatGPT

Resolves positively if Apple announces that OpenAI will partner with them on Siri. The question still resolves positively even if few details are provided regarding the partnership. An official statement during the main keynote of WWDC 2024 is needed,  something like "we partnered with OpenAI to improve Siri" or "Siri will be running the latest OpenAI models" (non-exhaustive list).

🍎 Apple

📱 WWDC 2024

IE "make me a 120 minute Star Trek / Star Wars crossover". It should be more or less comparable to a big-budget studio film, although it doesn't have to pass a full Turing Test as long as it's pretty good. The AI doesn't have to be available to the public, as long as it's confirmed to exist.

Scott Alexander's 5 year predictions

Technology

AI Media Creation

This question resolves to YES if during at least one of the main (non-VP) 2024 general presidential election debates in the United States, the moderator asks at least two separate questions directly related to artificial intelligence, such as the potential for job losses due to AI automation, or existential risk from AI. This question also resolves to YES if AI is otherwise brought up by a candidate in the context of a question unrelated to AI and ALL candidates talk about AI at least once during the same debate, with at least one of the candidates saying "AI", "artificial intelligence", "robots" or a close synonym at least three separate times, at least five seconds apart, during the same debate. Otherwise, this question resolves to NO.

Asking "at least two separate questions" means that the moderator must pose two semantically distinct and individual queries, each intended to elicit a unique response, specifically about artificial intelligence. In other words, simply repeating the same question doesn't count as two separate questions, even if the question is asked twice, first to one candidate, and then a second time to the other candidate. Moreover, asking two distinct questions without waiting for the answer to the first one counts as two separate questions for the purpose of this question. For example, a clear positive instance would be asking first, "How do you plan to manage the existential risks from AI?" and then later asking, "What are your proposals to mitigate job loss due to automation from AI?" These are two separate questions because they cover different facets of artificial intelligence—existential risk and employment. A clear negative example would be if the moderator simply asked, "How do you plan to manage the existential risks from AI?" to one candidate, and then later said "Same question to you" to the other candidate. Even though the question is asked twice, it's not considered two "separate" questions because it's a repetition of the same query.

When it comes to questions related to automation and job losses, the key factor that determines whether the question is "directly related to artificial intelligence" is whether the moderator mentions AI technologies or AI companies, such as ChatGPT, OpenAI, generative AI, or neural networks; any question will automatically qualify if the moderator says the word "AI" or "artificial intelligence" in the question. General questions about automation or job losses that don't clearly link back to AI won't be considered "directly related to artificial intelligence". For example, the following questions would NOT count as being directly related to artificial intelligence:

If there are no 2024 general presidential election debates, this question resolves to N/A.

US Politics

🗳️ Politics

presidential debate

If debate doesn't happen, resolves No. Any variation of "GPT" counts, GPT-4, ChatGPT, etc.  Including moderators.

👴🏼 Joe Biden

👴 Trump

🇺🇸 2024 US Presidential Election

🇺🇸 US Politics

OpenAI is working on a Google Search rival

. Will it release to the public by the end of 2024?

This market resolves Yes for a full version of a web search product, whether it's free or paid. Resolves No if the product is never released, or if it's still in alpha/beta.

Google

New York Mets beat Milwaukee Brewers - Mar 29

'29':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Baltimore Orioles beat Los Angeles Angels - Mar 28

'28':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 29

'29':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Chicago White Sox beat Detroit Tigers - Mar 28

'28':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Cincinnati Reds beat Washington Nationals - Mar 28

'28':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Houston Astros beat New York Yankees - Mar 28

'28':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Kansas City Royals beat Minnesota Twins - Mar 28

'28':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 28

'28':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Miami Marlins beat Pittsburgh Pirates - Mar 28

'28':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

San Diego Padres beat San Francisco Giants - Mar 28

'28':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Tampa Bay Rays beat Toronto Blue Jays - Mar 28

'28':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

'28':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Oakland Athletics beat Cleveland Guardians - Mar 28

'28':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Arizona Diamondbacks beat Colorado Rockies - Mar 28

'28':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

Seattle Mariners beat Boston Red Sox - Mar 28

'28':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Tampa Bay Rays beat Toronto Blue Jays - Mar 29

'29':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

Miami Marlins beat Pittsburgh Pirates - Mar 29

'29':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

Houston Astros beat New York Yankees - Mar 29

'29':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Arizona Diamondbacks beat Colorado Rockies - Mar 29

'29':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

Oakland Athletics beat Cleveland Guardians - Mar 29

'29':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

San Diego Padres beat San Francisco Giants - Mar 29

'29':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Seattle Mariners beat Boston Red Sox - Mar 29

'29':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 29

'29':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

New York Mets beat Milwaukee Brewers - Mar 30

'30':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Chicago White Sox beat Detroit Tigers - Mar 30

'30':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Baltimore Orioles beat Los Angeles Angels - Mar 30

'30':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 30

'30':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Oakland Athletics beat Cleveland Guardians - Mar 30

'30':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Cincinnati Reds beat Washington Nationals - Mar 30

'30':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Kansas City Royals beat Minnesota Twins - Mar 30

'30':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

Miami Marlins beat Pittsburgh Pirates - Mar 30

'30':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

Tampa Bay Rays beat Toronto Blue Jays - Mar 30

'30':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

'30':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Houston Astros beat New York Yankees - Mar 30

'30':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

San Diego Padres beat San Francisco Giants - Mar 30

'30':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Arizona Diamondbacks beatColorado Rockies - Mar 30

'30':6 'arizona':1 'beatcolorado':3 'diamondback':2 'mar':5 'rocki':4

Los Angeles Dodgers beat St. Louis Cardinals - Mar 30

'30':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Seattle Mariners beat Boston Red Sox - Mar 30

'30':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Baltimore Orioles beat Los Angeles Angels - Mar 31

'31':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 31

'31':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Cincinnati Reds beat Washington Nationals - Mar 31

'31':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Miami Marlins beat Pittsburgh Pirates - Mar 31

'31':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

New York Mets beat Milwaukee Brewers - Mar 31

'31':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Tampa Bay Rays beat Toronto Blue Jays - Mar 31

'31':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

Chicago White Sox beat Detroit Tigers - Mar 31

'31':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Houston Astros beat  New York Yankees - Mar 31

'31':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Kansas City Royals beat Minnesota Twins - Mar 31

'31':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

'31':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Oakland Athletics beat Cleveland Guardians - Mar 31

'31':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Arizona Diamondbacks beat Colorado Rockies - Mar 31

'31':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

San Diego Padres beat San Francisco Giants - Mar 31

'31':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Seattle Mariners beat Boston Red Sox - Mar 31

'31':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 31

'31':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Chicago White Sox beat Atlanta Braves - Apr 1

'1':8 'apr':7 'atlanta':5 'beat':4 'brave':6 'chicago':1 'sox':3 'white':2

Chicago Cubs beat Colorado Rockies - Apr 1

'1':7 'apr':6 'beat':3 'chicago':1 'colorado':4 'cub':2 'rocki':5

Washington Nationals beat Pittsburgh Pirates - Apr 1

'1':7 'apr':6 'beat':3 'nation':2 'pirat':5 'pittsburgh':4 'washington':1

Baltimore Orioles beat Kansas City Royals - Apr 1

'1':8 'apr':7 'baltimor':1 'beat':3 'citi':5 'kansa':4 'oriol':2 'royal':6

Miami Marlins beat Los Angeles Angels - Apr 1

'1':8 'angel':5,6 'apr':7 'beat':3 'los':4 'marlin':2 'miami':1

Philadelphia Phillies beat Cincinnati Reds - Apr 1

'1':7 'apr':6 'beat':3 'cincinnati':4 'philadelphia':1 'philli':2 'red':5

Tampa Bay Rays beat Texas Rangers - Apr 1

'1':8 'apr':7 'bay':2 'beat':4 'ranger':6 'ray':3 'tampa':1 'texa':5

New York Mets beat Detroit Tigers - Apr 1

'1':8 'apr':7 'beat':4 'detroit':5 'met':3 'new':1 'tiger':6 'york':2

Houston Astros beat Toronto Blue Jays - Apr 1

'1':8 'apr':7 'astro':2 'beat':3 'blue':5 'houston':1 'jay':6 'toronto':4

Arizona Diamondbacks beat New York Yankees - Apr 1

'1':8 'apr':7 'arizona':1 'beat':3 'diamondback':2 'new':4 'yanke':6 'york':5

Oakland Athletics beat Boston Red Sox - Apr 1

'1':8 'apr':7 'athlet':2 'beat':3 'boston':4 'oakland':1 'red':5 'sox':6

San Diego Padres beat St. Louis Cardinals - Apr 1

'1':9 'apr':8 'beat':4 'cardin':7 'diego':2 'loui':6 'padr':3 'san':1 'st':5

Seattle Mariners beat Cleveland Guardians - Apr 1

'1':7 'apr':6 'beat':3 'cleveland':4 'guardian':5 'marin':2 'seattl':1

Los Angeles Dodgers beat San Francisco Giants - Apr 1

'1':9 'angel':2 'apr':8 'beat':4 'dodger':3 'francisco':6 'giant':7 'los':1 'san':5

Milwaukee Brewers beat Minnesota Twins - Apr 2

'2':7 'apr':6 'beat':3 'brewer':2 'milwauke':1 'minnesota':4 'twin':5

Baltimore Orioles beat Kansas City Royals - Apr 2

'2':8 'apr':7 'baltimor':1 'beat':3 'citi':5 'kansa':4 'oriol':2 'royal':6

Miami Marlins beat Los Angeles Angels - Apr 2

'2':8 'angel':5,6 'apr':7 'beat':3 'los':4 'marlin':2 'miami':1

Philadelphia Phillies beat Cincinnati Reds - Apr 2

'2':7 'apr':6 'beat':3 'cincinnati':4 'philadelphia':1 'philli':2 'red':5

Tampa Bay Rays beat Texas Rangers - Apr 2

'2':8 'apr':7 'bay':2 'beat':4 'ranger':6 'ray':3 'tampa':1 'texa':5

New York Mets beat Detroit Tigers - Apr 2

'2':8 'apr':7 'beat':4 'detroit':5 'met':3 'new':1 'tiger':6 'york':2

Chicago Cubs beat Colorado Rockies - Apr 2

'2':7 'apr':6 'beat':3 'chicago':1 'colorado':4 'cub':2 'rocki':5

Chicago White Sox beat Atlanta Braves - Apr 2

'2':8 'apr':7 'atlanta':5 'beat':4 'brave':6 'chicago':1 'sox':3 'white':2

Houston Astros beat Toronto Blue Jays - Apr 2

'2':8 'apr':7 'astro':2 'beat':3 'blue':5 'houston':1 'jay':6 'toronto':4

Arizona Diamondbacks beat New York Yankees - Apr 2

'2':8 'apr':7 'arizona':1 'beat':3 'diamondback':2 'new':4 'yanke':6 'york':5

Oakland Athletics beat Boston Red Sox - Apr 2

'2':8 'apr':7 'athlet':2 'beat':3 'boston':4 'oakland':1 'red':5 'sox':6

San Diego Padres beat St. Louis Cardinals -  Apr 2

'2':9 'apr':8 'beat':4 'cardin':7 'diego':2 'loui':6 'padr':3 'san':1 'st':5

Seattle Mariners beat Cleveland Guardians - Apr 2

'2':7 'apr':6 'beat':3 'cleveland':4 'guardian':5 'marin':2 'seattl':1

Los Angeles Dodgers beat San Francisco Giants - Apr 2

'2':9 'angel':2 'apr':8 'beat':4 'dodger':3 'francisco':6 'giant':7 'los':1 'san':5

Baltimore Orioles beat Kansas City Royals - Apr 3

'3':8 'apr':7 'baltimor':1 'beat':3 'citi':5 'kansa':4 'oriol':2 'royal':6

Philadelphia Phillies beat Cincinnati Reds - Apr 3

'3':7 'apr':6 'beat':3 'cincinnati':4 'philadelphia':1 'philli':2 'red':5