DeepSeek is impressive, and they are current 7th on the leaderboard. There are concerns that at some point this leaderboard becomes less useful as an actual measure of AI capabilities (the optimization goal is human preference), and this would make it easier for lower-resource orgs to get a higher ranking.
I think there's a reasonable chance DeepSeek or another Chinese org could get to 3rd. I'd put about 1% on getting to first.
Another reason why it's not so low is that they only need to hold it temporarily, and product release cycles for AI models can be lenghthy, so it could be that the currently leading AI companies/labs don't publicize a new SOTA model for a while, and DeepSeek sneak in.
No Scores Yet
Relative Brier Score
0
Forecasts
1
Upvotes
Forecasting Calendar
Past Week | Past Month | Past Year | This Season | All Time | |
---|---|---|---|---|---|
Forecasts | 0 | 16 | 144 | 0 | 529 |
Comments | 0 | 13 | 16 | 0 | 31 |
Questions Forecasted | 0 | 16 | 35 | 0 | 100 |
Upvotes on Comments By This User | 0 | 3 | 33 | 1 | 95 |
Definitions |
Star Commenter - Dec 2024
Why do you think you're right?
Why might you be wrong?
Why do you think you're right?
Updating upwards based on @Revmag's analysis of the current data so far (shifting distribution right)
Why might you be wrong?
Perhaps, post-election the rate will rapidly fall off.
Why do you think you're right?
Didn't happen.
Why might you be wrong?
Trust me
Why do you think you're right?
I think this is a bit more likely, given the fall of the Assad regime, which I think probably slightly increases the potential for conflict between Iran and the US, but with very low confidence on that.
Why might you be wrong?
The Middle East is very unstable, things that seem unlikely can happen.
Why do you think you're right?
In general I think this becomes more likely over time, so I expect to slowly update this upwards - not on any specific events that have occurred.
Xi Jinping said in his New Year's speech that "no one can stop the historical trend of reunification", which continues to be a priority of China's government. But this doesn't seem like a change in position, or a particularly surprising thing for him to say.
Why might you be wrong?
3% probability events happen 3% of the time
Why do you think you're right?
Looks extremely unlikely, but I think Trump's incoming presidency makes this more likely: it could plausibly be a policy priority in the Middle-East.
Furthermore, the fall of the Assad regime means the Middle-East is just higher variance - there is more possibility for outcomes that seem impossible now to happen.
Perhaps one could be signed between Israel and Syria:
https://www.npr.org/2024/12/27/g-s1-40144/syria-israel-relations-hts-damascus-governor
Why might you be wrong?
Perhaps could be some big deal agreed between countries in the region and Israel on Gaza, as a resolution to the conflict, and perhaps this would be part of that.
Why do you think you're right?
Extremely unlikely he loses office in this period
Why might you be wrong?
He's had an assassination attempt before: https://en.wikipedia.org/wiki/2018_Caracas_drone_attack
and the risk is probably raised in the lead-up to his inauguration