Will AI progress surprise us by predictions of AGI jumping sharply?
Question description
Discontinuity in progress occurs when a particular technological advance pushes some progress metric substantially above what would be expected based on extrapolating past progress. If AI progress is unusually lumpy, i.e., arriving in unusually fewer larger packages rather than in the usual many smaller packages, then future progress might arrive faster than we would expect by simply looking at past progress. Moreover, if one AI team finds a big lump, it might jump way ahead of the other teams. According to <a href="https://aiimpacts.org/likelihood-of-discontinuous-progress-around-the-development-of-agi/"_blank">AI Impacts</a>, discontinuity on the path to AGI, lends itself to:
<li> A party gaining decisive strategic advantage <li> A single important ‘deployment’ event <li> Other very sudden and surprising events <br><br>A <a href="https://www.metaculus.com/questions/384/human-machine-intelligence-parity-by-2040/"_blank">previous question</a> did a good job operationalising Human-machine intelligence parity. It proposes a generalised intelligence test that compares machine systems to human experts in each of physics, mathematics and computer science. Using this, we can define a surprising discontinuity in AI progress as a tripling of the <a href="http://sphweb.bumc.bu.edu/otlt/MPH-Modules/BS/BS704_Confidence_Intervals/BS704_Confidence_Intervals10.html"_blank">odds</a> (given by p/(1-p)) in both the Metaculus prediction and community prediction within a 2-month period.
Indicators
Indicator | Value |
---|---|
Stars | ★★★☆☆ |
Platform | Metaculus |
Number of forecasts | 1038 |
Capture
Discontinuity in progress occurs when a particular technological advance pushes some progress metric substantially above what would be expected based on extrapolating past progress. If AI progress is unusually lumpy, i.e., arriving in unusually fewer...
Embed
<iframe src="https://https://metaforecast.org/questions/embed/metaculus-1394" height="600" width="600" frameborder="0" />