Safety Research and the Allocation of Frontier Compute

Who should give up compute for AI safety research: customers or capability research? Safety paid for by customers delays no capability. Safety paid for by research slows the frontier, which gives knowledge more time to accumulate but postpones what a finished frontier provides. In a frontier-takeoff model, the cheaper source at a given allocation is set by a threshold in demand capacity. Demand capacity is the share of compute customers can use once the frontier is finished. Research should pay too only when demand capacity lies below the threshold. Where the threshold sits depends on how fast the value of customer services diminishes. In the calibration it rises with the service budget, because each further unit taken from customers costs them more. Safety paid for by customers should come early: its ratio to customer compute falls over the takeoff unless safety productivity rises fast. In a calibration with a tight service budget, early customer-funded safety lowers the probability of catastrophe from 75 to 51 percent. That is within one point of the best rule found that may also slow research.