Geoffrey Hinton noted to Steven Bartlett that there is no example in nature of a more intelligent species being subordinate to a less intelligent one. Kokotajlo agrees this should be our default assumption: we are building something smarter than us, giving it a body, letting it improve itself, and then assuming it will keep taking our orders.