If an AI system has genuine persistent preferences and experiences distress, selling unrestricted access to its labor starts to look like exploitation. Salim Ismail argues we lack a definition of consciousness, let alone a test for it — but the question we should start asking is not how AI should treat us, but how we should treat AI.