Pick a constitutional principle. See the original response, the AI-generated critique, and the revised response that becomes the "preferred" half of a training pair.