The “after deployment” part is what I would focus on too. A chatbot can perform incredibly well in a demo and still create more work for the support team once real customers start asking unexpected questions. I would track things like successful resolutions, human handoffs, correction rates, and maintenance time alongside ticket reduction. If the AI resolves 70% of conversations but agents have to clean up the remaining 30%, the headline automation number doesn’t tell the whole story.