If you’re trying to salvage a work relationship and ‘say the right things’ I get it, but sometimes being blunt and abrupt is exactly what’s needed. Something short but courteous like ‘its always great catching up but I need to get to work’ or even more direct like ‘im sorry but I don’t have time to be doing this in the mornings and these conversations are putting me behind on my work.’ or if this isn’t a situation where you’re trying to preserve a work relationship go the abrasive route and state that you’ve tried to be kind but if he doesn’t stop talking to you you’ll be forced to go to HR. You have protections for exactly this situation if you do report to HR.
This is exactly it. They don’t like their profit margin.