Your model answered the wrong question
"Predict churn" is not a real brief. Churn in 7 days and churn in 6 months produce two different models that point you toward two different actions. An LLM builds whatever you asked for, confidently, even when the framing is off.