Sometimes people put off doing something for a long time. When they finally do it, they lament the fact that they waited. It sounds like you need to have your conversation, get free, and start working towards something better. Stop condemning yourself to a holding pattern.