Replacing windows is not cheap but it saves money long term.
Energy efficient windows keep heat in during winter and block it in summer. They also reduce outside noise and increase comfort.
Modern styles even have UV protection to prevent fading furniture.
Final thought: Good windows are an investment, not just an upgrade. Would you replace yours?