Don't toss your heat out of the window...

Windows are significant source of energy waste, which can amount to 10-25% of your total heating bill. To prevent heat loss through your windows, you can replace single-pane windows with double-pane ones.

https://www.energysage.com/energy-efficiency/101/ways-to-save-energy/