With kitchen aluminum foil and styrofoam, you can create a simple and passive solar heater. The goal is not to fully cover the window but to make it smaller than the window.
You can still see the view outside and let some sunlight in the room. You may opt to completely cover the window with foil for a more effective solar heater. Click the link below to get the step-by-step instructions.
