Line the window box with small bubble wrap on the inside because that will prevent heat being transferred over to the root system of the plant.
It's like a three-tier cake. If it's a window box, I definitely want something to drape over.