"I do a lot of windshield defrost testing at different temps. And I wonder is there any way that can keep from having the camera and myself reflected back into the images."Glass is about 15% reflective in the 8-12 micrometer waveband. If you are directly facing the windshield, you will inevitably get a reflection of yourself and the camera. I'm sure you have seen this.
One option is to change the angle at which you are observing the windshield, see the image below. If you are at point A, you and the camera will be reflected. If you are at point B, the camera will reflect whatever is above the vehicle, represented by C.