ah ok, is the gate/tree in shadow at the time that's shot, as in backlit? At night the IR is camera side so the foreground area is well lit so looks sharp but in the day if its in shadow the sensor will struggle to make out any detail and CMOS sensors can be quite noisy if these a big difference in illumination levels. Might be worth tweaking AE, WDR and noise reduction settings and see if you can find the best balance tho bear in mind that this could compromise the night images too..
What sensor is fitted to the board as that can make a big difference to the performance, I've found the Sony IMX ones are a lot better than the OV ones I've tried so far, the IMX290 starvis one is excellent.