I haven't measured the temperature of mine but I don't think they get too hot. Idle power consumption is ~400mW and maximum is 2W, so there shouldn't be a lot of heat to dissipate.
If you look at table 2 in the data sheet:
https://coral.ai/static/files/Coral-M2-datasheet.pdf
It shows that the...