One of the problems I’ve been told, and that I have found online is that Xeon-D Chips need good airflow over the heat sink as they put out a fair amount of heat and that the the heat sink is passive. I decided to pull out my FLIR ONE Camera and take a look. Although it doesn’t indicate temperatures, it gives you a good idea of how hot they can be.
Here is a view of the SuperMicro X10SDV-7TP4F. Top red spot is the CPU Heatsink, and the bottom is the LSI 2116 SW Controller.