The single biggest reason for the difference in the conductivities of metals is the difference in how far the free electrons can travel before they hit something. It turns out that the heat transfer is maximized when the substance has a perfect crystal lattice structure.