the weight difference comes from the diesel block having much more reinforcement cast into it, and that the cranks, unlike many gasser cranks, are fully counterweighted.
that and the extra weight of the injectors, injection pump, vacuum pump, intake manifold, etc... it all adds up.
100LB difference is not all that much when you consider the weight of the cast iron used in the block.