Oh ha, yeah. Sorry.
Apply gradients to the original layer, not the topography outlines.
Sorry about that.
Also, jegus I don't know what I was thinking with Difference. Set that layer to Divide, Darken, or Soft Light depending on the effect you want.