remove the need for T to be copy from MiniSet as was done for MiniMap
This makes everything about 1% faster in rustc-perf, mostly negating performance hit of previous commit.