This makes everything about 1% faster in rustc-perf, mostly negating performance hit of previous commit.