Formal measures of intelligence matter because they reflect reality. Intellectual capacity is genetic and determines a lot of things in our life. It’s as real and immutable as height or eye color. Accepting the physical reality of your intellectual capacity is as important as accepting the physical reality of your sex.
Conservatism is about accepting reality and not assuming godlike qualities which pitch you in an endless, unwinnable battle against it.