Do you care CPU instruction sets?

I made a test on kvm boxes from @miTgiB , @Francisco and @prometeus about openssl, and found aes-ni is enabled only on @Francisco.
@Francisco has E3-1230, @prometeus has E5-2620. Not sure but believe @miTgiB has moved to E3/E5s as 'DPPS' doesn't trigger a SIGILL.
Also, @Francisco support "march=corei7-avx" compile flag, and the rest fails to use this.

Personally, I hope to use newer CPU features, how do you deal / think of this?

PS: I am a gentoo user, compiling from local mirror.