After auto-tuner finishes on all ranks, test best setting on each rank and keep it if better.
After auto-tuner finishes on all ranks, test best setting on each rank and keep it if better.