Scalable self-improvement for compiler optimization