RLHF on the Tech Tree