The only large races that can generally make use of Enlarge person would be Giants, whom already have the detriment of high CR and racial HD. Most other large races are outside the humanoid type and unaffected by the spell, if I understand how the spell works, exactly.