I don't believe it's possible to be both Shaken and Frightened at once. Thus, if the Barbarian failed saves against each spell, he would end up Frightened for 1d4 rounds (as per the Cause Fear spell) and then Shaken for the remaining duration of Doom (1 min/level).