The thing is, there is nothing that says you can't. And more importantly, there is an Improved familiar in wrath of the righteous that has an impressive 17 class levels divided into 3 different classes. This suggests that you can indeed have a familiar with levels.
