I've used this character idea before. An arcane bloodrager who took the bloodline familiar option. Her mother was a wizard, so she was the source of the bloodline and the familiar. It might would have been more meaningful with a witch mother though.
To reiterate and expand Wheldrake's comment. Yes absolutely. But if you're a 1st level wizard receiving a familiar from a 20th level wizard then your familiar will only retain the powers and abilities of a 1st level wizard's familiar.
And you can even reason away the power difference in that the familiar may be passed down, but the bond is still "new", so the familiar can't access the powers it had when its master was a more powerful spellcaster