Not to change the subject, but I should mention that external genital warts are not linked to "high-risk" hpv. Sometimes "high-risk" can cause them, namely "flat warts", but from what I've heard, it's not common. If he had genital warts, more then likely he's infected with "low-risk" hpv. "High-risk" rarely ever shows sign in men. Not to say that he couldn't have given that to you as well. People can come in contact, and carry, more then one type/strain of the virus. However, it is possible, you could've gotten in from another person in the past. It's very possible for the virus to lay dormant for numerous years before showing any symptoms at all. Whether it's warts and/or dysplasia. Doesn't require penetration either. Even if a person were to rub genitals together, you can run the risk of catching it. It's passed via skin to skin contact. I've even heard it's possible to catch it from mutual masterbation. Where if you touch infected genitals, and then touch your own without washing beforehand, you could possibly get it. Now how common that is, I don't know any statistics. Same for if you share sexual toys.
If you're interested, and haven't already, you can read up more on HPV, and it's symptoms, on this site's HPV section:
http://www.ashastd.org/hpv/hpv_learn.cfm