That depends on how important you consider address verification.
Some banks, (Wells Fargo for one) store your account address and your visa
address in different places so that you could change your address and still
have the old address in your visa information (probably other types of cards
as well but my experience is with visa). Therefore you will fail address
verification.
Some online stores don't use address verification at all. Many
order-by-phone places do not. And almost no stores that you visit in person
care about the address.
So while verisign may not be doing it "right", how dangerous it is is largely a
matter of perception.