If you don't believe me, maybe you'll believe the American Heritage Dictionary....
sorry....

verˇmin (vűršmîn) noun
plural vermin
1. Various small animals or insects, such as rats or cockroaches, that are destructive, annoying, or injurious to health.
2. Animals that prey on game, such as foxes or weasels.
3. a. A person considered loathsome or highly offensive. b. Such people considered as a group.

[Middle English, from Old French, from Vulgar Latin *verměnum, from Latin vermis, worm.]

The American Heritage Dictionary of the English Language, Third Edition is licensed from Houghton Mifflin Company. Copyright Š 1992 by Houghton Mifflin Company. All rights reserved.
Selected Illustrations from the Concise Columbia Encyclopedia. Copyright Š 1991 by Columbia University Press.