SSH is primarily used for administration reasons which means that not many people should be logging into your hosts via SSH. With the advent of usb storage devices that work on all modern operating systems I see no reason why anyone should still be using password authentication for SSH. Store your private key and ssh client(s) on that usb storage device and you can log in worry free from anywhere in the world.

Also, here is a great little utility that anyone can use to brute force your host via ssh. From the code comments:

/*
*the first brutessh was only for users guest & test
*brutessh2 is a brute for sshd port wich atempts to login as root trying more than 2000 passwords for it.
*users guest , test , nobody and admin with no passwords are included.
*feel free to add more passwords and more users:=)
*by Zorg of #texter
*www.wget.home.ro
*wget@home.ro
*For mass use a synscan :
*Eg: ./biggssh sship.txt
* Ok.Try This : Hostname root:12345
*/