Unfortunately, while just running the installer for 5.1 worked great, it pointed the new server at a brand new set of databases - orphaning the couple of dozen databases I was working with. This was Not Good. The fix comes in two parts.
First, create /etc/my.cnf, with a single entry pointing to the old database files:
Second, tell MySQL to upgrade the files:
sudo mysql_upgrade -u root