I figured it out. The problem stems from having done a custom installation of Office Professional Plus 2010 and only installing Access.
If you are doing a custom installation, you must expand Office Tools and Microsoft SharePoint Foundation Support. Under Microsoft SharePoint Foundation Support, there is another Microsoft SharePoint Foundation Support. Set this to Run from My Computer, and the Open with Access button will work.