Just in case someone else encounters this problem: on VS2010 when Solution Explorer is closed, opening VisualGDB Project Properties via the Project menu will result in the following error:
80004005 E_FAIL
This is caused by a bug in VS2010 and can be solved by keeping the Solution Explorer visible or updating to VS2012 or later.