The issue is likely caused by some internal changes between different ESP-IDF versions. Normally doing a full rebuild should fix this (if you can confirm this, we can update VisualGDB to trigger a full rebuild automatically if the project was previously built with a different toolchain).
Please let us know whether a rebuild fixes the problem. If not, please also try creating a new project with the new toolchain and let us know if that works.