Currently, if a build fails due to an issue(5XX errors) with a 3rd party secret provider in pipelines, we fail the build with a System error.
It would be helpful for end users to have a meaningful error message so they can understand and fix the error.