Mail Version 9.3 (3124), SpamSieve 2.9.26
Googled around and haven’t seen this issue mentioned. This is on a new Mac where I did a clean install rather than a migration.
Just tried it on the old Mac and I get a dialog.
No error messages in Console that I could find.