Yes, this is possible.
Just navigate to Settings >> Email Notifications (under Customer-facing essentials) >> Dunning Management Profiles & Payment Failures. On this page, you can configure the email template for each reminder for a Payment Due invoice on the left panel shown in the screenshot below. You can read this document for more information.
Note that these emails will not be sent for each dunning attempt failure. They will be sent based on the number of days the invoice has been in Payment Due state.