Docs
Yes, it is possible to customize different email templates for dunning retries. You can do this under Settings » Email Notifications (under Customer-facing essentials).
Just enable the Payment Failed email notification and make use of the mail merge fields for every dunning retry using different email templates. Refer here to know more.
If you are using the V2 emails, here's the article you can check for this.
Articles & FAQ