Thanks to the integration with YITH WooCommerce Email Templates, you are also free to customize every single email it sends.
After installing and activating both plugins, enable the option Use YITH WooCommerce Email Templates available in the YITH Review Reminder settings.
Now, in YITH WooCommerce Email Templates settings, you will be able to select the template to combine to emails generated with YITH WooCommerce Review Reminder.
For further details about YITH WooCommerce Email Templates settings, please refer to the official documentation.