The "Subscribe" button text on the checkout page can be changed under "Settings >> Checkout and Self-Serve portal (under Customer-facing essentials section) >> Hosted Pages Settings >>Text Configurations" as shown below.
The changes will appear on the checkout page as shown below.