Can smallstep to generate an RSA-based certificate?

The short answer is yes; find out how here.

Although RSA-based certificates do not have the default encryption setting, users can create an advanced authority that is capable of generating RSA certificates.

If you're interested in generating RSA-based certificates, contact support.