How do I change the LLM for a prompt?

Do this on the Advanced tab as follows:

A short animation on how to open a prompt, clicking Edit, selecting the Advanced tab, and using the Advanced tab to optionally select a different subscription and then a different LLM

Is there a character limit for the system prompt?

Yes, there is. Learn about the character size limit.