User suggests that the current cache for text prompts is too large and proposes a specific size (256 unique text prompts) for better efficiency or resource usage.
That is to much cache there! Make it 256 unique text prompts...