unable to generate quiz due to code

[kiowafa]

I used Cohere to get an API key.
When I click generate quiz I get:
Expected ',' or '}' after property value in JSON at position 2365

[ECuiDev]

Can you try again? I just tested it myself and both the Command R and Command R+ models worked on the first try.

If it still doesn't work after multiple attempts, can you provide the model you used, the token count of your notes, and the type and number of questions you tried to generate?

[kiowafa]

Hey there!
It worked now with the same short note that I tried it with in the beginning (this plugin is so amazing I love it!)
I tried another long note and I got Unexpected end of JSON input

[ECuiDev]

How many tokens was the note and how many questions were you trying to generate?

[kiowafa]

The new one was 24088 tokens.

[ECuiDev]

How many questions did you try to generate?

[kiowafa]

I clicked on "Generate Quiz" with the standard settings, so 7.

[ECuiDev]

Ok, I'll look into it.

[kiowafa]

Hey, just a heads up: I still have this problem.

[ECuiDev]

I did some testing and turns out Cohere's models return nothing if your prompt exceeds ~4000 tokens. Note that this number can vary depending on the content of your notes because I use an extremely simple tokenizer which doesn't perfectly reflect how actual models tokenize inputs.

I plan to fix this by breaking down large inputs into chunks and processing each one separately. But in the meantime, I recommend either keeping each generation request under 4000 tokens, or using Google Gemini which can easily handle tens of thousands of tokens.

[kiowafa]

Thanks!

So I tried to test it with Gemini just now and I got the same error...

[ECuiDev]

That's surprising. I just tried with 80,000 tokens and had no issues. What generation language are you using and did your selected notes contain any "special" text (code, LaTeX, tables, non-English characters, embeds, etc.)?

[kiowafa]

I use german as the language for the questions to be generated in.
The only "special" text symbols I use are emojis, I guess.
But if I use different files (that have no emojis) I get the same error message (only with different "position")