Remove regular expressions

#11
by TeraGlitch - opened

This model returns a lot of junk like , and similar tokens. Is there a way to configure it to return JSON, or to force it to do so?

Hi @TeraGlitch
The Junk Tokens could be due to model misses the token . Can you try adjusting these parameters

  1. Stop Sequences: Explicitly add and } as stop triggers
  2. Repetition Penalty: Increase to 1.1 or 1.15 to prevent loops
  3. Temperature: Lower to 0.1 or 0.2 for more predictable, structured output.

To force the JSON Output you can try prompting strategies like Schema-as-Code where in you provide an exact template or schema within the prompt , Use explicit instruction tags like and and command the model to output only valid JSON.

Please try all these techniques and let me know if it helped for your usecase .
Thanks

Sign up or log in to comment