Remove regular expressions
#11
by
TeraGlitch
- opened
This model returns a lot of junk like , and similar tokens. Is there a way to configure it to return JSON, or to force it to do so?
Hi
@TeraGlitch
The Junk Tokens could be due to model misses the token . Can you try adjusting these parameters
- Stop Sequences: Explicitly add and } as stop triggers
- Repetition Penalty: Increase to 1.1 or 1.15 to prevent loops
- Temperature: Lower to 0.1 or 0.2 for more predictable, structured output.
To force the JSON Output you can try prompting strategies like Schema-as-Code where in you provide an exact template or schema within the prompt , Use explicit instruction tags like and and command the model to output only valid JSON.
Please try all these techniques and let me know if it helped for your usecase .
Thanks