Skip to content

set max tokens for safety

DErenrich requested to merge derenrich/set-max-tokens into main

set the max tokens so nobody can find some way to trick us and generate a huge response and eat our budget

I think these max token numbers are fairly generous so as to not break legit use

Merge request reports