plugins.llm.settings.fim.enabled
Set this if the model supports fill in the middle.
Type: null or boolean or raw lua code
Default:
null
Plugin default: true
Declared by:
plugins.llm.settings.fim.middle
The missing or masked segment that the model should predict.
Type: null or string or raw lua code
Default:
null
Plugin default: "<fim_middle>"
Declared by:
plugins.llm.settings.fim.prefix
The beginning of the text sequence to fill.
Type: null or string or raw lua code
Default:
null
Plugin default: "<fim_prefix>"
Declared by:
plugins.llm.settings.fim.suffix
The text following the missing section.
Type: null or string or raw lua code
Default:
null
Plugin default: "<fim_middle>"
Declared by: