plugins.llm.settings.fim.enabled

Set this if the model supports fill in the middle.

Type: null or boolean or raw lua code

Default: null

Plugin default: true

Declared by:

plugins.llm.settings.fim.middle

The missing or masked segment that the model should predict.

Type: null or string or raw lua code

Default: null

Plugin default: "<fim_middle>"

Declared by:

plugins.llm.settings.fim.prefix

The beginning of the text sequence to fill.

Type: null or string or raw lua code

Default: null

Plugin default: "<fim_prefix>"

Declared by:

plugins.llm.settings.fim.suffix

The text following the missing section.

Type: null or string or raw lua code

Default: null

Plugin default: "<fim_middle>"

Declared by: