Template Processing

Provides a way to specify templates in order to add the special tokens to each input sequence as relevant.

Super class

hftokenizers::post_processors -> processors_template_processing

Methods

Public methods

• post_processors_template_processing$new()

• post_processors_template_processing$clone()

Inherited methods

• hftokenizers::post_processors$process()

---

Method new()

Usage

post_processors_template_processing$new(
  single = NULL,
  pair = NULL,
  special_tokens = NULL
)

Arguments

single

(Template) – The template used for single sequences

pair

(Template) – The template used when both sequences are specified

special_tokens

(Tokens) – The list of special tokens used in each sequences

---

Method clone()

The objects of this class are cloneable with this method.

Usage

post_processors_template_processing$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.