Skip to contents

Get basic information of BERT models.

Usage

BERT_info(models = NULL)

Arguments

models

A character vector of model names at HuggingFace.

Value

A data.table:

  • model name

  • model type

  • number of parameters

  • vocabulary size (of input token embeddings)

  • embedding dimensions (of input token embeddings)

  • hidden layers

  • attention heads

  • [MASK] token

Examples

if (FALSE) { # \dontrun{
models = c("bert-base-uncased", "bert-base-cased")
BERT_info(models)

BERT_info()  # information of all downloaded models
# speed: ~1.2s/model for first use; <1s afterwards
} # }