Returns the tokens as a list of character vector of a recipe. This function can be useful for diagnostics doing recipe construction but should not be used in final recipe steps. Note that this function will both prep() and bake() the recipe it is used on.
A recipe object
name of variable
A list of character vectors
text_tibble <- tibble(text = c("This is words", "They are nice!")) recipe(~ text, data = text_tibble) %>% step_tokenize(text) %>% show_tokens(text)#> [] #>  "this" "is" "words" #> #> [] #>  "they" "are" "nice" #>