.. _tokenizer_api:

Corpus tokenizer
=================

.. currentmodule:: montreal_forced_aligner.tokenization.tokenizer

.. autosummary::
   :toctree: generated/

   CorpusTokenizer
   TokenizerValidator

Simple tokenizer
================

.. currentmodule:: montreal_forced_aligner.tokenization.simple

.. autosummary::
   :toctree: generated/

   SimpleTokenizer