An implementation of n-gram language models with various smoothing techniques for natural text generation and analysis with tokenization and perplexity calculations
python3 matplotlib linear-interpolation word-generation laplace-smoothing good-turing-smoothing smoothing-methods n-gram-language-models perplexity-metric
-
Updated
Feb 26, 2025 - Python