Skip to content

Token and text tools

Counting, splitting, budgeting and comparing text in the unit you are billed in — every calculation in your browser, every estimate labelled as one.

Token Counter

Paste text and get a script-aware token estimate, a full character breakdown, and an honest account of how far off the estimate is likely to be.

Token Segment Visualiser

Colours your text by the character classes that drive its token count, so you can see which part — indentation, digits, emoji, non-Latin script — is doing the damage.

Tokenizer Comparison Sheet

Put the token counts your own models reported for one piece of text side by side, with characters per token and the monthly cost of the gap between them.

Words to Tokens Converter

Converts a word count into tokens using a ratio derived from your own text, rather than the single constant every other converter uses.

Characters to Tokens Converter

Converts characters into tokens at a ratio measured on your own text, and shows how wrong the familiar four-characters-per-token rule would be for it.

Context Fit Checker

Reserves space for the answer first, then tells you how much of the context window is left for your prompt — or exactly how many tokens over you are.

Prompt Size Analyser

Splits a prompt into system, tool schemas, history and the user turn, and shows what each part costs per call and per month.

Conversation Token Tracker

Paste a transcript and see what the whole conversation was billed, including the history re-sent on every single turn.

Token Cost per Language

Put the same sentence in two languages side by side and see the token difference, the mechanism behind it, and what it costs you per month.

Chunk Size Calculator

Document size, chunk size and overlap in; chunk count, total tokens stored, the storage amplification and the embedding cost out.

Text Chunker

Split your own text four different ways and read the actual chunks, with the overlap arithmetic shown.

Prompt Truncator

Fit a prompt to a token budget by one of four strategies, and see exactly which text was removed.

System Prompt Token Cost

What your system prompt costs per request, per million requests and per month, at your own rates.

Tool Schema Token Cost

Paste your tool definitions and see the per-call token overhead, broken down tool by tool.

Context Window Visualiser

Enter any limits you like and see the system prompt, tools, documents, history and output reservation drawn to scale.

Prompt Diff and Cost Delta

Diff two prompts line by line and price the difference per call, per million calls and per month.

Cache Prefix Analyser

Paste two prompts and find the exact character where they stop being identical — the boundary that decides a cache hit.

Message History Trimmer

Paste a transcript and preview what four different trimming strategies keep and what they throw away.

API Usage Response Parser

Paste a response body, get the usage fields pulled out and costed at your own rates.

Corpus Token Counter

Point at a folder and get an estimated token total, broken down by folder, by extension and by largest file.

JSONL Dataset Token Counter

Paste or load a JSONL training file and get an estimated token count per example and for the whole file, with the training cost at your own rate.

Multi-Turn Cost Simulator

Simulates a chat conversation turn by turn to show how re-sending the history makes the input bill grow with the square of the turn count.

Prompt Compression Preview

Applies six deterministic compression rules to a prompt and lists exactly what each one removed, with the estimated tokens and monthly cost saved.

Text Statistics for AI

Characters, words, sentences, syllables, reading level, character entropy and an estimated token count for any text you paste.

Whitespace and Formatting Cost

Put the same content in two forms — pretty-printed and minified, markdown and plain — and see the estimated token difference and what it costs per month.

Table Format Token Comparison

Renders your own table as CSV, TSV, markdown and three JSON shapes, and ranks them by estimated tokens at whatever row count you actually have.

Unicode and Emoji Token Cost

Counts graphemes, code points and UTF-8 bytes exactly for any text, and shows the token range those bytes imply for a byte-level tokenizer.

Code Token Counter

Estimates the tokens in pasted code or in source files you load, with tokens per line and bytes per token broken down by file extension.

Diff Token Counter

Parses a unified diff and estimates its tokens three ways: the whole patch, the changed lines only, and the changed lines without context.

Repository Token Estimator

Point the browser at a folder and get an estimated token map by directory and file type, plus how many context windows the codebase would fill.

Log Sampler for Analysis

Draw a reproducible random sample from a large log file, with the sample size derived from the precision you need.

Text Deduplicator

Find exact and near-duplicate records in pasted text, with the similarity measure and the threshold both in your hands.

Sentence Splitter

Split text into sentences with an abbreviation list you can see and extend, and length statistics for the chunks it produces.

Reading Time and Token Time Estimator

Turn an output size and your own measured token rate into a wall-clock estimate, and compare it against how fast a person reads.

Truncation Point Finder

Check an output for the structural signs of a cut — unbalanced JSON, an open code fence, a half-written character — against the finish_reason you were given.

Stop Sequence Tester

See exactly where your stop strings fire in a sample output, which one wins, and what the API would return.

Prompt Whitespace Normaliser

Inventory the invisible characters in a prompt — code point by code point — and clean the ones you choose to.

Language Detector

Identify the language of a snippet from its script and its function words, with the evidence for the guess printed next to it.

Text Anonymiser

Replace emails, cards, IBANs, IPs and phone numbers with stable tokens in the browser, and put them back afterwards.

Token Cheat Sheet

A one-page token and cost reference that fills itself in from your own ratios, rates and context limits.

Token and text tools · Multigrid