Data Support Labs

Redefining what's possible with data

Proprietary AI, data engineering, GIS, and patented methods that transform how organizations see and use their data.

How Does Artificial Intelligence Work?

Ask a question to visualize how a Large Language Model (LLM) turns your prompt into an answer.

Input

What are tokens?

What·are·tokens?
Candidate Tokens
38/39
·step
9.0%
·time
81.0%
·turn
5.0%
·pass
3.0%
·go
2.0%
Tokens
Input5
Output37
Total42
Output
Tokens are the smallest pieces of text an AI model reads and generates, where parts of words, and punctuation each become individual tokens that the model processes one at a time
Contact Us

Let's talk about your data

Have a specific challenge or just want to explore what's possible? We'd like to hear from you.

Contact us