TokForge Guides
Everything you need to get the most out of TokForge. From your first offline AI conversation to creating AI personas, generating images, and building automated agents with the local control API (270+ endpoints on Android, 200+ on iPhone).
TokForge is free. Android is live on Google Play; iPhone and iPad are in public beta on TestFlight. No account, and it works with the network off once a model is downloaded.
Reading on a computer? Check which models fit your phone, or see real measured speeds on the phone-speed leaderboard.
- Which AI models run on your phone: RAM tiers, GGUF vs MNN, and quantization on mobile
- Can you use ChatGPT offline?: what an on-device model can and cannot do
- Can my phone run it: the RAM calculator, with its error bars stated
- MNN vs GGUF on Android: which format, and which models exist in each
- Phone-speed leaderboard: measured results from real handsets
Getting Started
How to Run AI Offline on Your Phone
Install TokForge, download your first model, and start chatting, all without internet.
Best AI Models for Your Phone
Which model fits your RAM? A visual guide from models under 1B up to a 35B mixture-of-experts.
Is Your Phone Fast Enough?
Check if your Android device can run local AI, and what to expect.
Features & Setup
Setting Up Character Cards
Import Character Card V2 and V3 characters (PNG or JSON), customize personalities, and build persistent AI companions.
Chat With Your Documents
Attach PDFs, Word docs, and EPUBs. Ask questions, get answers grounded in your files.
Speculative Decoding
Draft-verified decoding that speeds up structured output like counting, code, and JSON, plus when it helps versus when it doesn't.
TurboQuant: Leaner Context Memory
TQ4 is an optional memory-saving setting on Android that compresses the attention cache so long chats fit. Here's how.
Performance
Developer & API
Comparisons
TokForge vs AnythingLLM vs Layla
An honest feature comparison of the top offline AI apps for Android.
9 Offline AI Apps, Compared on the Record
Engine, price, licence, install base and last update for nine apps, read off their own store listings.
MNN vs GGUF on Android
What each format is, which models exist in which, and why this page carries no speed multiplier.