LLMs rely on their context to generate the next set of tokens. Over a long trajectory, the context fills with numerous types of components: a system prompt, past conversation turns, instructions that act on retrieved documents, tool responses or user data, requirements constraining the allowed output, and reasoning chains. The context carries a rich structure, most of which is either implicit to the model or encoded in formats such as JSON that were not designed to be digested by LLMs. This is one of the main reasons LLMs, particularly those on the smaller end of the scale, are brittle and sometimes fail in unexpected ways. The lack of explicit structure can also be exploited by attackers, for example, in the form of prompt injections.
LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B
A Blog post by IBM Granite on Hugging Face

Key takeaways
Hugging Face introduces LLMON, an LLM-native markup language to improve structure and semantics in model interactions.
- LLMON uses tags and special delimiters to explicitly communicate context structure.
- Two experimental models, granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview, are released.
- A GitHub repo provides tools and examples for working with LLMON.
Summarised automatically by AI from the original article by Hugging Face Blog. AI can make mistakes, so check the original for details.
Story details
- Published
- Format
- Article
- Original
- huggingface.co ↗

