Introducing MPT-7B: a new open-source, commercially usable LLM

MPT-7B offers optimized architecture and performance enhancements, including compatibility with the HuggingFace ecosystem. The model was trained on 1 trillion tokens of text and code and sets a new standard for commercially-usable LLMs.

Feb 3, 2025 - 01:00
 0
Introducing MPT-7B: a new open-source, commercially usable LLM
MPT-7B offers optimized architecture and performance enhancements, including compatibility with the HuggingFace ecosystem. The model was trained on 1 trillion tokens of text and code and sets a new standard for commercially-usable LLMs.