MiniLLM focuses on efficient training of language models through knowledge distillation, showcasing various pre-trained models under the MiniPLM initiative. It includes numerous text generation models, highlighting their parameters and updates, aimed at enhancing AI and machine learning applications.
mini-llm ✓
knowledge-distillation ✓
language-models ✓
text-generation ✓
+ ai-ml