🚸Skilled a Tiny Mannequin(30 million parameter) to Inform Kids’s Tales!🚸
Ever questioned if a small language mannequin, simply 30 million parameters, may write significant, imaginative tales for youths? So I constructed one and it really works.
Introducing Tiny-Kids-Tales, a purpose-built, open-source mannequin that focuses on producing quick and artistic tales.
📌 Why I Constructed It
Most giant language fashions are extremely highly effective, but in addition extremely resource-hungry. I needed to discover:
✅ Can a tiny mannequin be fine-tuned for a selected activity like storytelling?
✅ Can fashions this small truly create participating content material?
📌 What’s Inside
I educated this mannequin on a high-quality dataset of Kids-Tales-Assortment. The aim was to make the mannequin perceive not simply language, but in addition intent, like writing an “animal friendship story” or a “bedtime story with an ethical.”
❓ Why Construct From Scratch?
You would possibly surprise: why spend the additional effort coaching a brand-new mannequin slightly than merely fine-tuning an current one? Constructing from scratch permits you to tailor the structure and coaching knowledge particularly, so that you solely pay for the capability you really want. It offers you full management over habits, retains inference prices and environmental influence to a minimal, and most significantly, teaches you invaluable classes about how mannequin measurement, knowledge high quality, and tuning strategies work together.
📌 For those who’re searching for a single instrument to simplify your GenAI workflow and MCP integration, try IdeaWeaver, your one-stop store for Generative AI.Complete documentation and examples
🔗 Docs: https://ideaweaver-ai-code.github.io/ideaweaver-docs/
🔗 GitHub: https://github.com/ideaweaver-ai-code/ideaweaver
🤖 Attempt It Out or Construct Your Personal
🔗 GitHub Repo: https://github.com/ideaweaver-ai/Tiny-Children-Stories-30M-model
⭐ Star it when you assume Tiny Fashions can do Huge Issues!
🙏 Particular thanks, this wouldn’t have been potential with out these superb of us:
1️⃣ Andrej Karpathy — Your YouTube collection on constructing an LLM from scratch made the entire course of really feel much less intimidating and far more achievable. I will need to have watched these movies a dozen occasions.
2️⃣ Sebastian Raschka, PhD: Your ebook on constructing LLMs from scratch, actually the most effective hands-on guides I’ve come throughout. Clear, sensible, and filled with hard-won classes.
3️⃣ The Vizura crew: Your movies have been an enormous a part of this journey.
