RedPajama replicates LLaMA dataset to build open source, state-of-the-art LLMs

RedPajama, which creates fully open-source large language models, has released a 1.2 trillion token dataset following the LLaMA recipe.

RedPajama: New Open-Source LLM Reproducing LLaMA Training Dataset of over 1.2 trillion tokens

LLLMs: Local Large Language Models

Inside language models (from GPT to Olympus) – Dr Alan D. Thompson – Life Architect

Best Open Source LLMs of 2024 — Klu

Open-Source LLM Explained: A Beginner's Journey Through Large Language Models, by ByFintech @ AI4Finance Foundation

2311.17035] Scalable Extraction of Training Data from (Production) Language Models

🎮 Replica News

Beyond LLaMA: The Power of Open LLMs, by Cameron R. Wolfe, Ph.D.

The Latest Open Source LLMs and Datasets