The Open Super-large Crawled Aggregated coRpus

Joined April 2021
📣 The OSCAR Project and @DFKI are happy to announce the release of Colossal OSCAR 1.0 📚, which is now available on the @huggingface Hub 🤗 at huggingface.co/datasets/osca… Colossal OSCAR 1.0 was put together by @pjox13 as part of the @OpenGPTX collaboration.
2
15
3
52
16,495
Check out the new multimodal OSCAR by @FuteralMatthieu ! 🚀📚🖼️
Announcing mOSCAR, multilingual interleaved text-image corpus as part of @oscarnlp project. Paper: arxiv.org/pdf/2406.08707 Dataset: huggingface.co/datasets/osca… Doc: oscar-project.github.io/docu… 1/6
4
269
Announcing mOSCAR, multilingual interleaved text-image corpus as part of @oscarnlp project. Paper: arxiv.org/pdf/2406.08707 Dataset: huggingface.co/datasets/osca… Doc: oscar-project.github.io/docu… 1/6
3
27
5
55
5,661
✨ Colossal OSCAR 1.0 has also been made possible thanks to the continuous support of @Inria, @inria_paris, @InriaParisNLP and @CommonCrawl. Specially thanks to the contributions of @Uinelj, @imrua__ ,@sobamchan, @sebnagel and @bensagot.
1
261
👀 We're working on many new features for you, currently we're focusing on improving language identification, so if you want to help or contribute, please join our community 💬 on Discord: discord.com/invite/4JNg9FTar…
201
Everybody is talking about @OpenAI - we should talk more about cool projects like @silo_AI, @oscarnlp (for multilingual #LLMs), @bazril's work on high-performance language tech, or @OpenWebSearchEU. #Metaforum has been a great opportunity to learn more.
2
4
8
558
A ✨new version of the OSCAR corpus✨ is available! Say hello to OSCAR 23.01 📚🤓 ! Feature highlights in this thread 🧵
1
12
2
48
10,712
OSCAR 23.01 has been made possible thanks to @Uinelj @pjox13 @imrua__ @sobamchan @sebnagel and @bensagot
1
3
308
👀 We're working on many new features for you, currently we're focusing on improving language identification, so if you want to help or contribute, please join our community 💬 on Discord: discord.com/invite/4JNg9FTar…
1
1
278