Retrieval-Augmented Generator ni modeli ya lugha iliyoundwa na Facebook, New York University (NYU) na University College London (UCL) (Marekani, Uingereza), iliyotolewa 22 Mei 2020.
Uzito wake (weights) uko wazi: mtu yeyote anaweza kuipakua, kuiendesha na kuitumia hata kibiashara.
Ina vigezo (parameters) milioni 626.
Ni moja ya modeli zinazonukuliwa sana na watafiti.
Ilipotoka, ilivunja rekodi katika kazi yake.
Naweza kuiendesha mwenyewe?
Ndiyo, kwenye simu janja au kifaa chenye uwezo mkubwa zaidi.
SimuRAM ya GB 6–8
Kompyuta mpakatoRAM ya GB 16
Kompyuta yenye uwezo mkubwaGB 24 hadi 64 (kadi ya michoro au Mac yenye uwezo mkubwa)
Sevazaidi ya GB 64
Inahitaji takriban GB 1.4 za kumbukumbu (RAM) ikibanwa hadi biti 4.
Programu za simu zinazoendesha modeli bila intaneti (kwa mfano PocketPal) zinapakua toleo lililobanwa.
Modeli nyingine za Facebook
Eagle 2Hong Kong Polytechnic University, Johns Hopkins University, Nanjing University, New York University (NYU), Nvidia na Tsinghua UniversityJan 2025Utambuzi wa picha, Roboti
Wazi, si kwa biashara8.9BKompyuta mpakato
A
OLMo 2 Furious 13BAllen Institute for AI, New York University (NYU) na University of WashingtonDes 2024Lugha
Wazi13BKompyuta mpakato
A
OLMo 2 Furious 7BAllen Institute for AI, New York University (NYU) na University of WashingtonDes 2024Lugha
Wazi7BKompyuta mpakato
C
RWKV-5 (Eagle) 7BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
Wazi7.5BKompyuta mpakato
C
RWKV-6 (Finch) 3BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
Wazi3.1BSimu
N
Cambrian-1-13BNew York University (NYU)Jun 2024Data mseto, Utambuzi wa picha