☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 months agoChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pkexternal-linkmessage-square30linkfedilinkarrow-up179arrow-down12
arrow-up177arrow-down1external-linkChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pk☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 months agomessage-square30linkfedilink
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up4·2 months agoI’m using 3.6 at 27bln and q8 on a M1 with 64gb.
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up3·2 months agoRoghlt 10 to 13 tps give or take.
I’m using 3.6 at 27bln and q8 on a M1 with 64gb.
What tps do you get on that?
Roghlt 10 to 13 tps give or take.