Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[jipehog]

All of us can afford to run one consumer LLM (look at this sub and find people squeezing GPT-4 level performance out of casualer LLM's)

I'm just confused at this statement.
What?

LLM = language model neural network

I get that.
I’m just baffled by the assertion that GPT-4 quality can be ‘squeezed out’ by a consumer LLM ( Kobold? Pygmalion?)
Like what?

Have a look at r/singularity. There's apparently a whole lot of tricks being used now.

What sort of new tricks?

Also what is Kobold and Pygmalion ?

[TamerVirus]

Kobold and Pygmalion both refer to a series of open source LLM of various size.

Kobold: github (Many different models for different uses)
Pygmalion: Huggingface (New on the scene. Their 6B model is chat focused, but janky.)

Developments in the AI world are fast and furious, so discussion of consumer level LLM has shifted in finding ways to fine tune Meta’s llama model. (Stanford’s fine tune called Alpaca has gotten a lot of interest)