No it isn’t. Those models are trained on the big models. They will not get better if the big providers go under. Sure, they’ll keep running, but half of the reason people are buying into all this AI nonsense is that it’s going to be much much better than it already is in the future.
It’s a process called distillation. One way of doing it is creating thousands of accounts to prompt a big flagship model, then use the output to pre-train their own model.
No it isn’t. Those models are trained on the big models. They will not get better if the big providers go under. Sure, they’ll keep running, but half of the reason people are buying into all this AI nonsense is that it’s going to be much much better than it already is in the future.
That’s just not true. They might steal from the American models, but they don’t depend on them.
They literally use them as base models for compression.
How do they do that exactly?
It’s a process called distillation. One way of doing it is creating thousands of accounts to prompt a big flagship model, then use the output to pre-train their own model.