this post was submitted on 13 Sep 2023
264 points (98.5% liked)

Asklemmy

42489 readers
2517 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 5 points 9 months ago (8 children)

The lawyer fuck up is what happens when someone doesn't know or understand the limitations of a LLM.

If you want a GPT model tailored and specialized for a specific task, you have to train it with custom data, fine tune it and tweak the model's parameters. You cannot do that from the ChatGPT web/app, you need a custom implementation coded in Python or some other language.

[โ€“] [email protected] 2 points 9 months ago (2 children)

There are some uis that allow for fine tuning (assuming you have an extremely high end rig designed for ml). For example ChatGPT alternative and DALLE alternative.

[โ€“] [email protected] 2 points 9 months ago (1 children)

Thanks. I have a quite powerful rig, but at the moment I work with OpenAI's API using GPT 3.5 Turbo using a custom (but shitty) Python script with a simple Gradio web interface. However, I mostly stopped improving or updating it months ago. As long as I don't use LlamaIndex, the cost is quite low.

I already use Stable Diffusion WebUI, tho.

Also the "fine tuning" I was talking about is this https://platform.openai.com/docs/guides/fine-tuning

[โ€“] [email protected] 2 points 9 months ago

I am aware what fine tuning is. It is available from the train tab while the base checkpoint is loaded in both cases.

load more comments (5 replies)