4

I would like to ask for the definition of the word generative AI (GenAI) according to our community because some places define somethings different than others. Since we have rules and scopes set to orbit around generative AI, I think we should define it to be solid here for future reference.

What is generative AI (GenAI) according to this site? What is included, and what is not?

Relate

Is Google Translate, the web application, a Generative Artificial Intelligence (GenAI) tool?

6

1 Answer 1

5

I'll take an initial stab:

  • For the "AI" part:
    • Makes use of machine learning techniques (probably gradient descent on a neural network) to model the patterns/structures of a given data set
  • For the "generative" part:
    • Outputs new content in a relatively open-ended domain (such as text, images, or audio)
    • Task's output is underdetermined by input, such that there'd be a wide range of acceptable outputs rather than one/few "correct" results

Some examples, including tools mentioned:

Tool GenAI? Reasoning
GPT-3 ? AI: trained on web text. Generative: text is a broad domain, output of text continuation task is not fully defined by input text
Stable Diffusion ? AI: trained on web images. Generative: images are a broad domain, input prompt doesn't fully define a generated image
Gaussian filter ? Not AI: not trained on data. Not generative: output domain is broad, but output is fully defined by user's input
Github Copilot ? AI: trained on web text, then public Github repos. Generative: code is relatively open domain, and there are many ways to approach a given problem
Scigen ? Not AI: uses a hand-written context-free grammar rather than machine learning from data
Clippy ? Not AI: probably hand-tuned criteria. Not generative: Selects from a set of pre-defined suggestions, rather than an open domain
Cleverbot ? Not generative: assuming output is selected from previous user responses, rather than new text content
Google Translate ?? Maybe not generative: output could be considered too tightly defined by the input text
6
  • Usually, the descriptions of GenAI mention LLM. Are there other models used in GenAI? In other words, if a tool doesn't use an LLM, could it be considered a GenAI tool?
    – Wicket
    Commented Aug 10, 2023 at 17:39
  • I have forgotten text-to-image artificial intelligence. Does adding columns to your table for LLM and text-to-image make sense? P.S. "Google Translate" should be considered a brand encompassing several products / apps.
    – Wicket
    Commented Aug 10, 2023 at 17:57
  • 2
    @Wicket "Does adding columns to your table for LLM and text-to-image make sense?" - there is already GPT-3 and Stable Diffusion as examples of an LLM and a text-to-image model respectively. Could possibly add examples for music/audio generation or video generation, though none are widely popular at the moment AFAIK.
    – SirBenet
    Commented Aug 10, 2023 at 18:43
  • 1
    Cleverbot might not generate sentences, but it generates conversations. GPT models have word fragments for tokens; where's the line?
    – wizzwizz4
    Commented Aug 13, 2023 at 23:13
  • Does GPT with a temperature of 0 not qualify as GenAI?
    – Someone
    Commented Aug 19, 2023 at 1:03
  • 1
    @Someone "Task's output is under-determined by input" doesn't exclude models that can behave deterministically and land on one result, so long as other results would've been equally "correct" a priori - and presumably would be given by other models performing the same task.
    – SirBenet
    Commented Aug 19, 2023 at 16:41

You must log in to answer this question.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.