PulseAugur
EN
LIVE 15:18:54

Stable Diffusion captioning model generates explicit content

Users of the fancyfeast/llama-joycaption-beta-one-hf-llava model, which is used for auto-captioning images generated by Stable Diffusion, have reported encountering unexpected and inappropriate captions. These captions, which include references to adult websites like BRAZZERS.com and METART.com, appear even on seemingly innocuous images, leading to confusion and concern among users about the model's training data. AI

IMPACT Raises concerns about the safety and training data of image captioning models.

RANK_REASON User reports of unexpected and inappropriate output from an AI model.

Read on r/StableDiffusion →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Stable Diffusion captioning model generates explicit content

COVERAGE [1]

  1. r/StableDiffusion TIER_2 English(EN) · /u/GuruKast ·

    Er...What exactly joy captioner was trained on? lol

    <!-- SC_OFF --><div class="md"><p>Why are some of my auto captioned images having the most <em>interesting</em> endings? </p> <p>using <strong>fancyfeast/llama-joycaption-beta-one-hf-llava</strong></p> <p>Just trying to train a character model when.....<strong>a wild caption appe…