• Xylight@lemdro.id
    link
    fedilink
    English
    arrow-up
    22
    ·
    13 hours ago

    I thought it was just me, I was messing with gemini-2.5-flash API yesterday and it repeated letters into oblivion

    my bot is named clode in reference to claude, but its running on gemini

    • BootLoop@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      4 hours ago

      It can happen on most LLMs and is usually programmed to decentivize repeating text heavily.

      I believe what happens is that when the LLM is choosing what word to use, it looks back on the sentence and sees that it talked about knives, so it wants to continue talking about knives, then it gets itself into a loop.

    • skisnow@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      8 hours ago

      What’s the associated system instruction set to? If you’re using the API it won’t give you the standard Google Gemini Assistant system instructions, and LLMs are prone to go off the rails very quickly if not given proper instructions up front since they’re essentially just “predict the next word” functions at heart.