I love to show that kind of shit to AI boosters. (In case you’re wondering, the numbers were chosen randomly and the answer is incorrect).

They go waaa waaa its not a calculator, and then I can point out that it got the leading 6 digits and the last digit correct, which is a lot better than it did on the “softer” parts of the test.

  • GregorGizeh@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    4 months ago

    Idk personally i kind of expect the ai makers to have at least had the sense to allow their bots to process math with a calculator and not guesswork. That seems like, an absurdly low bar both for testing the thing as a user as well as a feature to think of.

    Didn’t one model refer scientific questions to wolfram alpha? How do they smartly decide to do this and not give them basic math processing?

    • lIlIlIlIlIlIl@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I would not expect that.

      Calculators haven’t been replaced, and the product managers of these services understand that their target market isn’t attempting to use them for things for which they were not intended.

      brb, have to ride my lawnmower to work

      • diz@awful.systemsOP
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        4 months ago

        Try asking my question to Google gemini a bunch of times, sometimes it gets it right, sometimes it doesn’t. Seems to be about 50/50 but I quickly ran out of free access.

        And google is planning to replace their search (which includes a working calculator) with this stuff. So it is absolutely the case that there’s a plan to replace one of the world’s most popular calculators, if not the most popular, with it.

        • HedyL@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          Also, a lawnmower is unlikely to say: “Sure, I am happy to take you to work” and “I am satisfied with my performance” afterwards. That’s why I sometimes find these bots’ pretentious demeanor worse than their functional shortcomings.

          • lIlIlIlIlIlIl@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            “Pretentious” is a trait expressed by something that’s thinking. These are the most likely words that best fit the context. Your emotional engagement with this technology is weird

            • diz@awful.systemsOP
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 months ago

              Pretentious is a fine description of the writing style. Which actual humans fine tune.

              • swlabr@awful.systems
                link
                fedilink
                English
                arrow-up
                1
                ·
                4 months ago

                Given that the LLMs typically have a system prompt that specifies a particular tone for the output, I think pretentious is an absolutely valid and accurate word to use.

                • HedyL@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  4 months ago

                  Also, these bots have been deliberately fine-tuned in a way that is supposed to sound human. Sometimes, as a consequence, I find it difficult to describe their answering style without employing vocabulary used to describe human behavior. Also, I strongly suspect that this deliberate “human-like” style is a key reason for the current AI hype. It is why many people appear to excuse the bots’ huge shortcomings. It is funny to be accused of being “emotional” when pointing out these patterns as problematic.

            • ebu@awful.systems
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 months ago

              “emotional”

              let me just slip the shades on real quick

              “womanly”

              checks out