• Rampsquatch@sh.itjust.works
    link
    fedilink
    arrow-up
    2
    arrow-down
    2
    ·
    14 hours ago

    I can run a small LLM locally which I can talk to using voice to turn certain lights on and off, set reminders for me, play music etc.

    Neat trick, but it’s not worth the headache of set up when you can do all that by getting off your chair and pushing buttons. Hell, you don’t even have to get off your chair! A cellphone can do all that already, and you don’t even need voice commands to do it.

    Are you able to give any actual examples of a good use of an LLM?

    • Ek-Hou-Van-Braai@piefed.socialOP
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      13 hours ago

      Like it or not, that is an actual example.

      I can lay in my bed and turn off the lights without touching my phone, or turn on certain muisic without touching my phone.

      I could ask if I remembered to lock the front door etc.

      But okay, I’ll play your game, let’s pretend that doesn’t count.

      I can use my local AI to draft documents or emails speeding up the process a lot.

      Or I can used it to translate.

      • Rampsquatch@sh.itjust.works
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        13 hours ago

        If you want to live your life like that, go for that’s your choice. But I don’t think those applications are worth the cost of running an LLM. To be honest I find it frivolous.

        I’m not against LLMs as a concept, but the way they get shoved into everything without thought and without an “AI” free option is absurd. There are good reasons why people have a knee-jerk anti-AI reaction, even if they can’t articulate it themselves.

        • Ek-Hou-Van-Braai@piefed.socialOP
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          edit-2
          13 hours ago

          It’s not expensive for me to run a local LLM, I just use the hardware I’m already using for gaming. Electricity is cheap and most people with a gaming PC probably use more electricity gaming than they would running their own LLM and asking it some questions.

          I’m also against shoving AI in evening, and not making it Opt-In. I’m also worried about privacy and concentration of power etc.

          But just outright saying LLMs are bad is rediculous.

          And saying there is no good reason to use them is rediculous. Can we stop doing that.

          • Rampsquatch@sh.itjust.works
            link
            fedilink
            arrow-up
            2
            ·
            12 hours ago

            It’s not expensive for me to run a local LLM, I just use the hardware I’m already using for gaming. Electricity is cheap and most people with a gaming PC probably use more electricity gaming than they would running their own LLM and asking it some questions.

            I don’t personally know the monetary cost of running one of these things locally, and I should be more informed before I make sweeping statements.

            I’m also against shoving AI in evening, and not making it Opt-In. I’m also worried about privacy and concentration of power etc.

            Then we are on the same page

            But just outright saying LLMs are bad is rediculous.

            I didn’t say that, in fact I said that I didn’t have a problem with them as a concept, go back to the previous point for a reason why someone might have instant dislike of “AI”

            And saying there is no good reason to use them is rediculous. Can we stop doing that.

            I also didn’t say that. I just said your examples weren’t good uses of it. I happen to think that there are very good applications for this technology, but none of those are publicly available GenAI slop and soulless automation systems/assistants that are really just corporate spyware to collect advertising data.

            If you want a “smart home” with voice commands because it make you feel like Tony Stark talking to Jarvis go right ahead, but don’t pretend that your locally run LLM is what people are talking about when they level criticism against “AI” (or even if they just say ‘AI bad’)

            • Ek-Hou-Van-Braai@piefed.socialOP
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              2
              ·
              11 hours ago

              You didn’t say that no, but people here do say those things.

              It’s basically how this thread started.

              I’m on the same page with a lot of the hate for AI and fears of it, but let’s not pretend it’s just all bad.