• 0 Posts
  • 204 Comments
Joined 1 year ago
cake
Cake day: June 30th, 2023

help-circle




  • The AI summaries were judged significantly weaker across all five metrics used by the evaluators, including coherency/consistency, length, and focus on ASIC references. Across the five documents, the AI summaries scored an average total of seven points (on ASIC’s five-category, 15-point scale), compared to 12.2 points for the human summaries.

    The focus on the (now-outdated) Llama2-70B also means that “the results do not necessarily reflect how other models may perform” the authors warn.

    to assess the capability of Generative AI (Gen AI) to summarise a sample of public submissions made to an external Parliamentary Joint Committee inquiry, looking into audit and consultancy firms

    In the final assessment ASIC assessors generally agreed that AI outputs could potentially create more work if used (in current state), due to the need to fact check outputs, or because the original source material actually presented information better. The assessments showed that one of the most significant issues with the model was its limited ability to pick-up the nuance or context required to analyse submissions.

    The duration of the PoC was relatively short and allowed limited time for optimisation of the LLM.

    So basically this study concludes that Llama2-70B with basic prompting is not as good as humans at summarizing documents submitted to the Australian government by businesses, and its summaries are not good enough to be useful for that purpose. But there are some pretty significant caveats here, most notably the relative weakness of the model they used (I like Llama2-70B because I can run it locally on my computer but it’s definitely a lot dumber than ChatGPT), and how summarization of government/business documents is likely a harder and less forgiving task than some other things you might want a generated summary of.











  • If this was real I’d be interested in the details. Did anon accept fiat or crypto? Were the boxes advertised mainly on the darknet itself? Or clearnet, and if clearnet how did they get users that know wtf an onion link is or how to use it? Were the police alerted by an irate customer calling the police near the return address, or were the cops buying the cookies as a sting operation?



  • chicken@lemmy.dbzer0.comtohmmm@lemmy.worldhmmm
    link
    fedilink
    arrow-up
    1
    ·
    1 month ago

    You get to be proud if your country or your people are a force for good in the world; doing things worth being proud of. Being proud that your parents were from Alabama and hooked up one night and you just so happened to be their spawn makes no sense. This applies no matter where you’re from.

    Do you get mad every time someone plays Country Roads? When you live somewhere that place, the people in it, the way they live and your connections to them becomes a part of who you are. I think it’s alright to demand that southerners not use the confederate flag for that because of its inherent racism, but basic respect for the humanity of someone who came from a different place means also respecting the fond feelings they may have for it and the way that place is part of their identity.


  • If you are at the point where you are having to worry about government or corporate entities setting traps at the local library? You… kind of already lost.

    What about just a blackmailer assuming anyone booting an OS from a public computer has something to hide? And then they have write access and there’s no defense, and it doesn’t have to be everywhere because people seeking privacy this way will have to be picking new locations each time. An attack like that wouldn’t have to be targeted at a particular person.