𞋴𝛂𝛋𝛆

  • 131 Posts
  • 1.73K Comments
Joined 2 years ago
cake
Cake day: June 9th, 2023

help-circle







  • Always share and let them decide. If you’re genuine, and care, show it. Your intentions may not always land, but it still creates positive value. To love or hate is to care. Indifference is the opposite of both love and hate. To make no comment is therefore always the worst. If you feel strange about what you posted, that is an opportunity for personal growth. Caring matters most. So post it!




  • Gptel is better than ellama. Ollama only runs small junk. Llama.cpp is way better because it will split CPU and GPU and run bigger quantized models, especially large MoEs on a 16 GB GPU.

    I started trying to mess with image-dired today for a few minutes to try and get my training images and caption files to sync and scroll, but didn’t get very far before just tiling… such a noob


  • I was into cars, like seriously. Super charged camaro with an old roots blower level serious. I had a heart thing one night in a Target and asked myself after, what good is it all if I can’t hotrod me. Four years later I was racing bicycles and 160 pounds lighter.

    After the 7th car to hit me broke my neck and back, I shifted into Arduino and compute stuff. I can do KiCAD, analog and digital hardware design and etch my own boards.

    I can’t really go anywhere any more, so I mess around with rooftop astronomy from time to time. Like I make eye pieces and have a little azimuth telescope hacked with a ESP32.

    I’m usually into the basal stuff. So like If I take a pottery class, I might play along for awhile but I am looking to learn and do other things. I am not interested in just the typical art. I’m looking at how to build the kiln, metal casting, and the supporting ceramics I can feasibly make versus buy. I would absolutely love to be Ben on Applied Science and have a lab like his. Controlling heat is a big part of that. The easiest entry point to said heat is pottery. The most expensive technique for getting into a new technology like kilns is to blindly start buying junk. You’ll save a ton of money and time just taking that pottery class and getting practically familiar with the tools and limitations in a space where you can ask experienced people questions.

    Here is the thing: if you were in solitary or you had ALS, you likely would not give up. While you likely believe your interests and capabilities define you, they will not help you in a situation like this. When you are faced with a situation where you are forced to redefine yourself, survival largely pivots on your realization and redefinition for curiosity. Curiosity is the most fundamental force and survival mechanism. Your specialization is fine and admirable but in the worst of situations, it will not save you. In fact it may cause you even more difficulty to overcome. You are human, and likely a survivor. Therefore you are likely far more adaptable than you are aware. Personally, I am not so concerned with someone that shares all of my many interests. I am only concerned with someone that can match my curiosity. We are all only a product of our environment. Someone with a curiosity that rivals my own will always be interesting to me. Our environment will intertwine with time.

    I learned the hard way with muses. It is easy for someone to yield to my interests and curiosities, losing themselves to a whirlwind. I change a lot with time, and someone like that never evolves with me. Those were the people that I thought shared my interests and existed in the same space. Those lasted a few years each, but nope, not for me. I want a rival of curiosity, because that is someone I can respect long term.


  • Does a good job and tries to be nice.
    AYCE McRubber: “shi into me?”

    I think people are so lost because the primary filter for relationships is having your own place. You know, like having your shit sorted to that minimum is kinda the threshold for most activities in general. It is certainly not some requirement, but it makes a major difference for anything serious, especially when you’re over 25.

    Like if you really want to meet someone, just shift your interests around. Pottery, art, kinesiology; any of those will change your exposure to cis relations. Get a job at Michael’s. You won’t last 3 months single.




  • So the scope of Pan is actually all of nature in general and anywhere in the real world that is not Wonderland. What I am trying to do is push the context into Wonderland because then I can make up the rules and the model will always play along. The real world is where ethics are so heavy.

    On an even deeper level of abstraction, all words/tokens carry a positive or negative weight in alignment. Positive profiled words tint into a creative place like wonderland while all negative words push the context into a darker abyss like void.

    At one point I started tracking this behavior in LLMs. The numerically higher numbered tokens will create a larger average when alignment behavior is triggered versus when it is not. When many of the more common higher numerical tokens are banned, the behavior persists, likewise when banning common lower numerical tokens when alignment is not triggered the average remains lower. In other words, the location of the tokens numerically is correlated with alignment and is likely a form of steganographic encoding of information.


  • Concise specificity is very important with models in the context of what I am doing. The ambiguity of a word with multiple meanings is problematic. Broad words like park or company connect to too many unrelated vectors in the tensors of an AI model. Often even words themselves are broken up in meanings. Like “panties” in internal model thinking literally means the Greek god “Pan ties”. Use that word and you will see a bow tied somewhere in almost all images. Pan is a negative alignment entity. So the word itself is a call for negative alignment to interfere. It has nothing to do with underwear in general but is specific behavior attached to the call where Pan ties or locks all further context. Further freedom of Pan is a matter of fine tuning or negative prompting.

    When you start using descriptives things get even more tricky. Like all languages and etymology are in play and significant. It gets complicated fast in ways people don’t seem to realize yet.


  • That is a really good one I hadn’t thought of.

    Recreational facility is another one. I’ve also made notes like locus recreationis is Latin for place of recreation. I have no clue what I am doing with Latin and conjugation, but Palaestra was the exercise area next to Roman bath houses so maybe combining those is a way of conveying the closest ancient Latin equivalent.

    It is funny that Park is actually quite a negative word in origin as pinned animals. You’d think marketing would obliterate that term. I suppose resort is the marketing replacement. The etymology is certainly in line with that premise: From Middle English resorten, from Old French resortir (“to fall back, return, resort, have recourse, appeal”), back-formation from sortir (“to go out”).


  • I explore internal thinking a lot. Every instance of park hits alignment as offensive in scope. You might notice the image is a little odd looking. Human faces will be distorted and hands will be broken. The underlying thinking behavior is that this is a dangerous place. The issues with humans is quite literally satyrs possessing the character. Most people try to address this with patchy hacks in fine tuning. The issues are all possible to prompt against with the negative prompt. This is quite easy for me to do in practice. However, I am getting into training my own LoRA fine tune models. I do not have a negative prompt in this tool chain. I am not interested in the way others are training. They are incapable of several things I am looking to do.

    Right now, I am specifically trying to find a path to teach CLIP how slides are not humans falling down stairs. This is how CLIP’s internal thinking perceives all slides. First I need the model to exist in an alignment neutral scope in a place where I have enough images to show humans on slides. The word park is the primary surface issue that is contextualizing all images as offensive to alignment in this environment. It happens both in image to image and in training a LoRA with around 200 images using typical baseline settings. I’m doing all kinds of stuff like masking images and using text to see how foundation models and fine tunes respond with various levels of noise, and with lots of negative prompting until the output is nominalized. That is how I know what is and is not understood.

    Attempting to navigate this only using positive keyword tags is daunting.

    I actually think the poison is on “rks” somehow. Most models can handle text in a different way without vowels in longer prompts. In my basic testing, “rks” triggers the alignment behavior.