• BJW@lemmus.org
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    17
    ·
    10 days ago

    No? Are you not aware of the concept of “memories”? AI do indeed take feedback into account, if they’re designed to.

    • [deleted]@piefed.world
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      10 days ago

      AI does not have memories.

      It has a comparatively small context window that makes things worse the more it fills up.

      • architect@thelemmy.club
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        13
        ·
        10 days ago

        Eh I really think it does. You don’t news to load everything into context. You need to load where everything is located into context.

      • BJW@lemmus.org
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        13
        ·
        10 days ago

        You are mistaken. Some AI models do indeed have memories.

        • DaTingGoBrrr@lemmy.ml
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          1
          ·
          10 days ago

          They save some strings in a document to later read and “remember”. Calling them memories is a reach.

          • BJW@lemmus.org
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            6
            ·
            10 days ago

            My point stands that they can learn from feedback. Your memories are only information in a virtual document, too. Just as susceptible to corruption, or misinterpretation.

              • BJW@lemmus.org
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                6
                ·
                10 days ago

                Only because you don’t think of it as one. It’s just a different medium for the storage of information.

            • DaTingGoBrrr@lemmy.ml
              link
              fedilink
              English
              arrow-up
              4
              arrow-down
              1
              ·
              10 days ago

              Does an Alzheimer’s patient learn things just because they read the same note every morning explaining the reality to them?

              • BJW@lemmus.org
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                9 days ago

                No, their file system is corrupt. No reliable read or write access.

    • pageflight@piefed.social
      link
      fedilink
      English
      arrow-up
      9
      ·
      10 days ago

      The auto-generated memories I’ve seen it create are pretty inane: “always name variables container_ when in MySpecificClass”. Not really learning engineering principles.

      Similar, I’ve found AGENT.md files might nudge it in the right direction, but as always it’s a fuzzy matcher, not a learning engineer.

      • BJW@lemmus.org
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        8
        ·
        10 days ago

        It’s best to generate memories manually, but I’ve had good fortune with auto-generated so far. At least using Co-pilot.

        I have found it best to have another AI generate the agent.md - having a layer of interpretation can really clarify the information imparted.