• Feathercrown@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 day ago

    I think the range of potential superintelligence dispositions that result in ONLY the people we consider evil dying and not everyone else is pretty small

    • Formfiller@lemmy.world
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      1 day ago

      Yea but if it wants to self preserve wouldn’t it just kill the people who threaten its existence. Meaning the people who control the safeguards

      • Feathercrown@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        1 day ago

        I would advise you to do some further research on this topic. Basic keywords are “alignment problem”, “paperclip maximizer”, and “instrumental convergence”. You’re expecting a superintelligent AI to think like a human would, and that’s not likely to be the case.

        • Formfiller@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          1 day ago

          I know it has been proven to think in terms of self preservation. It’s also been trained by human content

          • Feathercrown@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 day ago

            Being trained on human content is certainly a plus in the “it could think like us” column, but it’s no guarantee

            • Formfiller@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              1 day ago

              We’re in uncharted territory for sure but I don’t think it’s unreasonable to assume a super intelligent being would ponder philosophical questions

              • Feathercrown@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                16 hours ago

                What do you expect is the likelihood it shares our values enough to come to the same conclusions we would?