Had this thought the other day and tbh it’s horrifying to think about the implications of one, or God forbid all, of them going down.
Stackoverflow too but that only applies to nerds haha

  • Possibly linux@lemmy.zip
    link
    fedilink
    English
    arrow-up
    8
    ·
    2 days ago

    I wish that the Internet Archive would focus on allowing the public to store data. Distribute the network over the world.

    • csm10495@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 days ago

      In theory this could be true. In practice, data would be ripe for poisoning. It’s like the idea of turning every router into a last mile CDN with a 20TB hard drive.

      Then you have to think about security and not letting the data change from what was originally given. Idk. I’m sure something is possible, but without a real ‘omph’ nothing big happens.

        • csm10495@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          15 hours ago

          Hashed by whom? Who has the source of truth for the hashes? How would you prevent it from being poisoned? … or are you saying a non-distributed (centralized) hash store?

          If centralized: you have a similar problem to IA today. If not centralized: How would you prevent poisoning? If enough distributed nodes say different things, the truth can be lost.

          • Possibly linux@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            15 hours ago

            This is a topic that is pretty well tested. Basically the data is validated when received.

            For instance in IPFS data is tracked by its hash. You request something by a CID which is just a hash.

            There are other distributed networks and they all have there own ways of protecting against attacks. Usually an attack requires a huge amount of resources.

            • csm10495@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              1
              ·
              13 hours ago

              Even in ipfs, I don’t understand discoverability. Sort of sounds like it still needs a centralized list of metadata to content I’d, etc.

      • Badoker@lemmy.nz
        link
        fedilink
        arrow-up
        6
        ·
        2 days ago

        But all the data is on IA’s servers. In the event their servers go down for good, that’s it. There’s no way to self host parts of the Archive fediverse style.

        • antonim@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          2
          ·
          2 days ago

          That’s true, but organising and managing such a distributed form of IA would probably be a nightmare of a job. I’ve seen many people suggest that to IA, but they seem to be very very reluctant about the idea.