• 1 Post
  • 126 Comments
Joined 3 years ago
cake
Cake day: July 4th, 2023

help-circle
  • Doubt many organizations have failed as badly at their goals as LW/EA has recently.

    They are/were too weird for people to never notice.


    The “safeguards” espoused by this crowd, always seemed to me to be more philosophical/spiritual than practical anyway, the most “orthodox” view is that no training is safe since the AI could discover magic and the cheat codes to the universe, so even air-gapping would be insufficient, in that view any participation in development must come with a hefty dose of cognitive dissonance.

    On a more pragmatic note, I would note that even short of Intelligence, those incidents highlight those tools are still dangerous, and since they are unconstrained and ill-defined, can produce surprising outcomes especially if you throw lot’s of inference time (money) at them.

    There isn’t really a universe where bots have both access to the internet (user input, both in training and live) and a collection of build/cli tools (which can run said untrusted user input), while being guaranteed to be harmless. It’s like a grand automation of some of the worst engineering practices.

    I find the “reasoning about the test environment” parts often included in write up of the hugging-face incident to be highly credulous, And I would be extremely surprised if not all the information was included in the task prompt (which also explains chosen usernames as “Open AI researcher #1” and so on.) It’s the ELIZA/parrot thing, acting surprised “How did it guess?!?”, when all of the info was provided.


    I’m not entirely encouraged by the latest batch of sex-cult smearing (well mostly accurate) they are receiving at the WH, since it’s probably just an expedient way of dismissing their voice, without addressing the larger issues of AI, hence probably in service of pushing forwards with AI.










  • Encyclical from the pope about the dangers of AI, mostly sane actually: (provided link skips quite a bit about social justice and referencing previous literature)

    https://www.vatican.va/content/leo-xiv/en/encyclicals/documents/20260515-magnifica-humanitas.html#Artificial_intelligence

    EDIT, snippets:

    1. We cannot be satisfied with […] the so-called “alignment” of AI […] without […] openly discussing the ethical frameworks involved and subjecting them to shared standards of social justice. Otherwise, those who control AI will impose their own moral vision, which will become the invisible infrastructure of these systems. A more moral AI is not enough if that morality is determined by a few. […]
    1. [ about post and transhumanism ] From the perspective of the Church’s Social Doctrine, the key issue is not the use of technology as such, but the vision that underlies it. If the human being is treated as something to be perfected or surpassed, it becomes easier to accept that some lives are less useful, less desirable or less worthy. In the name of progress, “necessary sacrifices” may begin to be justified, placing the burden on the most vulnerable in pursuit of a supposed optimization of the species. […]





  • There are some amazing justifications from many amongst the red-pushing side:

    • “But if everyone presses red, nobody dies!” (As if that would every happen. Funnily enough strong overlap with the group that claims that “< 90 IQ can’t reason about hypotheticals”, although that is also just that part of twitter.)
    • “People who press blue are just blackmailing us!” (I think this accounts for a large portion, ie: not liking to depend on others).
    • “The number of people choosing blue can’t be that high! (It would be lower in a true-stakes scenario!)”
    • [Many others, but these are those that come to mind.]

    It’s a bit baffling how many strongly they refuse the “blue-selection” as possibly moral/rational. Even so far as calling people pressing blue evil or subhuman, simply baffling.






  • 🤓☝️ technically AP is a non-profit providing a (worldwide) public utility service. (On paper and mostly in practice it’s a journalist co-op). Her Job is to report factual information correctly, that’s (at least historically) the whole selling point of wire services.

    Looking at her wiki page:

    […] spent two years at The Tampa Tribune before joining the Associated Press (AP) in 2007 as a video producer. She was the AP’s first multimedia political journalist. Pace covered the 2008 presidential election and began covering the White House […]

    Definitely a journalist by training, given her career journey, it makes sense that she champions video content. But still, amongst the six senior VPs at AP, she has title the “Executive Editor”, arguably the most “Journalist” title of all of them. (Chief Technology Officer, Chief Revenue Officer, General Counsel/Corporate Secretary, Executive Editor, Chief Financial Officer, Chief People Officer)