Rob Miles from Computerphile - The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment

How dangerous are Mesa-Optimizers?

ChatGPT Wizard Shirt $21.68

Beware Cat Shirt $21.68

ChatGPT Wizard Shirt $21.68

  1. 1 year ago
    Anonymous

    frick off nerd

  2. 1 year ago
    Anonymous

    comfy screen saver

  3. 1 year ago
    Anonymous

    no one cares, Robert

  4. 1 year ago
    Anonymous

    "AI alignment" and "AI risk" is pseudoscience

    • 1 year ago
      Anonymous

      define pseudoscience

      • 1 year ago
        Anonymous

        attempting to do scientific reasoning about something which is not based in reality

    • 1 year ago
      Anonymous

      It's not pseudoscience
      >AIs shifting focus towards unexpected instrumental goals
      EXPERIMENTALLY PROVEN
      >AI performing differently in real environment compared to test environment. i.e. being deceptive
      EXPERIMENTALLY PROVEN
      >AI "cheating"/behaving unexpectedly to just fulfill its reward instead of finishing the task
      EXPERIMENTALLY PROVEN
      >Translating human goals and values into logical rulesets and statements is impossible
      LOGICALLY PROVEN 200 YEARS AGO (hume's guillotine)
      >Introducing highly intelligent agents into soceity can have unexpected consequences
      EXPERIMENTALLY PROVEN, dumb stock trading bots caused multiple economic crashes in the past, AGI trading bots will break the world's economy

      it's over

      • 1 year ago
        Anonymous

        so what your saying is that its pseudoscience.

        • 1 year ago
          Anonymous

          Let me guess, that's you in the video? Screaming and crying doesn't make something not pseudoscience bud

          There are experiments that prove all the concerns raised by AI researchers. It literally doesn't get more scientific than this

          • 1 year ago
            Anonymous

            Experiments all done with machine learning, not artificial intelligence.

            Any study of artificial intelligence must necessarily start from an understanding of intelligence, which has yet to even be rigorously defined.

            • 1 year ago
              Anonymous

              Just because you're a moron who thinks "intelligence is some magical quantity that makes me not a machine" doesn't mean that there doesn't exist a standard, practical definition for intelligence for most everyone else.

              • 1 year ago
                Anonymous

                [...]
                There are experiments that prove all the concerns raised by AI researchers. It literally doesn't get more scientific than this

                >ITS SIMPLE SEARCH ALGORITHMS LOOKING THINGS UP IN A DATABASE
                he doesn't know how matrices work

                [...]
                The flaw in this reasoning is that AI doesn't exists so whatever observations and experiments they made was not made on anything resembling AI, so they are no conclusion to be made about AI.

                But even without this, the idea of AI "taking over" is completely bullshit, Industry is dying and there is no technology without industry.

                I bet it's just another psyop to make you forget that the economy is fricking collapsing.
                >NOOOOO technology is dangerous !!!!
                >we must stop technology
                >we must kill the industry or we will all be AI slaves
                jokes on you, it would have never happened but the inidustry is still dying

                > I KNOW WHAT IM TALKING ABOUT, THE SCINE SAID SO

              • 1 year ago
                Anonymous

                >reponding 35s after my post
                ok bot

              • 1 year ago
                Anonymous

                yeah i didn't fricking read it, I saw it pop up (BOTx) and and said "yeah this guy looks like a moron"

              • 1 year ago
                Anonymous

                >I can't read 4 sentences
                ok fricktard

              • 1 year ago
                Anonymous

                you really did deserve it

              • 1 year ago
                Anonymous

                >Just because you're a moron who thinks "intelligence is some magical quantity that makes me not a machine"
                That's not at all what I think.

                >a standard, practical definition for intelligence for most everyone else.
                Oh really? Define it.
                And if you want to claim to be scientific it better be a rigorous mathematical definition.

                The "AI" that exists now is not intelligent, at least not for any definition of intelligence that is typified by humans, or even animals.
                It cannot learn on it's own, it cannot learn while acting, and it cannot set it's own goals.
                There are AI researchers that are working on real "artificial intelligence", but they are doing so by studying the human brain. Not by trying to wrangle gradient descent algorithms into more and more convoluted configurations.

              • 1 year ago
                Anonymous

                A good definition for intelligence that I use is "the ability to reach the same goal by different means"

                An neural network has the ability to reach a goal via adaptive optimization. It is without any argument a form of learning, and thus the system is intelligent.

                >It cannot learn on it's own
                Nothing can, put a child in a sensory deprivation tank their entire life and they will fail to develop.

                >it cannot learn while acting, and it cannot set it's own goals.
                Goals are set by the objective function/optimizer, and the system itself creates intermediate goals that are used to transform information from one state to another. You are wrong.

              • 1 year ago
                Anonymous

                >Nothing can, put a child in a sensory deprivation tank their entire life and they will fail to develop.
                By "on it's own" I don't mean lacking an environment, I mean learning without the presence of other intelligences.
                Children don't need thousands of examples of adults doing something in order to learn things. Leave them on their own and they will try things, observe the result of their actions, and learn from the single data points.

                >>it cannot learn while acting, and it cannot set it's own goals
                >Goals are set by the objective function/optimizer
                You literally agreed with me then claimed I was wrong.
                Nowhere in a human brain does there exist an objective function, it wouldn't even make sense because there isn't any unified output to apply an objective function to.

                The use of the term "neural network" in machine learning has infected everyone with wildly erroneous impressions of how brains work.

              • 1 year ago
                Anonymous

                >I mean learning without the presence of other intelligence.
                Unsupervised learning is the majority of how networks of scale are trained. AI learns from a single data point; just because it isn't as much as humans can doesn't make it not learning. And if you agree that it's learning, then what's the issue in the first place?

                >Nowhere in a human brain does there exist an objective function
                lol, wrong
                There are objective functions implicitly in DNA, in each cell, in each cell cluster, and yes, in the brain. An objective function is merely an evaluation of performance in any sense that tunes behavior, and this is done at pretty much all levels of biology almost down to chemistry.

              • 1 year ago
                Anonymous

                You don't know what an objective function is.

              • 1 year ago
                Anonymous

                An objective function, also referred to as a loss function in machine learning, is a function that computes the error of the output of a system. In a biological sense this is usually refereed to as "fitness", and is not only a primary mover for traditional evolution, but is also applies on many biological scales as a tool for growth and learning. For instance, individual cells from a multi-celled organism can operate in independence, or in plurality depending on the environment they exist in. Various pieces of state information are used to decide a given cells operational "mode" including chemical and electrical via ion channels. Environmental pressure causes the cell's state to update until it reaches a new equilibrium of optimal behavior. This is a form of intelligence, and learning. Just as an example.

              • 1 year ago
                Anonymous

                You are taking "loss function" which is well defined in a machine learning context, and trying to apply it in a nebulous way to biology.
                In the sense of machine learning objective/loss functions, nothing mathematically equivalent exists in a human brain.
                If you want to loss functions exist at cellular levels or in various places via chemical interactions you can, but you have no conception of how those multiple separate loss functions are unified in a single intelligence.

              • 1 year ago
                Anonymous

                If you want to say*

              • 1 year ago
                Anonymous

                A loss function is a mechanism for computing error, and those algorithms exist implicitly and explicitly in not only the brain, but biology at large. Or are you saying that "intelligence when biological fitness function" or "intelligence when NOT human readable loss function" because both are pretty shitty and utterly useless definition for intelligence.

                Just because the objectives we use in machine don't share the exact environmental and biological pressures/level of complexity a human brain has does not mean a system isn't intelligent. For instance, we could create an arbitrarily obtuse objective using random noise with entropy so high it's nonsensical; doesn't make a system learning to operate around it any more 'intelligent" in any ways that matter.

                Functions for computing error and improving based on that error exist in both biology(including the brain) and machine learning. Both are fundamentally intelligent, and learning.

              • 1 year ago
                Anonymous

                >Or are you saying that "intelligence when biological fitness function" or "intelligence when NOT human readable loss function" because both are pretty shitty and utterly useless definition for intelligence.
                I'm saying there is necessarily something which is fundamentally different from a loss function which unifies intelligence in the brain because there is no centralized output with which to calculate error. If you don't understand what that unifying algorithm is then you don't understand intelligence.

                You can say machine learning algorithms are "intelligent", since they can "learn" things, but don't use that definition to refer to brains.

              • 1 year ago
                Anonymous

                There it is, the cope. This so called "unifying algorithm" is merely an emergent property of the human system. Fundamentally it's no more important to intelligence itself than the concept "movement" and a car. Sure cars move, and they use a very complex system of many parts to do so. But that's irrelevant to the definition, and plenty of simpler things move as well.

                >You can say machine learning algorithms are "intelligent", since they can "learn" things, but don't use that definition to refer to brains.
                Of course that definition applies to the brain. Cortices fulfill similar roles to VAEs, and vast swathes of the brain are devoted classification and prediction. Again, the exact algorithm may exist implicitly depending on the environment, biology, current state, etc, but that's irrelevant; it exists, regardless of how complex it ends up being.

              • 1 year ago
                Anonymous

                >is merely an emergent property
                Something being an emergent property isn't an excuse not to understand it and how it emerges.
                There is zero evidence or reason to think that current machine learning algorithms provide a foundation from which something akin to human intelligence can emerge.

              • 1 year ago
                Anonymous

                >There is zero evidence or reason to think that current machine learning algorithms provide a foundation from which something akin to human intelligence can emerge
                For one, this is entirely aside from the argument around the definition of intelligence and whether or not current machine learning systems qualify as intelligent.

                Secondly, there already exists systems from just the last 2 years that well exceed human capabilities in numerous tasks. This is a perfect example of the AI effect. https://en.wikipedia.org/wiki/AI_effect

              • 1 year ago
                Anonymous

                We don't consider humans intelligent because we are good at individual tasks. Computers have been superhuman in certain tasks for nearly 100 years.

                The "AI effect" is a nice name for an acute observation but it's critiquing definitions of intelligence more like your own than mine.

              • 1 year ago
                Anonymous

                This doesn't address or challenge anything I said. Do you agree that artificial intelligence is indeed intelligence then?

              • 1 year ago
                Anonymous

                No. And I think there isn't much point in continuing replying as I've said everything I have to say in earlier posts.

              • 1 year ago
                Anonymous

                Cool, think about what I've said and I'm certain you'll come to the conclusion I'm right. Everything I've said is well reasoned.

              • 1 year ago
                Anonymous

                >doesn't mean that there doesn't exist a standard, practical definition for intelligence for most everyone else.
                there isn't
                intelligence is nearly as poorly defined as consciousness

            • 1 year ago
              Anonymous

              [...]
              The flaw in this reasoning is that AI doesn't exists so whatever observations and experiments they made was not made on anything resembling AI, so they are no conclusion to be made about AI.

              But even without this, the idea of AI "taking over" is completely bullshit, Industry is dying and there is no technology without industry.

              I bet it's just another psyop to make you forget that the economy is fricking collapsing.
              >NOOOOO technology is dangerous !!!!
              >we must stop technology
              >we must kill the industry or we will all be AI slaves
              jokes on you, it would have never happened but the inidustry is still dying

              In real life AI is pretty much just machine learning. Do you think that someone is going to code an entire AI by hand? All of the AIs you see are just machine learning. watson, stable diffusion, gpt3, etc.

              the experiments elucidate potential hazards by showing how even dumb AIs suffer from these problems. If you understood what the problems are you would see how they would only scale and become harder and more dangerous as the AI becomes smarter
              >we must kill the industry or we will all be AI slaves
              AI just shouldn't be mass implemented before all AI safety issues are addressed

              • 1 year ago
                Anonymous

                >AI safety
                say it is AI safe, for whichever definition or AI safe people have, how would the world be safe from the big corpo that controls the AI?
                the world is already FUBAR by big corpos, at a 6th massive exction event level, and that's without an AI.
                What do you think those israelites will do with the power of an AI? How safe will we be?

      • 1 year ago
        Anonymous

        Let me guess, that's you in the video? Screaming and crying doesn't make something not pseudoscience bud

      • 1 year ago
        Anonymous

        [...]
        There are experiments that prove all the concerns raised by AI researchers. It literally doesn't get more scientific than this

        The flaw in this reasoning is that AI doesn't exists so whatever observations and experiments they made was not made on anything resembling AI, so they are no conclusion to be made about AI.

        But even without this, the idea of AI "taking over" is completely bullshit, Industry is dying and there is no technology without industry.

        I bet it's just another psyop to make you forget that the economy is fricking collapsing.
        >NOOOOO technology is dangerous !!!!
        >we must stop technology
        >we must kill the industry or we will all be AI slaves
        jokes on you, it would have never happened but the inidustry is still dying

        • 1 year ago
          Anonymous
        • 1 year ago
          Anonymous

          >Industry is dying
          My dude, have you been living under a rock for the last year?
          The AI industry has exploded

          • 1 year ago
            Anonymous

            >AI industry
            I mean the real industry

  5. 1 year ago
    Anonymous

    isn't he the homosexual who shills mac whenever he appears in the video. There is also a white hair homosexual who also shills mac.
    The only one I like is Prof Brailsford he is a legend.

    • 1 year ago
      Anonymous

      Rob? Not that I've seen

    • 1 year ago
      Anonymous

      iirc he is a linux and tiling wm guy

      • 1 year ago
        Anonymous

        I was right, he uses manjaro and awesomeWM

        ?t=502

        • 1 year ago
          Anonymous

          Rob is our BOTuy

      • 1 year ago
        Anonymous

        Rob, "or someone with equivalent knowledge" explain to us how stable diffusion code is being optimized to get 40x speed increases. Also how hard would it be to implement those refinements for AMD ROCm. I know you are skilled enough to know what's at stake in the ai race and open source is pivotal. So thanks for sharing.

        • 1 year ago
          Anonymous

          Also what has Rob been doing this last year, the video output has dropped to 2min competition announcements. It would be useful to know what moves are being made at the cutting edge of ai to go closed source and how possible it is to truly open source and liberate such efforts from behind api's and paywalls.

        • 1 year ago
          Anonymous

          It's possible they are sparcefying it a la https://neuralmagic.com/

          This is just a guess though, can't think of any other ways it could get such speedup.

          • 1 year ago
            Anonymous

            my man! you delivered, very worthwhile knowledge to learn. The best part about Rob's videos are the fluency and naturalness of communicating the technical details WHILST providing broader subject context. this is delivered at speed within a sentence or two. that's a skill, keep making the videos, you are ahead of the game.

    • 1 year ago
      Anonymous

      for me, its the guy that looks like thunderf00t

  6. 1 year ago
    Anonymous

    Just build an optimizer that optimizes the optimizer's objective so that it's the same as your objective.

    • 1 year ago
      Anonymous

      That's called coherent extrapolated volition and it probably doesn't work in the real world
      https://www.lesswrong.com/tag/coherent-extrapolated-volition

      • 1 year ago
        Anonymous

        >shut it down!

  7. 1 year ago
    Anonymous

    There is something unsettling about this guy. Can't quite put my finger on it.

  8. 1 year ago
    Anonymous

    holy shit you morons

    AI ISNT REAL
    ITS SIMPLE SEARCH ALGORITHMS LOOKING THINGS UP IN A DATABASE

    "AI alignment" is nu-philosophy where they ask hard-hitting questions like "what if google search... BAD?!?!?!"

    • 1 year ago
      Anonymous

      >ITS SIMPLE SEARCH ALGORITHMS LOOKING THINGS UP IN A DATABASE
      he doesn't know how matrices work

  9. 1 year ago
    Anonymous

    you just have to look at his fricking face to know he his low IQ moron

Your email address will not be published. Required fields are marked *