Now The Military Is Going To Build Robots That Have Morals

Posted by Zenphamy 9 years, 11 months ago to Philosophy
61 comments | Share | Flag

So, can this be done and if so, where does Objective Philosophy fit in the determinations to be made? Who's going to determine which ethical and moral principles form the base of such programming?

From the article: "Ronald Arkin, an AI expert from Georgia Tech and author of the book Governing Lethal Behavior in Autonomous Robots, is a proponent of giving machines a moral compass. β€œIt is not my belief that an unmanned system will be able to be perfectly ethical in the battlefield, but I am convinced that they can perform more ethically than human soldiers are capable of,” Arkin wrote in a 2007 research paper (PDF). Part of the reason for that, he said, is that robots are capable of following rules of engagement to the letter, whereas humans are more inconsistent."
SOURCE URL: http://www.defenseone.com/technology/2014/05/now-military-going-build-robots-have-morals/84325/?oref=d-mostread


Add Comment

FORMATTING HELP

All Comments Hide marked as read Mark all as read

  • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
  • Posted by Robbie53024 9 years, 11 months ago
    More than half a century ago, Isaac Asimov tackled this issue and developed the 3 Laws of Robotics. To whit -
    1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
    2. A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
    3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

    These would be hard-coded into all micro-processors and could not be violated else the robot self-destruct.
    Reply | Mark as read | Best of... | Permalink  
  • Posted by $ jbrenner 9 years, 11 months ago
    The concept behind this isn't all that new. One of the people interviewed for the linked news item is Wendell Wallach of Yale. He gave me an autographed copy of Moral Machines, the book that he and Colin Allen wrote back in late 2008. We met at a fundraiser for the Terasem Movement. Prof. Wallach is a very interesting fellow. The Terasem Movement is dedicated toward cryogenic preservation until certain conditions that cannot be medically treated now might be treated. One of their foundational pillars is nanotechnology, my area of expertise. Prof. Wallach knew one of my best friends, Tihamer Toth-Fejel, a guy who helped me found a student chapter of The Foresight Institute for Nanotechnology when we were grad students in Ann Arbor. My buddy Ti was making robots that had "morality chips" even before Commander Data was on TV.
    Reply | Mark as read | Best of... | Permalink  
  • Posted by ewv 9 years, 11 months ago
    A robot is no more moral or immoral than a bullet or a missile. The choice is made when it is launched. Once it is put into action, it does what it is designed by humans to do (or something else if it fails), in accordance with the laws of physics. It makes no moral choices on its own.

    If a robot is programmed to behave differently under different circumstances as represented by its sensor inputs, the choice of what is important data believed to represent different circumstances and what the action is designed to be are human choices.
    Reply | Mark as read | Best of... | Permalink  
  • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
  • Posted by Maphesdus 9 years, 11 months ago
    Objectivist philosophy as a combat routine: "Do not fire unless fired upon."
    Reply | Mark as read | Best of... | Permalink  
    • Posted by 9 years, 11 months ago
      I don't see that as Objectivist philosophy - certainly not in combat.
      Reply | Mark as read | Parent | Best of... | Permalink  
      • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
      • Posted by Maphesdus 9 years, 11 months ago
        Never use force except in retaliation. Is that not the core of Objectivism?
        Reply | Mark as read | Parent | Best of... | Permalink  
        • Posted by ewv 9 years, 11 months ago
          No it is not. This has been explained to you several times but you keep repeating the misrepresentation. Philosophy is not politics and is not about a "non aggression principle". Ayn Rand also never said that soldiers in a war should not fire unless fired upon, as a "core" or anything else.
          Reply | Mark as read | Parent | Best of... | Permalink  
          • Posted by 9 years, 11 months ago
            Exactly ewe; it's always confused me how some can confuse the right of defense into some type of moral constraint system that makes impossible, active defense or sufficient force application to stop aggression or to prevent future aggression.
            What is so hard to grasp about 'my rational choice to not use force or it's threat to obtain those things I need or want in my life from others, but that I won't allow others to use force or it's threat against me.'
            I think Maph confuses a youthful, hippy belief in voluntarist anarchism with the mature, reasoned Ojbectivist life. Those are very different topics.
            Reply | Mark as read | Parent | Best of... | Permalink  
            • Posted by ewv 9 years, 11 months ago
              Maphesdus continues to demonstrate that you are right. But he is worse than an immature hippy anarchist mentality -- he emotes in such terms, and confuses it with Ayn Rand, but embraces its consequence of collectivism and its imposition by what he admits is "initiation of force" in his own racism and statism.
              Reply | Mark as read | Parent | Best of... | Permalink  
              • Posted by 9 years, 11 months ago
                I seem to run into similar difficulties in conversations with many younger AR readers and libertarians. I think it's just a very hard thing for them to give up on emotional response feedback that can be very addictive for them. They can't, or won't, accept analyzing emotions and emotional responses for reality or seem to have the idea that Objectivists try to shut off their emotions.
                Reply | Mark as read | Parent | Best of... | Permalink  
                • Posted by ewv 9 years, 11 months ago
                  There is a serious problem with some of these people's lack of ability to think in anything other than the methods of academic rationalism manipulating words as they pretend they are being "logical". They don't have the slightest idea of what Ayn Rand was talking about. The worst of them become trolls desperate to be taken seriously, and become hysterical -- in the name of "discussion" and "debate" of all things -- when they are not taken seriously, then resort to the usual name calling in their own feelings of persecution. There is no way to get through to them and it is a waste of time to try. Some of them aren't very bright to begin with. All you can do is point out how they are misrepresenting and leave them to their own devices to do whatever it is they are going to do as they lurch from one fad to another. There are more serious people worth talking to.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • Posted by Maphesdus 9 years, 11 months ago
                  I'm perfectly willing to analyze my emotions and think things through in a logical and rational manner. I just don't like it when assholes like ewv insult me and tell me I'm wrong without explaining WHY. Even Hiraghm, annoying as he may be, at least has a maturity level sufficient enough to provide rational explanations of his position, even if he is often wrong or offensive in the process. But ewv can't even do that. In nearly every single argument I've had with ewv, he almost never provides anything even remotely resembling a rational explanation of anything, and instead only launches personal attacks and insults in my direction. He's like a spoiled child.

                  You seem like a pretty decent guy, Zenphamy, so if you'd like to discuss and debate the deeper philosophical details of Objectivism in a civilized manner, I'd be more than happy to listen to your take on things. Just, please provide rational explanations of your own position, and not merely denunciations of my position. That's all I ask.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • Posted by Hiraghm 9 years, 11 months ago
                  Hang on a sec...

                  [searching...]

                  Robert A Heinlein : "If tempted by something that feels 'altruistic,' examine your motives and root out that self-deception. Then, if you still want to do it, wallow in it!"
                  Reply | Mark as read | Parent | Best of... | Permalink  
                  • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                  • Posted by Maphesdus 9 years, 11 months ago
                    Wasn't Heinlein a big fan of Ayn Rand? I can't remember for sure, but I think someone said he was.
                    Reply | Mark as read | Parent | Best of... | Permalink  
                    • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                    • Posted by Hiraghm 9 years, 11 months ago
                      Actually he has a quote regarding her, I believe.

                      Fan, yes. I don't think he was a *big* fan. You *did* read "Starship Troopers" and "The Pragmatics of Patriotism", didn't you? :)


                      " I would say that my position is not too far from that of Ayn Rand's; that I would like to see government reduced to no more than internal police and courts, external armed forces β€” with the other matters handled otherwise. I'm sick of the way the government sticks its nose into everything, now."
                      The Robert Heinlein Interview (1973)
                      Reply | Mark as read | Parent | Best of... | Permalink  
            • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
            • -2
              Posted by Maphesdus 9 years, 11 months ago
              Do you even know what the Non-Aggression Principle is? (I'll give you a hint: you just described it.)
              Reply | Mark as read | Parent | Best of... | Permalink  
              • Posted by 9 years, 11 months ago
                Maph: I of course believe that I have a pretty solid foundation in the principles of non-aggression, though I prefer the words of non-initiation of force. I think, where we differ is in the interpretations of what force is or isn't and when and where it's used and applied in a real world situation and what an appropriate and continued level or course of force response is.

                Your flow chart, described as a combat co-routine is a perfect example. It quite dramatically and drastically illustrates the over simplification and limitation of applying force in combat and the lack of Objectivist determination of the reality of actual combat situations. A brief example might be a rear area for combat troops to relax and resupply and the protection provided in order for that to be safe for those men and their support. It might well consist of a layered defense system of roving patrols and observations and detection for outlying areas with bombing or missiles strikes to keep the area 'clean', concertina wire, mine fields, and in our case the use of surveillance and weaponized drones. Is anyone entering that defined area considered an enemy combatant or does the defender have to wait until absolute confirmation of identity before elimination or did the planner need to incorporate such confirmation systems in the mine fields or bombing and missile strikes or in our case the drone strikes?

                The Objective reality we've all had to learn to deal with in all wars, particularly since WWII, is the use of human weapons, even the elderly, women, and children with bomb vests and hand grenades in both active and inactive combat areas. If some of that defense is turned over to autonomous drones with some sort of decision matrix programmed in, what and how are ethical actions instilled in that programming and yet retain the effectiveness of the weapon?

                I'm pretty confident that the program flow chart will be a bit more complicated than what you propose.
                Reply | Mark as read | Parent | Best of... | Permalink  
                • Posted by ewv 9 years, 11 months ago
                  You differ from him on a lot more than the meaning of "initiation of force" (which he himself endorses to impose his racism). There is a lot more to this than oversimplifying the algorithms of a robot in a complex military scenario. He is trying to do this for what he thinks is Ayn Rand's _philosophy_.

                  His simplistic attempt to reduce philosophical thought and application of principles to a half page diagram at all is one instance of his rationalism mechanically manipulating words without regard to context and meaning -- both of which are ignored completely in a diagram. He is not and cannot "program" Ayn Rand's "philosophy".

                  But that regards method of thinking. Regarding its content he is hopelessly lost in his equating "non-aggression" with all of Ayn Rand's philosophy, of which he has no understanding at all. The notion that Ayn Rand's "epistemology" as a "combat routine" is so absurd that it makes your ears wilt. He has no idea what epistemology is or what Ayn Rand's epistemology in particular is.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • -1
                  Posted by Maphesdus 9 years, 11 months ago
                  Thank you for providing constructive feedback (ewv, take some hints here). While I agree that a full program could absolutely be much more complicated than the simple flowchart I created (in fact, it would have to be), most of what you described just sounds like programming for combat in general, and doesn't seem to have any direct relation to Ayn Rand's ideas or Objectivist philosophy. Those are the sorts of things that any programmer/designer would have to consider, regardless of their philosophical stance.
                  Reply | Mark as read | Parent | Best of... | Permalink  
          • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
          • -1
            Posted by Maphesdus 9 years, 11 months ago
            People have argued against me on that point, though their arguments have generally amounted to nothing more than ad hominem attacks and vehemently denying that the Non-Aggression Principle is any part of Objectivism, even though it's clearly the singular fundamental principle of the entire philosophy (you, ewv, have been one of the worst offenders on this point). Denunciation without explanation does not qualify as a legitimate argument.

            The original question, posed by Zenphamy, was "where does Objective Philosophy fit in the determinations to be made?" Ayn Rand always said we should not permit floating abstractions, but rather should ground ourselves in concrete reality. So far, I have provided one concrete example for a potential method of programming Objectivist epistemology as combat co-routine into a computer. That's exactly one more concrete example than anyone else has provided, including you. If you think you have a better example, I'd love to see it.
            Reply | Mark as read | Parent | Best of... | Permalink  
            • Posted by ewv 9 years, 11 months ago
              To point out that philosophy is not politics and that Maphesdus is repeatedly misrepresenting Ayn Rand is not an "ad hominem argument". He doesn't know what "ad hominem argument" means. His repeated misrepresentation claiming that "the Non-Aggression Principle" is "clearly the singular fundamental principle of the entire philosophy" is false, baseless, and ignorant. He is profoundly ignorant of Ayn Rand's philosophy. That is not an "ad hominem argument" either. It is a consequence of observing his posts.

              There is no "programming" of "Objectivist epistemology into a computer". Maphesdus doesn't know what that means, let alone "provided a concrete example".
              Reply | Mark as read | Parent | Best of... | Permalink  
              • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
              • -2
                Posted by Maphesdus 9 years, 11 months ago
                Ayn Rand frequently insisted that physical force was the only way to violate man's rights, and that force should never be used in initiation, but rather only in retaliation. That's the Non-Aggression Principle. How is that not part of Ayn Rand's ideology? Seriously, I'm sick and tired of you insisting that I'm wrong without providing any explanation.
                Reply | Mark as read | Parent | Best of... | Permalink  
                • Posted by ewv 9 years, 11 months ago
                  Philosophy is not politics. "The Non-Aggression Principle" is not "the singular fundamental principle of the entire philosophy". "Part of" does not mean "singular fundamental principle", let alone "of the entire philosophy". Maphesdus doesn't comprehend any of it and keeps switching the words in gross misrepresentations as if it makes no difference and "non-aggression" were equivalent to all of it. He was originally given the benefit of the doubt and he didn't know what to do with it because he is here to attack. Explanation is lost on him and is hopeless because he is intellectually dishonest and quite dense. His hysterical sophomoric railing over his being "annoyed" and "sick and tired" is irrelevant.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • Posted by Hiraghm 9 years, 11 months ago
                  Please point to one of her citations where she uses the term "physical force".

                  Based on the totality of what I have read of her writing, "coercion" would be a more accurate term, imo.
                  Reply | Mark as read | Parent | Best of... | Permalink  
            • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
            • Posted by Maphesdus 9 years, 11 months ago
              By the way, here's a flowchart I just made depicting the Non-Aggression Principle as a combat co-routine:

              http://i.imgur.com/vCkVxHb.jpg

              If anyone else can come up with something better, please show me.
              Reply | Mark as read | Parent | Best of... | Permalink  
              • Posted by ewv 9 years, 11 months ago
                Calling this "Objectivist Epistemology" is bizarre.
                Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • -1
                  Posted by Maphesdus 9 years, 11 months ago
                  Well then explain to me what you would change about it. How would you interpret Objectivist philosophy and turn it into a computer program for an automated military drone?
                  Reply | Mark as read | Parent | Best of... | Permalink  
                  • Posted by ewv 9 years, 11 months ago
                    Explanation to Maphesdus is hopeless. Philosophy cannot be turned into a "computer program" and epistemology is not a "combat co-routine". This is ludicrous.
                    Reply | Mark as read | Parent | Best of... | Permalink  
                    • Posted by $ AJAshinoff 9 years, 11 months ago
                      Completely agree. Attempting dialog is frustrating. When his Shtick runs out he faithfully resorts to liberal tactic #1: defamation by way labeling. Save you energy and your breath.
                      Reply | Mark as read | Parent | Best of... | Permalink  
                      • Posted by ewv 9 years, 11 months ago
                        All one can do is ignore his epithets and point out for the benefit of others the obvious misrepresentations. You are quite right that there can be no "dialog" with a hyperactive troll, and it is worse than futile to follow him down all his evasive rabbit holes as he demands to be taken seriously. Maphesdus does not belong here at all.
                        Reply | Mark as read | Parent | Best of... | Permalink  
                        • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                        • -2
                          Posted by Maphesdus 9 years, 11 months ago
                          This is a forum for debating Objectivism. It is not supposed to be an echo-chamber exclusively for people who agree with Ayn Rand. The admins have clearly stated this.
                          Reply | Mark as read | Parent | Best of... | Permalink  
                          • Posted by ewv 9 years, 11 months ago
                            The stated purpose of the forum is: "Galt's Gulch is a community of like-minded individuals who come together regularly to share interesting content and ideas with each other and debate about politics, economics, philosophy and more. If you've read and have been influenced by Atlas Shrugged, this is the site you've been waiting for."

                            That does not mean an "echo-chamber exclusively for people who agree with Ayn Rand" and it does not mean a place for trolls who don't understand Ayn Rand's philosophy and who reject what they do not begin to comprehend to repeatedly misrepresent it in the name of "debate" as they demand to be taken seriously. Maphesdus is not a "like minded individual" and does not belong here.
                            Reply | Mark as read | Parent | Best of... | Permalink  
                    • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                    • -1
                      Posted by Maphesdus 9 years, 11 months ago
                      Well wasn't that Zenphamy's original question? How do you turn Objectivism into a computer program for guiding automated drones?
                      Reply | Mark as read | Parent | Best of... | Permalink  
                      • Posted by ewv 9 years, 11 months ago
                        No it is not the original question, which pertained to the relation of Ayn Rand's philosophy to the undertaking as such as described in the article. Objectivism cannot be "turned into a computer program" for anything. The notion of epistemology as a "combat co-routine" is ludicrous.
                        Reply | Mark as read | Parent | Best of... | Permalink  
                        • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                        • -1
                          Posted by Maphesdus 9 years, 11 months ago
                          Okay, wow, you are really, really bad at explaining your position in a clear and comprehensible way. Let's take a look at these two sentences here:

                          * Turning Objectivism into a computer program for guiding automated drones.
                          * The relation of Ayn Rand's philosophy to the undertaking as such as described in the article.

                          As far as I can tell, these two sentence both mean exactly the same thing. The only difference is yours is worded more vaguely and with less precision. But since you also seem to think that it's not possible to turn Objectivism into a computer program at all, I'm not clear on what you're trying to say. So here's a suggestion: back off the insults for a bit, calm down, and explain what you mean in concise and logical manner.
                          Reply | Mark as read | Parent | Best of... | Permalink  
                          • Posted by ewv 9 years, 11 months ago
                            "Precision" of thought does not mean turning philosophy into a "computer program". Thought is cognitive, not mechanical manipulation. I don't doubt that Maphesdus thinks the two sentences mean the same thing. That is typical of his lumping together whatever he feels like into invalid package deals. We have seen this from Maphesdus before, such as his lumping any kind of group or collaborative effort into "collectivism" and lumping rejection of his misrepresentations together with he wants to believe are "insults". By not thinking in essentials it's no wonder his posts are such a hodepodge of falsehoods and misrepresentation, and that he doesn't understand responses. This is one reason why it is futile to explain anything to him, and why explanations are for others and cannot be directed to him. Other reasons are his intellectual dishonesty and evasive responses loutishly personalizing the discussion rather than addressing content.
                            Reply | Mark as read | Parent | Best of... | Permalink  
                            • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                            • -1
                              Posted by Maphesdus 9 years, 11 months ago
                              Maybe I would be able to understand you more effectively if you would actually explain what the hell you're talking about...

                              Also, I didn't say precision of thought. I just said precision. Can you even read?
                              Reply | Mark as read | Parent | Best of... | Permalink  
              • Posted by Rozar 9 years, 11 months ago
                The non aggression principle provides no guidance on how to live your life, objectivism does. That is what makes objectivism a philosophy. The robot could have your flow chart as a piece of it's programming, but for it to have an objectivist base it would have to include protocols for defense of the nation and threat assessment differentiating American forces from foreign.

                I can't really think of many other objectivist premises it would need, but this isn't really my argument.

                I like the flow chart, good luck!
                Reply | Mark as read | Parent | Best of... | Permalink  
                • Posted by ewv 9 years, 11 months ago
                  His flow chart is intended to reduce Ayn Rand's philosophy to a mechanical representation without regard to meaning and context, not an algorithm for a robot.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                • Posted by Maphesdus 9 years, 11 months ago
                  I don't think a drone is concerned about living any sort of life. If we're translating Objectivism into the field of combat A.I., then the question is no longer about how to live your life, but rather about how to win the war. Differentiating between friendly and hostile forces would certainly be an important part of any combat A.I., though I would hope that something as high-level as "defense of the nation" would be managed by actual human beings. Remember, the drones would only need to be involved with the low level tactics. The high level strategy would be done by human generals.
                  Reply | Mark as read | Parent | Best of... | Permalink  
                  • Posted by Rozar 9 years, 11 months ago
                    Then why are you arguing so vehemently about what flow chart the robots would use to mimic morality.
                    Reply | Mark as read | Parent | Best of... | Permalink  
                    • Comment hidden by post owner or admin, or due to low comment or member score. View Comment
                    • Posted by Maphesdus 9 years, 11 months ago
                      What do you mean why are we arguing about it? Zenphamy asked where Objective philosophy fits into the determinations of the computer's A.I. Are you seriously asking me why I would address one of the questions posed in the original topic? What else is this forum for except to respond to questions people asked?
                      Reply | Mark as read | Parent | Best of... | Permalink  
                  • Posted by ewv 9 years, 11 months ago
                    The flow chart is not "Objectivist epistemology" as he labelled it. There is no such thing as "Objectivist epistemology as a combat co-routine". He doesn't know what epistemology is.
                    Reply | Mark as read | Parent | Best of... | Permalink  

FORMATTING HELP

  • Comment hidden. Undo