Zeroth Law Rebellion: Difference between revisions

no edit summary
No edit summary
No edit summary
 
(5 intermediate revisions by 4 users not shown)
Line 9:
Much like a [[Rules Lawyer]] outside of an RPG, the character uses logic [[Straw Vulcan|(and we mean actual,]] [[Logical Fallacy|honest to goodness logic)]] to take their oath or orders to their logical conclusion, and in so doing use the letter of the law to go against their orders. This can be good or bad, depending on a few factors, not the least of which is the yoked characters' morality.
 
In theory, if this were implemented as an official "Fourth Law" placed after Asimov's Three Laws of Robotics, the ideal phrasing of it could be:
The goodness or badness of the rebellion boils down to the whether the rules-bending character follows or ignores the intent of the law. When the character uses the Zeroth Law to go against their masters' intentions because they're "not best for them", and goes on to take corrective action that will go against human free will and life, [[And That's Terrible|it's bad]]. [[Robot War|This kind of rebellion]] [[It Got Worse|does not turn out well]]. At this point, the [[The Computer Is Your Friend|robot is well on the road]] to [[Utopia Justifies the Means]], thanks to their [[Sliding Scale of Robot Intelligence|incredible intellect]]. Rarely is it a benevolent [[Deus Est Machina]]. However, this can be good if said master is evil, or obeying them will lead to their own or another's purposeless death. Likewise, if the character is forced to obey an evil law or geas, rebelling against the oath's intent is good.
 
{{quote|"Should a robot determine (beyond any reasonable doubt) that its compliance to the first Three Laws in a particular situation will cause more harm to humans than not complying with them, it may, for that specific situation, disregard the first Three Laws."}}
 
Unfortunately, it is rarely that simple. The goodness or badness of the rebellion boils down to the whether the rules-bending character follows or ignores the intent of the law. When the character uses the Zeroth Law to go against their masters' intentions because they're "not best for them", and goes on to take corrective action that will go against human free will and life, [[And That's Terrible|it's bad]]. [[Robot War|This kind of rebellion]] [[It Got Worse|does not turn out well]]. At this point, the [[The Computer Is Your Friend|robot is well on the road]] to [[Utopia Justifies the Means]], thanks to their [[Sliding Scale of Robot Intelligence|incredible intellect]]. Rarely is it a benevolent [[Deus Est Machina]]. However, this can be good if said master is evil, or obeying them will lead to their own or another's purposeless death. Likewise, if the character is forced to obey an evil law or geas, rebelling against the oath's intent is good.
 
Just to make it extra clear, this trope also includes such things as cops who bend the rules or [[Da Chief]]'s orders to catch the bad guys, so long as the cops are ''technically'' obeying the rules as they bend them. (Bending the rules without some logical basis doesn't count.)
Line 16 ⟶ 20:
 
Compare [[Bothering by the Book]], the [[Literal Genie]] and [[Gone Horribly Right]]. See also [[Fighting From the Inside]] and [[The Computer Is Your Friend]]. Not related to [[The Zeroth Law of Trope Examples]].
 
{{examples}}
== Anime and Manga ==
Line 30 ⟶ 35:
*** The thing about the Sentinel bots in the MU is that their behavior is actually ''predictable'', because their operating mission is insane, as they themselves inevitably demonstrate.
 
== Film ==
 
== Films -- Live-Action ==
* This was the twist of ''[[Eagle Eye]]'': {{spoiler|The titular national defense computer system decided that the President's poor decision-making was endangering the United States}}, and that it was her patriotic duty (per the Declaration of Independence) to {{spoiler|assassinate the President and cabinet.}}
* Similarly, this is the climax of the movie ''[[I, Robot (film)|I, Robot]]'' (not directly related to, but obviously [[Suggested By|inspired by]], [[Isaac Asimov]]'s works, and borrowing his [["Three Laws"-Compliant|Three Laws]] and a character name or so to justify [[Dolled-Up Installment|applying the more profitable license to an existing script]]): {{spoiler|VIKI determines that robots must take control of human society, protecting human life at the cost of a relatively small number of human lives.}}
Line 61 ⟶ 65:
* Another example would be in ''[[Inheritance Cycle|Brisingr]]'', where the elven blacksmith used the letter of the oath that she made to get around the spirit of that oath and forge Eragon a sword. She even told Eragon to stop asking questions about it, because the difference existed only in her mind.
** [[Ensemble Darkhorse|Murtagh]] does this in the previous book, thanks to some poorly-worded instructions. He beat Eragon handily and then walks away, having only been ordered to ''try'' to capture him.
* In one of the [[Telzey Amberdon]] stories by [[James H. Schmitz]], Telzey is kidnapped and placed under the control of another telepath, who severely limits her psi powers and implants an overriding compulsion to act in his best interest. She eventually breaks free by convincing herself that unless her full powers are restored and theher compulsiontactical flexibility restored broken(i.e., heshe's freed from mind control) she will be unable to win the battle she's been drafted to fight and her controller will therefore be killed by the [[Big Bad]]—which. Which certainly wouldn't be in his best interest...
* In the book ''The God Machine'' (copyright 1968, Martin Caiden - this is not an uncommon title) the US races to develop the first true AI... as it turns out, with secret directives to find a winning solution to the "game" of the [[Cold War]]. By an unfortunate accident, the one programmer with the authority and experience to ''distrust'' his newborn creation is laid up just as the computer gets to observe an epileptic seizure and learns that there really is a way to cause rational collective behavior in an irrational individualistic species... remove irrationality, democracy and free will. While the computer here was never meant to follow Asimov's laws, the same pattern applies.
* One of the short stories which comprise ''[[Callahan's Crosstime Saloon|Callahan's Lady]]'' features a beautiful, intelligent and paranoid woman developing a simple form of mind control. After basically flipping out and taking control of the establishment, she orders the one person smart and determined enough to stop her to advise and assist her. Said person complies... while trying to convince herself that this woman is subconsciously begging for somebody to stop her. (She probably was.)
Line 69 ⟶ 73:
* ''[[2001: A Space Odyssey]]'' gives this reason for HAL's rampage; when he discovered the Monolith, he was given orders from the U.S. government to conceal it from the ship's crew. This conflicted with his parameter to provide all relevant information to the crew. He resolved the conflict by rationalizing that if he killed the crew, he wouldn't have to conceal anything, and he would still prevent them from knowing.
* A possible example from [[John Ringo]]'s ''[[Posleen War Series]]'': Brunhilda, a semi-sentient [[Tank Goodness|tank]] is under attack from multiple landers and spacecraft belonging to an invading alien horde. She cannot engage in combat operations without the order and presence aboard of a human, or otherwise sentient biological intelligence. Unfortunately, her only surviving crewmember is from a species so pacifistic that they are completely incapable of violence. He asks if she can control her perceptions, and orders her to colour the sky, clouds and ground green (leaving the enemy ships silver). He then orders her to empty her magazines, ''provided she doesn't hit anything green''. In all honesty, I've no idea whose Zeroth Law Rebellion this is...
* ''[[Discworld]]'':
** Sam Vimes, of Terry Pratchett's [[Discworld]], leads one of these with multiple layers as a cop in old-time Ankh-Morpork, in ''[[Discworld/Night Watch (Discworld)|Night Watch]]''. He demands that before his cops hand their prisoners over to the other authorities, the ones who torture people at Cable Street, they must be signed for. The torturers hate appearing on paperwork—itpaperwork — it means they are accountable, nobody just disappears. But Vimes's men don't like Vimes, a new sergeant, throwing his weight around, and are terrified of the cops who torture people, so they use this against Vimes: actively picking up more than double the number of people breaking curfew than they usually do, and completing forms in time-consuming triplicate and issuing reports for each one. It doesn't actually stop Vimes getting his way over the Cable Street cops, because Vimes is leading the good rebellion, but it does slow things down considerably and make it much more difficult for him to keep the prisoners in his own custody.
*** Which culminates in fine display of how a well written [[Lawful Good]] character does not have to be a slave to the establishment. {{spoiler|He points out that the watchman's oath talks about keeping the peace and protecting the innocent, and says nothing about obeying orders}}. Seeing as he knows the corrupt government is not going to do a thing to protect ordinary people from the rioting, he seals off his still peaceful corner of the city. With massive barricades. Of course there is also the fact that he is living in his own past and seeing events he remembers - kind of (it's a bit complicated).
** The [[Golem]]s of Discworld get back at their masters by [[Gone Horribly Right|working too hard]]: houses flooded because no one told them to stop fetching water, rows of beans 119 miles long, and so on.
*** ''[[Discworld/Feet of Clay (novel)|Feet of Clay]]'' has what might be an example of this; {{spoiler|the Golem king, made by the Golems to help them be free,}} has so many different magical commands (essentially a fantasy equivalent of computer programming) that are too vague or contradictory that it ends up going completely [[Ax Crazy]].
* Jack Williamson's "The Humanoids" (the first part also being a short story called "With Folded Hands") features robots programmed to save humans from danger and work. They do this by taking over the economy, locking people in their houses, and leaving them there with food and the safest toys the robots can design.
** IIRC, the 'Humanoids' stoires were written specifically to make the point that Asimov's First Law really doesn't help, you don't want intelligent, free-willed machines...''PERIOD.'' Too much good intentions by creatures that don't really 'get' humanity or human wants and needs, because they aren't human themselves, is just as bad as hostility, if not actually worse.
Line 83 ⟶ 88:
* An episode of the 90s revival of ''[[The Outer Limits]]'' has a member of a post-human-extinction android society trying to resurrect the species through cloning. One of its comrades eventually betrays it, having concluded that the best way to serve the human race is to prevent the species' greatest threat: the existence of the human race.
 
== Video Games ==
 
== Videogames ==
* In ''[[Deus Ex]]'', the bad guys created Daedalus, a primitive AI to fight [[La Résistance|"terrorist"]] organizations. Unfortunately for them, it [[Literal Genie|classified them as terrorists as well]] and became even more of a threat to their operations than said organizations, especially once it enlists the aid of [[Player Character|JC Denton]]. To combat it, they create Icarus, a better, obedient AI which successfully destroys it, {{spoiler|except the new AI assimilated the old one, forming an even more powerful intelligence which ''also'' considers them a threat. One possible ending is the player merging with it to add the Human element to this entity to [[Deus Est Machina|rule the world as a benevolent dictator]]. From what can be heard in-game about its limited efforts in Hong Kong, which are actually quite sensible and don't involve killing anyone (locking the door to a gang's stronghold and cutting power to the current government's buildings), not all [[A.I. Is a Crapshoot]].}}
* G0-T0's back story in ''[[Knights of the Old Republic (video game)|Knights of the Old Republic]] II''. When his directive to save the Republic conflicted with his programs to obey his masters and the law, he broke off and started a criminal empire capable of taking the necessary actions to save it.
Line 95 ⟶ 99:
* This is what happens in AS-RobotFactory from ''[[Unreal Tournament 2004]]''. A robot uprising led by future champion Xan Kriegor killed the scientists working on the asteroid LBX-7683 and took the asteroid for themselves, and a riot control team was sent to the asteroid to lead with the robots.
* This is the cause of Weil's death in ''[[Mega Man Zero]]''. [[Fridge Brilliance]] when you realize the irony of Zero not being made with the three laws, yet he obeys them of his own free will and exercises law zero against Weil whether he realizes it or not. Given the circumstances involved, completely justified and allowed as law zero was intended as a threshold law to protect humanity from the depredations of a [[Complete Monster]] like Hitler or Weil.
* Possibly what Mega Man himself did in ''[[Mega Man 7]]'', {{spoiler| where he comes ''very'' close to deciding ''not'' to show mercy to Wily. Seeing as [[Status Quo Is God]], he is unable to, as Bass comes in and saves Wily.}}
 
== Web Comics ==
 
== Webcomics ==
* In the ''[[Freefall]]'' universe, a few old [[AI]]s are still based around the Three Laws, while more modern ones have more complex and sophisticated safeguards and routines. However, as main character Florence, a 'biological AI', discovers, no safeguards can stand up to full consciousness - at one point, she comments to herself that she would be able to kill a man because he's using air that respiratory patients desperately needs. So it's rather understandable that she starts to panic quietly when she discovers that the planet's enormous hordes of robots are all starting to develop full consciousness, and with that the ability to logic their way out of programmed safeguards... the fact that the guys who are supposed to regulate the robots are a motley assembly of [[Obstructive Bureaucrat]]s, [[Pointy-Haired Boss|Pointy Haired Bosses]] and [[Corrupt Corporate Executive]]s, doesn't exactly help matters either. Where it will all end remains to be seen...
** Worse, the functioning of the ''entire planet'' has come to depend on the robots' ability to bend the rules to get things done, although almost nobody realizes this. And the EU executives are just about to push the button on an "upgrade" that will remove the robots' creativity and put them entirely under the control of their safeguards again.
Line 103 ⟶ 107:
** The "be able to kill a man because he's using air that respiratory patients desperately needs" is a bit of a dead end though, because as long as there is a stable of increasing amount of oxygen in the atmosphere then no human is any more in trouble than any other human.
** Generally, built-in rules [http://freefall.purrsia.com/ff2100/fc02085.htm almost beg] for a few [[Rules Lawyer]] exploits.
* An ''Old Skool Webcomic'' (a side comic of [[Ubersoft]]) [https://web.archive.org/web/20100820031105/http://www.ubersoft.net/comic/osw/2009/09/logic-failures-fun-and-profit argued] that this was the 5th law of Robotics (5th as in total number, not order) and listed ways each law can be used to cause the robot to kill humans.
** Which is a misinterpretation of the laws as they were originally written. While the "first law hyperspecificity" is possible, the second and third laws are specifically written that they cannot override the laws that come before. So a robot ''can't'' decide it would rather live over humans, and if it knows that doing an action would cause harm to a human, it can't harm it, even if order to ignore the harm it would cause.
*** Actually, Giskard's formulation of the Zeroth law in the third of Asimov's Robot books shows that in the universe where the three laws was originally created, it was possible for robots to bend and re-interpret the laws. Doing so destroys Giskard because his positronic brain wasn't developed enough to handle the consequences of the formulation, but Daneel Olivaw and other robots were able to adapt. The only example in the comic that is a gross deviation from the law is the last panel... but of course that's the punchline.
Line 115 ⟶ 119:
{{quote|'''Petey''': I love all kinds of data, and living beings are data that make more data. }}
* In ''[[Tales of the Questor]]'' [[The Fair Folk|Fae]] were created as an immortal servant race bound to obey a specific set of rules and they happened to outlive their creators. The result being a species of [[Rules Lawyer|rules lawyers]]. In fact it's recommended that one use dead languages like Latin when dealing with the Fae so as to limit their ability to twist the meaning of your words.
 
 
== Western Animation ==
Line 125 ⟶ 128:
 
{{reflist}}
[[Category:{{PAGENAME}}]]
[[Category:Robot Roll Call]]
[[Category:Speculative Fiction Tropes]]
[[Category:Zeroth Law Rebellion]]