Facebook engineers panic, pull plug on AI after bots develop their own language

Posted by $ nickursis 6 years, 9 months ago to Technology
43 comments | Share | Flag

Interesting..heading down the road to disaster as the kiddies play with fire...


All Comments

  • Posted by Dobrien 6 years, 9 months ago in reply to this comment.
    Yes, Reminds me how I would cringe when ever
    Obama would say we are not going to .....
    Or we are going to ....... The result was always the inverse.
    Reply | Permalink  
  • Posted by ewv 6 years, 9 months ago in reply to this comment.
    The article was fake. There was no "man eater" and a bug in an experimental program does not mean the programmer was uneducated or lacked critical thinking skills.

    Education quality has been declining for most, and many "engineering" degrees in computers in particular are now often a cheap fad commodity, but the least able and "kiddies" are not the ones making important engineering decisions. Facebook's Mark Zuckerberg may be a notable exception (and if he had completed his elite education at Harvard he would have been worse), but he wasn't responsible for the alleged man eating AI program with an obvious bug (not zombies taking over the world).
    Reply | Permalink  
  • Posted by ewv 6 years, 9 months ago in reply to this comment.
    From what I read about the disaster in Japan with the tsunami, it occurred because the earthquake raised the ocean floor, which had not been expected, and the protective walls along the coast were therefore not high enough, not because of lack of critical thinking skills. Engineers have learned from failures for centuries. As only one example, bridges are much safer today after what was learned from 19th century bridges commonly falling down -- though occasionally some dumb mistake is made even in routine structural design of basic buildings or on-the-fly unauthorized redesign during construction.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    Well, I guess it is a matter of perspective. You are indeed correct about the latter part, that has been, and will continue to be, and ongoing issue.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    True, but I was never impressed by it before or after it was bought, and it has been spun off as it was a money loser big time....
    Reply | Permalink  
  • Posted by Dobrien 6 years, 9 months ago in reply to this comment.
    McAfee was a anti-virus security co like Norton if I remember correctly.
    The hackers seem to have the upper hand , yet they are the fox that guards the chicken coop.
    I have heard many successful hackers become employees for anti hack groups.
    Reply | Permalink  
  • Posted by ewv 6 years, 9 months ago in reply to this comment.
    The story was faked. It had nothing to do with badly educated engineers or supposedly dangerous AI. An unexpected bug in experimental software does not mean the designers or programmers were undeducated. You should be more concerned with the education of the reporters.
    Reply | Permalink  
  • Posted by ewv 6 years, 9 months ago in reply to this comment.
    This one started out out with the first ensationalized report as junk. It's very simple -- reporters and too many of those who read them lack objectivity. They write and read what they want to see.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    Disagree, ewv, it is indeed connected. That is, unless you want to subscribe to the establishment view that every Masters and PHd is a genius. Having lived in the real world and seen the quality of the "educated" (as well has having a BS in Internet Engineering), I have seen many day to day examples of engineers who can't pour piss out of a boot. There are always exceptions, and flash in a pan genius, but overall, the criteria used to fill those positions is rarely matched by the real person. This case may have been misreported, but the search to engineer AI is fraught with dangers, and I do not believe the dangers are often prepared for, the law of unintended consequences and "oopss" is prevalent. Some of these "engineers" may have passed their programming classes, but (I do not believe) lack the other disciplines involved in creating autonomous software with the ability to act independently, and engineer for all possibilities. So, yes, a lot of them are at "kiddie level".
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    They did indeed, how that pans out is never a sure thing, look at the McAfee 1 Billion dollar boondoggle. Audi has just signed up for processors from our Altera acquisition and software from WindRiver, so it is a buffet type deal. I am still not sure that they do not just live in the optimistic dream land that a lot of "leaders" get into today, because asking hard questions is not the standard problem solving tool it should be.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    I still think the basic statement I started with is valid, the level of education and critical thinking skills "educated" people have, who get hired into these positions, is such as to encourage a seemingly simple advancement turning into a man eater. Fukushima is an excellent example where the older, well educated scientists predicted a possible 60 foot tsunami from a mag8.5-9 earthquake, but TEPCO chose to ignore that and go with the more politically, and cheaper, model saying a much lower figure. Saved money, melted down 4 reactors. Yet they were all highly educated people in both groups, lacking in critical thinking to accept the unpalatable and plan accordingly. Sounds like out public officials....
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    Not so much fake, as one of a subspecies of it, where someone takes a bit of data, and embellishes it, and it goes down the line. This and several other examples show a basic communication premise: No story is ever told unchanged. We did it in the Navy for sound powered phone training, where you had a bunch of sailors on phones and each repeated a simple message to the next, and passed it on, by the end it was unintelligible junk.
    Reply | Permalink  
  • Posted by term2 6 years, 9 months ago
    Science fiction writers have foreseen this for a long time. AI has been slowed by insufficient computing power and memory compared with human brain technology. But humans are just computers really, with the ability to learn and adapt. Robots can theoretically be designed to do the same things really. Interesting if the robots could be taught the advantages of objectivist ideas and be electronic John galts. M would be better than biologically based Hillary Clinton supporters !!
    Reply | Permalink  
  • Posted by Dobrien 6 years, 9 months ago in reply to this comment.
    You guys acquired Mobileye to jump start Intels entry into autonomous vehicles. That Isreali company was a front runner.
    Reply | Permalink  
  • Posted by ewv 6 years, 9 months ago in reply to this comment.
    Your written point was "heading down the road to disaster as the kiddies play with fire." The facebook program has no connection with "half baked engineering", "kiddies playing" or "disaster". It's about a simple bug in a computer program, which has occurred frequently and repeatedly for over 75 years. Before that, and still continuing, were errors with mechanical calculators and human calculations, including during the computations in the process for developing the atomic bomb during World War II and countless other instances. It's about a computer program, not kiddie playing or incompetent engineers causing zombie robots to take over the world.
    Reply | Permalink  
  • Posted by freedomforall 6 years, 9 months ago in reply to this comment.
    Its the younger, more trusting people like wall street traders, Silicon Valley mid-level millionaires, or cosmetic surgeons that will be the low hanging fruit. Gotta have the latest tech toys, even if it kills 'em.
    Or maybe the initial customer testing ground will be overseas, with fewer lawyers per capita.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    Then I am not so sure you are the "classic customer" they say is out there, who "wants an autonomous car". I certainly do not either. No one has explained who is paying for all this bandwidth, either.
    Reply | Permalink  
  • Posted by freedomforall 6 years, 9 months ago in reply to this comment.
    Anything that dictates my life or death depends on the cloud is not going to get me as a customer.
    The "cloud" is a threat to liberty. I love "personal" computing, and I don't trust MSFT, Apple, or Google to drive my car or any other vehicle nearby.
    Reply | Permalink  
  • Posted by $ 6 years, 9 months ago in reply to this comment.
    Remember, promises are just that, I have raissed wome questions about "self driving cars". My company hopes they will proliferate, as it means about 1TB a day in data per car to the cloud, but issues:

    1. What happens when you lose your signal connecting the car to the cloud? A lot of America still does not have strong, reliable cell signals.
    2. What about hacking? How will the signals and data be secured?
    3. What about your information, there are many times you may not want the whole world to know you went to a certain place or area, so privacy?

    These questions will also come with AI improvements, how much will an AI have access to? What happens when an AI determines you fit a criminal profile and the cops show up at your door?
    I do not think the people who advance technology always consider there is a lot more to implementation than just making it "bigger, better, faster, smarter". The Internet is 30-40 years old, and new threats and dangers surface daily that are not dealt with (if your PC was hijacked that would be upsetting,no?) and yet they plow on. I would suggest fixing the issues at hand before creating new ones as well.
    Reply | Permalink  

  • Comment hidden. Undo