I find this post the height of irony; as a Mechanical Engineer I use technology in various forms daily – certainly my job doing design work and other analyses is made far, far easier with computers (though I still longingly remember my first “real” calculator, a HP 15C… ok, so I’m dating myself). I have used the internet to meet people all over the world who, absent that technology, I’d have never known. Without email my varied relatives (blood and in-laws) would not see my children as they are growing with any frequency. I’m using Duolingo to learn Hebrew, and making more progress in the first few weeks than I ever did leading up to my Bar Mitzvah (enthusiasm for it helps!). And in my consulting business, without technology and the internet, I would not have my current overseas client nor, potentially, some other not-close-to-me clients whom I am trying to cultivate.
So let me revisit my 2015 essay, The Threat of AI: The Slow Fade, (links and bolding in the original):
Implicit in the above quote is blind faith in the programmers’ ability to anticipate everything; remember, programmers program based – in part – on interviews of users. Could a programmer anticipate a bird ingestion into an engine, as happened in 2009 resulting in Captain Sullenberger managing to land the plane in the Hudson River – with no loss of life… and anticipate it to the degree of confidently programming a computer to handle every possible variation? Or the crash in Sioux City where a turbine blade fractured, cutting through the hydraulic lines and causing catastrophic system failures. On the Sioux City flight it was only the experience of the pilots, plus another pilot traveling as a passenger, who on-the-fly tried something they’d read about theoretically: using varying thrusts from the engines to steer and control the plane in an improvised control system to save over half the passengers.
Note my comment about situations that have not been anticipated and then read How much do you really want artificial intelligence running your life? (bolding added):
Replacing human sensory input with electro-mechanical devices is common enough that the possibility of malfunction of either is a real consideration. Humans have the evolutionary advantage in that their brains have an innate ability to make distinctions in the real world. A.I. systems require learning exercises to identify objects and situations already mastered by a six-month-old child. The A.I. computer must build its own library of objects against which it will base future decisions as it navigates its decision tree based on sensor inputs. What happens when a bug or ice fouls a sensor? A.I. also lacks the adaptability and value-judgement skills possessed by humans to deal successfully with a situation for which it has no prior training or reference data in its decision-tree core.
I’ll let actor Jeff Goldblum say it:
If they can’t anticipate this; Non-Emergency Automated Braking:
Something strange – and dangerous – happened to me the other day while I was out test-driving a new Toyota Prius.
The car decided it was time to stop. In the middle of the road. For reasons known only to the emperor.
Or the software.
The car braked hard, too.
I can now describe what the dashboard of a Prius tastes like. Needs A1.
And I wasn’t able to countermand the car. Dead stop – no matter how hard I pressed down on the gas. The car wouldn’t budge for several seconds that felt much longer than that as I eyed the car in the rearview getting bigger and bigger as it got closer and closer.
Automated emergency braking is one of several technologies now commonly available (and often standard equipment) in new cars that pre-empt the driver’s decisions – which opens up a yuge can of legal worms.
Another one of these saaaaaaaaaaaaafety technologies is lane keep assist, which countersteers (using electric motors connected to the steering gear) when the car thinks the driver is veering out of his intended lane of travel.
What else can’t they anticipate? I’ve been in multiple situations where I’ve had to suddenly swerve and/or brake (and sometimes floor it!), and not because something is in my lane, but – as an alert driver – I’ve seen and anticipated other drivers’ actions and proactively take action. (The sudden-swerve scenario just happened to me after I saw another car suddenly swerve to avoid a bookshelf that had fallen onto the road. I had to too.)
People are addicted to their smartphones; literally addicted, with increasingly-proven negative effects; This Fascinating New Ivy League Study Shows the ‘Clear Causal Link’ Between Facebook, Instagram and Snapchat and ‘Loneliness and Depression‘:
The participants could see the positive way that cutting back was helping them. Among their comments:
“Not comparing my life to the lives of others had a much stronger impact than I expected, and I felt a lot more positive about myself during those weeks.”
“It was easier than I thought to limit my usage. Afterwards I pretty much stopped using Snapchat because I realized it wasn’t something I missed.”
“I ended up using less and felt happier and like I could focus on school and not (be as) interested in what everyone is up to.”
This digital addiction has been commented on many times, and is especially noted not just for addiction, but making us crave constant approval of others. And beyond that, there are the effects on children’s development:
Related to the second item above, this video makes me tremble whenever I see toddlers baby-sat by the electronic drug (and it is a drug; I’ve read horror stories of kids reacting wildly and violently when denied their electronic fix – even, sometimes, with my own children I’ve seen them forgo eating and drinking to stare at the flickering images and only become aware of screaming thirst and hunger when the screen time ends, often with protests and even tears):
Thank G-d my kids do sports almost every day.
So the other day I’m doing the dishes and my phone gives off a chime. I am about to reach for a towel to dry my hands when I realize – with a WOW! moment – that I’ve become operant-conditioned to look at my phone when it makes a sound. I finished the dishes and then looked; no messages, no emails, no nothing. I started to pay attention: at least once a day my phone chimes for no reason I can discern. Watching others, I often see people literally drop what they were doing, no matter what they were doing, to check their phones when it beeped / chimed / dinged.
Track it yourself.
You cannot easily escape the debate these days about social media platforms filtering content, and doing so in a biased way to promote specific views. AI can do that too; AI Social Media Could Totally Manipulate You:
But that’s not the only problem he has been thinking about. He has also done some thinking about “the highly effective, highly scalable manipulation of human behavior that AI enables, and its malicious use by corporations and governments.” For example, social media companies, which have been recording everything you do, can show you mainly content that promotes ideas that medium owner wants you to have. If you express approved views, you will get likes that could be from bots. If you deviate, you could be shown mainly negative responses “(maybe acquaintances, maybe strangers, maybe bots)” on the theory that you will shut up or change your mind. In the social bubble, you may believe that the medium owner’s preferred views are far more prevalent than they are.
People can, and should, have debates on various hot button topics, for it is through debate that we help burn away irrelevancies until we arrive at the truth, or at least as close to the truth as it is humanly possible to be. But to do this we need information both for and against those views to avoid confirmation bias. And while I, like most people, have political / ideological leanings, the idea that the main organs of information searching actively considered, let alone are involved in, silencing voices and squelching information with which whom they disagree – with the aim of nudging the population – should make you tremble if you value a vibrant and free society.
And also check out:
Orwell was an optimist
Smart devices are going to gain the capacity to monitor movement and location in your home… and transmit that back to home base.
Smart devices in the home often raise privacy concerns. The proposal here uses hidden sensors in walls and floors instead of cameras, with the device listening instead of watching, making it potentially less invasive but, at the same time, perhaps easier to hide. Another upside is that, compared to cameras, it is less easy to identify individuals, though it may be possible to train the system to recognize the gait of specific people which could have interesting security applications like identifying potential home intruders.
We’re seeing a growing body of research into non-optical means of observation and surveillance that can still, in some senses, see people through walls. And while there are clearly both innocent and useful applications for such technology, one can’t help feeling we’re tiptoeing towards a world of omnipresent surveillance – even in our own homes.
More about smart devices and privacy; Google Reveals Plans to Monitor Our Moods, Our Movements, and Our Children’s Behavior at Home:
“The language of these patents makes it clear that Google is acutely aware of the powers of inference it has already, even without cameras, by augmenting speakers to recognize the noises you make as you move around the house,” The Atlantic wrote. “The auditory inferences are startling: Google’s smart-home system can infer ‘if a household member is working’ from ‘an audio signature of keyboard clicking, a desk chair moving, and/or papers shuffling.’ Google can make inferences on your mood based on whether it hears raised voices or crying, on when you’re in the kitchen based on the sound of the fridge door opening, on your dental hygiene based on ‘the sounds and/or images of teeth brushing.'”
And we’ve all heard about China’s beyond-Orwellian Social Credit Score system, but here;
More, while this article focuses on electric vehicles in China:
“You’re learning a lot about people’s day-to-day activities and that becomes part of what I call ubiquitous surveillance, where pretty much everything that you do is being recorded and saved and potentially can be used in order to affect your life and your freedom,” said Michael Chertoff, who served as Secretary of the U.S. Department of Homeland Security under President George W. Bush and recently wrote a book called “Exploding Data.”
American car makers have had recording “black boxes” in their cars for a while now. Ostensibly for accident reconstruction, there’s no technological barrier to the data being expanded. “Big Data” is big money… I feel my creeped-out-o-meter is approaching its limit, for example:
Last year almost 20 percent of all K-12 students were required to use Google Chromebooks, and more than 30 million students, teachers, and administrators used Google’s G Suite for Education. The inexpensive laptop and powerful software have become a very cost-effective solution for schools to teach computer and other skills and to communicate with the students and parents. Kids can submit their homework, take tests. check grades, and collaborate with others using these Google products.
According to an Electronic Frontier Foundation (EFF) report, these Google products also provide an opportunity for Google, the schools, and other software makers to collect students’ personal data. Essentially the products are Trojan horses used by Google to boost their advertising business.
Marry all this together – big data from your home, your commute and everywhere else you go, a nascent cashless society, a push to driverless (i.e., not controlled by the driver) cars, and social media information-flow Newspeak… not to mention the seemingly common data breaches and facial recognition recognizing you out in public… how soon before this dystopian scenario happens?
CALLER: Is this Tony’s Pizza?
FACEBOOK: No sir, it’s Facebook Pizza.
CALLER: I must have dialed a wrong number. Sorry.
FACEBOOK: No sir, Facebook bought Tony’s Pizza last month.
CALLER: OK. I would like to order a pizza.
FACEBOOK: Do you want your usual, sir?
CALLER: My usual? You know me?
FACEBOOK: According to our caller ID data sheet, the last 12 times you called you ordered an extra-large pizza with three cheeses, sausage, pepperoni, mushrooms and meatballs on a thick crust.
CALLER: OK! That’s what I want …
FACEBOOK: May I suggest that this time you order a pizza with ricotta, arugula, sun-dried tomatoes and olives on a whole wheat gluten-free thin crust?
CALLER: What? I detest vegetables.
FACEBOOK: Your cholesterol is not good, sir.
CALLER: How the hell do you know?
FACEBOOK: Well, we cross-referenced your home phone number with your medical records. We have the result of your blood tests for the last 7 years.
CALLER: Okay, but I do not want your rotten vegetable pizza! I already take medication for my cholesterol.
FACEBOOK: Excuse me sir, but you have not taken your medication regularly. According to our database, you only purchased a box of 30 cholesterol tablets once, at Drug RX Network, 4 months ago.
CALLER: I bought more from another drugstore.
FACEBOOK: That doesn’t show on your credit card statement.
CALLER: I paid in cash.
FACEBOOK: But you did not withdraw enough cash according to your bank statement.
CALLER: I have other sources of cash.
FACEBOOK: That doesn’t show on your last tax return unless you bought them using an undeclared income source, which is against the law.
CALLER: WHAT THE HELL?
FACEBOOK: I’m sorry, sir, we use such information only with the sole intention of helping you.
CALLER: Enough already! I’m sick to death of Google, Facebook, Twitter, WhatsApp and all the others. I’m going to an island without internet, cable TV, where there is no cell phone service and no one to watch me or spy on me.
FACEBOOK: I understand sir, but you need to renew your passport first. It expired 6 weeks ago…
1984… or BRAVE NEW WORLD?
“A really efficient totalitarian state would be one in which the all-powerful executive of political bosses and their army of managers control a population of slaves who do not have to be coerced, because they love their servitude.”
– Aldous Huxley, Brave New World
We buy this stuff voluntarily. We put our innermost secrets out there deliberately and focus ever-more desperately on entertainment-entertainment-entertainment to distract us from reality. We have Alexa, Echo, and who knows what – or who – else listening to our conversations, monitoring our web searches and potentially our movements in our own homes and everywhere else, compiling dossiers on our kids, and transmitting them to analysis centers designed to customize what we see to make us buy more… and that’s the benign outcome.
George Orwell’s 1984 dystopia features an all-powerful, all-knowing surveillance state that limits language and thought itself, controls the information flow, and presents a focus of a personalized enemy to distract the population.
Aldous Huxley’s Brave New World has a population of a ruling elites using entertainment, sex, and drugs to keep the population docile and compliant.
They wrote warnings. Who decided to use them as manuals?
© 2018, David Hunt PE