“we have repeatedly demonstrated our species's bottomless ability to lower our standards to make information technology look good.”
“But the Turing test cuts both ways. You can't tell if a machine has gotten smarter or if you've just lowered your own standards of intelligence to such a degree that the machine seems smart. If you can have a conversation with a simulated person presented by an AI program, can you tell how far you've let your sense of personhood degrade in order to make the illusion work for you?People degrade themselves in order to make machines seem smart all the time. Before the crash, bankers believed in supposedly intelligent algorithms that could calculate credit risks before making bad loans. We ask teachers to teach to standardized tests so a student will look good to an algorithm. We have repeatedly demonstrated our species' bottomless ability to lower our standards to make information technology look good. Every instance of intelligence in a machine is ambiguous. The same ambiguity that motivated dubious academic AI projects in the past has been repackaged as mass culture today. Did that search engine really know what you want, or are you playing along, lowering your standards to make it seem clever? While it's to be expected that the human perspective will be changed by encounters with profound new technologies, the exercise of treating machine intelligence as real requires people to reduce their mooring to reality.”
“Forgotten phone numbers and birthdays represent minor erosions of our everyday memory, but they are part of a much larger story of how we've supplanted our own natural memory with a vast superstructure of technological crutches—from the alphabet to the BlackBerry. These technologies of storing information outside our minds have helped make our modern world possible, but they've also changed how we think and how we use our brains.”
“Everybody achieves success in life—a blessed few early in their careers, the rest of us when we lower our standards”
“But technology is the real skin of our species. Humanity, correctly seen in the context of the last five hundred years, is an extruder of technological material. We take in matter that has a low degree of organization; we put it through mental filters, and we extrude jewelry, gospels, space shuttles. This is what we do. We are like coral animals embedded in a technological reef of extruded psychic objects. All our tool making implies our belief in an ultimate tool. That tool is the flying saucer, or the soul, exteriorized in three-dimensional space.”
“We have lived by the assumption that what was good for us would be good for the world. And this has been based on the even flimsier assumption that we could know with any certainty what was good even for us. We have fulfilled the danger of this by making our personal pride and greed the standard of our behavior toward the world - to the incalculable disadvantage of the world and every living thing in it. And now, perhaps very close to too late, our great error has become clear. It is not only our own creativity - our own capacity for life - that is stifled by our arrogant assumption; the creation itself is stifled.We have been wrong. We must change our lives, so that it will be possible to live by the contrary assumption that what is good for the world will be good for us. And that requires that we make the effort to know the world and to learn what is good for it. We must learn to cooperate in its processes, and to yield to its limits. But even more important, we must learn to acknowledge that the creation is full of mystery; we will never entirely understand it. We must abandon arrogance and stand in awe. We must recover the sense of the majesty of creation, and the ability to be worshipful in its presence. For I do not doubt that it is only on the condition of humility and reverence before the world that our species will be able to remain in it. (pg. 20, "A Native Hill")”