Archive for the ‘Internet’ Category

MEDIA FUTURES 2006: 2/5 ALGORITHM: History of Algorithm

Sunday, September 3rd, 2006

An algorithm is a machine that can be used to reproduce a unique pattern of behavior.   The history of the word traces back to the Greeks and the instruments they used for mathematics; for example, the sieve.  In the context of Media Futures, imagine that algorithms are tightly woven filters that capture the full range of human Automata and slowly sift through them to produce the most meaningful, intentional gestures.

Animation_sieb_des_eratosthenes







Ancient Algorithms

Finding its root in algorism, a reading of the name of Abu Ja’far Muhammad ibn Musa Al-Khwarizmi, the 9th century Persian mathematician who described a set of rules for solving both Linear and Quadratic equations, algorithm came to its present state by way of an 18th century European Latin translation and soon expanded its meaning to encompass all definite procedures for solving problems or performing tasks.  The very first algorithms are a part of the Babylonian mathematical legacy – a legacy which not only left us with algorithms for factorization, finding square roots and performing long division, but which also left us with the base 60 system that gives 60 minutes to an hour, 60 seconds to a minute, 360 degrees to a circle and 24 hours to a clock.  Babylonians were in fact able to calculate things with the same accuracy as Renaissance mathematicians due to their use of number tables, like the Plimpton Tablet, a table of Pythagorean Triples from about 1700 B.C.

Plimptontablet

While the Babylonians based their mathematical system in large part on algebra, the Greek system of mathematics was heavily based upon geometry.  It is speculated, though, that the founder of Greek science and mathematics, the philosopher Thales of Milet, visited Egypt and Babylon during his lifetime (634 – 546 B.C.) and brought back knowledge of their astronomy and geometry.  The Egyptians made great contributions in the fields of medicine, astronomy and applied mathematics, and while the former triumphs are well documented, there exist no records of the process by which they reached their mathematical conclusions.  Thales built on the knowledge brought back from his trips, inventing deductive mathematics and proving a number of theorems – a circle is bisected by a diameter; the base angles of an isosceles triangle are equal; and pairs of vertical angles formed by two intersecting lines are equal.

The foremost text on geometry came from fellow Greek Euclid, whose Elements put together former geometric knowledge with definitions, postulates and opinions – and, of course, Euclid’s elegant and rigorous proofs of the above.  In that text, he discussed the algorithm for finding the greatest common divisor of two numbers, which is today referred to as the Euclidean algorithm.  One hundred years later around 200 B.C., the world saw the next great algorithm – the Sieve of Eratosthenes, which was used to find prime numbers.

Sieve

From Wikipedia: 

Sieve of Eratosthenes is a simple, ancient algorithm for finding all prime numbers up to a specified integer. It is the predecessor to the modern Sieve of Atkin, which is faster but more complex. It was created by Eratosthenes, an ancient Greek mathematician.

 

Another important site in the history of the algorithm was Alexandria, home to Hero, Ptolemy, and Diophantos.  Hero, whom we will remember as the inventor of the steam eolipile and other Automata, published widely on geometrics, optics and mechanics – as well as mathematics.  Though sources suggest his work is derivative of Archimedes and the work of the Babylonians, his Formula to calculate the area of a triangle in terms of its sides and his Method to extract a root are important contributions to the world of mathematics.  Ptolemy published widely on astronomy and geography and calculated the best approximation of ‘pi’ for his time.  And Diophantos, known as the ‘father of algebra’, wrote his thirteen-volume Arithmetica on the solution of algebraic equations and the theory of numbers and introduced the use of algebraic symbolism with an abbreviation for the unknown for which he was solving.

But Diophantos shares the title of the ‘father of algebra’ with the aforementioned Al-Khwarizmi, whose work was responsible for significant advances in the world of mathematics. 

Alkhwarizmi_kitab_large

It was Al-Khwarizmi’s work that promoted the use of Hindu-Arabic numerals that not only pushed forward the numeral system we use today, but that gives us the very term algorithm. From the very first algorithms of the Babylonians to those of Al-Khwarizmi – to John Napier’s 1614 method for performing calculations using logarithms to the 19th century work of Boole, Frege and Peano, which set out to reduce arithmetic to a series of symbols which could be manipulated by rules – to the work of Babbage, Lovelace and Turing, which took these rules and transformed them into agents of action in computing, these feats of problem-solving are instrumental in understanding man’s quest for a grasp of the workings of the world at large.      

Babbage and Turing

One great advantage which we may derive from machinery
is from the check which it affords against the inattention, the
idleness, or the dishonesty of human agents.
From Babbage’s 1832 work “On the Economy of Machinery and Manufactures”

In our discussion of rules that govern the Internet, we must turn to the work of Babbage and Turing, for it serves as the important foundation for computing at all.  Babbage’s work grew out in part out of a need for more accurate mathematical tables, which were essential calculating aids used in navigation and astronomy, insurance and civil engineering.  These tables were produced by human computers and by hand – and as such, they were prone to error in terms of computation and reporting.  Even the slightest errors in navigational or astronomical tables can be costly – so it is no surprise that in the years leading up to Babbage’s project, government sources were willing to fund projects that would minimize the costs of troubleshooting. 

For example, the British Nautical Almanac, the world’s first permanent table-making project – had a reputation for ever-improving accuracy since its inception in 1766.  But moving into the 19th century, that seaman’s bible swung into a dangerous territory of inaccuracy and error, and the British government recognized the promise of producing mathematical tables mechanically and typesetting them by the same machine. 

So Babbage set out, with financial support (and the admirals’ prayers) to improve the accuracy of those ever-important mathematical tables by constructing algorithm-driven machines.  It was a move that mechanized the production of thought, a move that would eliminate human folly in computation, transcription and typesetting.  The result would be better answers, answers which would in turn be used for giving new instructions, as inputs in other algorithms.   

Babbage never finished his Difference Engine – though, in 1832 his manufacturing engineer did construct a working portion of it, which measured two and a half feet high by two feet wide by two feet deep.  Babbage moved forward to conceptualizing what would be the world’s first programmable digital computer – the Analytical Engine.  Babbage’s designed the engine such that it would separate the sites of arithmetic computation from the storage of numbers.  The computation would be carried out through a series of steps recorded on punch cards, such as the ones used in the technology of the Jacquard loom. 

A_engine

But however intriguing and important the technology seemed, Babbage’s Analytical Engine – due to factors financial and logistical – was never built.  It comes to us only through Ada Lovelace’s annotated translation of a French introduction to the machine – a piece of writing that established the algorithm for the computation of Bernouilli numbers, and a piece of writing that established the idea of computer programming.  Turing would later build on the work of Lovelace and Babbage, formalizing their concepts in the Universal Machine.

When Turing introduced the mathematical description of the Universal Machine in the 1936 paper “On Computable Numbers”, he set out to answer the Entscheidungsproblem, the third question left by mathematician David Hilbert.  Gödel had already answered Hilbert’s first two questions – No, mathematics was not complete, and it was not consistent.  Turing showed that mathematics was not decidable.  And that recipe to solve a particular problem, gave us an answer that begs the asking of a new set of questions.

MEDIA FUTURES 2006: 2/5 ALGORITHM: The Transition from Automata to Algorithm

Thursday, August 31st, 2006

In the beginning there is the Automata.  It is the prime mover: an intention that drives human action.Uniquealgorithm81306

Over time, the record of these actions, both individually and across people,  establish a unique pattern of behavior that is known as an Algorithm.  In the context of Media Futures, an algorithm is a computing engine designed to process behavioral data and convert it into content that engages ones Attention.

You can imagine an Algorithm like a strange Rube Goldberg machine with a complex set of routers, pulleys and chutes that turn a certain input into an equally certain output. 

Rg_48

Recall our reinterpretation of Hamlet:

We encourage others to participate so that we may consume them
and we make ourselves interesting for the blogosphere.  Your Internet CEO and your Joe Blogger are just different algorithms- two APIs, but to one network.

Each decision that I make as to what to pay Attention to, and the physical gesture that I use to effect this choice (search, click, form, sign in, etc) establishes a little personal algorithm that gets joined with all of my other personal algorithms.  Together, this bundle of personal information algorithms establishes and maintains my persistent, stable electronic identity.  This is a deeper, more authentic version of me than simply a numeric ID that establishes my offline physical presence.  The me that makes me me online is one that I actively create and reinforce every moment based on a series of interlocking gears (which I control based on data I produce).

 

Root830051

And now if you pull up from the tree of me as an individual to the forest of all of us in society, then you see a much broader fabric.  The fabric represents Social Media, each of its infinite threads representing one individual’s momentary micro algorithmic gesture. 

One would assume that each of these mini decisions was distributed to the edges, and that the control over it was determined by its owner.  But this would be to ignore the gravity of the Attention economy, which is Influence.  On the Internet, Influence is measured by the amount of Attention one gets relative to the amount of information one gives  The most influential online individual is able to syndicate a limited but steady stream of what makes me me-ness through his personal API and nevertheless generate a high pagerank that lands him above the Google fold.

The area that I am most interested in exploring in this current chapter on Algorithm is the rub between what you are searching for and where you emerge from other people’s searches.  This is located between (1) the record of your Attention (for example as expressed recently by AOL through their disclosure of "anonymous" search histories) and (2) the position you occupy within the pagerank universe based on what keywords produce results that point to you, above the fold.

For me,  these keywords might include: "Seth Goldstein"  "Media Arbitrage"  "Algorithm Futures" "Transparent Soft Dollars"

Coming next, a brief history of Algorithm

Media Futures 2006: 1/5 Automata: The Human Computer

Wednesday, August 9th, 2006

Autocover
Automataoldandnewimage87_1

While the recent inventions of Web 2.0 and User Generated Content (UGC) seem to be radical departures from the computing culture we grew up in, their organic social metaphors are in fact rooted in the beginning of computer science.  In the 1940’s and 50’s work of Alan Turing, John Von Neumann and Norbert Weiner, most discussions of the future of computing evolve into a study of the brain.  The natural automata of human thought, the way in which our ideas express our independence, this is the machine intelligence that technologists tried to design into early computers.   

Alan Turing was fascinated by Automata and its relationship to natural human thought.  In his 1950 “Computing Machinery and Intelligence,” Turing outlined an experiment that was able to determine whether a computing machine could be defined as having the capacity to think.  The Turing test functions as follows: Human “X” and respondent “Y” take part in a teletype conversation, but X cannot know whether Y is human or a machine.   If, after a specified amount of time, X believes that Y has responded like a human, and Y is a machine, then Y can be defined as having that human capacity of thought.

In his biography of Turing, William Aspray writes that this:

“was among the earliest investigations of the use of electronic computers for artificial-intelligence research…He attempted to break down the distinctions between human and machine intelligence and to provide a single standard of intelligence, in terms of mental behavior, upon which both machines and biological organisms could be judged.   In providing his standards, he considered only the information that entered and exited the automata…Turing was moving toward a unified theory of information and information processing applicable to both the machine and the biological worlds.”

The fusion of machine and biology is promoted as a core computer architectural principle in the Interim Progress Report on the Physical Realization of an Electronic Computing Instrument:  Julian H. Bigelow, James H. Pomerene, Ralph J. Slutz and Willis H. Ware; Princeton: The Institute for Advanced Study; 1 January 1947.  This report was prepared for John Von Neumann, and the rest of the IAS authorities, on the development progress of a machine based entirely on mathematical equations.

Vneumannpeeps

Left to right: James Pomerence, Julian Bigelow, von Neumann and Herman Goldstine

Von Neumann had joined Princeton’s Institute for Advanced Study as a Mathematician in 1933.  About 10 years later he started concentrating on something less theoretical and more practical (which alienated many of his colleagues): building an electronic computing machine.  This project was a deep meditation on the act of creation.  Some of the greatest minds, across a variety of disciplines (math, biology, engineering, physics) converged in Princeton to help Von Neumann “physically realize” his ideas. 

Iasreport

IAS Report, 1947

According to the report, Organs are:  “portions or sub-assemblies of the machine which constitute the means of accomplishing some inclusive operation or function; as “arithmetic organ.”  Note how the processor in this case is able to extend its influence onto others in an “inclusive operation.”  The organ of social media was anticipated already then, in 1947, even without an Internet to enable it at scale.   

Von Neumann continued to extend his computer research towards an understanding of the human brain.  He described this specifically in his introduction to his 1958 work The Computer and the Brain:

Vonneumannbrainintro8706

In 1948, Norbert Weiner, the leader of cybernetics wrote Control and Communication in the Animal and the Machine.  His use of the word animal is different than Turing’s logic or Von Neumann’s brain, but he is similarly concerned with the organs of information and their ability to relay information between systems:

“It is a noteworthy fact that the human and animal nervous systems, which are known to be capable of the work of a computation system, contain elements which are ideally suited to act as relays.  These elements are the so-called neurons or nerve cells… The mechanical brain does not secrete thought <as the liver does bile>, as the earlier materialists claimed, nor does it put out in the form of energy, as the muscle puts out its activity.  Information is information, not matter or energy.”

Cyberneticssmall

Weiner, Control and Communication in the Animal and the Machine, 1947

In late 2004, the creator of del.icio.us Joshua Schachter described to me that tags were simply crystallized attention.  Both terms interested me: while attention has become my chief investigation, the transparent materialism expressed by “crystallized” has also been a key focus.  When you put these together, you get, in Weiner’s words, a “secretion” of passive behavioral data.

Socialmediaorgan_1

Seth Goldstein, April 2006

Just because a tag is a form of  information doesn’t mean that it lacks physicality  Without being matter or energy, can a tag be made of something else, something that comes closer in nature to mirror neurons?  Attentrons.  Remember that mirror neurons are a form of biological material.  These mirror neurons fire when the subject performs an action, but also when it observes somebody else performing an action.  In this latter case, the successful firing of a mirror neuron is based entirely on its ability to passively mimic the behavior of somebody else.  In this quiet absence of a human impulse, attention is full.

Electronicdataprocessing
Brainsforsale87