Monday, November 9, 2026
HomeTechnologyHow Claude Shannon Helped Kick-start Machine Studying

How Claude Shannon Helped Kick-start Machine Studying

[ad_1]

Among the many nice engineers of the twentieth century, who contributed probably the most to our Twenty first-century applied sciences? I say: Claude Shannon.

Shannon is greatest identified for establishing the sector of knowledge concept. In a 1948 paper, one of many best within the historical past of engineering, he got here up with a method of measuring the knowledge content material of a sign and calculating the utmost charge at which data may very well be reliably transmitted over any form of communication channel. The article, titled “A Mathematical Idea of Communication,” describes the premise for all trendy communications, together with the wi-fi Web in your smartphone and even an analog voice sign on a twisted-pair phone landline. In 1966, the IEEE gave him its highest award, the Medal of Honor, for that work.


If data concept had been Shannon’s solely accomplishment, it could have been sufficient to safe his place within the pantheon. However he did much more.

A decade earlier than, whereas engaged on his grasp’s thesis at MIT, he invented the logic gate. On the time, electromagnetic relays—small gadgets that use magnetism to open and shut electrical switches—had been used to construct circuits that routed phone calls or managed advanced machines. Nevertheless, there was no constant concept on the way to design or analyze such circuits. The best way folks thought of them was by way of the relay coils being energized or not. Shannon confirmed that Boolean algebra may very well be used to maneuver away from the relays themselves, right into a extra summary understanding of the operate of a circuit. He used this algebra of logic to investigate, after which synthesize, switching circuits and to show that the general circuit labored as desired. In his thesis he invented the AND, OR, and NOT logic gates. Logic gates are the constructing blocks of all digital circuits, upon which your complete edifice of laptop science relies.

In 1950 Shannon printed an article in Scientific American and in addition a analysis paper describing the way to program a pc to play chess. He went into element on the way to design a program for an precise laptop. He mentioned how knowledge constructions could be represented in reminiscence, estimated what number of bits of reminiscence could be wanted for this system, and broke this system down into issues he known as subprograms. In the present day we’d name these features, or procedures. A few of his subprograms had been to generate potential strikes; some had been to offer heuristic value determinations of how good a place was.

Whereas engaged on his grasp’s thesis at MIT, Shannon invented the logic gate.

Shannon did all this at a time when there have been fewer than 10 computer systems on the planet. And so they had been all getting used for numerical calculations. He started his analysis paper by speculating on all kinds of issues that computer systems may be programmed to do past numerical calculations, together with designing relay and switching circuits, designing digital filters for communications, translating between human languages, and making logical deductions. Computer systems do all this stuff right this moment. He gave 4 the explanation why he had chosen to work on chess first, and an necessary one was that individuals believed that enjoying chess required “pondering.” Due to this fact, he reasoned, it could be an ideal take a look at case for whether or not computer systems may very well be made to suppose.

Shannon instructed it may be potential to enhance his program by analyzing the video games it had already performed and adjusting the phrases and coefficients in its heuristic evaluations of the strengths of board positions it had encountered. There have been no computer systems available to Shannon on the time, so he couldn’t take a look at his concept. However simply 5 years later, in 1955, Arthur Samuel, an IBM engineer who had entry to computer systems as they had been being examined earlier than being delivered to prospects, was working a checkers-playing program that used Shannon’s precise technique to enhance its play. And in 1959 Samuel printed a paper about it with “machine studying” within the title—the very first time that phrase appeared in print.

So, let’s recap: data concept, logic gates, non-numerical laptop programming, knowledge constructions, and, arguably, machine studying. Claude Shannon didn’t trouble predicting the longer term—he simply went forward and invented it, and even lived lengthy sufficient to see the adoption of his concepts. Since his passing 20 years in the past, we have now not seen anybody like him. We in all probability by no means will once more.

This text seems within the February 2022 print subject as “Claude Shannon’s Best Hits.”

[ad_2]

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments