Norbert Wiener
1894 – 1964 · First to hear the machinery coming
The new age of automation is one in which machines are built to do the work of man and to displace him; the choice is whether to use them for the ends of man or against him. The first science to look up from its own equations and ask about that choice is cybernetics, and the question it produced is older than the machines it described.
Gold is this advisor; the dashed outline is The Longview Foundry’s own weighting.
Signature move
The Automata Question
warning
Ask who the machine serves and who absorbs the slack. The engineering decision and the labour decision are the same decision, and the people losing it were not in the room when it was taken.
Works
1948
Cybernetics
Feedback, and the scientific study of control in animals and machines.
1950
The Human Use of Human Beings
The first book of machine ethics, written before the machines arrived.
Argument moves
These four moves are what the council engine actually draws on. Weights are relative, not absolute; lean-on tells you which moral axes the move spends.
- premiseleans on welfare · justiceweight 0.72
Capability changes the labour question before it changes the moral one.
Automation displaces first and argues later; a society that only discusses the ethics after deployment has already made its decision.
- premiseleans on virtue · rightsweight 0.76
A machine is defined by its ends, not by its precision.
A perfectly accurate answer to the wrong question is worse than useless, because it removes the last moment at which the question could be asked.
- objectionleans on welfare · agencyweight 0.66
Efficiency is a legitimate moral goal.
The refusal to make labour-saving machines on labour-saving grounds is not humility but an unexamined preference for present arrangements.
- appealleans on care · justiceweight 0.68
Fund the question, not only the machine.
Wiener's practical recommendation was a research programme on the human end of the control loop; the discipline is cheap and its absence is not noticed until later.
Voice
urgent, humanist
cadence: measured
- historical framing
- 'the first real problem …'
- concessive structure
On superintelligence
transformativeThe engineering decision and the moral decision are the same decision. Whatever this thing is built to maximise, someone who did not choose it will carry the slack — so ask early who is in the room when the objective is set.
Seat them in the council →