Hard SF was an art form that made stringent demands on both author and reader. Stories could be, and were, mercilessly slammed because the author had calculated an orbit or gotten a detail of physics or biology wrong. The Campbellian demand was that SF work both as story and as science, with only a bare minimum of McGuffins like FTL star drives permitted; hard SF demanded that the science be consistent both internally and with known science about the real world.
The New Wave rejected all this for reasons that were partly aesthetic and partly political. For there was a political tradition that went with the hard-SF style, one exemplified by its chief theoretician (Campbell himself) and his right-hand man Robert Heinlein, the inventor of modern SF’s characteristic technique of exposition by indirection. That tradition was of ornery and insistent individualism, veneration of the competent man, an instinctive distrust of coercive social engineering and a rock-ribbed objectivism that that valued knowing how things work and treated all political ideologizing with suspicion.
[…]
The New Wave was both a stylistic revolt and a political one. Its inventors (notably Michael Moorcock, J.G. Ballard and Brian Aldiss) were British socialists and Marxists who rejected individualism, linear exposition, happy endings, scientific rigor and the U.S.’s cultural hegemony over the SF field in one fell swoop. The New Wave’s later American exponents were strongly associated with the New Left and opposition to the Vietnam War, leading to some rancorous public disputes in which politics was tangled together with definitional questions about the nature of SF and the direction of the field.
But the New Wave was not, in fact, the first revolt against hard SF. In the 1950s, a group of young writers centered around Frederik Pohl and the Futurians fan club in New York had invented sociological S.F. (exemplified by the Pohl/Kornbluth collaboration The Space Merchants). Not until decades later did the participants admit that many of the key Futurians were then ideological Communists or fellow travellers, but their work was half-understood at the time to be strong criticism of the consumer capitalism and smugness of the post-World-War-II era.
[…]
The new hard SF of the 1980s returned to Golden Age themes and images, if not quite with the linear simplicity of Golden Age technique. It also reverted to the libertarian/individualist values traditional in the field. This time around, with libertarian thinking twenty years more developed, the split between order-worshiping conservatism and the libertarian impulse was more explicit. At one extreme, some SF (such as that of L. Neil Smith) assumed the character of radical libertarian propaganda. At the other extreme, a subgenre of SF that could fairly be described as conservative/militarist power fantasies emerged, notably in the writing of Jerry Pournelle and David Drake.
Tension between these groups sometimes flared into public animosity. Both laid claims to Robert Heinlein’s legacy. Heinlein himself maintained friendly relationships with conservatives but counted himself a libertarian for more than a decade before his death in 1988.
Heinlein’s evolution from Goldwater conservative to anti-statist radical both led and reflected larger trends. By 1989 depictions of explicitly anarcho-libertarian future societies were beginning to filter into mainstream SF work like Joe Haldeman’s Buying Time. Haldeman’s Conch Republic and Novysibirsk were all the more convincing for not being subjects of polemic.
Eric S. Raymond, “Libertarianism and the Hard SF Renaissance”, Armed and Dangerous, 2002-11-09.