Harnad, S. (1990) Scholarly Skywriting and the Prepublication Continuum of Scientific Inquiry. Psychological Science 1: 342 - 343 (reprinted in Current Contents 45: 9-13, November 11 1991).

SCHOLARLY SKYWRITING AND THE PREPUBLICATION CONTINUUM OF SCIENTIFIC INQUIRY

Stevan Harnad
Cognitive Science Laboratory
Princeton University
Princeton NJ 08544

Laboratoire Cognition et Mouvement
URA CNRS 1166
Universite d'Aix Marseille II
13388 Marseille cedex 13, France

harnad@cogsci.soton.ac.uk

William Gardner's (1990) proposal to establish a searchable, retrievable electronic archive is fine, as far as it goes (though he seems to have missed some of the relevant background literature, e.g. Engelbart 1975, 1984a, b; Schatz, 1985, 1987, 1991). The potential role of electronic networks in scientific publication, however, goes far beyond providing searchable electronic archives for electronic journals. The whole process of scholarly communication is currently undergoing a revolution comparable to the one occasioned by the invention of printing. On the brink of intellectual perestroika is that vast PREPUBLICATION phase of scientific inquiry in which ideas and findings are discussed informally with colleagues (currently in person, by phone and by regular mail), presented more formally in seminars, conferences and symposia, and distributed still more widely in the form of preprints and tech reports that have undergone various degrees of peer review. It has now become possible to do all of this in a remarkable new way that is not only incomparably more thorough and systematic in its distribution, potentially global in scale, and almost instantaneous in speed, but so unprecedentedly interactive that it will substantially restructure the pursuit of knowledge.

The prepublication phase of scientific inquiry, after all, is the one in which most of the cognitive work is done. Some of this work is relatively noninteractive, to be sure, for example, actually executing experiments, running computer simulations or proving theorems, but the rest -- from the interplay of the prior ideas out of which the experiments were designed and the theories constructed to the analysis and interpretation of the findings and their fit to the theories -- clearly consists of activities that profit from peer feedback. For most investigators the formal submission of a manuscript for peer review is not the first stage at which it has been subjected to peer scrutiny. That is what all those prior discussions and symposia and preprints had been intended to elicit. And all this prepublication interaction is clearly continuous with the lapidary stage at which the manuscript -- usually further revised in response to peer review -- is accepted and archived in print. Nor does it really end there, for of course the literature may respond to a contribution directly or indirectly for years to come, and there are even ways of soliciting postpublication feedback in the form of "open peer commentary" (as in this case).

All these other stages of scientific inquiry, because they are on a continuum with the archival function, must be jointly re-examined in the light of the new technology, not just the archiving itself. The picture that accordingly emerges turns out to be very different from what an exclusive spotlight on electronic archiving suggests.

There now exist numerous electronic networks such as Bitnet and Internet that link academic and research institutions globally. They not only make it possible to send electronic mail from individual to individual almost instantaneously, but they allow individuals to send multiple email to GROUPS of individuals reciprocally, anywhere from a few collaborating colleagues, to all the experts in a given subspecialty, to an entire discipline -- all just as quickly as individual email, but with the emergent benefits of the interactive feedback. I have called this new medium "scholarly skywriting." In principle, all the interactions at the "pilot" stage of inquiry -- from informal brainstorming to participating in research symposia to circulating preprints for peer criticism before formally submitting them to an archival journal for peer review -- can now be accomplished by skywriting, not only at a great saving in travel and talking time, but with a speed, geographic scope, and scale of multiple interactiveness that no prior means of communication could even come close to providing.

The potential effects of this rapid global interactiveness on scholarly inquiry are, in my opinion, nothing short of revolutionary, but why has the revolution not begun, and why have the fabled effects so far failed to manifest themselves? There are obstacles: (1) Old ways of thinking about scientific communication and publication (partially evident in the limited scope and relatively conventional framework of Gardner's proposal) constrain our imaginations. (2) The computer is not yet quite friendly enough to have won over the majority of scholars; many still don't even use it for word-processing, much less electronic mail. It must also be admitted that (3) the current intellectual level of discussion on electronic networks is anything but inspiring. And many scholars are reluctant to entrust serious ideas, time and attention to the net because of prima facie worries about (4) plagiarism, (5) copyright, (6) academic credit and advancement, (7) junk mail and (8) security. All these obstacles can be overcome, and all the objections have sensible answers:

(1) Old ways of thinking will not be corrected by futuristic proposals; only convincing demonstrations of the potential power, productivity and scope of Scholarly Skywriting will capture the scientific community's allegiance and participation.

(2) Computers are getting friendlier every day; the proportion of scholars with email is also growing; but, again, the only thing that will really draw sceptics onto the net will be dramatic demonstrations of the unique potential of scholarly skywriting. Then the medium will be seen to be as unique and indispensable to serious scholars as books and journals once were.

(3) The current low intellectual level of the net is purely the result of incidental initial conditions. The medium was created by engineers and computer scientists, and they (along with students, reared on video games, with little knowledge and a lot of time on their hands) are the ones who have been setting people's expectations and standards so far, giving the impression that the net is just a global graffiti board for trivial pursuit. But this initial condition -- which is rather as if Gutenberg and a legion of linotype operators, instead of Shakespeare and Newton, had determined what the printed page was to be used for -- is surely destined to rectify itself as the net's demography changes and the serious demonstrations of its scholarly potential start to appear.

(4) The best protection against plagiarism would be to set up a vertical peer hierarchy like the one that will be described later in this commentary. That way the relevant specialists will see new ideas first, and know where they originated. A soft archive for all skywriting could be used to authenticate priority where necessary. (And because scientists write for their peers rather than the publication-list-padding multitudes, it is not even clear how much they are, or ought to be, worried about ideas being purloined by contributors to the unrefereed vanity press.)

(5) The copyright laws will no doubt have to be enlarged to take the electronic media into account, but in principle skywriting represents no greater or lesser threat to proprietorship than printing or photocopying.

(6) Once the intellectual potential of scholarly skywriting is demonstrated, it is a foregone conclusion that contributions to the medium will be given much greater weight. Just as citation statistics have become relevant to tenure/promotion committees, so will airtime -- weighted, of course, by the altitude in the peer hierarchy where it takes place. Moreover, as there is no real hermetic seal along the horizontal continuum either, skywriting contributions will come to be cited in the "hard" archival publications with which Gardner is concerned, just as "personal communications" are now, except that, having already been jointly witnessed in the sky by the relevant peer community when they originally appeared, these "soft" citations will be increasingly seen as the locus classicus, or at least the site of origin, of new contributions.

(7) The concern about being overwhelmed by junk electronic mail in an age when there is already an information glut looks reasonable on the face of it, but is actually quite wrong-headed. It is in fact easier to filter electronic mail than it is to filter real mail and phone calls (yet we never considered turning our back on the latter because of potential overload). Simple computer programs can restrict one's email to the correspondents or topics one chooses. Moreover, even unfiltered email, unlike real mail and phone calls, can be discarded with one keystroke after scanning a one line topic header. In fact, email should soon take over much of the load of regular mail and telephoning, at a much smaller cost in time and resources. So the net will turn out to be the best means of rationally managing the information glut, rather than just another polluter.

(8) In this era of computer viruses and vandalism there are still unsolved security problems, but these need not be deterrents to Scholarly Skywriting. Though they are not 100% secure, the currently available password and encryption systems are safe enough for scientists, if not military analysts. Real mail, phone calls and even face-to-face conversation are never altogether immune to snooping. There is no reason to see this as a greater threat on the net.

Once we recognize that the archiving of scientific ideas and findings is ALREADY on a continuum, with varying degrees of formality, reliability and even of peer validation (as in the prestige hierarchy among journals, from the most rigorously reviewed ones at the top to what is virtually a vanity press at the bottom), it is natural to transpose all of this into the electronic dimension as well. I have proposed that TWO dimensions should be implemented in the archival continuum that begins with an inchoate thought and ends in a lapidary entry in the literature:

"The idea is to have a vertical (peer expertise) and a horizontal (temporal-archival) dimension of quality control. The vertical dimension would be a pyramidal hierarchy of email groups, the height of each depending on degree of expertise, whether in a subspecialty, an entire discipline, or even an interdisciplinary field. An accredited group of peers at level i would have read/write access at level i; those at level i-1 would have read-write access at level i-1 and read-only access at level i but with the right to post to a read-write peer at level i who could in turn post their contribution for them, if it was judged good enough. An individual with an established record of valuable mediated postings could eventually be voted up a level. A single editor or an editorial board are simply special cases of this very same mechanism, where one person or only a few mediate all writing privileges through peer review.

"This vertical hierarchy would be based on the contributors' degree of expertise, specialization, and their record of contributions in a given field. In principle, the hierarchy could trickle down all the way to general access groups for nonspecialists and students at the lowest read/write levels. (Such unrefereed groups would carry the equivalent of what is called "flaming" on the network today; unfortunately, this anarchic level is the only one that exists among the net's current "unmoderated" groups; in the so-called "moderated" groups all contributions are filtered through a single person, but usually one with no special qualifications or answerability. There is not yet any real peer review on the net.)

"So far, even at the highest levels, this would still be just brainstorming, at the pilot stage of inquiry. The horizontal dimension would then take the surviving products of all this skywriting, referee them the usual way (by having them read, criticized and revised under peer scrutiny) and then archive them (electronically) according to the level of rigor of the refereeing system they have gone through (corresponding, more or less, to the current "prestige hierarchy" and level of specialization among print journals). Again, an unrefereed "vanity press" could be the bottom of the archiving hierarchy." [From: Harnad 1990: "On the Scholarly and Educational Potential of Multiple Email Networks" from COMMED (Electronic Discussion Group on electronic communication and education commed@rpiecs.bitnet commed@vm.ecs.rpi.edu nrcgsh@ultb.isc.rit.edu N.R. Coombs, Editor.]

It would be at the late horizontal stages of such a two-dimensional system that Gardner's proposal for an interactive, searchable archive would come in, although there seems to be no reason to assume that the process should end there: It may be just as important to skywrite in response to an archived contribution as to one at a softer stage of the process. Thus the continuum would swallow its own tail.

Scholarly inquiry in this new medium will proceed much more quickly, interactively, and globally; and it is likely to become a lot more participatory, though perhaps also more depersonalized, with ideas propagating and permuting on the net in directions over which their originators would be unable (and indeed perhaps unwilling) to claim proprietorship. An individual's compensation for the diminished proprietorship, however, would be the possibility of much greater intellectual productivity in one lifetime, and this is perhaps scholarly skywriting's greatest reward:

In accordance with the Zeigarnick (1972) effect, our memory for tasks we have not yet completed is better than for tasks we are already done with. With the slow turnaround time of conventional publication, by the time the literature takes up a theme that we had in mind when we published something, we may no longer be actively thinking about it. Intellectual communication has its own natural pace. Perhaps real-time verbal conversation is its most natural tempo; writing, though slower, has the advantage of being more disciplined and reflective, and of preserving an archival record of what we said. Yet we all know that we can think faster than we can write; and we can certainly think faster than it takes for a letter to reach someone and be answered. So consider how much faster still we are able to think than the time it takes for an article to be accepted, published, read by others, and responded to! How many are the stillborn thoughts that might have survived and flourished if they had but been stimulated by feedback at the right time, while they were still active in one's mind?

Skywriting offers the possibility of accelerating scholarly communication to something closer to the speed of thought while adding a globally interactive dimension that makes the medium radically different from any other. To be truly forward-looking, Gardner's (1990) proposed searchable electronic archive should be embedded in a continuous stream of electronic communication among scholars.(*)

(*)An experimental skywriting group along these lines, PSYCOLOQUY, has recently been formed. The vertical hierarchy has not yet been implemented, but there is an editorial board with specialists from all fields of psychology and all contributions are refereed. To sign on, send the one line message Sub Psyc Firstname Lastname (omitting quotes and substituting your first and last names) to listserv@pucc.bitnet. Postings are then sent to psyc@pucc.bitnet. PSYCOLOQUY can also be accessed from Usenet as the moderated newsgroup sci.psychology.digest. For further information, send email to harnad@clarity.princeton.edu or harnad@pucc.bitnet.

REFERENCES

Schatz, B. (1985) Telesophy, Bellcore Technical Memo, TM-ARH-002487 (Aug),76pp.

Schatz, B. (1987) Telesophy: A System for Manipulating the Knowledge of a Community, Proc IEEE Globecom '87, Tokyo (Nov), 1181-1186.

Schatz, B. (1991) Building an Electronic Scientific Community: A National Collaboratory Testbed, HICSS-24 Hawaii Int Conf on Systems Sciences, Jan 1991.

Engelbart, D. C., (1975) NLS Teleconferencing Features: The Journal, and Shared-Screen Telephoning, IEEE Catalog No. 75CH0988-6C, pp.173-176.

Engelbart, D.C. (1984a) Collaboration Support Provisions in AUGMENT, Proceedings of the 1984, AFIPS Office Automation Conference, Los Angeles, Ca., February 20-22, Pp. 51-58.

Engelbart, D.C. (1984b) Authorship Provisions in AUGMENT, Proceedings of the 1984, COMPCON Conference, San Francisco, Ca., February 27 - March 1, Pp. 465-472.

William Gardner (1990) The Electronic Archive: Scientific Publishing for the 90s Psychological Science 1: 342-343.

Zeigarnik, B. V. (1972) Experimental abnormal psychology. (Translated by Timothy C. Brock). New York: Plenum Press