For decades, authors have been drawing parallels between the rise of digital technology and the invention of the printing press. It’s a worthwhile comparison: both have changed the way people transmit, produce, and ingest information. Notions of power and access are central to these comparisons. Scholars argue that the printing press, much like the World Wide Web and other digital innovations, leveled the playing field and provided more access to information. Gutenberg’s invention allowed new knowledge to circulate, laying the groundwork for the kinds of discoveries that would define the Enlightenment. It helped produce the type of literary, philosophical, and scientific texts that would forever influence how humans discussed and perceived the world.
The problem is that print was not just used to spread intellectual freedom and new information. It was also complicit in acts of repression. As a prime example, Gutenberg’s press, while opening space for new religious ideas through the reformation, also helped launch the violence and censorship of the counter-reformation.
At the end of the day, the cultural values behind, and political uses of, a given medium affect the information it produces just as much as the physical technology that constitutes it. If we truly want to understand the transition we’re living now, the one that is taking us from books to digital platforms and from pages to screens, we must understand the cultural values behind these media formats. I believe the comparison between digital technologies and the rise of the printing press is incredibly useful. However, in order to understand the degrees of freedom and openness associated with the printed book, I propose we focus not on the physical technology of the printing press but rather on the cultural values behind the book, and particularly the perceived superiority of western alphabetic language. The rise of the printing press in a colonial context demonstrates how this perception operated. Situating the printed book in colonial Mexico (home to the first printing press in the Americas) allows us to grapple with what Walter Mignolo calls “the darker side of the renaissance.” Indeed, the story of the colonial Mexican book also provides a starting point to think about some of the darker sides, as well as the possibilities, of digital technologies.
Power and Language in Colonial Mexico
Power and Language in Colonial Mexico
Almost two decades after Hernan Cortés and his native allies captured Tenochtitlan (present-day Mexico City) in the name of the Spanish Empire, the bishop of New Spain requested that a printing press be brought from Europe to colonial Mexico. In order to understand why he issued such a request, we have to jump back to 1492. It’s the year Columbus famously arrived in the Antilles and also the year that Antonio Nebrija, a sixteenth century linguist and man of letters, wrote the first dictionary of the Spanish language. The bishop of Avila, commenting on this dictionary and the role of language in the Spanish empire, is said to have told Queen Isabel:
The dictionary, then, was recognized as a tool of empire. It would help spread an imperial language and culture. The first books that Europeans published in Mexico, with the help of indigenous scribes, translators, and printers, reflected this emphasis on the civilizing force of the dictionary. These texts are largely religious and linguistic ones. They are grammars, prayer books, and dictionaries, created in order to aid friars in the evangelization of the native population. Nebrija’s dictionary, and the cultural values behind it, informed the first years of print in Mexico and helped catalyze the colonization of Mesoamerican territory.
When the printing press was installed in the Americas for the first time, certain cultural hierarchies were installed along with it – namely, the perceived superiority of alphabetic Western languages and Christianity over indigenous cultures and forms of expression. When the Spanish arrived in present-day Mexico City, the Nahua indigenous population (the cultural group that made up the Aztec empire) employed a pictographic painting and writing tradition. In fact, in Nahuatl, the principle language of the Aztecs, the same word (tlacuilolizti) means ‘to paint’ and ‘to write.’ Pictographic methods were used for everything from record-keeping to songwriting to the documenting of religious ideas. The ‘paintings’ that expressed poetic or religious knowledge were often accompanied by oral interpretation, articulated by members of the political and cultural elite according to traditions that had been passed down through the generations.
When the Spanish arrived to Mesoamerica, they came from a Western culture in which alphabetic text was used to record facts and deliver linear narratives. European text, assembled in manuscripts and later in print, was often accompanied by illustrative mimetic images – images that sought to illustrate the world as the human eye saw it. Mexican pictographic documents were dramatically different. Pre-Hispanic codices (of which only 15 have survived due to destruction during the colonial period) were prepared on long strips of bark paper or hide and conveyed information through sets of image-based symbols. These glyphs signified objects, ideas, and names – sometimes by indicating a phonetic sound in that word and sometimes through metaphorical representations. Pictography generated knowledge through the diagrammatic and relational structures of sets of glyphs, as well as through the oral interpretations that specialists performed when reading these documents. European alphabetic writing, on the other hand, was designed as a linear sequence of symbols especially suitable for linear narrative structures. The alphabet is a glottographic system that represents, in the first instance, phonetic sounds that are then used to construct ideas. Pictographs, on the other hand, are primarily semasiographic, signifying directly through icons and signals without passing first through each phonetic sound of a word.
Despite the intricacy of pictography and its ability to express complex concepts, the majority of friars and conquistadores, upon viewing indigenous documents and symbols, saw only simple drawings. For them, glyphs, paintings, and symbols couldn’t possibly be equated with ‘real’ language. Language was built from letters that corresponded to phonetic sounds and grammatical rules. It was comprised of the structures that Nebrija had analyzed and disseminated in his grammar of the Spanish languages. Indeed, sixteenth-century humanists believed (as many writing specialists and historians do today) that textual methods express truth and reality more accurately than pictographic or oral ones and that the alphabet symbolizes a more advanced and civilized form of expression. However, text is not simply an improved way to communicate the same ideas more efficiently than using oral or pictographic methods. Mesoamericanists have demonstrated that these very different modes fulfill similar cultural, communicational, and aesthetic needs.
We can also look to our contemporary society to see the ability of image-based expression to convey complex and useful information. If pictographs represent a semasiographic (rather than phonetic or glottographic) system of symbols, so too do modern methods for representing music, choreography, mathematical equations, and data. The many signs that orient us in every-day situations, from emoticons and memes to traffic signs and the icons used in instructions are also pictographic in this sense – taking us directly to a concept without passing through phonetics.
Scholars from the semiotic tradition remind us that image-based and alphabetic symbols must both be considered communicative codes. In La Estructura Ausente, Umberto Eco affirms that the ability of image-based signs to function depends always on a set of shared cultural references between receiver and sender. Whereas linguists traditionally placed images outside of language (as an intermediary point between the textual ‘signifier’ and the conceptual ‘signified’) semioticians in the tradition of Umberto Eco, C.S. Pierce, and Charles W. Morris affirm that the ‘iconic’ or image-based sign does represent its own structure of communicating if and only if the cultural referents of these images are understood. Colonialism in sixteenth century Mexico severed the connection between pictographic expression and its cultural referents through destruction and transliteration. Dismissing indigenous documents as idolatry, many of these were destroyed in the first years of colonization. The first books published in Mexico, made up largely of Spanish-Nahuatl dictionaries and sermons translated into Nahuatl, are products of a transliteration process whereby Mesoamerican languages were re-encoded in alphabetic form.
Marina Garone Gravier, in her analysis of translation and typography in 16th century Mexico, reminds us that every transliteration is a destructive translation, insomuch as it disrupts the oral, time-based and visual elements of a language. In the Mexican example, transliteration occurred in a context of uneven power dynamics: a dominant culture retained the power to keep and discard certain elements of the language – choosing to retain elements that supported Spanish empire and culture. The colonial period gave rise not only to conflicts of armies and territories but also to what Mignolo describes as a “conflict of literacies.” Alphabetic and pictographic reading and writing methods collided, and the Spanish were determined to establish the hegemony of their text-based forms.
Hybrid Languages: from Codices to Motion Grahics
Hybrid Languages: from Codices to Motion Grahics
Although colonialism in Mexico led to the displacement of pictographic forms by alphabetic ones, this did not happen from one day to the next. Indeed, the initial encounter between European and native forms led to a brief period (or as anthropologist Serge Gruzinski calls it, a ‘renaissance’) of hybrid communicational codes. The hybridity in colonial media of the sixteenth century parallels, and helps us to understand, the hybridity and remixes that define digital media today. Colonial texts and digital platforms combine methods from previously separate media, creating entirely new and remixed visual languages.
The production of texts in the first decades of colonialism depended on the collaboration between indigenous and Spanish agents (printers, writers, painters, scribes, and translators). The various genres of colonial documents – from translations of Christian doctrine to encyclopedias of indigenous history to records of legal cases – required combinations of Mesoamerican and European knowledge. The College of Santa Cruz de Tlatelolco presents an emblematic case of such collaborations. Here, the sons of the Nahua elite were taught by friars trained in the humanist European tradition. These Nahua students became trilingual in Nahuatl, Spanish, and Latin, and worked alongside friars to record and document indigenous traditions in the scriptorium of the school. Texts that emerged from such contexts contain combinations not only of content but also of writing methods that were borrowed from systems that had never encountered each other before.
In some of the earliest attempts at evangelization in colonial Mexico, European friars appropriated elements of pictographic writing to create their cartillas or prayer books. In these small pamphlet-like books, friars utilized what they had learned about Nahua forms to make up their own pictorial system, in which various glyphs represented Christian words and concepts. The glyphs are arranged, however, in a linear sequence (as alphabetic letters would be arranged). Early cartillas combined the linearity of alphabetic text with the pictorial style of Mexican pictography. This same combination of alphabetic linearity with Mesoamerican pictographs can be see in the representations of years (which were portrayed as glyphs rather than numbers) in Nahua histories. Early sixteenth century documents show the glyphic signs for years assembled in many different spatial patterns on the page – but, in the later parts of the century, these histories adopted alphabetic-style left to right and top to bottom arrangements.
Depictions of nahua traditions in the Florentine codex combine mimetic and pictographic styles to create a new visual language. The images in this famous chronicle of Mexican history, assembled by Bernardino de Sahagún along with students at the College of Santa Cruz, are largely mimetic. They tend to utilize European conventions of three dimensional space that are not found in traditional Mesoamerican symbols. However, some of these images do include glyphic elements. These elements are not simply illustrative or decorative. As Boone notes in her analysis of the codex, they “retain their indigenous function as glyphic signifiers.” In such cases, the ‘writing’ method for both kinds of images are combined as well as their reading methods – as one can read such images for their glyphic and mimetic content at the same time.
In one final example of colonial hybridity, the reading styles associated with pictographic symbols can be found alongside those associated with alphabetic text in the Codex de la Cruz Badiano, a medical book based on the practices of Martin de la Cruz, an indigenous doctor. Although this text had been regarded by many historians of medicine and science as a typical European work of the herbal genre, Millie Gimmel argues that these scholars have overlooked its biculturality. This hybridity of cultural forms expresses itself not only in its conceptions of medicine and the body but also in its hybrid reading practices. The images that accompany the alphabetic names of medicinal plants can be seen on one level as traditional, European-style images. However, Gimmel argues that some of these can also be interpreted as pictographic symbols. These symbols contain a wealth of information about the plant, as a glyphic symbol would. For example, the illustration for one plant whose Nahuatl name translates to “snake fruit” depicts two snakes eating the fruit, signifying the plant’s name without the need for alphabetic writing. The image also reveals information about the plant’s habitat that is not contained in the text. Gimmel argues that such images represent a specifically Mesoamerican reading practice: “a native reader/interpreter could discern information about these plants and their habitats without actually reading the alphabetic script.”
Just as the colonial encounter provided a platform for new combinations of formerly separate communicational strategies, the software environments of a digital age provide a platform for new combinations of formerly separate media techniques. This type of hybridity in digital media content is perhaps most clearly elaborated by theorist Lev Manovich, who has analyzed the “logic of deep remixability” that operates in a media software context. According to this logic, it is not just the contents of separate media that are remixed, but the techniques associated with them.
Manovich begins his chronology of digital hybrid media with the ideas of Alan Kay, the influential engineer who developed the Sketchpad program in the early 1960’s. Kay imagined the computer as a ‘metamedium’ where existing and new media could be simulated and utilized. This has become a reality: one can simulate both older media (photographs, films) and newer forms (3D animation and modeling, GIS systems) in a personal computer. Manovich argues that once media could be simulated in the same environment, they created hybrids: new visual languages that have re-defined narrative and communicational possibilities. These hybrids occur not because the content of these media are combined (as they might be in collage-based works) but because their techniques are combined. In a simulated media environment, a ‘technique’ (like applying color filters to a photograph, or laying out text on a page) becomes an algorithm that can be applied to many different kinds of media formats.
One example of this type of hybrid media can be found in digital books. Techniques associated with other media can now be applied to the pages of a book or article. A user can zoom in as she would with an image, or seek out particular words and phrases as she would in a database. This creates a new sort of experience that combines writing and reading methods from different forms. As Mathew Kirshenbaum has noted, “books on the screen are not books, they are models of books.” There is no single 'corrrect' way to model a book in the digital space, according to Kirschenbaum. Rather, the digital book allows for a range of hybrid reading experiences that echo both the traditional book and various screen-based information formats.
For Manovich, the most emblematic hybrid language of our media context can be found in the genre of motion graphics. Motion graphics refers to the contemporary visual language of moving image production: a language that incorporates elements of animation, graphic design, and traditional cinema. This genre grew out of artists’ use of Adobe’s revolutionary After Effects software. After Effects offers an interface that allows users to combine layers of images across a timeline. It’s a kind of Photoshop that moves in time, creating limitless possibilities for remixing still and moving visual media from typography to still photography to traditional live action footage to 3D animation. Techniques are easily remixed as well: motion blur (once specific to photography) can be applied to computer graphics, animated movement can be applied to typography, changes in opacity and colors associated with graphic design can be applied to film, etc. As in our colonial examples, this hybridity does not occur through writing methods but through reading ones as well. Motion graphics have produced a new visual literacy: in the minute-long span of a commercial spot or a title sequence we ‘read’ elements from formerly separate genres: creative lettering associated with typography and print design alongside cuts associated with experimental film alongside hyperrealism associated with fashion and documentary photography. If, in the colonial period, formerly separate visual strategies collided in the scriptoriums of the College of Santa Cruz, they are once again colliding in After Effects and digital environments.
Coloniality and Possibilities in a Digital Age
Coloniality and Possibilities in a Digital Age
Although the digital manifestations of hybrid visual languages begin with thinkers like Alan Kay, there are clear antecedents to this type of visual language that can be found in colonial Mexico. Thinking about digital media alongside colonial contexts provides us with both possibilities and warnings for this (second) age of hybrid media. Power has been built not just through wars and armies but also through the systematic privileging of some languages, cultures, and forms of expression over others. Mignolo argues that the foundational ideas of our modern world are based not only in enlightenment ideals but also in ‘coloniality’, the underside of our modernity. Drawing from philosopher Anibal Quijano’s use of the word, Mignolo’s ‘coloniality’ refers not to colonialism as an event that occurs before modernity, but rather as a part of its very essence, a constant underpinning that defines it and its structures of thought. The biases of coloniality remain essentially the same from the Christian theological discourse of the sixteenth century to the political and economic discourses of today. One of these biases is the preference for Western cultural forms over others. Many scholars continue to uphold a strong distinction between writing and drawing, as well as a bias against image-based documentations of history. Additionally, the precarious situation of indigenous ‘endangered’ languages, territories, and peoples shows us that we are still witnessing the effects of colonial decisions to displace native forms.
The experience of colonialism warns us that the hegemony of certain expressive forms does not fade quickly and can lead to devastating results, uprooting communication systems (like Mexican pictography) from their communities and chasing indigenous languages to extinction. If, as Gruzinski puts it, the renaissance of hybrid communication in sixteenth century was “smothered by the colonial machine,” these histories can warn us against the machinery of power in our own context. We must be vigilant against communication standards that stifle experimentation and hybridity in visual languages. Indeed, colonial histories teach us that decisions to privilege one communicational code over another often have more to do with power than efficiency or rationality. If innovation is as important to digital culture as the leaders of the tech world profess, a knowledge of the colonial past is crucial for understanding how experimentation in media can be quashed by the dictates of powerful individuals and structures.
In addition to these dangers, we must be aware of the openings and possibilities offered by hybrid digital media. I believe that the emergence of hybrid visual languages in our digital age provides an opportunity for interrogating the divisions between text and image-based forms as well as for challenging the biases that were established against pictographic methods. History, political thought, and journalism are no longer rooted in traditional textual forms. Alphabetic text no longer functions as an uncontested platform for knowledge production: newspapers open themselves up to social media platforms, popular political criticism is expressed and shared massively in memes and gifs, searchable galleries of image-based records and crowd-sourced websites provide us with historical context. These changes may provide an opening to imagine writing as something that exists independently of the alphabet and to affirm, as Mignolo writes that “the history of writing is not an evolutionary process driving toward the alphabet, but rather a series of co-evolutionary processes in which different writing systems followed their own transformations.” Colonialism and other encounters may have provided the original “remix”, but if we can embrace the multiplicity of hybrid forms of this remixed digital age, perhaps we can also embrace the multiplicity of experiences and communicational codes that exist in our globalized world. The hybrid ‘metamedium’ of digital platforms, where many media and genres exist together, may provide precisely the platform needed to “construct a world in which many worlds can exist.”