Sensing Data: Encountering Data Sonifications, Materializations, and Interactives as Knowledge Objects

Abstract

Digital and networked media are characterized by a fundamental disconnection between the modes of operating of these media, the human sensorium and knowledge. In order for humans to consciously participate in this expanded domain of sensibility, additional mediation is required to ‘presentify’ what is not accessible to human perception. This situation has motivated the creation of manifold ‘data objects’ in the form of visualizations, soundscapes and sonifications, 3D materializations, and data-driven interactives in the neighboring domains of art, design, science, and humanities scholarship. These new knowledge objects, as we propose to call them, both produce and mediate knowledge in the process of making data experienceable. They turn that what essentially does not correlate to human sensory capacities into something that the human sensorium is capable of engaging with. As such, they can play a crucial role in providing access, and thereby modalities of critical and creative relating, to what Hansen (2015) describes as the expanded domain of sensibility. Yet, the effects and implications of the sensory specificities of these knowledge objects remain underacknowledged, as are the potentials of these modes of presentifying data. Here, we explore and compare a diversity of such knowledge objects and look at their different media modalities and different experiential qualities, and how these afford ways of knowing.