our approach

We aim to introduce a non-narrative (no textual, verbal or video) approach to communicate scientific processes.


challenges at biological laboratory

scientistTranslation of basic stem-cell research into therapeutics demands reproducibility and identification of subsequent experimental processes variations, in order to assure cellular quality and efficacy. However, many methodologies of stem cell research remain highly idiosyncratic; and the traditional narrative (textual, verbal or video) approaches still lack the ability to identify or assess process variations.

capturing laboratory process variations

PN_text_logoProtocolNavigator, which is a virtual laboratory environment where researchers can emulate their laboratory activities, and the software automatically annotates the practice or activities and depicts a time-integrated interactive experimental map, that includes action patterns, manipulations and data acquisition icons. Interlinking and traversing through this map, a provenance trail for samples becomes apparent and the underlying process emerges visualised across a timeline. Learn more about ProtocolNavigator

converting to OSC messages

osc_iconWe have developed algorithms that automatically converts ProtocolNavigator captured laboratory processes into open sound control (OSC) messages.  Through ProtocolNavigator we basically capture the provenance information of the sample (stem cell). Provenance embodies the history of an object or data with chronological description of the 5Ws – who, where, when, what and why. Provenance has been extensively used in the manufacturing industry to determine the quality of a product, by providing better interpretation, assessment, attribution and authentication via these 5Ws.

parameter mapping and sonification

Screen Shot 2015-02-20 at 18.55.43Extensive parameter mapping were undertaken on the multi-dimensional provenance information (eg. activity, location) into auditory dimensions (eg. pitch and rhythm) to facilitate the auditory perception for laboratory process interpretation. The goal has been to generate a language independent approach so that researchers from any discipline can abstract knowledge and discover relationships between process variation and sample quality.

musical mapping

An interdisciplinary team consists of sonification experts, musicians, biologists, social scientists and bioinformaticists converged and mapped laboratory activities and the interactive musical system.  We have developed algorithms that sonify these provenance trails and map them into compositions. Basic musical process have been designed that respond to the OSC messages and process or generate new musical material.

Bellow are some common laboratory activities and their associated music.  All examples are in relation to six well plate.

stockSeed: Cells are put into wells with certain density (mapping)


Incubate: whole plate is placed in incubator at particular temperature incubatorand time period (mapping)


treat Label: labelling cells with chemical labels (mapping)


Picture1 Wash: cells washed with fresh medium (mapping)


Picture2Transfer: samples are transferred from one location (well) to another (tube). (mapping)


Picture3Measure: experimental effect on the sample measured via instruments.  In this case by flow cytometer. (mapping)


Labelling with Quantum Dots 

Two alternate experimental designs for the labelling stem cells with quantum dots -Continuous sampling vs. Staggered seeding. For continuous sampling cells were seeded in all 6 wells at time 0h and then labelled with quantum dots and measured at different time intervals. For staggered approach cells were seeded at different time intervals while measurement was carried out at the end of the experiment.

In the video, top panel shows the design of the experiments captured and depicted via ProtocolNavigator, while the bottom panel shows the status of the wells (orange colour) where activity is undertaken.

Continuous sampling

 Staggered seeding




Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s