Home

HomeChapter 08 / 8A grounded roadmap

Source analysis

459 words · 3 min read · Arsh Shah

Future work

What the next study could reveal

Seventeen sessions are on record. Participants themselves expect engagement to fall, and two of them named a missing action: hold water. Grow the vocabulary they asked for. Then ask whether the instruments used to evaluate systems like this can carry what they are asked to carry.

Hold water, colour, duration — and instruments that can carry experience

Commandable arrest already has a name. A colour condition is the factor this protocol held constant so it could not become the operative variable. Longer exposure is the only test of the exhaustible-mapping account: if engagement rests on calibrating an open mapping, it should decay on a timescale set by how long that mapping takes to solve. Participants talking about novelty decay, or about figuring the mapping out, does not mean they actually exhausted it. Those are design experiments. Behind them sits a measurement one.

The largest open question this study raises is not about RowSim. It is whether the instruments used to evaluate systems like it can carry multifaceted constructs of experience without flattening them into a sentence one is asked to agree with. Nagel’s point is that a complete third-person account leaves untouched what it is like to be the organism.[089] Polanyi’s is more compact, and more relevant to a questionnaire: we can know more than we can tell.[094] Where the thing to be reported exceeds the vocabulary available for reporting it, what comes back is not a smaller version of the experience but a different kind of object.

Dijkstra stated the computer-science version: the purpose of abstracting is not to be vague, but to create a new semantic level at which one can be precise.[036] RowSim’s display is an abstraction in that sense — exact at a level other than the numeric one. The instrument used to evaluate it works only at the level of nameable propositions. Dunne and Raby write that design usually ignores dark, complex emotion and treats people as obedient, predictable users.[042] A five-point agreement scale is that view in instrument form. Isbister, Höök, Laaksolahti and Sharp’s sensual evaluation instrument is one existing alternative: oblique, embodied, not a sentence.[064] The next study should treat the interview as the primary instrument for experiential constructs, and the scale as the secondary one, rather than the reverse.[089] Zimmerman, Forlizzi and Evenson’s research-through-design stance is the publication form that can carry that reversal.[138][Th.]

Evidence first

The loop is closed.

01 · ProtocolREB 2025-8251 and the single-condition design ran: seventeen sessions on one floor.

Fig. 08.1

ASCII field for the empirical loop: the protocol ran, seventeen sessions are on record, measurement is next.

Instrument GPU frame time

Ingest is measured. GPU frame time is available from the command-buffer handler and was not logged.[004] State-to-photons needs an external camera. Log the first; design the second.

Measurement

Benchmark before vocabulary.

01 · InstrumentIngest is measured. Log GPU frame time next; state-to-photons needs an external camera.

Fig. 08.2

Bayer dither of the critical path — instrument timing before expanding features.

Keep the seam visible

Implemented claims, empirical claims, and the remaining display-path gap stay labeled differently. The next study should reveal more because the packet got stronger.

Roadmap

More measurable before more complex.

01 · EvidenceThe empirical loop is closed under REB 2025-8251. Vocabulary they asked for first; then GPU frame time.

Fig. 08.3

8-bit ROWSIM title card for the roadmap order: loop closed, then measurement, then vocabulary.

Works cited

Superscripts use the thesis bibliography number. Click a number to return to the first mention.

  1. [089]

    Thomas Nagel (1974).

    What is it like to be a bat?.

    The Philosophical Review, 83(4), 435–450.

    doi:10.2307/2183914

  2. [094]

    Michael Polanyi (1966).

    The Tacit Dimension.

    Doubleday.

  3. [036]

    Edsger W. Dijkstra (1972).

    The humble programmer.

    Communications of the ACM, 15(10), 859–866.

    doi:10.1145/355604.361591

  4. [042]

    Anthony Dunne and Fiona Raby (2013).

    Speculative Everything: Design, Fiction, and Social Dreaming.

    MIT Press.

  5. [064]

    Katherine Isbister, Kristina Höök, Jarmo Laaksolahti, and Michael Sharp (2007).

    The sensual evaluation instrument: Developing a trans-cultural self-report measure of affect.

    International Journal of Human-Computer Studies, 65(4), 315–328.

    doi:10.1016/j.ijhcs.2006.11.017

  6. [089]

    Heather L. O’Brien, Paul Cairns, and Mark Hall (2018).

    A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form.

    International Journal of Human-Computer Studies, 112, 28–39.

    doi:10.1016/j.ijhcs.2018.01.004

  7. [138]

    John Zimmerman, Jodi Forlizzi, and Shelley Evenson (2007).

    Research through design as a method for interaction design research in HCI.

    Proceedings of CHI 2007. ACM.

    doi:10.1145/1240624.1240704

  8. [004]

    Apple Inc. (2024).

    Metal: Documentation and programming guide.

    Apple Developer Documentation.

    Link

  9. [Th.]

    Arsh Shah (2026).

    RowSim: Designing and Evaluating Ambient Interaction in Mixed-Reality Rowing.

    Master’s thesis, Dalhousie University, Halifax, NS.

    §6.4, ch. 7hdl.handle.net/10222/86331PDF