wearable x-osc biometric prototype; observer / observed problem, and characteristic time

[ Synthesis:  This recent thread recaps a discussion about what sensors are sensing, the observer / observed problem, and characteristic time.  - Xin Wei ]

From: Adrian Freed [mailto:adrian@adrianfreed.com
Sent: Friday, August 15, 2014 8:28 AM
To: Vangelis L; Vangelis L; marientina.gotsis@gmail.com; John MacCallum; Sha Xin Wei

hi, Vangelis, Marientina

John and Teoma may bring this box of goodies down to show you. It is a quick prototype for them to experiment with to help them figure out what they need for their IRCAM project. It has an x-OSC with imu, analog devices 2-lead EKG chip and inputs for a handmade respiration sensor based on EEonyx fabrics and an ear-clip pulse sensor (https://www.sparkfun.com/products/11574).

Obviously I would build something more substantial for regular use but this should suffice for building the signal processing and evaluating the sensors.

Incidentallally, Marientina it occurs to me that an ear lobe pulse sensor has a lot of potential for the large scale walking meditation experiments you discussed. It gives a muscle-noise free pulse signal and somebody must have created a BLE earring by now? Intel is building this kind of sensor into earbuds:http://www.sfgate.com/technology/article/50-Cent-Intel-team-on-heart-beat-headphones-5690650.php
<image001.jpg>


==================================================

On Aug 18, 2014, at 3:33 AM, Sha Xin Wei <shaxinwei@gmail.com> wrote:

Motivated by the same “curiously skeptical” judgment, I decided form the get go that the TML would avoid “physiological" sensors.
The practical ethical problems far exceeded any artistic or scientific or pedagogical contribution I could imagine us making.   In fact, the main pedagogical contribution was and is Adrian’s observation.

On a different, related matter:

As for CO2, or other gas sensing — I advised a former colleague who was just getting into that in one of his installation pieces that there are a lot of molecules out there in a typical room, and the room’s CO2 levels don’t change all that fast due to breathing bodies, even if you stuff a bunch of them onto pallets in a room and make them watch pseudo-mystic videos.  The characteristic time of changes from such aggregate sensing is much longer than the characteristic time of a human twiddling thumbs waiting for something to happen.   (I think the statement is true whether thumbs are twiddled mentally or with physical tendons.)    In and fact, it was so.

How can young artists get a feel for material experiment?

Xin Wei


==================================================

On Aug 18, 2014, at 5:05 AM, Adrian Freed <adrian@adrianfreed.com> wrote:


On Aug 18, 2014, at 3:33 AM, Sha Xin Wei <shaxinwei@gmail.com> wrote:

The characteristic time of changes from such aggregate sensing is much longer than the characteristic time of a human twiddling thumbs waiting for something to happen.   (I think the statement is true whether thumbs are twiddled mentally or with physical tendons.)    In and fact, it was so.

Yes, this notion of characteristic time is a good one and raises some interesting questions philosophers have looked at such as whether there are kinds of perception and knowings (consciousness) that people (and larger things such as biospheres and the universe) can have that operate over much longer or much shorter time frames
than we are commonly familiar with.

How can young artists get a feel for material experiment?

I believe John and Teoma are planning to do this by producing events that experimentally coarticulate the materialities of performer bodies (dance, musicians)
and the materialities of sound (yes, I am rejecting important arguments for the immateriality of sound and music). The challenge for them is how
to notice interesting results through the blizzard of ungrounded hermeneutic noise wearing the seductive,  rose glasses of technique? This noise is what the use of biosensors produces. Technique frames everything by its regimes of discipline and control. Material agency is thus able to slip unnoticed out of the scene
and go down the road for a good drink at the local pub.


==================================================

On Aug 18, 2014, at 5:53 AM, Sha Xin Wei <shaxinwei@gmail.com> wrote:

Seriously, how do we think techniques of observation together 
with techniques of performance?  I know it may be confusing to use those pair of terms -- observation and performance...  

we need a better vocabulary that retains some of the mechanisms of entanglement from quantum mechanics, but not this dualism.

Xin Wei


==================================================

On Aug 18, 2014, at 7:00 AM, Adrian Freed <adrian@adrianfreed.com> wrote:

Teoma has done a nice job in this piece we just finished recording ("X") of expressively challenging that dualism with numerous
ambiguous framings and reframings of the gaze - a productive place to confront the problems of observation/performance.

How do we move past this stage of exploring and celebrating this difficulty?

All I have to offer so far on the "better vocabulary" front is to account for the fragilities of intersubjectivity
(the process that coproduces performance and observation) using the metaphor of a contract. I haven't unpacked this much
in solid writings yet.


==================================================

On Aug 23, 2014, at 11:53 AM, Adrian Freed <adrian@adrianfreed.com> wrote:

I would add that the observation/performance pair problems are connected to the problems of signal/noise - both dependent
on POV and preschema. Another tactic I have started to explore is the material agency of "lenses" (or filters as lenses are framed in the signal processing literature). This points to bringing in the material aspects of intersubjectivity - one of the key conundrums of quantum theory that has had to invoke a lot of magic around the macroscopic and microscopic properties
of "apparatus" to keep the rest of the theory coherent.


==================================================

On Aug 23, 2014, at 12:02 PM, Adrian Freed <adrian@cnmat.berkeley.edu> wrote:

Vangelis has been tracking the ready-to-wear IMU space more carefully than I.
I am hoping IMU's are a temporary bootstrap and that we will have less encumbering techniques with
absolute position measurements such as the upcoming Sixense Stem system.

My fear is that we will be surrounded by even cheaper, slower,  uncalibratable IMU's before the situation
improves substantially.

Keep an eye out for the next-gen x-OSC with a built-in charger and better IMU.

==================================================

Jonathan Sterne on materiality

Hi

Dehlia — As a tangent from your tangent about the material turn, here’s Jonathan Sterne’s essay, “What Do We Want?” “Materiality!” “When Do We Want It?” “Now!”  ( http://sterneworks.org/Sterne--Materiality.pdf )

Maybe we could use it as a survey in a course on technology someday...

Ed and David — in the same essay as an aside Jonathan makes some comments about forms of writing (e.g. book, journal article), and event (e.g the seminar, or music lesson) :

"Geoff Bowker’s materialist and somewhat scary analysis of our own situation in the production of knowledge is quite telling. As he surveys the every-grow- ing glut of journal articles, each of which has a smaller and smaller audi- ence, he sees: “We are clearly not creating a species of knowledge-power appropriate to the issues that we face. We are producing knowledge that is predicated on and replicates mass production and mass consumption. Our information infrastructure, willy-nilly, is the fold in the Moebius strip that permits the world to seem as society writ large” (chapter 5, this book). The declining relevance of the journal article as the materialization of schol- arly knowledge, and the uncertain struggle to find alternatives, demands a certain patience, since if there is a new form of knowledge coming, it hasn’t yet arrived. Bowker finds some hope in massive collaborations and new database logics. For my part, I retain some confidence in the resiliency of both the essay form and the codex, which have thrived for hundreds of years. Meanwhile, the journal article seems to undergo transformations every two or three decades.

Boczkowski and Siles turn more hopefully to pedagogy as a solution, get- ting students to work across disciplinary categories. If I still believe in the book and the essay, I still believe in the seminar even more. I am experi- menting with disallowing rehearsals of “technological vs. cultural deter- minism” arguments in my classes and exams. It’s harder than it sounds, especially when the rhetoric of techno-utopianism is alive and well in the commercial world and still operates in the truth spaces of journalism and online discussion. It’s also difficult given how much this comes up in cultural analyses of technology of whatever stripe. But if we want to get beyond the argument, our students stand a better chance of succeeding than we do, so it’s up to us to stop trying to reproduce it, even as a historical curiosity. At the graduate level, my seminar on the historiography of new media in winter 2013 takes Boczkowski’s approach to the extreme, though my model is less the social scientific diagram (with its quadrants) than the record collection with its eclecticism. Students will select the topic of their semester’s research at the beginning of the term and each week retrieve a primary source relevant to it. Each week, they will also read a distinc- tive work of media historiography (mostly books, since that is still the core traffic in the field). They will then write about their artifact in the style of the author, which requires them to determine what the important stylistic aspects of the work really are. At the end of the term, the students can then revise these short papers into something longer, synthesized into some- thing approaching their own authorial style. The approach is meant to encourage openness to other ways of writing and thinking, to free students of the pressure to take positions as their own against the positions of oth- ers, and to challenge them to reverse-engineer the work of other scholars so that they get a better sense of what’s actually involved in the interface between writing and thought. The pedagogy imposes some strict limits and demands for imitation (at first) to encourage creativity by freeing students of the demand for creativity in the places we usually look for it (choice of object, originality of voice, etc). It is drawn from how musicians learn their instruments: when I wanted to learn to play a good bass line, my teachers had me learn to imitate what the best bassists did. I either succeeded and incorporated their techniques with my own, or failed and came up with something original-sounding in the process.”

pp 126-127


__________________________________________________________________________________
Professor and Director • School of Arts, Media and Engineering • Herberger Institute for Design and the Arts • Synthesis • ASU • +1-480-727-2846
Founding Director, Topological Media Lab / topologicalmedialab.net/  /  skype: shaxinwei / +1-650-815-9962
__________________________________________________________________________________

Fwd: wearable x-osc biometric prototype (Was: Wireless sensor networks)

Hey everyone,

I would like to invite John MacCallum and Teoma Naccarato to come workshop their project at iStage,
bringing the wearable  x-osc biometric prototype that Adrian built in Berkeley. 

When?  I don’t know.  It will be up to the local host here at ASU to determine if and when John and Teoma can come.    Ideally the host could be a combination of Dehlia, Chris Roberts, and Kristi … Or ?

Chris Ziegler will be busy with the lighting workshop — which I think should be scheduled for late October because that’s when Omar is available, and that gives us more time to prep for the ASU-wide event focused on AME and Synthesis, assisted by the Deans and OKED.

Xin Wei

PS Dehlia, Chris, Kristi.  I’m going to start feeding you the research chatter for this OTHER and older stream of research at SYNTHESIS:  movement, improvisation and responsive environments.  This will expose cutting edge work on movement by very accomplished set of collaborators in TML Montreal, CNMAT Berkeley, USC Los Angeles, IRCAM Paris, and AME.   There’s a lot to absorb.  I suggest that you and everyone cc’ing chatter worth re-reading by mates in subsequent years in post@synthesis.posthaven.com 



__________________________________________________________________________________
Professor and Director • School of Arts, Media and Engineering • Herberger Institute for Design and the Arts • Synthesis • ASU • +1-480-727-2846
Founding Director, Topological Media Lab / topologicalmedialab.net/  /  skype: shaxinwei / +1-650-815-9962
__________________________________________________________________________________



Begin forwarded message:

From: Adrian Freed <adrian@adrianfreed.com>
Subject: wearable x-osc biometric prototype
Date: August 15, 2014 at 8:28:02 AM MST

hi, Vangelis, Marientina

John and Teoma may bring this box of goodies down to show you. It is a quick prototype for them to experiment with to help them figure out what they need for their IRCAM project. It has an x-OSC with imu, analog devices 2-lead EKG chip and inputs for a handmade respiration sensor based on EEonyx fabrics and an ear-clip pulse sensor (https://www.sparkfun.com/products/11574).

Obviously I would build something more substantial for regular use but this should suffice for building the signal processing and evaluating the sensors.

Incidentallally, Marientina it occurs to me that an ear lobe pulse sensor has a lot of potential for the large scale walking meditation experiments you discussed. It gives a muscle-noise free pulse signal and somebody must have created a BLE earring by now? Intel is building this kind of sensor into earbuds: http://www.sfgate.com/technology/article/50-Cent-Intel-team-on-heart-beat-headphones-5690650.php
                                         

Synthesis lighting research cluster / responsive environments

Dear Chris, Omar,

In the responsive environments research area:

Let’s start gathering our notes into a Posthaven — for now use 

Kristi can help summarize once a fortnight  or so...








__________________________________________________________________________________
Professor and Director • School of Arts, Media and Engineering • Herberger Institute for Design and the Arts • Synthesis • ASU • +1-480-727-2146
Founding Director, Topological Media Lab / topologicalmedialab.net/  /  skype: shaxinwei / +1-650-815-9962
__________________________________________________________________________________

Re: good comparison of IMU's and sensor fusion source

cool. thanks. Adrian suggested last year a ready-to-wear IMU that went for ~ $200- $250. Can’t recall the make. Xin Wei

On Aug 22, 2014, at 7:11 PM, Vangelis Lympouridis <vl_artcode@yahoo.com> wrote:

That's great! Thanks a lot Adrian.

Vangelis Lympouridis, PhD Visiting Scholar, School of Cinematic Arts University of Southern California

Senior Research Consultant, Creative Media & Behavioral Health Center University of Southern California http://cmbhc.usc.edu

Whole Body Interaction Designer www.inter-axions.com

vangelis@lympouridis.gr Tel: +1 (415) 706-2638

-----Original Message----- From: Adrian Freed [mailto:adrian@cnmat.berkeley.edu] Sent: Friday, August 22, 2014 10:47 AM To: Xin Wei Sha; Vangelis L Cc: John MacCallum Subject: good comparison of IMU's and sensor fusion source

https://github.com/kriswiner/MPU-6050/wiki/Affordable-9-DoF-Sensor-Fusion

Wireless sensor networks

FYI see Adrian’s response re McGill's Sensestage miniBee gadgets.

I know the guys who did the SenseStage work at McGill from Marcelo’s lab.  
They were nice folks, but not the best, and the research application was misguided.
This device was not useful to advance movement / gesture research at the TML.

To check my own assessment, I asked Adrian.

If you want to buy them on your own research funds, chacun à son goût :)
But I would prefer not to throw general AME or Synthesis money at buying such things
unless there’s a specific legacy need for a critical research project that will lead to an concrete outcome in predictable future.

Otherwise, let me suggest that we track the state of the art with Adrian Freed <adrian@cnmat.berkeley.edu>
and Vangelis Lympouridis <vangelis@lympouridis.gr> in USC
and get the best devices for the job under cost time constraint just when we need them.

Cheers,
Xin Wei



Begin forwarded message:

Subject: RE: Fwd: Wireless sensor networks
Date: August 22, 2014 at 7:07:02 PM MST
To: "Sha Xin Wei" <shaxinwei@gmail.com>

I am sure they are good for something but I can't use them for various
reasons.
They just aren't reliable enough unless the performers are out of reach
of RF noise from the
audience/ambient sources.

+ Slow, old atmega cpu with too little memory,
+ old accelerometer instead of full IMU.

There are lots of smaller form factor things in the works like SparkCore
and all the bluetooth LE things coming out.
The problem is you have to look at the fully integrated size with
battery, the additional sensors you actually want, the case
etc etc. Small is 6 months away (BLE), small and fast enough for serious
movement work is still a few years away.

Sixense is a company getting this right with stem:
http://www.sixensestore.com/stemsystem-2.aspx

-------- Original Message --------
Subject: Fwd: Wireless sensor networks
From: Sha Xin Wei <shaxinwei@gmail.com>
Date: Fri, August 22, 2014 3:36 pm
To: Adrian Freed <adrian@adrianfreed.com>


Are these xBees any good?   would these be superseded by other common wireless microprocessors …?

We (at Synthesis and AME) are happy with the xOSC boards,
tho I do hope for a much smaller form factor.   

...
Xin Wei

[Synthesis] [TML] Founding documents of an atelier for ethico-aesthetic play: What we do. How we do it. Why we do it the way we do.

Dear Chris, Dehlia, Kristi, and Tamara,
(Hi Katie, Omar and JA, who know this well!)

Here are some texts that describe more completely how I envision what Synthesis is about, and how I would like it to be a home for radically empirical, ethico-aesthetic play.  I have developed a progressively more nuanced notion of play over the past decade of institutional experiment, funded thanks to the Canada and Quebec's more generous attitude toward experimental cultural work.

(1) The opening chapter of Poiesis, Enchantment, and Topological Matter (MIT Press 2013): 
gives a sense of how I see philosophical inquiry (which is not the same as philosophy as practiced conventionally in the United States academy) comes out of and feeds back into poetic, speculative practice.

(2) The second part of Chapter 7 gives an analysis of the political economy of the amodern atelier that I established in 2001 at Georgia Tech (in the Graphic Visualization and Usability Center, and the School of Literature Communication and Culture), but then moved to Montreal in 2005 with a Chair in critical studies of media arts and sciences in the Fine Arts and Computer Science.   My key meta-goal for the past 15 years has been to create an alternative ecology of practices based on collective, poetic knowledge practices.   I regard FoAM to be the lovelier sister to the Topological Media Lab.

This predecessor version links to a set of colour plates.

With the Synthesis Center I want to extend both the TML's central research streams and its model for how to go about doing that sort of transdisciplinary work.   To be very clear I came back to the States not to slip back into more conventional interpretations and practices of technology, art or humanities, but to harness Yankee enterprise to the much more radical work of ethico-aesthetic improvisation.   (I use radical both in its political sense and in the sense of William James’  radical empiricism.)

(3) Here are two one-page letters written at the invitation of the President of Concordia University about art practice versus art research.  They are not the same.  Many confusions abound here at Herberger as well.

 

(4)  Here’s the Synthesis Center pitch.   I invite your help to polish it before sending it up to the Provost and Engineering Dean. --- in the coming week




(5) Working ethos


(6) And finally, a letter that I share with people who want to study or work with me. 

Hope this gives you a more complete and substantial understanding of what I would like us to do, and why I would like to do it in certain ways.

I sincerely hope that after mulling this over, and considering that this has already actually flourished in two contexts, you will feel inspired to help me realize a third and even more beautiful atelier here at ASU.

Looking forward to working with you!
Xin Wei


__________________________________________________________________________________
Professor and Director • School of Arts, Media and Engineering • Herberger Institute for Design and the Arts • Synthesis • ASU • +1-480-727-2146
Founding Director, Topological Media Lab / topologicalmedialab.net/  /  skype: shaxinwei / +1-650-815-9962
__________________________________________________________________________________

Re: wearable x-osc biometric prototype

Seriously, how do we think techniques of observation together with techniques of performance? I know it may be confusing to use those pair of terms -- observation and performance...

we need a better vocabulary that retains some of the mechanisms of entanglement from quantum mechanics, but not this dualism.

Xin Wei

[Synthesis] Portals needed

Hi!

We need portals supporting concurrent conversation via common spaces like tabletops + audio… (no video!)
not talking-heads.     It may be useful to have audio muffle as a feature — continuous stream audio, but default is to  “content-filter” the speech.   (Research in 1970’s … showed which spectral filters to apply to speech to remove “semantics” but keep enough affect…)

Maybe we can invite Omar to work with Garrett or Byron or Ozzie to install Evan’s version in the Brickyard and Stauffer and iStage as a side effect of the Animated spaces: Amorphous lighting network workshop with Chris Ziegler and Synthesis researchers.

BUT we should have portals running now ideally on my desk and on a Brickyard surface.  
And that workshop remains to be planned (October ??)
And possibly running also on the two panel displays re-purposed from Il Y A — now moved to Stauffer...

Xin Wei


__________________________________________________________________________________
Professor and Director • School of Arts, Media and Engineering • Herberger Institute for Design and the Arts • Synthesis • ASU • +1-480-727-2146
Founding Director, Topological Media Lab / topologicalmedialab.net/  /  skype: shaxinwei / +1-650-815-9962
__________________________________________________________________________________

[TML][Synthesis] Plant-Thinking Meeting/Seminar: discuss Marder, November 1 - Dec 19 ?

Hi Michael, everyone,

All great! 

I’ve been talking with Oana and most recently Omar about the vegetal studies research
From Omar it seems that most of the interested folks are away or too busy in September.  And October there are other events (e.g. Listen(n) @ ASU; lighting animation workshop, Einstens Dreams workshop) planned related to Synthesis or TML. 

It’s a good idea to do it on a weekly basis.  But instead of stretching over a whole semester, how about we concentrate the Marder-based part of the seminar into 1.5 months during a period when people are prepared to really grapple with the Marder.

To take the reading of Marder seriously, I think it’d be necessary to do this in person, or as synchronously as our portals can deliver.   And we need time for each one to prepare himself/herself with absorbing related works.  I would strongly recommend some of the Aristotle and Goethe.   ( to make time we invest worth the investment. ) 

So our — Oana and my — suggestion is to prep readings and exchange references etc. in vegetal studies stream
now, and do the actual readings  of Marder over seven weeks: November 3 through Dec 19.   
We recommend 
Week 1 Chap 1
Week 2 Chap 2
Week 3-4 Chap 3 & 4
Week 5-6 Chap 4 & 5
Week 7 Papers and Crits (double long session)

It’d be great to aim to deliver some substantial multi-format responses — on the order of a paper, short video, sketches of experiments that really synthesize the insights form the seminar.


Here are two key starting operating rules for this game :

• Avoid allegory — not the depiction of “what plants look like" but how plants grow, and experience dynamical existence.   

• Avoid as radically as possible anthropomorphizing .


Perhaps I can come mid November and mid December.
On the other hand my duties this Fall may well be so heavy that it’d be easier if Synthesis hosted this theoretical phase of the joint TML-Synthesis vegetal studies research stream in Phoenix.

Suggestions?
Xin Wei


__________________________________________________________________________________
Sha Xin Wei, Ph.D. • xinwei@mindspring.com • skype: shaxinwei • +1-650-815-9962
__________________________________________________________________________________