Fluid gesture interaction design

Topological Media Lab was established in 2001, among other things, to study continuous (in time and space), free-hand, improvised gesture with no a prior schema.

Our time has come! — 

Zamborlin, Bevilaqua, Gillies, D’Inverno. Fluid gesture interaction design: applications of continuous recognition for the design of modern gestural interfaces (2015)

Prior art:

Resistance Is Fertile: Gesture and Agency in the Field of Responsive Media (2002)

—, Serita, Fantauzza, Dow, Iachello, Fiano, Berzowska, Caravia, Reitberger, Fistre. Demonstrations of Expressive Softwear and Ambient Media Ubicomp (2003)

—, Serita, Dow, Iachello, Fistre. Gestural Audio Instruments (2003) (PDF)

—, Gill. Gesture and Response in Field-Based Performance (2005)

Van Nort, Gauthier, —, Wanderley, Extraction of Gestural Meaning from a Fabric-Based Instrument (2007)

—, Calligraphic Video: Using the Body's Intuition of Matter (2010) (PDF)

3 orchestrations for Serra: TIME, BODY-MORPH, TENDRILS

Dear Oana, Todd, Chris,

How about these Working Definitions for Serra (from media choreography work): 

orchestration = a suite of instruments with a definite conditioning of the environment
(eg  breathing,  cusp of collapse, prone to chiaroscuro, prone to freezing  etc.)

instrument = a set of Jitter patches (abstractions) with definite set of parameters


To recap from our design meeting in my office, I think we only have 3 orchestrations to code for Sep:

• Time — explore fresh ways to use / generate index videos in timespace+elastic time (what Evan produced in April), but rigged with video from Oana (Janelle, Connor)

•  Body morph — like IL Y A (Evan update code he wrote for IL Y A)

•  Tropism / tendrils — inter-body 

By varying its parameters, a richly-designed Max abstraction (code) can manifest as widely different instruments,  in an infinite variety in a family.

The last orchestration — Horizon — is  not so much code, but scenography, lighting etc.
I do wish we could have the moving light fixed sooner, then I would’ve asked Julian to show Ian his moving light code from the 2012-13 Einsteins Dreams workshop, to show Ginette to explain how we would work expressively with lighting.     This should be a Fall project.

Connor Synthesis Core Dev / Jitter: First test of charged bodies with particles

This is really promising dynamics!  Good work.  
It’s worth reading up on actual lattice physics, as I recommended to Josh M. — e.g. chapters in Numerical Recipes, and google computational physics, lattice physics, computational chemistry.

(1) 
Can you show Josh how this works, so he can think about writing some code to compute some flow or density features according to our conversations with Melissa and Dee ?  I will want to work with Josh on the maths algorithms today approx 1:15 - 1:40 after my visit to Stauffer Lounge to see Ian and Garrett’s work.

(2) Everyone, please email cc. documentation of your work  to post@synthesis.posthaven.com


On Jul 1, 2015, at 12:05 PM, Connor Rawls <Connor.Rawls@asu.edu> wrote:

I attached the video of my first test of using the charged bodies code I've been working on with the fluids and particles. I used two of the puzzle pieces as objects to drive the interaction. The parameters could use some refinement to make the interaction more visible, but it looks neat in an abstract visual sense.

-Connor

<IMG_0141.MOV>

AME story pitches for ASU News

Thanks Kristi :)  You can also read and post in-house questions and notes post@synthesis.posthaven.com
This research blog is the scratch space for ongoing work at Synthesis.

On Jun 18, 2015, at 9:15 PM, Kristi Garboushian <Kristi.Garboushian@asu.edu> wrote:

Hi Everyone,

Marshall, “our” ASU News reporter, enjoys writing about the arts, so let’s give him something to write about! All the things, actually. Please send any story pitches to me, and I’ll pass them along to him for consideration. He actually asked me to contact him once a week with any ideas, so don’t hesitate if you have an idea that might be even remotely news-worthy!


Thank you,
Kristi

Re: Today 1:00 - 2:00 PM (Phoenix time): check-in and plan Ozone visual instrument development

I won't be able to join on Friday

todd from my phone

On Jun 18, 2015, at 7:17 PM, Xin Wei Sha <Xinwei.Sha@asu.edu> wrote:

Dear Evan, Connor, Todd and Chris R,
(FYI Oana):

So let’s Skype today 1:00 - 2:00 PM (Phoenix time) to plan Ozone visual instrument development relevant to Serra: 
Quorum: Evan, Connor, XW.

Ideally Todd &  Chris R. too if you are available, so we can all be on the same page with your expertise and coordination.

One of us should email notes to   post@synthesis.posthaven.com  (posted on synthesis.posthaven.com ) for Oana and ones who cannot make it to this discussion.

I’ll be at my host’s home in Cambridge so hope to have wifi at that hour :

Cheers,
Xin Wei


________________________________________________________________________________________
Sha Xin Wei • Professor and Director • School of Arts, Media and Engineering + Synthesis
Herberger Institute for Design and the Arts + Fulton Schools of Engineering • ASU
Fellow, ASU-Santa Fe Institute, Complex Biosocial Systems
skype: shaxinwei • mobile: +1-650-815-9962
Founding Director, Topological Media Lab 
_________________________________________________________________________________________________

On Jun 18, 2015, at 10:31 PM, Evan Montpellier <Evan.Montpellier@asu.edu> wrote:

On Jun 18, 2015, at 8:04 PM, Christopher Roberts
<Christopher.M.Roberts@asu.edu <mailto:Christopher.M.Roberts@asu.edu>>
wrote:

Hi Evan, 

Can you and Connor Rawls setup a time to talk about the current state
of the SERRA instruments and what has been done is waiting to be done etc.

Thanks

Chris

Christopher M Roberts
Assistant Research Professor
School of Arts, Media + Engineering
Arizona State University

Today 1:00 - 2:00 PM (Phoenix time): check-in and plan Ozone visual instrument development

Dear Evan, Connor, Todd and Chris R, (FYI Oana):

Let’s Skype today 9 PM UK = 4 PM Montreal = 1 PM Phoenix to plan Ozone visual instrument development relevant to Serra.

Quorum: Evan, Connor, XW.
Ideally Todd & Chris R. too if you are available, so we can all be on the same page with your expertise and coordination.

One of us should email notes to   post@synthesis.posthaven.com  (posted on synthesis.posthaven.com ) for Oana and ones who cannot make it to this discussion.

I’ll be at my host’s home in Cambridge so hope to have wifi at that hour :

Cheers,
Xin Wei


On Jun 18, 2015, at 8:04 PM, Christopher Roberts
<Christopher.M.Roberts@asu.edu <mailto:Christopher.M.Roberts@asu.edu>>
wrote:

Hi Evan, 

Can you and Connor Rawls setup a time to talk about the current state
of the SERRA instruments and what has been done is waiting to be done etc.

Thanks

Chris

Christopher M Roberts
Assistant Research Professor
School of Arts, Media + Engineering
Arizona State University

two essays by Vera Bühlmann: "The creative conservativeness of computation" & "Reclaiming the Role of the Mathematical in Understanding Media [and the Technics of Digital Communication]" with Michel Serres

Vera Bühlmann is one of the most challenging new thinkers of media and technology around.  
(Applied Virtuality Lab, ETH Zürich, http://www.caad.arch.ethz.ch/  )
Well worth engaging.

The creative conservativeness of computation
http://monasandnomos.org/2015/01/29/the-creative-conservativeness-of-computation/

The Sun and its Inverse: Reclaiming the Role of the Mathematical in Understanding Media [and the Technics of Digital Communication] with Michel Serres