heartbeat workshop Feb 15-20; organizational meeting Monday Feb 16, afternoon iStage

Hi 

Let’s plan on meeting John & Teoma in iStage Monday Feb 16 for a planning session?   Hour TBA (probably after noon).

John and Teoma — can you check the preliminary schedule?   Please edit freely!   Baton is yours.

Please coordinate with 
Mike Krzyzaniak (PhD music grad) on the correlation + dance; 
Garrett on exchanging data into Julian Stein’s (FTM) matrix representation via OSC (like last year?) and finding musicians to work with;
Dr. Chris Roberts (Synthesis) for overall coordination.

I list the people and contacts I could imagine being interested / interesting & available this week.


Mike Julie + Varsha, (and Jessica) — Mike, can you organize / put out the word for some dancers to come work with Teoma and John next week regularly through the week?

For their “heartbeat" project  ( https://ccinternaltime.wordpress.com/ ) it is best to have the same two dancers work with the music and techniques over the entire period.  But some rotation is fun and fine too

John would like to work with some musicians as well.  So let me rely on Garrett and you to put out the word when John Teoma and you work out an improv session(s).  But I cc Prof. Kotoka Suzuki in the composition faculty and the Synthesis grad students.

Kristi, Garrett — please let people know the URL for the workshop again.

 


________________________________________________________________________________________
skype: shaxinwei • mobile: +1-650-815-9962
_________________________________________________________________________________________________

o4.track (video +sensor osc data), gyro (Was: Synthesis Center / Inertial Sensor Fusion)

Great!

Mike, Can you generate data in Julian’s data structure and store them in a shared directory for us all
along with the journaled video?  Julian Stein wrote the object for journalling data.

On Nov 10, 2014, at 1:07 AM, Julian Stein <julian.stein@gmail.com> wrote:
Also included in the O4.rhyth_abs is a folder labeled o4.track. This features a simple system for recording and playing video with a synchronized osc data stream.
I’ll cc this to the SC team so they can point out those utilities on our github.

It’d be great if you can give the Signal Processing group some Real Live Data to matlab offline this week, as a warmup to Teoma + John’s data the week of Feb 15.

We must have video journaled as well, always.

I’d be interested in seeing an informal brownbag talk about Lyapunov exponents one of those mornings of the week of Feb 15, together with some analysis of the data. 

Let’s cc Adrian Freed and John MacCallum on this “gyro" thread —
Adrian’s got the most insight into this  and could help us make some actual scientific headway
toward publishable results.

My question is : By doing some stats on clouds of orientation measurements
can we get some measure of collective intention (coordinated attention)
not necessarily at any one instant of time (a meaningless notion in a relativistic world like ours) — 
but in some generalized (collective) specious present?

Let’s plan John and Teoma’s workshop hour by hour schedule this coming week at a tea?

Kristi or Garrett, or __: please let us know when the “heartbeat”  workshop weebly site is posted and linked to the Synthesis research ok?

Cheers,
Xin Wei

On Feb 6, 2015, at 12:13 PM, Michael Krzyzaniak <mkrzyzan@asu.edu wrote:

I translated Seb's sensor fusion algorithm into Javascript to be used within Max/MSP:


There was still quite a bit of drift when I tested it, but I was only using 100Hz sample rate which I suspect may have been the main issue.

Mike


 On Sat, Jan 31, 2015 at 3:45 PM, Adrian Freed <adrian@adrianfreed.com
 wrote:
  Thanks Xin Wei.
  Tt would indeed to at least develop a road map for this important work. We should bring the folk from x-io
  into the discussion because they have moved  their considerable energies and skills further into this space in 2015.
 
  I also want to clarify my relative silence on this front. As well as weathering some perfect storms last year, I found
  the following project attractive from the perspective of separating concerns for this orientation work: http://store.sixense.com/collections/stem
  They are still unfortnuately in pre-order land with a 2-3 month shipping time. Such a system would complement commercial and inertial measuring systems well
  by providing a "ground truth" ("ground fib") anchored to their beacon transmitter.  The sixense system has limited range for many of our applications
  which brings up the question (again as a separation of concerns not for limiting our perspectives) of scale. Many folk are thinking about orientation and inertial
  sensing for each digit of the hand (via rings).
 
  For the meeting we should prepare to share something about our favored use scenarios.

 On Jan 31, 2015, at 1:37 PM, Xin Wei Sha <Xinwei.Sha@asu.edu
 wrote:
 
 
  Can you — Adrian and Mike —  Doodle a Skype to talk about who should do what when to get gyro information from multiple (parts of ) bodies
  into our Max platform so Mike and the signal processing maths folks can look at the data?
 
  This Skype should include at least one of our signal processing  Phd’s as well ?
 
  Mike can talk what he’s doing here, and get your advice on how we should proceedL
  write our own gyro (orientation) feature accumulator
  get pre-alpha version of xOSC hw + sw from Seb Madgewick that incorporates that data
  adapt something from the odot  package that we can use now.
  WAIT till orientation data can be integrated easily (when, 2015 ?)
 
  Half an hour should suffice.
  I don’t have to be at this Skype as long as there’s a precise outcome and productive decision that’ll lead us to computing some (cor)relations on streams of orientations as a start...
 
  Cheers,
  Xin Wei
 
  __________


On Jan 31, 2015, at 1:27 PM, Vangelis <vl_artcode@yahoo.com wrote:

 Hello!
  Yes, there is great demand for something that works in sensor fusion for inertial sensors but I think the best way to do so is as part of o. so to benefit every inertial setup out there. It will take ages for Seb to implement it for xosc and would be an exclusive benefit. Seb's PhD is out there and I am sure he will help sharing new code for solving the problem. The question is can we do this? :)
  My warm regards to everyone!
  v


On Jan 30, 2015 6:45 PM, Adrian Freed <adrian@adrianfreed.com
 wrote:

  Hi.
  The experts on your question work at x-io. Seb Madgewick wrote the code a lot of people around the world are using for sensor
  fusion in IMU's.
  Are you using their IMU (x-OSC) as a source of inertial data?
 
  We started to integrate Seb's code into Max/MSP but concluded it would be better to wait for Seb
  to build it into x-OSC itself. There are some important reasons that this is a better approach, e.g.,
  reasoning about sensor fusion in a context with packet loss is difficult.
 
  It is possible Vangelis persisted with the Max/MSP route
 
 
  On Jan 30, 2015, at 3:01 PM, Michael Krzyzaniak <mkrzyzan@asu.edu  wrote:
 
  Hi Adrian,
 
  I am a PhD student at ASU and I work with Xin Wei at the Synthesis Center. We are interested in fusing inertial sensor data (accel/gyro/mag) to give us reliable orientation (and possibly position) information. Do you have in implementation of such an algorithm that we can use in (or port to) Max/MSP?
 
  Thanks,
  Mike

please supply floor diagram for Stauffer Gallery=Lounge

Dear Synthesis Space Design team:

Let's fill in, correct the diagram and Stauffer Gallery=Lounge tech rider for Chris R.     Connor, Prashanth, Garrett, can you please create a machine layout diagram for the Stauffer Gallery=Lounge for Pete, Chris R and Todd to review?

Then ask Chris / Kristi where to share this project info on the Synthesis private research website. (Ozzie set up wiki for us last year — maybe we can add a link to that in our public Synthesis website?)


Cheers,
XIn Wei

cc.d TML folks.

Petitot’s sensorimotor perception and morphodynamics of cognition

FUTURE:

Josh — Byron and I can talk with you about the sensorimotor research done by Kevin O’Regan (Why Red Does Not Sound like a Bell).   This should be deeply relevant to rigorous work with whole-body-interfaces like those that you’ve described.   I’d also recommend recent works by Jean Petitot and his students and colleagues that signal a profound jump in sophistication in the study of perception and intentional experience paralleling the leap from classical Newtonian physics of particles to field theory :

Neuromathematics of Vision, ed. Giovanna Citti, Alessandro Sarti

Jean Petitot, Cognitive Morphodynamics: Dynamical Morphological Models of Constituency in Perception and Syntax


To the extent that Pavan’s students develop more grip on some of the relevant differential geometry, we may explore ways to artistically and experientially and computationally exploit this emerging paradigm.   This will be a long term project.

There are implications for Chris Roberts’ interest in “semiotics” —  but the Oz not Kansas versions of semiotics!

[Synthesis] rhythm analysis research progress

Dear Mike, Rushil, Qiao,
(FYI only cc’d folks)

Last I recall there was agreement for 
• generating data from Mike + dancers for offline analysis by Rushil…
• coding up Lyapunov exponents (based on OSC in Julian’s matrix format ) as Max external

I’m available for brief progress check-ins today
f2f or Skype.

11- 12 noon @ BY 390
or
2:30 - 3:00 PM Tea @ Stauffer B203

Xin Wei


Begin forwarded message:

From: Xin Wei Sha <Xinwei.Sha@asu.edu>
Subject: [Synthesis] rhythm research: a self-organizing map (SOM) (jit.robosom)-->
Date: December 27, 2014 at 2:48:08 AM MST
To: Garrett Laroy Johnson <garrett.laroy.johnson@gmail.com>, Julian Stein <julian.stein@gmail.com>, Michael Krzyzaniak <mkrzyzan@asu.edu>, Omar Faleh <omar@morscad.com>, Christian Ziegler <Chris.Ziegler@asu.edu>

Dear, Garrett, Mike, Julian, Omar, Chris Z,

Swiss-French artist Robin Meier used self-organizing maps
Paper about Max Jitter patch: jit.robosom

Self-organizing map abstraction for MaxMSP Jitter.

Don’t know if jit.robosom works or is very interesting in effect but his jit.robosom may be worth a try                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      for rhythm experiments driving our lighting instruments. 
This is a relatively trivial application of linked oscillators.
We should be able to achieve much more interesting behaviour, 
especially with live action in the loop.

A presentation by an authority in SOM’s: Timo Honkela (Finland)



HUNCH : Mike K’s correlation-based method should yield more interesting temporal textures.



On Dec 4, 2014, at 12:57 PM, Qiao Wang <qiao.asu@gmail.com> wrote:

I have discussed about the further analysis part with Mike before. We need to talk about annotating the data for analysis purposes.


On Thu, Dec 4, 2014 at 12:27 PM, Xin Wei Sha <Xinwei.Sha@asu.edu> wrote:
Hi Garrett, Mike, all

Can you please upload all your LRR data + videos to
/Volumes/synthesis/Data/LightingRhythm2014Nov
?

I’d like to schedule a scientific review, separate from the overall Synthesis Debrief, of the correlation rhythm work
with whoever in Pavan’s group is interested in seeing if we can devise some analysis— Rushil, Qiao?

Physis, poiesis in the highest sense

Not only handcraft manufacture, not only artistic and poetical bringing into appearance and concrete imagery, is a bringing-forth, poiesis. Physis also, the arising of something from out of itself, is a bringing-forth, poiesis. Physis is indeed poiesis in the highest sense. For what presences by means of physis has the bursting open belonging to bringing-forth, e.g., the bursting of a blossom into bloom, in itself (en heautoi). In contrast, what is brought forth by the artisan or the artist, e.g. the silver chalice, has the bursting open belonging to bringing­ forth not in itself, but in another (en alloi), in the craftsman or artist.

[Heidegger, Question Concerning Technology, 11]

[Synthesis] --> sheaf theoretic approach to quantum field theory, topology


Self=organizing maps (SOM in my previous email to Synthesis research) may be as appealing as picking up shells at the beach, 
but how about diving into the ocean and making deeper work?

At the SOM event sponsored by Ludgar Hovestadt and Vera Buhlmann in ETH Zurich, 
Elias Zafiris and Mike Epperson presented  a far richer body of ideas 
based on a sheaf theoretic approach to quantum field theory (greatly extending Whitehead)  :             


Mike Epperson has a way of combining causal and logical ontologies that may work, 
and is in any case worth serious post-Deluzian and post-Whiteheadean attention:

(4) 
For some elementary mathematical background to Mike and Elias' work: