Structural representation of media

An introduction to hierarchised tiles

Alice Rixte

Université de Bordeaux

13th of November, 2023
Sound and Fury of Modeling, Arpino Winter School
Alice Rixte

What is musical structure ?

William E. Thomson, Functional Ambiguity in Musical Structures, 1983
Musical structure [...] refers to the way elements are organized into patterns of coherence, the perceptual act of small events joining to create large events.
Morris R. Cohen, A preface to logic, 1944
Anything acquires meaning if it is connected with, or indicates, or refers to, something beyond itself, so that its full nature points to and is revealed in that connection.
Alice Rixte

Structure could then be

1. A hierarchy

Atoms are combined together to form patterns, themself combined into metapaterns more and more complex.

2. An articulation of this hierarchy

The different components should be compared and related one to the other

Alice Rixte

Outline

1. The hierarchy of patterns

  • Level 0 (atoms) : music note, letter, pixel ...
  • Level 1 (patterns of atoms) : bar, word ...
  • Level 2 (patterns of patterns of atoms) : phrase, sentence ...
  • Level 3 (patterns of patterns of patterns of atoms) : section, paragraph ...
  • ...
Alice Rixte

Outline

2.Transformations of patterns

They allow to express similarity between patterns

  • Shifting
  • Symmetries
  • Scaling
  • ...
Alice Rixte

Outline

3. How to construct patterns

  • A musical composition procesxs
  • Algebraic operations over patterns
  • Programmation language
Alice Rixte

1. The hierarchy of patterns

Alice Rixte

More formally

  • A pattern is a partial function from a space to a set of atoms
  • The type/set or patterns is
Alice Rixte
Alice Rixte

Metapatterns

What if ?
What if we replaced atoms by patterns?
  • The set of meta patterns would then be
Alice Rixte

Let's recap

  • Patterns are partial function from the space to atoms
  • Metapatterns are partial functions from space to subpatterns
  • By itering this construction, we get a pattern hierarchy.
Alice Rixte

2.Transformations of patterns

Alice Rixte

Patterns of transformations

  • We'd like to express the fact that "La Perdrix" corresponds to a constant pitch version of "Do Ré Mi".
  • Let's use patterns of transformations !
  • A pattern of transformations maps points of space to a transformation
Alice Rixte
Alice Rixte
Alice Rixte
Alice Rixte
Alice Rixte

Transformations : recap

  • One can transform patterns by applying a transformation
  • Patterns of transformations allow to locally les transformations localement.
Alice Rixte

3. Building patterns

Alice Rixte

Tiles

  • Combining patterns and transformation allow to get an iterative process to draw .
  • Patterns are hierarchised content.
  • Transformations express the articulation of that content.
Definition of tile

A tile is a pair composed of a transformation and a pattern .

Alice Rixte
Alice Rixte
Alice Rixte
Alice Rixte
Alice Rixte

What tile allow

  • Locate patterns relatively one to another.
  • Duplicate patterns in time and space
  • Overlapping patterns (in particular, anacrusis)
  • ...
Alice Rixte

Conclusion

Hierarchised tiles are a language that allow:

  1. hierarchic structuration of media
  2. express similarities within that hierarchy
  3. a constructivist approach based on the sum of tiles.
Alice Rixte

On going and future work

  • Implementation
  • Rendering engines for diffent kind of media
  • Real-time control on the hierarchy
  • Multimedia performances
Alice Rixte

Do you have questions ?

Alice Rixte