We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.

Paper: https://arxiv.org/abs/2006.09645

Our lab: https://cclab.sfc.keio.ac.jp/2020/06/16/exsampling/

---

System Overview

Classification Architecture

MIDI Track Mapping

Demo videos

BibTex

@inproceedings{kobayashi_NIME20_58,
  author = {Kobayashi, Atsuya and Anzai, Reo and Tokui, Nao},
  title = {ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds},
  pages = {305--308},
  booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
  editor = {Michon, Romain and Schroeder, Franziska},
  year = {2020},
  month = jul,
  publisher = {Birmingham City University},
  address = {Birmingham, UK},
  issn = {2220-4806},
  doi = {10.5281/zenodo.4813371},
  url = {https://www.nime.org/proceedings/2020/nime2020_paper58.pdf}
}