Akson, an Audio-Visual Environment for Networked Interaction and Performance

Main Article Content

Luis Arandas
Universidade do Porto, Faculdade de Engenharia
https://orcid.org/0000-0001-5413-2832
José Alberto Gomes
Universidade Católica Portuguesa, School of Arts, Research Center of Science and Technology of the Arts
https://orcid.org/0000-0002-0428-267X
Rui Penha
Polytechnic Institute of Porto, School of Music and Performing Arts / Universidade Nova de Lisboa, CESEM
https://orcid.org/0000-0002-6071-7367

Abstract

In this article, we present Akson, a web-based audio-visual (AV) environment for networked interaction and performance. It is demonstrated as an emerging artefact of an investigation in computer music and media art from collaborative interfaces exploring the cloud. Akson allows both the generation of content in a customized network and the structuring of agents connected in different interaction models. There are detailed experiments carried out during the development process, their existence taking advantage of the Internet and the way in which the software works technically is detailed extensively. As an interface that extends the artistic gesture, it is presented as a result of research in the context of Braga Media Arts, a creative city of UNESCO (UCCN).

Keywords: Computer music, Media art, Networked interaction, Audiovisual art, Artistic performance, Networked art, Web technologies

Downloads

Download data is not yet available.

References

Arandas, L., Gomes, J. & Penha, R. (2019). Towards Large Scale Artistic Practice with Web Technologies. Proceedings of the Web Audio Conference.

Atzori, P., & Woolford, K. (1995). Extended-Body: Interview with Stelarc. CTheory. https://journals.uvic.ca/index.php/ctheory/article/view/14658/5526

Akkermann, M. (2016). Performing Computer Network Music. Well-known challenges and new possibilities. Proceedings of the International Computer Music Conference, 395-401.

Angel, E., & Shreiner, D. (2014). Interactive Computer Graphics with WebGL. Addison-Wesley Professional.

Arkko, J. (2020). The influence of internet architecture on centralised versus distributed internet services. Journal of Cyber Policy, 5(1), 30-45. https://doi.org/10.1080/23738871.2020.1740753

Baran, P. (1964). On Distributed Communications Networks. IEEE Transactions on Communications, 12(1), 1–9. https://doi.org/10.1109/tcom.1964.1088883

Barbosa, Á. (2006). Computer-supported Cooperative Work for Music Application. Universitat Pompeu Fabra.

Boutwell, B. (2009). The League of Automatic Music Composers, 1978–1983. With John Bischoff, Jim Horton, Tim Perkis, David Behrman, Paul DeMarinis, and Rich Gold. New World Records 80671-2, 2007. Journal of the Society for American Music, 3(2), 263-264. https://doi.org/10.1017/S1752196309091147

Colomina, B. (2001). Enclosed by images: the Eameses' multimedia architecture. Grey Room, 6-29.

Clément, A., Ribeiro, F., Rodrigues, R., & Penha, R. (2016). Bridging the gap between performers and the audience using networked smartphones: the a. bel system. Proceedings of the International Conference on Live Interfaces.

Deutsch, R, and Deutsch, L. J. (1978). ADSR envelope generator. U.S. Patent No. 4,079,650. 21 Mar.

Engelbart, D. C. (1962). Augmenting human intellect: A conceptual framework. Stanford Research Institute.

Fencott, R. (2012). Computer Musicking: Designing for Collaborative Digital Musical Interaction (Doctoral dissertation, Queen Mary University of London).

Freeman, J., & Troyer, A. V. (2011). Collaborative Textual Improvisation in a Laptop Ensemble. Computer Music Journal, 35(2), 8–21.

Gray, J. (2009). Google chrome: The making of a cross-platform browser. Linux Journal, 2009(185), 1.

Greenberg, S. (1997). Collaborative interfaces for the web. Human factors and web development, 18, 241-254.

Hugill, A. (2005) Internet music: An introduction. Contemporary Music Review Journal, 24(6), 429-437. https://doi.org/10.1080/07494460500296094

Ione, A., & Tyler, C. (2003). Was Kandinsky a synesthete?. Journal of the History of the Neurosciences, 12(2), 223-226.

Jana, R., & Tribe, M. (2009). New media art. Taschen America, LLC.

Le, C. D., Calcagno, M., Hamaker, J., Chambers, R., Plumpe, M., & Wilson, T. (2020). U.S. Patent No. 10,749,989. Washington, DC: U.S. Patent and Trademark Office.

Lyu, S. (2021). High-Performance Web Frontend Using WebAssembly. Practical Rust Web Projects (pp. 193-249). Apress.

Magnusson, T. (2009). Of epistemic tools: Musical instruments as cognitive extensions. Organised Sound, 14(2), 168-176. https://doi.org/10.1017/S1355771809000272

Manovich, L. (2001). The Language of New Media. The MIT Press.

Mardan, A. (2018). Deploying Node.js Apps. Practical Node.js (pp. 365-388). Apress.

Matuszewski, B., Schnell, N., & Bevilacqua, F. (2019). Interaction Topologies in Mobile-Based Situated Networked Music Systems. Wireless Communications and Mobile Computing, 2019, 1–9. https://doi.org/10.1155/2019/9142490

Mills, R. (2019). Towards a Theory of Tele-Improvisatory Collaboration. Tele-Improvisation: Intercultural Interaction in the Online Global Music Jam Session (pp. 119-141). Springer, Cham.

Mowery, K., Bogenreif, D., Yilek, S., & Shacham, H. (2011). Fingerprinting information in JavaScript implementations. Proceedings of W2SP, 2(11).

Panourgia, E. I., Wheelaghan, F., & Yang, X. (2018). Digital interactions. Airea: Arts and Interdisciplinary Research, (1), 3-10. https://doi.org/10.2218/airea.2732

Pfeiffer, S., & Green, T. (2015). Manipulating Audio Through the Web Audio API. In Beginning HTML5 Media (pp. 227-276). Apress.

Rai, R. (2013). Socket. IO Real-time Web Application Development. Packt Publishing Ltd.

Reimann, P. (2011). Design-based research. Methodological choice and design (pp. 37-50). Springer.

Renaud, A., & Rebelo, P. (2006). Network performance: Strategies and applications. NIME Conference Paper.

Schooler, E. M., & Touch, J. (1993). Distributed music: a foray into networked performance. International Network Music Festival, Santa Monica, CA.

Surianarayanan, C., & Chelliah, P. R. (2019). Fundamentals of Cloud Computing. Essentials of Cloud Computing (pp. 33-67). Springer.

Teixeira, I. (2018). O Espaço Aumentado na Experiência Artística: Ecrãs, Sistemas e Contextos Físicos.[PhD Dissertation]

Wilson, E., & Thompson, A. (2020). Live coding the code: an environment for ‘meta’ live code performance. International Conference on Live Coding.

Winkler, T. (1998). Composing interactive music. Techniques and ideas using Max.

Wolff, D. (2018). OpenGL 4 Shading Language Cookbook: Build high-quality, real-time 3D graphics with OpenGL 4.6, GLSL 4.6 and C++ 17. Packt Publishing Ltd.

Yamazaki, T. Electronic device with a master fader and a plurality of slave faders. U.S. Patent No. 9,215,021. 15 Dec. 2015.