About

I am a researcher, a software designer and an interactive media artist. I am mainly interested in Human-Computer Interaction, interactive machine learning, interactive audiovisual art, digitally enhanced performance, and innovation in the music business and creative industries.

I hold a B.S. in Computer Science and Systems Engineering and an MSc in Mobile Systems, both from University of Minho. I also hold an M.A. in Management of Creative Industries, from Portuguese Catholic University, with specialism in Creativity and Innovation in the Music Industry.

Previously, I have worked in the software industry as front-end engineer for Interactive Digital Signage and Corporate TV ( Ubisign) and Business Intelligence ( PRIMAVERA BSS) products. I developed front-end architectures for SaaS services and did software engineering and interaction design for public screen, web, mobile and augmented reality applications.

I have also been working at the interface between academia and industry, mostly on applied research or R&D in public-funded projects. I developed context-aware middleware and applications for pervasive public displays ( Ubicomp@UMinho). I developed proofs of concept in augmented reality and natural user interfaces ( VisualyzARt@ CITAR/ UCP). I also lectured interactive sound design in the Digital Design post-graduation course.

Currently, I am a PhD candidate in Computer Science at Goldsmiths, University of London, in the Embodied Audiovisual Interaction ( EAVI) group. I work on the EU Horizon 2020-funded Innovation Action RAPIX-MIX, where I focus on Human-Computer Interaction approaches to design machine learning technologies into creative and expressive tools.

I am also an Alpha Developer for Google ATAP Project Soli, for which I develop software and interaction design for new application concepts.

Selected work

Research

Projects

2015-2018 — RAPID-MIX: Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive technology
Project Id: 644862, funded by EU Horizon 2020 ICT-2014-1

2013-2014 — VISUALYSART: Visual programming framework for augmented reality and ubiquitous natural user interfaces
Ref: 23201, funded by FEDER, through COMPETE program (POFC)

2006-2007 — SITUACTION: Situated web portal for local awareness and transient interaction
Ref: POS-C/EIA/58832/2004, UbiComp group, ALGORITMI Center, University of Minho

Publications

Bernardo, F., Grierson, M., Fiebrink, R. (forthcoming). User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning Toolkit
Journal of Science and Technology of the Arts (CITARj) - ISSN: 1646-9798

Bernardo, F., Zbyszyński, M., Fiebrink, R., Grierson, M. (2017). Interactive Machine Learning for End-User Innovation
Designing the User Experience of Machine Learning Systems
Proceedings of Association for the Advancement of Artificial Inteligence (AAAI) Spring Symposium, Stanford University, Palo Alto, CA

Bernardo, F., Arner, N., Batchelor, P. (2017). O Soli Mio: Exploring Millimeter Wave Radar for Musical Interaction
Proceedings of New Interfaces for Musical Expression 2017, Aalborg University, Copenhagen, Denmark

Parkinson, A., Zbyszyński, M., Bernardo, F. (2017). Demonstrating Interactive Machine Learning Tools for Rapid Prototyping of Gestural Instruments in the Browser
Proceedings of Web Audio Conference 2017, Queen Mary University of London, London, UK

Ward, N., Ortiz, M., Bernardo, F., Tanaka, A. (2016). Designing and measuring gesture using Laban Movement Analysis and Electromyogram
3rd Workshop on Full-Body and Multisensory Experience (BodySenseUX@UbiComp'16), Heidelberg, Germany

publications ++

Tilmanne, J., d’Alessandro, N., Barborka, P., Bayansar, F., Bernardo, F., Fiebrink, R., Heloir, A., Hemery, E.,
Laraba, S., Moinet, A., Nunnari, F., Ravet, T., Reboursière, L., Sarasua, A., Tits, M., Tits, N., Zajéga, F. (2018).
Prototyping a New Audio-Visual Instrument Based on Extraction of High-Level Features on Full-Body Motion
Technical Report, in Proceedings of eNTERFACE 2015 Workshop on Intelligent Interfaces, Mons, Belgium

Bernardo, F., Pestana, P., Martins, L. (2015). The Smart Stage: Designing 3D Interaction Metaphors for Immersive and Ubiquitous Music Systems
International Conference on New Music Concepts (ICNMC 2015), Treviso, Italy - ISBN: 978-88-6551-188-6

Bernardo, F., Martins, L. (2014). Disintermediation Effects on Independent Approaches to Music Business
International Journal of Music Business Research (IJMBR) – issn 2227-5789

Bernardo, F. (2014). Music video games in live performance: Catachresis or an emergent approach?
Videojogos 2014 - Conferência de Ciências e Artes dos Videojogos, Barcelos, Portugal

Bernardo, F. (2014). Dodging the Middleman: Insights on Disintermediation in the Independent Music Sector
KISMIF International Conference on Underground music scenes and DIY cultures, Porto, Portugal

Bernardo, F., Martins, L. (2013). Disintermediation effects in the music business – A return to old times?
Music Business Research Days 2013, Vienna, Austria.
Best Paper award at the Young Scholars Workshop.

José, R., Bernardo, F. (2009). Extended Bluetooth naming for empowered presence and situated interaction with public displays
3th Symposium of Ubiquitous Computing and Ambient Intelligence 2008


Lectures

2018 — Designing with Data and Interactive Machine Learning
Master in Product Design
Royal College of Art, London, United Kingdom

2014 — Interactive Sound Design and Dataflow Programming with PureData
Post graduation in Digital Design
Portuguese Catholic University, Porto, Portugal

2014 — Research strategy and methodology design
Master in Music Teaching
Portuguese Catholic University, Porto, Portugal

2014 — Research strategy and methodology design
Master in Management for the Creative Industries
Portuguese Catholic University, Porto, Portugal

2013 — Research methodology design
Science and Technology of the Arts Doctoral Programme
Portuguese Catholic University, Porto, Portugal

Workshops + Presentations + Talks

2018 — Fostering synergies between Art and Innovation
Invited speaker @ "El Arte como herramienta de innovación y emprendimiento"
ETSIDI-UPM, Madrid, Spain

2017 — The RAPID-MIX API: a toolkit for fostering innovation in the creative industries with Multimodal, Interactive and eXpressive (MIX) technologies
Workshop leader with Joseph Larralde (IRCAM), Sebastian Mealla and Panos Papiotis (MTG/UPF)
eNTERFACE'17 - 13th International Summer Workshop on Multimodal Interfaces, 3 – 28 July, Porto, Portugal

2017 — Sound Design In The Cloud
Workshop facilitator with Visda Goudarzi, Mathieu Barthet, Miguel Ceriani, Johan Pauwels, György Fazekas and Rebecca Fiebrink
AudioMostly 2017: Augmented and Participatory Sound and Music Experiences, 23-26 August
Queen Mary University of London, UK

2016 — SoliDSPFeatures2OSC: Feature Selection Tool for Prototyping Creative Audiovisuals with Soli
Presenter - Soli Alpha Developers Workshop, Google, Mountain View, California

workshops + talks ++

2016 — Interactive Applications in Machine Learning
Workshop co-presenter with Atau Tanaka
Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

2015 — Design de Tecnologias Wearable para Performance Expressiva e Musical
Workshop co-presenter with Michael Zbyszyński
MakerFaire Lisbon 2015, Lisbon, Portugal

2014 — The Smart Stage: Designing interaction for immersive and ubiquitous music systems
Presenter – Encontro Nacional de Investigação em Música (ENIM) 2014, Lisbon, Portugal

2013 — Disintermediation effects in the music business - A return to old times?
Presenter - Vienna Music Business Research Days 2013 - Vienna, Austria

2008 — Bluetooth Naming for Situated Interaction in Ubiquitous Environments
Presenter - UCAMI 2008 - Salamanca, Spain


Dissertations

Bernardo, Francisco (2013). The Impact of Disintermediation in Independent Music Business Models,
Master in Management of Creative Industries, Universidade Católica Portuguesa, Porto, Portugal, advised by Luis Gustavo Martins and Ricardo Morais

Bernardo, Francisco (2009). Bluetooth Naming for Situated Interaction in Ubiquitous Environments ,
Master in Mobile Systems, Universidade do Minho, Braga, Portugal, advised by Rui José

Say hello