Skip to content

Automated Composition of Picture-Synched Music Soundtracks for Movies

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationProceedings of the 16th ACM SIGGRAPH European Conference on Visual Media Production
Publisher or commissioning bodyAssociation for Computing Machinery (ACM)
DateAccepted/In press - 15 Oct 2019
EventACM SIGGRAPH European Conference on Visual Media Production - London, United Kingdom
Duration: 17 Dec 201918 Dec 2019
Conference number: 16
https://www.cvmp-conference.org/2019/

Conference

ConferenceACM SIGGRAPH European Conference on Visual Media Production
Abbreviated titleCVMP2019
CountryUnited Kingdom
CityLondon
Period17/12/1918/12/19
Internet address

Abstract

We describe the implementation of and early results from a system that automatically composes picture-synched musical soundtracks for videos and movies. We use the phrase _picture-synched_ to mean that the structure of the automatically composed music is determined by visual events in the input movie, i.e. the final music is synchronised to visual events and features such as cut transitions or within-shot key-frame events. Our system combines automated video analysis and computer-generated music-composition techniques to create unique soundtracks in response to the video input, and can be thought of as an initial step in creating a computerised replacement for a human composer writing music to fit the picture-locked edit of a movie. Working only from the video information in the movie, key features are extracted from the input video, using video analysis techniques, which are then fed into a machine-learning-based music generation tool, to compose a piece of music
from scratch. The resulting soundtrack is tied to video features, such as scene
transition markers and scene-level energy values, and is unique to the input video. Although the system we describe here is only a preliminary proof-of-concept, user evaluations of the output of the system have been positive.

Event

ACM SIGGRAPH European Conference on Visual Media Production

Abbreviated titleCVMP2019
Conference number16
Duration17 Dec 201918 Dec 2019
CityLondon
CountryUnited Kingdom
Web address (URL)
Degree of recognitionInternational event

Event: Conference

Documents

Documents

  • Full-text PDF (accepted author manuscript)

    Accepted author manuscript, 841 KB, PDF document

    Embargo ends: 1/01/99

    Request copy

View research connections

Related faculties, schools or groups