Portugal

We present how we built the dataset and models, summarize evaluation results and show a few examples of generated music at the end.

ICCC&#39;20

Automated Music Generation for Visual Art through Emotion

audio visual art

image to music translation

automatic composition

music generation

emotion

### Looking for Cogsci 2023? Please [click here](https://underline.io/events/405/reception) to switch to 2023 edition.


**Dear Colleagues,**

Welcome to the 43rd Annual Conference of the Cognitive Science Society! 

This year’s conference brings together the latest research from all Cognitive Science and also highlights this year’s theme **Comparative Cognition: Animal Minds.** 

The program features four plenary speakers: Friederike Range (University of Veterinary Medicine, Vienna), Onur Güntürkün (Ruhr University Bochum), Julia Fischer (University of Göttingen), and Erich Jarvis (The Rockefeller University). The keynotes and invited symposia showcase the broad spectrum of ideas that encompass the conference theme of comparative cognition. 

Further, the program includes the Rumelhart Prize keynote presentation by Susan Goldin-Meadow (University of Chicago), and symposia to celebrate the winner of the Elman Prize: Wei Ji Ma (New York University), the Heineken Award winner Robert Zatorre (McGill University), and the Robert J. Glushko Dissertation Prizes session.

The program committee for CogSci 2021 received 1,025 submissions, including 710 full papers, 275 member abstracts, 8 publication-based talks, as well as 15 proposals for symposia, and 17 for workshops and tutorials. After a rigorous review process, the committee selected 152 papers for oral presentation and inclusion in the conference proceedings (14.8%), 332 papers for poster presentation and inclusion in the proceedings (32.4%), and 175 papers for poster presentation with inclusion of abstracts in the proceedings (17.1%) We also selected 275 submitted member abstracts. In addition, we accepted 6 publication-based talks, 12 symposia, and 9 workshops and tutorials to make for an exciting and inclusive program.

We hope that you enjoy the conference this year!<br><br>

**Your Program Chairs,**
![](https://assets.underline.io/uploads/markdown_image/1/image/99984908caba5e6453e5fc5ba34f3507.jpg)

**Learn more about the Vienna Cognitive Science Hub at the University of Vienna, hosts of CogSci 2021**

<iframe width="560" height="315" src="https://www.youtube.com/embed/464h1m3iU68" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

To review the proceedings for the conference or review the searchable program, please visit the [website](https://cognitivesciencesociety.org/program/).


CogSci 2021

The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education. The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

technical paper

Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviours that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalising what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.


ICCC'20

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.
Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviors that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalizing what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.



We present a proposal for meta-level evaluation in creative systems. In this paper, the Mexica creative system is the subject of our analysis. To achieve meta-level evaluation, we have constructed a program that interacts with Mexica's inputs and its outputs. The meta-level system evaluates the results and makes decisions based on them. For decision-making it includes heuristics that are defined in terms of Mexica's results; these are rules particular to the object- level system. We also include other general metrics that apply in any other creative system. For example, Ritchie's criteria for evaluating creative systems are included in this proposal.

Meta-level Evaluation and Transformational Creativity; An analysis of MEXICA

"Music variations consists of modifying an original music piece so that it remains harmonious and provides a sense of novelty while still remain relatable to the original song. The melody should progress in a harmonious way and under a reasonable chord hierarchy, due to this constraints, music 
variations can be considered as a rule based composition system. In this research, we develop a genetic algorithm to compose a variation on a given music piece. To achieve this we design a novel evaluation function and evolutionary operators which favor the modification process. These are designed to include components of melody similarity and tempo diversity in addition to harmony. The experimental results show that the proposed  system can generate variations that preserve musicality. A human evaluation study is also included to validate the proposed evaluation function. Additionally a link to listen to our generated compositions is provided."

Melody Similarity and Tempo Diversity as Evolutionary Factors for Music Variations by Genetic Algorithms

The automated evaluation of creative products promises both good-and-scalable creativity assessments and new forms of visual analysis of whole corpora. Where creative works are not ‘born digital’, such automated evaluation requires fast and frugal ways of transforming them into data representations that can be meaningfully assessed with common creativity metrics like novelty. In this paper, we report the results of training a Spatiotemporal DeepInfomax Variational Autoencoder (STDIM-VAE) on a digital photo pool of 162 LEGO ducks to generate a phenotypical landscape of clusters of similar ducks and dissimilarity scores for individual ducks. Visual inspection suggests that our system produces plausible results from image pixels alone. We conclude that under certain conditions, STDIM-VAEs may provide fast and frugal ways of automatically assessing corpora of creative works.

Automatic Similarity Detection in LEGO Ducks

Natural language generation provides designers with methods for automatically generating text, e.g. for creating summaries, chatbots and game content. In practise, text generators are often either learned and hard to interpret, or created by hand using techniques such as grammars and templates. In this paper, we introduce a novel grammar induction algorithm for learning interpretable grammars for generative purposes, called GITTA. We also introduce the novel notion of template trees to discover latent templates in corpora to derive these generative grammars. By using existing human-created grammars, we found that the algorithm can reasonably approximate these grammars using only a few examples. These results indicate that GITTA could be used to automatically learn interpretable and easily modifiable grammars, and thus provide a stepping stone for human-machine co-creation of generative models.

Discovering Textual Structures: Generative Grammar Induction using Template Trees

We introduce CANIS, our computationally creative system for generating novel constellations. We explain the motivations behind its creation, how it works, and demonstrate several of its artifacts. 

Creative Constellation Generation

"Humor is incorporated into our daily interactions, but conceiving jokes ideas can be inherently difficult to produce spontaneously. The PAUL BOT system, “puns are usually lame but occasionally terrific”, includes features of the JAPE system by incorporating aspects of the SAD generator, templates, and sentence forms to automatically generate a pun (Ritchie 2003). A two-word database is composed of adjective-noun phrases that contain a homophone. The punchline to the pun is replacing a word in the two- word phrase with a homophone. A synonym is derived from the homophone, and a hypernym is chosen from the non- homophone word in the original phrase. The synonym and the hypernym are incorporated into a predetermined sentence structure to construct the question. Surveys were conducted to evaluate our artifacts produced by PAUL BOT in order to identify future improvements of the system. The creativity in the system is attributed to the novelty of the unique artifacts, the level of surprise, the typicality of the artifacts as classic puns, and the intentionality by providing the connection between the setup and punchline. This paper proposes the PAUL BOT system that incorporates the JAPE system to create puns in order to produce a humorous, creative system utilized for entertainment.
Source: github.com/knw7x9/PunGenerator"

Computational Humor: Automated Pun Generation

"We present ERwEM (Events Represented with Emotive Music), a system that generates cross-domain artefacts between text and music by drawing from emotional sentiments. Our system uses keywords extracted from a
news article to filter live-stream tweets containing these keywords and analyze the tweet collection’s emotion data. It then uses the emotion sentiment (a scale from positive to negative) to influence the mood of the music it writes using an adapted bi-axial long short term memory (BALSTM) model. From this, our system determines
which mode the generated song will be transposed to. We use the FACE model to characterize the creative aspects of our system as a collection of generative acts. We provide examples of the artefacts our system generates as well as the response we received from external sources who reviewed the generated songs."

ERwEM: Events Represented with Emotive Music Using Topic-Filtered Tweets

"We propose three methods for the adaptation of well-known sayings~(e.g., proverbs, movie titles) for a context, given by a textual input~(e.g. news headline).
These methods -- word substitution, analogy and vector difference -- present different ways of exploiting word embeddings for word replacement towards a new text that should be semantically related to the input, in the sense that it could be used as a sub-title or comment, though more creative.
They were further combined with two selection methods, based on word overlap and on sentence embeddings, and used in the production of text in context with a small set of Portuguese headlines. To better understand how well our purpose was suit, results were manually assessed. All methods produced text with both syntax and relatedness to the input above average, contrasting the underachieving funniness scores."

Exploring Word Embeddings for Text Adaptation to a given Context

In this paper, we present a system that generates letterpress-inspired typographic posters from a user-given text. This system employs lexicon-based approaches not only to recognise emotions and sentiments but also the colours related to the content. Moreover, the system generates and evolves outputs employing an Evolutionary Computation approach. The generated outputs are evaluated according to their legibility, aesthetics and semantics, throughout a multi-criteria hardwired fitness function scheme. Also, this system enables its users to guide the generation process through the dynamic definition of several setting parameters.

Evolutionary Experiments in Typesetting of Letterpress-Inspired Posters

The Pokérator is a generator of Pokémon names and descriptions, based on user input. The names are generated by blending words based on syllables or characters according to a bigram language model. An accompanying description is generated by filling a template with ConceptNet answers. This sentence is then used as a prompt for text generation with the GPT-2 language model which was finetuned on Pokédex entries. The evaluation of the generated Pokémon names shows that the names are not realistic, but appreciated and creative.

Downloads

Next from ICCC'20

Meta-level Evaluation and Transformational Creativity; An analysis of MEXICA

Similar lecture

Time for Music

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from ICCC'20

Meta-level Evaluation and Transformational Creativity; An analysis of MEXICA

Similar lecture

Time for Music

Downloads