the Co-creation Space: Open Pilots
Supported by the Traction team, I facilitated and analysed two open pilots of the Co-creation Space that included 300 participants from 15 institutions. The first was a materials co-creation workshops with the Irish National Opera, and performance co-creation experience with the Liceu opera house in Barcelona.
(with the TRACTION project team at the opening of La Gata Perduda opera project)
Hypothesis: The team and I theorized that the CCS would be valuable to participants during moments when they needed to discuss and reflect on co-creation materials.
Method: To validate this hypothesis, we performed a mixed-methods analysis by triangulating four methods: 1) a quantitative statistical report summarizing usage of the tool across the workshop period, 2) a content analysis of CCS text, 3) a network analysis of interactions, and 4) qualitative group interviews of participant feedback collected on the last day of the workshops.
(screenshot from the Co-creation Space interface used during the LICEU pilot)
Summary of Use
My team and I compared professional and non-professional use of the tool for the two pilots. This included viewers per week, multimedia interactions, posts, multimedia uploads, comments, and emoji reactions. We interpreted results of usage in context of the ebb and flow of co-creation activities.
(Metrics data for one of the open-pilots)
Text Content Analysis
With the help of a second coder, I performed a content analysis of the open pilot text was performed through a qualitative coding procedure. First, we independently looked for open codes across the text of the two open pilots. In addition to the text coding, an automatic sentiment analysis was performed on the text using the AWS Comprehend cloud service that generated a positive, neutral, negative, or mixed response for each text.
We visualized the differences in discussion of the open pilots as tree maps, with higher saturation indicating more positive sentiment.
(Qualitative Content analysis codebook for Pilot data)
(Treemap visualizations showing the difference in the types of conversations
participants had during the two open-pilots)
Network Analysis
Our team performed a network analysis of interactions through the weeks of each pilot to understand the structure of the discussions taking place. We built a network with users as nodes, using node size corresponding to total posts and comments a user created.
(Networks of the two open-pilots, showing the types of interaction dynamics between professional and non-professional participants)
Post Pilot Interviews
A subset of professional and community participants from the two pilots were interviewed at the end of each pilot over Zoom to understand how they used the tool and what value it provided. These interviews, in combination with the quantitative data, led to a better understanding how to support discussion processes in different co-creation dynamics.
(screenshot of post-open pilot interviews)
Findings: We found that the relative differences in use and value of the Co-Creation Space between the two trials suggests that technology for artistic co-creation should support 1) flexible space segmentation, 2) direct and indirect communication channels, and should 3) consider new tool features in the context of existing app ecosystems. Click here for the detailed findings.