Our Project:

Our final project was divided into an e-book website, a mini-game, and a game showcase video. The feature of our work is to provide an interactive experience, combining various media forms to create together. Since we focus on immersion, the ultimate goal is to make the player/audience the story’s character experience. I hope to present it comprehensively. In Asia, SCRIPT MURDER, also known as LIVE ACTION ROLE PLAYING, is widespread. The features of script murder are the atmosphere, props, and costumes. The owner sets up scenes from the script, provides costumes and props that match the plot, and helps players fully immerse themselves in the game. Therefore, the arrangement of the scene, the use of props, and the coordination of costumes will enhance the audience’s experience and participation, making them more immersed; such a comprehensive presentation will make the work more mature and complete. Compared to the current exhibition method, doing it this way would be more thorough, maximising the interactive media’s features.

CR: NEWYORK TIME

I will refine the game’s plot and settings further if I continue creating this project. Due to time constraints, the current storyline is relatively simple, leading to fewer choices in the game, which needs to be more prosperous. It is essential because it affects the audience’s experience. In addition, to present the project better, we must prepare more promotional materials. For example, this time, we did not get the opportunity for an on-site presentation; all projects were screened instead. Therefore, the audience could not personally experience our project and its features. Fortunately, we prepared a showcase video, but if we could also provide a trailer or an online launch event to introduce the project, it would have a better effect and attract more people.

Studio Projects:

My favorite project is re_generate. First, their work is visually complete and coherent, with little of the incongruity often seen in AI-generated content. The most successful aspect is their extensive use of AI in the memory part, using the instability of AI to create effects of memory loss and confusion. Turning the disadvantages of AI into the highlight of their work is a very clever idea. The nostalgic style is also outstanding, especially the first part, which gives a strong Y2K vibe, making me feel like I have returned to my childhood. In this studio, my biggest takeaway is that collaborating with AI and humans can achieve better results. This group has successfully proven that the collaboration between AI and humans can be outstanding with planned and purposeful development.

Another group that I think attracted is Wing Wing Situation. The name of a project determines whether it can attract people’s attention in the shortest time, and this name is very successful. Secondly, in the future, the impact and change of AI on people’s daily lives will undoubtedly be huge. This group has demonstrated how AI can integrate into people’s daily lives. Nowadays, AI is often seen as having negative social and ethical impacts, but this work illustrates that AI also provides convenience and benefits to society. In addition, their editing is humorous and realistic, making the audience feel pleasant while watching. The most crucial point is that during the course, we all participated in interacting with and tasting chicken wings. This interaction deepens our connection with the work, enhancing our anticipation of the project.

Other Studio Project:

The other studio I chose is Room with a View. I decided to do this because of my curiosity about creating engaging works using only sound in an era dominated by screen media. Audio media, especially radio, has gradually returned to public attention recently. Many users are willing to download radio apps. In China, more and more people are using radio applications like Himalaya and Xiaoyuzhou. Although radio media is criticised for being outdated and unpopular, it has essential social uses. When people cannot look at screens or are busy while driving or for the blind or elderly, obtaining information from the radio becomes crucial.

The work I am most interested in from this studio is FUN-Damental Access. Their content explores three future designs for Melbourne: housing, the Yarra River, and transportation. Their topics are very well-suited to the information that radio needs to convey. From my perspective, if I were driving and heard these three topics, I would perk up my ears to listen to what they say. Additionally, the interview format enhances the content’s authenticity and engagement, allowing listeners to understand other people’s thoughts and situations better. The characteristic of radio media is to provide information when people are away from a convenient situation, and the content of this project is both necessary and appealing for radio. Their recording is apparent in sound, and the music fits the theme well, giving listeners ample space to imagine the visuals without pictures.

Love Broker Website

https://s3749447.wixsite.com/my-site-2

Love Broker Game Showcase

Final Reflection

Week 5

TOGETHER IN ELECTRIC DREAMS – Blog 5

Week 6

TOGETHER IN ELECTRIC DREAMS – Blog 6

Synopsis – Stella

Love Broker

Scene – Suki

Love Broker Script

Reflection

This week, we continued to explore script writing and delved into the use of AI to assist with creative writing. In class, we engaged in writing exercises once again, and after multiple attempts at using AI for writing assistance, I still believe that AI helps create ideas, but its output tends to be too random and cannot compare to that of professional writers. This week’s reading also points out this issue. Through the practices of thirteen professional writers, it became evident that artificial intelligence can streamline certain aspects of the creative process, alleviating writers from tedium, but it cannot replace the entire creative process. The authors suggest that the future direction of artificial intelligence should be to assist people in solving the most time-consuming and tedious aspects of writing, a viewpoint with which I strongly agree.

As for our sketches, we encountered some challenges in the creative process. We were not familiar with the formats and distinctions between scripts and screenplays, so we sought assistance from ChatGPT, which provided us with helpful references. A script serves as the initial outline, encompassing dialogue and action but omitting the basic information required for production. On the other hand, a screenplay is the final outline, offering more detailed and comprehensive coverage than a script. Therefore, our production last week was a relatively basic script, this week, we learned how to create a more detailed screenplay.

The media work that caught my interest is Memo Akten’s “Learning to See” series. What’s fascinating about this series is that we don’t see the true essence of things; rather, we see our essence. The author uses machine algorithms to reflect on how we perceive the world. The images we see are not real; they are reconstructions based on our imagination and expectations. Similarly, artificial neural networks observe the world and attempt to understand what they see. However, they can only perceive through the filters they already know. They have only seen patterns like oceans, clouds, and flowers, so anything they generate is associated with these three things.

Synopsis – Stella

Film Title: 《Time Difference》

Introduction:

As a photo of Princess Catherine leaked, the British royal family once again found themselves at the centre of a storm, with public opinion washing over the proud royal dynasty like spit. To quell this uproar, the royal family hastily convened an emergency meeting. They decided to enlist the world’s top public relations firm to help them weather this crisis.

Main Characters：

Adam: The official representative of the royal family, issuing commands to the representatives of the civilian public relations companies. He is calm, serious, fiercely loyal to the royal family, and determined to help them navigate through this crisis.

Bert: The business manager of Beek, one of the top 3 public relations companies in the UK. He has outstanding business abilities and has helped a former US president resolve urgent crises, aiding in his successful reelection.

Cecelia: The head of Cemale, a rising public relations company in Singapore. She excels in handling cases related to women and is adept at using the female perspective to shift public opinion.

Dominic: The founder of Allion, one of the top 3 public relations companies in the UK, who also owns a cutting-edge AI studio. He specializes in integrating technology into public relations solutions, discreetly resolving challenges unnoticed.

Initial Conflict：

“Kate Middleton Dead,” “Kate’s Mysterious Disappearance,” “William Accused of Wife’s Murder” – these sensational headlines flood the internet alongside a photo of Princess Catherine lying in a hospital bed. Kate has been missing from the public eye for six months, repeatedly absent from royal engagements. Her absence has sparked panic among the British public, who have eagerly awaited her appearance, only to be disappointed each time.

Rising Action:
To quell the public’s panic and mitigate negative publicity, the royal family dispatches their trusted confidant, Adam, to seek out the most top-notch PR talents. Through meticulous selection, Adam identifies Bert, skilled in handling political crises, Cecelia, an expert in the female perspective, and Dominic, possessing dual expertise in PR and AI. He christens this trio with the code “Time Difference” team and commands them to devise the optimal plan within 48 hours to buy the royal family more time and soothe the public’s anxiety.

Climax:

With just two days at their disposal, Bert, Cecelia, and Dominic find themselves in the secret meeting hall of Buckingham Palace, exchanging looks of urgency. They swiftly scour through information and discuss feasible strategies. Racing against the clock, they are unaware of Kate Middleton’s fate and current status, but they must devise a plausible reason for her disappearance or find a way to bring her back into the public eye.

Falling Action:

After a brainstorming session, the “Time Difference” team will utilise Dominic’s AI solution. However, they’ve already spent 20 hours, leaving them with limited time. With only 28 hours remaining, they need to create a 100% realistic AI video to allow Princess Cathrine to communicate with the public via video.

Conclusion:

As the 48-hour deadline approaches, the “Time Difference” team successfully produces a video that satisfies the royal family. They release the video to major media outlets and the royal family’s exclusive channels, temporarily calming the storm. However, before long, a new controversy arose as numerous technology companies and AI enthusiasts declared the video to be AI-generated content. How will they face this new challenge?

Scene – Suki

(Inside the secret meeting room at Buckingham Palace)

Adam: Good day. I trust you all understand why I’ve asked you here.

Bert, Cecelia, & Dominic: Sure.

Adam: Princess Catherine cannot make an appearance at the moment. We need your help to stall for time. No further questions or discussions are permitted.

Cecelia: (hesitant) But if Princess Catherine cannot be present, then…

Adam glanced at Cecelia, causing her to immediately lower her head, refraining from further speech.

Bert: (sensing the tension, speaks up) How long do we have to come up with a solution?

Adam: 48 hours. I believe you all can handle that. Even if Princess Catherine cannot be present. (He gave Dominic a meaningful look, then rose and left the room)

Dominic: (meeting Adam’s gaze, understanding the implied message) No problem, we will make sure everything is taken care of.

Adam: (grasping the door handle, back to them) Also, for the next 48 hours, I need you all to stay here until a satisfactory response is provided.

Bert, Cecelia, & Dominic: (exchanging glances, feeling an unseen pressure) Sure, it would not be a bother.

Adam exits.

Cecelia: (exhales deeply) Do any of you have any leads?

Bert & Dominic: (shaking their heads) Not at the moment.

Cecelia: Then let’s start by researching, understanding the current situation. After all, we know nothing about the status of Princess Catherine.

Dominic: All we can see are speculations from the public. Many specifics are unknown to us. But we’re tasked with stalling for time, isn’t that a bit of a stretch… sigh…

Bert: (patting Dominic’s shoulder) We’ll figure something out. Let’s start researching, and we’ll discuss further later.

(20 hours later. They are visibly exhausted, having discussed for hours, yet no solution meets their criteria.)

Bert: (sighs) The situation is more than just tricky now. We can’t find much information. Do you have any other suggestions?

Cecelia: The ideas we’ve come up with are plausible, but they all require someone from the royal family to step in. And none of these proposals meet our own requirements. How could they possibly be satisfied? (She scratches her head) Is there any other way?

Dominic: (silent for a while, then suddenly speaks) What about using AI?

Cecelia: (slams the table) Absolutely not! Using AI is too risky; it’ll be easily detected.

Dominic: (contemplating for a moment) Then do you have any other ideas? AI is currently our best option, especially given our time constraints.

Bert: He’s right. If we keep hesitating, we’ll run out of time.

Cecelia: (hesitant) Shouldn’t we at least try asking Princess Catherine for a photo or a voice recording?

Bert: Didn’t you hear what Adam said earlier? Our only task is to buy time; the royals won’t step in!

Cecelia: Just because one person says it’s true, then it’s true. Likewise, if one person says it’s false, then it’s false. Have you considered the consequences if our use of AI is discovered?

Bert: Of course, I have thought about it but do you have a better solution then? (Staring at Cecelia)

Cecelia: Nope.

Dominic: Cecelia, you said it yourself: if one person says it’s true, then it’s true, right? We can only gamble now; time’s running out.

Cecelia: Fine, I’ll start drafting the message. You two better train that AI quickly. Let’s hope our gamble pays off.

Vlog

Week 1

TOGETHER IN ELECTRIC DREAMS – Blog 1

Week 2

TOGETHER IN ELECTRIC DREAMS – Blog 2

Week 3

TOGETHER IN ELECTRIC DREAMS – Blog 3

Week Three Reflection

The focus of this week’s was on sound, music, and voice. In class, we practised and learned various sound-generating AI tools. After class, I also explored AI-generated music works. Among them, “Heart on My Sleeve” by TikTok user ghostwriter977 caught my interest. This song utilises AI-generated voices imitating Drake and The Weeknd while incorporating popular lyrics from celebrities like Selena Gomez and Justin Bieber. From this song, it can be observed that generative AI could easily copy the voices of others, blurring the lines between human artistry and AI-generated content. I believe that the existence of this type of music is controversial in terms of ethics and legality. While such songs may indeed garner popularity in the short term, they have implications for the artists themselves, record companies, copyright issues, and the music industry as a whole. However, this song has now been taken down due to numerous threats

Based on the research mentioned above, I created a music video for this week’s sketch. I used AI generative software to extract Selena Gomez’s voice and sing Justin Bieber’s “Love Yourself.” Overall, I believe the effect is quite similar, with about 70% of Selena’s voice. In creating this song, I wanted to understand the difficulties and processes behind it. If a beginner can produce such music in a short time, similar actions in the future may cause more controversy. Additionally, I also made a video for this song. I recorded their first collaboration stage and converted the video into a pixelated style, giving the entire MV a humorous, funny tone with a hint of nostalgia and reminiscence. I believe using AI generative tools in this way is inappropriate. If it’s simply for humour or paying tribute, it might be more suitable. If the purpose is profit-driven, there may be legal implications.

AI technology indeed assists musicians by providing creative inspiration, expediting the music production process, and utilizing deep learning systems to create various music styles and performance forms, thereby pushing the boundaries of music creation further. Additionally, AI can generate personalized content based on user preferences, offering customized music experiences tailored to individual users and market demands, which is currently beyond human capabilities. If used in this manner, generative AI can provide more convenience and insights to the music industry. However, AI has always been a double-edged sword. How it is used determines what people can gain, whether it be enhanced creativity or potential risks.

References

Week Two Media Sketch

Week Two Vlog Reflection

Week One Reflection

Recently, the media work that has captured my interest is “The Next Rembrandt” by J. Walter Thompson Amsterdam and Microsoft.
This project involves the use of analytical algorithms and a study of Rembrandt’s works to generate paintings mimicking his distinctive style. What fascinates me about this piece is the concept of “resurrection.” The emergence of AI enables the revival of elements that were once lost. Such works not only pay homage to historical artists but also capture the essence of the artist to create new pieces. Last week, I came across a video created using AI on a forum. In a satirical manner, the creator “resurrected” Empress Dowager Cixi, transforming an old photograph into a dynamic form. Although virtual, the ability to revisit history in such a manner is both intriguing and entertaining.

This week, we utilized AI to create our own media sketches, and overall, I found the experience quite interesting. However, there exists a disparity between the final output and our expectations. We used Runway as the tool, and I’m uncertain whether the perceived gap is due to the tool still being in its early stages of development. While generating videos using text, I observed that AI exhibits a certain degree of accuracy in recognizing and generating content but lacks precision. In comparing emotions and actions, AI seems to be more proficient in capturing actions than emotions. In addition, I incorporated real images, hoping for a secondary generation based on these pictures, but the results were not satisfactory.
I believe AI places high demands on the clarity and conciseness of instructions; our provided instructions need to be clearer and more concise. Although the text box indicates a maximum of 320 words, I feel that AI struggles to generate content responsibly in a single attempt. This time, our team controlled the video duration at 4 seconds each. Next time, we could adjust to a longer duration to see if it conveys better results.

The reading that captured my attention in this week’s reading is the distinction between generative artificial intelligence (AI) and other forms of AI. Generative AI creates new works by gathering information. The reading mentions that “Generative AI is an automated form, and its outputs in this form are narrow and limited. These systems do not comprehend what they generate, nor can they evaluate their outputs, sometimes leading to misunderstandings.”(Garon 2023)
Reflecting on our media sketch this week, AI did indeed generate something resembling the overall direction but exhibited issues and lacked emotion. Currently, most AI is business-oriented, streamlining complex work, automating routine tasks, and increasing productivity and profitability. However, generative AI produces content rather than regular work. In the media world, where precision in content and final presentation is crucial, generative AI needs accurate capturing abilities. Similar to “The Next Rembrandt,” if AI cannot precisely capture the essence/artistic habits/core topic of the artist, it becomes challenging to create satisfying new works. Reading this article informed me about the distinctions in various forms of AI, and I look forward to trying more AI tools, using generative AI to create works in different media forms.

References

For Real World Media Studio: Dream, Alienation

In our studio, I chose the Dream group and was the first to experience their work at the exhibition. In my reflection for Week 13, I mentioned that the Dream team had done a great job with their exhibition setup, and it was worth taking inspiration from and learning. Therefore, I read the reflections of my teammate, Nat, from Week 9 and Week 10 (as this team has not yet posted contributions on the studio website). Their project aimed to ignite the five senses of the audience and deliver a powerful viewing experience. While experiencing their work, it was evident to me that they had designed the environment, lighting, objects, and sounds around the concept of dream. In particular, they attempted to create an as enclosed as possible environment using cardboard, which they referred to in their reflection as using “tunnel and confined spaces” to imply a “tunnel vision” concept.

Additionally, the blue lighting created a serene atmosphere that aligned perfectly with the theme of dreams. In Trevor Chen’s reflection, he mentioned that even without an explanation from the group members, the audience can freely experience their exhibition. This is also one of the remarkable aspects that I appreciate, as it creates a sense of storytelling and immersive experience through the atmosphere. It’s as if I was sitting there, watching the videos, and being transported into the narrative they intended to create. Their exhibition was the most immersive for me, and through each object and lighting, I could understand the dream-like concept they aimed to build.

Another group I chose was Alienation, and what impressed me about their project was the creation of a small booklet and the inclusion of an origami experience during the exhibition.

According to Gloria Ye’s reflection, the purpose of creating the booklet was to provide a sense of engagement for the audience. The booklet primarily consisted of visuals and text, enriching the project’s visual effects. Additionally, I believe the origami activity was an important step in providing a sense of participation for the audience. In my previous reflection, I mentioned that offering offline activities for the story allowed for greater audience involvement. (Attewell 2021)

Moreover, there is another aspect of the Alienation group that I find worth emulating. They incorporated the experiences of international students into their story, which helps evoke emotions in a broader audience. According to Allan Yang’s reflection, they intended to merge elements of reality and fantasy, using authentic experiences of international students to stimulate empathy in the audience and create a stronger connection to the story. According to (Dam & Siang 2022), empathy plays a crucial role in story construction, and authors need to have a deep understanding of the character’s motivations and emotions, incorporating empathy into the narrative. In this regard, I think this group did a great job. Although our story also aims to evoke empathy in the audience through the theme of love, I feel that the integration of story details is not as strong as in Alienation, and this is something I hope to attempt again in the future.

For Other Studio: Sound Futures

Project Name: A License to Krill

Project Name: The Last Bastion

The other studio I selected was Sound Futures. This semester, we conducted extensive research on transmedia storytelling. While I’m not particularly interested in sound-related studios, I prefer visual media technologies to audio ones. However, as sound is a type of transmedia technology, I’m curious to see what Sound Futures has produced.

I listened to two projects from Sound Futures studio, “A License to Krill” and “The Last Bastion,” and I must say that these work far exceeded my expectations for sound media. Both stories are futuristic science fiction narratives that use a variety of sound elements to impart their narratives. As I listened to these tales, vivid mental images of the narrative settings kept resurfacing. For instance, at the beginning of “The Last Bastion,” the sound of footsteps evoked an image of a weary wanderer urgently searching for a permanent home while walking on sand. In “A License to Krill,” the use of reverberation and resonance created a futuristic atmosphere. I realized that by listening to these sounds, I was able to conjure up precisely matched images and even consider more imaginative possibilities. Temple argues that sound plays a crucial role in scene narration by, among other things, conveying time and location, character backgrounds, narrative atmosphere, and intensifying existing emotions. These audio narratives from both projects demonstrate this theory plainly and piqued my interest in sound media. Perhaps I can also convey the story of “The Maya Odyssey” through sound, expanding the audience’s imagination.

Reference List

CARPENTER , B 2022, How to Create an Immersive Attraction Experience With Local Artists, Eventbrite Blog, viewed 31 May 2023, <https://www.eventbrite.com/blog/tech-immersive-attraction-ds00/>.

Dam, RF & Siang, TY 2022, The Power of Stories in Building Empathy, The Interaction Design Foundation.

iZotope 2018, Understanding Atmosphere in Music, and How to Create It, iZotope.

Temple, I 2022, Exploring the Functions of Music in Visual Media, Flypaper by Soundfly.