My Mediafactory blog

This week’s studio experience has provided me with a deeper understanding of sound post-production and made me realize the significance of sound in film and gaming projects. The sound of the “Clicker” in the game “The Last Of Us” demonstrated by Cat left a profound impression on me. It proved how meticulously designed sound can create a unique atmosphere and evoke emotions in a game. Through an in-depth analysis of the sound production process, I realized that sound design requires a strong technical foundation and creative thinking.

In class, we attempted to emulate this distinctive sound using Valhalla’s plugins. During this process, I not only learned how to create specific sound effects by adjusting parameters but also found the exploration of sound design to be incredibly fascinating and challenging. Through continuous experimentation and adjustment, I gradually discovered methods to create similar sounds, which boosted my confidence in my future productions.

Furthermore, we engaged in foley exercises in the recording studio. I vividly remember vigorously crumpling plastic paper, attempting to mimic the sound of a campfire. While it might sound amusing, this practice made me realize that sound sources can be diverse and that creativity is crucial in sound design. Recording dry sounds using the Zoom H4n recorder further highlighted the techniques and importance of the sound collection. Clean recordings offer greater room for post-production, making sound effects more realistic and immersive.

 

 

What you were trying to achieve in terms of critically communicating about synthetic media and explain the method in which the editing process was used to attempt this?

Synthetic media has had a significant impact on the digital media landscape in the age of technology. It serves as a tool that utilizes artificial intelligence to generate virtual content. Through this technology, we can easily create virtual images, audio, and videos, opening up new possibilities and inspirations for content creation, entertainment industries, and news reporting. According to Jon M. Garon (2023), the application areas of synthetic media cover text, music, video, games, and design, with the potential to change the way we interact with media, thereby reshaping and influencing our communication methods.

However, with the development of this technology, we face numerous potential issues, including the spread of misinformation and privacy breaches. This may result in the abundance of false information and misleading content that we often encounter in news and social media.

In the film opening title sequence, the protagonist is constantly under surveillance by a mysterious figure, symbolizing the threat that each of us may face in terms of fake information and privacy violations. I hope such a story design can deeply immerse the audience in the protagonist’s anxiety and fear and imply the negative effects that synthetic media may bring. As emphasized by Bobby and Danielle (2018), synthetic media technology may be widely

disseminated and popularized, regardless of whether participants possess a high level of technological literacy or responsibility. Fake synthetic media content may be used for malicious purposes, such as spreading misinformation on social media, defame persons, or engaging in online scams, causing irreparable harm and losses to people.

Therefore, while synthetic media technology brings many new possibilities and innovations, we cannot overlook its potential negative impacts. Gregory (2018) believes, “Equally troubling, hyper-realistic simulations or manipulated personalized audio and video may erode the concept of truth.” In the digital age, the credibility of media has become a significant concern, and the misuse of synthetic media technology may further undermine the public’s trust in the sources of information and the authenticity of the content.

 

How did your preproduction/production/post-production process go and what would you do differently/improve next time?

During the pre-production, I dedicated considerable time to pondering the most compelling theme for the opening sequence. My aim was to captivate the audience’s attention within 2 minutes. After thorough deliberation, I decided suspense theme, a genre I personally enjoy watching in movies. To gain further inspiration, I extensively studied the openings of suspense films online and found inspiration in a Korean TV series “BLIND.” With a clear direction in mind, I approached the filming process with a preconceived storyline. The narrative’s core revolves around the protagonist facing tracking by an enigmatic figure.

The mysterious figure always attempts to pry into the protagonist’s life and actions. I find this storyline captivating, and I’m filled with anticipation for future filming and production. However, during the filming process, I encountered challenges. The limitations of having only one camera hindered the ability to capture images from multiple angles simultaneously, making multi-camera shots difficult. This constraint limited my use of certain shots, affecting some of the intended effects I had envisioned. To overcome this, I decided to use the text-to-video feature of RUNWAY to generate some shots that enhance the suspenseful atmosphere. I also incorporated some green screen effects to enhance the visual impact of it. I had no filming experience before this, so I struggled with shooting skills. During the filming, I struggled to effectively convey the specific actions and expressions I needed from the actors. In post-production, I encountered new challenges as well. One major issue was organizing and selecting the video footage. I shot a lot of material, but not all shots were suitable for the final edit. It took me much time to review and choose the most appropriate footage. Adding sound effects and background music also posed challenges. Despite planning some sound effects and music in advance to create a suspenseful atmosphere, it was difficult to find ones that perfectly matched the video’s rhythm and mood. The beginning of the synchronization between sound effects and videos was not ideal and required constant adjustments and refinements.

However, amidst the challenges, I also experienced some pleasant surprises. Sometimes, unexpected events or sudden inspirations led to outstanding shots in the film. This made me realize how valuable creativity and inspiration can be in the process of filmmaking.

Next time, I want to experiment with different filming techniques to enhance the story and beauty of the movie. More special effects will enable me to create a fascinating atmosphere and will better convey the film’s vibe to the audience. I’ll also learn different shooting techniques, such as time-lapse photography, fish-eye lenses, and tilt-shift lenses.

 

Your reflection should also include commentary on what you thought the most and least successful parts of your Film Opening Title Sequence were, and why so?

In this production, I believe the most successful aspect was the integration of background music and sound effects with the video. Though I encountered challenges initially, through continuous selection and refinement, I achieved a result that I am highly satisfied with. I matched appropriate video footage with changes in the music’s melody, providing the audience with a perfect fusion of auditory and visual experiences. To further enhance the overall atmosphere of it, I gave careful consideration to the selection of sound effects. For instance, I used heavy footsteps to convey the protagonist’s tension, snake hissing sounds to add a sense of mystery and eeriness, and the sound of a heartbeat to bring the audience closer to the protagonist’s emotions. These sound effects made it more authentic and vivid.

In this production, I consider the least successful aspect to be the video color grading. Despite making numerous attempts during the color grading process, I couldn’t achieve the color scheme I had envisioned, leaving me frustrated. I believe that successful color grading is crucial for a film as it imparts a unique style and atmosphere. Unfortunately, I couldn’t live up to my own aspirations because of how little experience I had in this field. A worthwhile lesson was imparted to me by this incident. Even when faced with difficulties during production, I think it’s a great chance for learning and development. I  realize my shortcomings and plan to dedicate myself to learning video color grading techniques to improve my skills. I am confident that in future productions, I will master more color grading techniques, creating visually captivating and unforgettable works.

References：

Garon, Jon M. 2023. A Practical Introduction to Generative AI, Synthetic Media, and the Messages Found in the Latest Medium. NSU: Shepard Broad College of Law.

Gregory, Sam. 2018. Mal-uses of AI-generated Synthetic Media and Deepfakes: Pragmatic Solutions Discovery Convening. Harvard Kennedy School: Shorenstein Center on Media, Politics and Public Policy

Chesney, Robert and Citron, Danielle Keats, 2018. Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security. 107 California Law Review 1753 (2019), U of Texas Law, Public Law Research Paper No. 692, U of Maryland Legal Studies Research Paper No. 2018-21.

 

Story Board Material

 

Screen Shot Of Production

W1-W3 Reflection

Synthetic Video Reflection Week 1

Synthetic Video Reflection Week 2

Synthetic Video reflection Week 3

 

In this week’s class, we discussed the gradual realization of AI development, which has led to the intelligence of machines. Modern robots are no longer straightforward program executors; They are more like intelligent, self-aware creatures. The advent of VR technology has further contributed to the advancement of modern robots. As Gergana (2022) points out, the integration of VR technology has provided robots with a more real and immersive experience, enabling them to perceive and understand the human world. With technology advancing further, it has raised a series of thought-provoking questions about the moral and ethical responsibility of robots. How to ensure that the decision-making of robots conforms to human values and moral standards has become an urgent problem to be solved.

We also used Murf to generate a completely virtual voice, with its powerful capabilities to produce any desired voice and even control the emotion and intonation of speech. This technology holds immense potential for improving life and advancing society, such as by enabling more efficient communication, providing convenient services, and even assisting in the medical field. However, we must also recognize the challenges and risks that these technologies may bring. When utilizing virtual voice technology, we must carefully consider its potential impacts on interpersonal communication, information authenticity, and privacy protection, ensuring its ongoing development aligns with moral and social ethics.

references：

Mileva, G 2022, VR Robots: Enhancing Robot Functions With VR Technology | ARPost, arpost.co, viewed 3 August 2023, <https://arpost.co/2022/12/09/vr-robots-robot-functions-vr-technology/>.

This week was a highly meaningful learning experience for me. We delved into in-depth discussions about Deepfakes and Metahumans, which are hot topics in today’s digital media production field. Gaining a deeper understanding of these concepts has provided me with a clearer perspective on cutting-edge technologies in digital media production.

About Deepfakes, I learned that it is a method that uses artificial intelligence technology to synthesize realistic virtual video or audio content. This technology has enormous potential in the entertainment and digital art fields, but at the same time, it has also raised a series of ethical and security concerns. Hamilton refers that： Synthetic media enhances brand interactions but poses ethical questions about usage, security, and authenticity due to the difficulty in differentiating real from ultra-realistic fake content. This made me realize the importance of authenticity in the digital age and prompted me to approach media production with caution and a sense of responsibility.

Metahumans is indeed a remarkable concept. We used MetaHuman Creator to create our own virtual human avatars. I was deeply impressed by the advancement of this technology, as character design, which used to be a complex and time-consuming process, can now be accomplished more efficiently through MetaHuman Creator. This brings convenience to synthetic video production and opens up new possibilities in character design.

References：

Hamilton, P 2019, Deepfaking and the ethics of synthetic media – AdNews, www.adnews.com.au, viewed 27 July 2023，<https://www.adnews.com.au/opinion/deepfaking-and-the-ethics-of-synthetic-media>.

I had a truly unforgettable learning experience in the first week of the studio. I had never been exposed to any film-making-related studios before. However, in the Synthetic Video studio, I was able to experience the joy of filmmaking. During the first class of this week, we used the 3D LiDar Scanning feature in Polycam to scan objects around us. I  scanned my backpack, and the processed result left me surprised. The scanning process captured the complete details of the object and presented it in a 3D format. Later, we used Runway AI to generate a video. I couldn’t help but marvel at the power of AI and how its presence has become a crucial aid in filmmaking. The videos generated by AI are so realistic that it’s hard to distinguish them from reality. In her article, Yaxing Li points out, “The rapid development of AI technology has opened up new possibilities for film-making, providing strong support in various aspects, from visual effects synthesis to intelligent editing.” I believe AI can help broaden the creative space in filmmaking, enabling filmmakers to better materialize their ideas.

In the end, we also shot a green screen video and used PR’s keying function to isolate the subject from the video. This technology allows for the freedom to replace backgrounds during production, providing filmmakers with greater creative freedom and flexibility. Not only does this feature save production costs, but it also delivers more authentic and breathtaking film visuals.

Reference：

Li, Y 2022, ‘Research on the Application of Artificial Intelligence in the Film Industry, SHS Web of Conferences

Real-World Media explores questions of old/new media, material culture, and the potential for telling stories in a mixture of digital and real-world modalities. After a whole semester of learning, each group produced their final exhibitions based on this concept, presenting stunning works. I developed a strong interest in the exhibit of the ALLENATION and THE VILLAGE REPORT groups, and they both showcased the innovative potential of transmedia elements.

The intriguing aspect of the exhibition “ALLENATION” lies in their depiction of international students as aliens and their clever use of various transmedia techniques to convey the experiences and psychological states of international students. The story is adapted from real-life study abroad experiences, which created an emotional resonance within me as someone who shares similar experiences. While the topic of the story is not uncommon, the concept of metaphor through the way of “aliens” adds a mystery to the artwork. They also created a physical booklet that expands the story into different media formats. It allows me to delve deeper into the story and embark on my own exploration as I read through its contents. The combination of illustrations and text allows me to have a more intuitive understanding of this story. This booklet successfully provides more details and depth to the entire narrative, enhancing my immersive experience.

They also have a paper-folding activity, and I actively participated in this. I could create origami models that corresponded to the characters and scenes in the story, bringing the elements of the narrative to life. The production of this real-world craft not only enhances the sense of interactivity but also allows me to have a deeper understanding and experience of the story. In the end, I realized that what captivated me was not only the creative form of the ALLENATION. What fascinated me, even more, was that I found my own reflection in their work and, after the experience, deeply felt the uniqueness of the international student identity.

Soon after, I was drawn to the props on the table of THE VILLAGE REPORT: a sword and a golden bottle. This exhibition is based on a fictional village as the game background, where 5 players are assigned different skilled roles. Players need to discuss, reason and even observe the subtle expressions of other players to find the real culprit. In addition, this game combines real-world media and transmedia elements, giving me a greater sense of participation and immersion, and creating an illusion of being immersed in the fictional village. It allows me more than just passively watching; I can actively participate in it. By thinking and engaging in real interactions, I can deduce the game’s clues. The presence of physical props adds a sense of realism and interactive enjoyment. The feeling of grasping the sword and gently shaking the golden potion bottle all made me feel connected to the game world. The virtual characters and game rules provide the game with more possibilities and challenges. Through interaction and cooperation with other players, I experienced the fun of the game and the challenges of reasoning.

I was invited to participate in the exhibition at Festival Experience Studio. It was a completely new field for me. I approached it with a learning mindset, hoping to gain new knowledge from the experience. On-site, I saw a professional team working together, each fulfilling their respective roles. I received a beautiful booklet, which enabled the audience to select the movies they were interested in. As Brown’s research： precise and engaging design not only captures the audience’s attention but also provides the necessary information, encouraging audience participation. The behind-the-scenes technical team also demonstrated their expertise in website and social media production. They introduced to me how they utilized innovative technological means to transform exhibition information and interactive experiences into content on websites and social media platforms. This enables the audience to gain early insights and participate in the exhibition, deepening their understanding and interest in the exhibition’s themes and activities. I admire their creative abilities in digital media, as these technological methods have expanded the impact of the exhibition and reached a wider audience.

I have great respect for their work, which has made me realize that a successful exhibition relies on the collaboration of both the front and backstage teams. Their professional skills and creative thinking have made significant contributions to the success of the exhibition. Additionally, they have sparked my interest in media production and teamwork.

 

References：
Brown, A. (2019). The Role of Design in Enhancing User Engagement.

This week we successfully completed the final exhibition and Our table was very busy. I played our theme song “Cupid’s Arrow” playing as the background music.I think a theme song is very necessary for our project. When I was creating the theme song, I deliberately chose an accompaniment that suited the romantic story. Additionally, I wrote lyrics that aligned with the game’s narrative. I do this so that we can be the focus of the exhibition.

During the exhibition, I realized that many audiences came because they heard the theme song.I started thinking: What role can the theme song play in attracting the audience and enhancing the impact of our exhibition? Smith states： The role of music in an exhibition is not only to capture people’s attention but, more importantly, to create an emotional resonance and enhance the audience’s experience of the exhibition.”This made me realize that the theme song is not just a form of artistic expression, but it can also easily establish an emotional connection with the audience, thereby sparking their interest and resonance. Based on these emotional resonances, can further deepen their understanding and engagement with the content of “The Maya Odyssey”.

In addition to engaging the audience and guiding the mood, theme music can enhance the memory effect of the exhibition. According to Brown’s research, music as a trigger of emotions and memories, can help people better remember things related to music. In our exhibition, the theme song “Cupid’s Arrow” serves as a bridge between the audience and the game content. Through the power of music, the audience can easily recall the plot and details of the game.

References list：

Smith, J. (2018). The Role of Music in Capturing Audience Attention.

Brown, L. (2021). Music as a memory trigger in exhibition design: Enhancing visitor engagement and recall.

This week we completed the creation of the forum website. The site not only contains the full story of <The Maya Odyssey> and also provides a dedicated area for players to communicate and interact. When making the website I was thinking about a question: What role can the website play in transmedia? Is it necessary to maintain user relationships?

Forum websites play an important role in promoting participation and sharing information in transmedia. Our website shows a complete story, adding appeal to the game and facilitating players’ understanding of it. I want to make the website an open and friendly community of players, as Lamb refers: “Forum sites provide a platform for users to communicate, discuss and share their understanding and experience of stories with other users.”Player interactions and discussions on the forum can facilitate more effective and widespread dissemination of game information, further realizing the concept of “community.”

The forum website plays a pivotal role in enhancing user experience and promoting a sense of community. Through the forum functionality on the website, players can engage in discussions about the game with like-minded peers, fostering intimate and unique relationships with them. Building a website can successfully cultivate a sense of belonging, and when players play the game, they feel that they have a group of companions with them, which leads to a more fulfilling game journey.

In addition, the website can serve as a medium for us to build lasting relationships with our players.” Through the website, we can stay connected with users, ensuring their ongoing engagement and sustained interest.”（Kaplan，2010）It also allows players to provide us with feedback so that we can promptly optimize them to meet their expectations. We also constantly updating the site to provide new interactive experiences to attract and keep players engaged, thus building a strong community and loyal user base.

Reference list：
Kaplan, A. M., & Haenlein, M. (2010). Users of the world, unite! The challenges and opportunities of Social Media.

Lamb, C. (2013). Speaking of users: On user discourse in online fan fiction communities.

This week we started work on audio, side story, and social media. I was mainly responsible for audio recording and production. In the production process, I considered its various functions in transmedia. I wanted to connect it to a romantic treasure hunt story that would resonate with the player.

Audio, as an integral part of transmedia storytelling, can create an immersive experience for the audience. Gaver points out that： “Sound can provide a rich and evocative means for conveying narrative information, mood, and atmosphere.” Therefore, I first analyzed the story’s background and the game’s setting. On this basis, I chose the background sound in line with the style to render the relaxed and happy atmosphere of the game. Since there are many elements on the map, I choose different sound effects according to their different characteristics and functions to make the experience more attractive. I changed the voice tone to make each character unique because it can give the player a multi-layered experience.

In addition, audio can creates an effective connection between the story and the audience, It plays a significant role in enhancing player stickiness. Schafer refers that：“ Sound can touch the audience’s deep emotions and arouse their memories, emotions, and associations.”Vivid sound effects may touch the childlike interest in the player inside and even trigger their memories of certain experiences and arouse their yearning for a beautiful story world. This creates an emotional sense of belonging to our story.

We hope to incorporate a complete story within the game, so I personify the elements in the visuals, giving them the ability to speak. By allowing objects to narrate the story, we cleverly weave together the storyline while simultaneously creating a sense of fantasy that transports players deeper into the virtual world.

References：

Gaver, W. W. What in the World Do We Hear? An Ecological Approach to Auditory Event Perception.

Schafer, R. M. The Soundscape: Our Sonic Environment and the Tuning of the World.

During the production process this week, I have been thinking about these questions: As a love treasure hunt game, who is our target group? How to choose the appropriate transmedia narrative form according to the needs and preferences of the audience? Why can treasure hunting games increase players’ sense of participation and experience in the game?

First, we need to determine the likes and interests of the target audience before formulating the story and game mode. Henry Jenkins, emphasizes the importance of understanding audience preferences when choosing suitable storytelling formats. He states: The preferences and demands of the audience should shape our storytelling decisions. Based on the content of our stories, we decided to target the audience: 18-50 years old; people who have love experience, are active on the Internet, and are keen to participate in offline activities.

Secondly, we need to consider the needs and preferences of the audience and choose a transmedia narrative method that suits them. In response, we changed the original story name from <Romantic Treasure Hunt>to <The Maya Odyssey>. The changed name has more adventurous meaning, which can better attract them to join our story. As Richard Bartle said: Treasure hunting games can stimulate players’ goal orientation and motivation to solve problems, thereby increasing user participation and investment in the game. In order to create an emotional connection with the players, we chose to use a physical map and Letter. This kind of real-world media form allows the audience to truly touch our stories, and the audience can more directly participate in our story world.

References list：

Jenkins, H. (2016). Convergence culture: Where old and new media collide.

Bartle, R. A. (2010). Designing Virtual Worlds. New Riders.