Tsukiji Memory: A One-Man Production Exploring the Lengths of AI Possibilities
As a VFX artist and producer with extensive experience working on high-profile projects, Michał Dwojak-Hara, managing director at Juice, says he is “acutely aware of the significant time and resources that are traditionally required” for short film animations. So with the onset of AI and the numerous tools available, he became naturally intrigued by what it could mean for creativity.
In an effort to test the limits of what is possible, he created ‘Tsukiji Memory’ – an AI powered short film that challenges the status quo and pushes the boundaries of possibility. “The quality may not be on par with massive, high-budget productions, but that’s not really the point. This project is about exploring where the industry is headed and what we can achieve right now, with the tools we have today.”
To find out more about his experimental film, LBB’s Sunna Coleman interviews Michał about drawing inspiration from his trip to Hong Kong, the tools he used to get the style right, and how he believes AI can push creative evolution forward.
LBB> Tell us about how this project came about.
Michał> I actively explore new AI tools, especially Stable Diffusion (ComfyUI), which I've been fine-tuning and integrating into my daily workflow as a complement to traditional tools. At Juice, we’re heavily invested in developing AI tools as part of our R&D efforts to enhance our pipeline, and all of my explorations are naturally aligned with and inspired by this direction.
This project felt like the perfect opportunity to put those ideas to the test. I wanted to see how AI would perform in full-scale production and benchmark it against similar work we've done using more traditional methods. It’s all about finding where it can amplify our workflow while still leaving room for the artistry and precision that only humans can bring.
LBB> What was your inspiration and starting point?
Michał> You know what really got this project rolling? My awesome trip to Hong Kong. The city’s vibe was electric and felt like the perfect reference for the old-school Tokyo fish market I set the story in – it just clicked. I took a walk around Tsukiji Market, camera in hand, capturing photos to build a solid mood board. Then I experimented with the images to lock in the lighting and atmosphere I wanted.
Then, getting the look just right in ComfyUI and Flux was not exactly smooth sailing. There was a lot of trial and error (and, let’s be real, some late-night frustration hah). But once I figured it out, I leaned into it. The wide shots? Highly stylised for impact. The close-ups? A bit more raw and intimate. It’s all about creating that contrast to make it pop.
LBB> The short film is entirely created and produced by you. How long did it take you to complete and how did you organise yourself to undertake such a big project?
Michał> I squeezed this project in between my producer / supervising duties – because who needs sleep, right? It took me about two weeks to create all the visuals and another week to fine-tune the music and editing.
Thankfully, we’ve got a dedicated AI PC setup in the office. I used it remotely for generating stills and animations, and it was a lifesaver. It meant I could keep my own computer free for the usual day-to-day chaos while letting the AI machine do its thing, free for regular tasks while tapping into some serious computing power.
LBB> Which AI tools did you use and why?
Michał> From the start, I prioritised tools that offer precise control to bring my vision to life. Instead of using platforms like Midjourney which limit control over layout and framing, I relied on tools – ComfyUI with Flux, Loras and ControlNet – to maintain full creative control.
Building on our Juice AI team’s workflows, I enhanced the process with geometric scenes in Houdini as references for ControlNet. I then used KLING AI to animate still images, chosen for its superior quality and minimal artifacts. After creating two-five animations per shot, I finalised everything in DaVinci Resolve for editing, colour grading and adjustments.
Above: ComfyUI
LBB> What were some of the biggest challenges on this project?
Michał> Maintaining visual consistency across all shots was initially a concern, but after developing a robust ComfyUI setup and conducting thorough R&D, I knew we could achieve a cohesive look. The main challenge shifted to generating enough high-quality animation frames without introducing visual artifacts in the final edit.
LBB> Was there anything that surprised you? Were any elements of this project more difficult than you imagined them to be?
Michał> The airplane shot was quite an adventure! I needed to add some special touches with compositing to make it really shine. The tricky part was getting the plane's movement to look natural – these AI tools tend to keep everything in slow motion, and there's no way to tell them "hey, make this plane zip across the sky!" Sometimes the plane would get a bit camera shy and either try to blend into the buildings or play hide and seek! I can't tell you how many cups of coffee it took to get that shot perfect, but that's part of the fun of pushing creative boundaries in AI.
LBB> What are you most proud of achieving on this film?
Michał> The ending of the movie features a powerful mirror reflection of the main character. This reflection carries deeper meaning, raising questions about the relationship between humanity and artificial intelligence. By deliberately keeping the face in shadow, I enhanced the scene's mystery. The final result, with its fluid animation and authentic mirror imperfections, creates an impact I haven't seen before in AI-generated footage.
LBB> Has your opinion on AI changed at all after taking on this project?
Michał> Honestly, this project demonstrates the potential of AI tools, particularly those developed in-house at Juice, to enhance our creative capabilities. Even as a one-person team, I could achieve results that would’ve been unthinkable a few years ago. Imagine what smaller teams could accomplish with the right tools – they’d be able to take on projects that were once reserved for much larger studios. AI doesn’t replace creativity, but it amplifies it and definitely levels the playing field.
LBB> What are your feelings on the final piece?
Michał> I've been deeply engaged with AI technology since its early days, consistently exploring and testing new tools. This project marks my first venture into creating content at this significant scale. Drawing from my extensive experience with traditional CG production resources, I'm impressed by the efficiency of this process. The rapid advancement of AI tools, with weekly updates and continuously improving render quality, has exceeded my expectations.
LBB> Anything else you’d like to add or that we should know about?
Michał> New technologies are fundamentally transforming our workflow and project organisation. These tools empower us to develop initial concepts and run tests with unprecedented efficiency. Yet the creative vision remains firmly in human hands. AI serves as a powerful tool that enhances our creative process. Rather than fearing job displacement, artists should embrace this technology's potential to elevate their projects to new creative heights. We're in an era of innovation – just as past technological advances have shaped our industry, we're now positioned to harness these new capabilities and drive creative evolution forward.
