Did We Just Change Animation Forever?

I thought Midjourney was better as well, until I saw some recent videos from Corridor Crew on Youtube. For those who don't know, this is a VFX studio in LA that tries to keep at the cutting-edge of video production techniques and posts content to their Youtube channel, and they have a massive number of followers and several viral videos. They recently created a full 7-minute anime using Stable Diffusion with their own models and their existing video production gear, I'll post the links and let the results speak for themselves The actual 7-minute anime piece produced using SD: [link] Behind the scenes: "Did we change anime forever?" ▶ this video "VFX reveal before and after" [link]

in “Introducing ChatGPT and Whisper APIs” · View on HN

> There was a video of some guys doing this (sorry can’t find it) to make an anime type animation. With consistent characters. They used videos of themselves running through their own models to make the characters. That was Corridor Crew: ▶ this video

in “Sora: Creating video from text” · View on HN

The characters here are processed with Stable Diffusion. This is an impressive progress in the field of video generation with help of AI, considering how consistent the generated characters look like across frames, in my opinion. Also here is another video ▶ this video "Did We Just Change Animation Forever?" where they demonstrated how it came to be.

in “Anime rock, paper, scissors [video]” · View on HN

This reminds me alot of this techniquefor turning live action into animation: ▶ this video It unsurprisingly received alot of pushback from people in the industry but I think it's really impressive.

in “Wonder Studio: this AI-powered tool might be a preview of the future of VFX” · View on HN

The issues you mention with Stable Diffusion are teething issues. Here's an example of a current technique to get temporally stable animations with Stable Diffusion - [link] Corridor digital show off a similar technique here - ▶ this video GPT4 with its new plugin architecture is rapidly becoming more capable. I think you're absolutely correct in the tendency of all LLMs to hallucinate is a major issue that we don't know how to correct even in principle. But there are techniques to moderate its impact on responses - triangulating using multiple models, citing sources etc. You could build an assistant like say this, today - [link] to make your appointments and answer the phone today, using technology like Uberduck for voice generation, GPT for conversation analysis and DeepSpeech, Kaldi or Whisper for speech to text. I agree with the criticism that we're not likely to develop AGI this way. We're not going to have a wilful agent with it's own goals trying to escape the bonds of its server to destroy humanity any time soon. But that's not necessary for this technology to be incredibly dangerous. A mindless philosophical zombie with the capacity to convince people it isn't could lead to an extinction event too. Given that we don't understand precisely how these models process information, how to imbue them with goals or motivation (or measure those), how to accurately assess how well they've been trained - or any of a dozen other major alignment issues - there's a strong argument that

in “If AI scaling is to be shut down, let it be for a coherent reason” · View on HN

The whole thing with SD is extremely interesting and difficult to keep up with as there are so many new things coming in almost daily. Just last week I saw ControlNet[1] which ads a lot more control. Today I saw what corridor crew[2] did to stabilize the randomness when you want to make videos. Very exciting. [1] [link] [2] ▶ this video

in “Diffusion with Offset Noise: Finetuning SD to generate very dark or light images” · View on HN