The computer starts to determine the 'outline' around the performer, and the more the performer moves, the clearer that 'outline' becomes. It has a paramater called "Performers" which is set to 1 by default, telling the computer that there's only 1 performer in this scene, and it's only looking for one continuous area.įirst, the computer tracks forwards through the footage looking for portions of the screen where there is major change over time. The effect is called "Movement Rotoscope". So let me try to explain how this might work… (Even basic video compression is able to identify areas of minor/major movement in the picture.) The calculations are quite similar to AE's existing motion tracking. Maybe I haven't made my idea clear enough? No AI is needed. I'm not trying to discourage you from submitting a feature request, but the reality is that the tool would only work on certain kinds of footage much the same way that Rotobrush will only work on footage that was either purposely shot or accidentally shot with Rotobrush in mind. The automatic background replacement you can get from your webcam doesn't have to deal with camera movement and it knows what focus distance is. It's not that you couldn't build an AI system that identified common shapes and looked for them, but you would need a supercomputer to get any kind of speed out of analyzing footage, especially if the camera moves. Look back and forward one frame, examine the luminance value of every pixel, look at the blocks of color information, determine which pixels have changed, then look back another frame and forward another frame and make sure that the actor that hasn't moved their head for 2 frames is actually moving so you don't remove his head, then look back and forward another frame so you can compensate for the actor that just stopped moving, then do it again until something on the actor moves and the software can predict that the pixels that make up the actors head should stay. No lighting changes, no wind, no video noise or compression artifacts.
For that kind of a tool to work nothing in the background could move at all.
0 kommentar(er)
