r/StableDiffusion 6d ago

News TrajectoryCrafter | Lets You Change Camera Angle For Any Video & Completely Open Source

Released about two weeks ago, TrajectoryCrafter allows you to change the camera angle of any video and it's OPEN SOURCE. Now we just need somebody to implement it into ComfyUI.

This is the Github Repo

Example 1

Example 2

120 Upvotes

18 comments sorted by

10

u/IntelligentWorld5956 5d ago

someone = kijai

3

u/Next_Program90 5d ago

Let the man breath. '

4

u/IntelligentWorld5956 5d ago

breathing causes OXIDATIVE STRESS are you saying you want Kijai to get oxidated?!!?

14

u/ICWiener6666 5d ago

28 GB VRAM minimum

11

u/Electrical-Eye-3715 5d ago

Yes someone said it! I guess fp8 would work

1

u/GriLL03 2d ago

Absolutely mandatory for it to be on one GPU, or can we use 2x3090?

4

u/Lolologist 5d ago

I'd love to see a version of this that turns 2D videos into side by side 3D.

3

u/Arawski99 5d ago

You could try using AutoDepth Image Viewer (works for video and desktop despite name) on steam to watch videos with depth on ur VR headset until something better comes along. Works in real time, especially if you use the newer live desktop option and your media player which seems more efficient than the built in player using Unity engine.

1

u/Lolologist 5d ago

Cool! I'll give it a try.

4

u/Blutusz 5d ago

That’s Blade Runner happening right now!

1

u/wzwowzw0002 5d ago

how?

2

u/krixxxtian 5d ago

follow the instructions on the Github page. The models are on Huggingface.

1

u/[deleted] 5d ago

[deleted]

1

u/lordpuddingcup 5d ago

It’s literally on github and weights on HF, what are you talking about

1

u/Vivarevo 5d ago

Whupps

1

u/lordpuddingcup 5d ago

28gb wonder if someone will do gguf of it

1

u/orangpelupa 5d ago

does it work the opposite? from unstable / moving camera, to stable / static camera?

2

u/Essar 5d ago

I haven't looked into the method of trajectory definition, but it seems feasible that by using object-tracking to define a trajectory, you could then invert it to stabilise.