Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when I change the keyframes from 2D to 3D[Bug]: #837

Open
3 tasks done
cyberbadger6969 opened this issue Aug 9, 2023 · 4 comments
Open
3 tasks done

Error when I change the keyframes from 2D to 3D[Bug]: #837

cyberbadger6969 opened this issue Aug 9, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@cyberbadger6969
Copy link

Have you read the latest version of the FAQ?

  • I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

  • I have Deforum updated to the lastest version and I still have the issue.

What happened?

when I go to the deforum and change the keyframes to 3D it shows mee this error:
Error: 'Input type (float) and bias type (struct c10::Half) should be the same'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of . Full error message is in your terminal/ cli.

Win11
GTX 1660Ti
Python3.10.6

Steps to reproduce the problem

Go to Deforum
Change keyframes to 3D
Click generate
ERROR

What should have happened/how would you fix it?

No response

Torch version

[webui [5ab7f213]
deforum exten](torch: 2.0.0+cpu)

On which platform are you launching the webui with the extension?

Local PC setup (Windows)

Deforum settings

https://drive.google.com/file/d/1bnOKfQIgegX4wdNfWEvhKUIiHyeR_y8A/view?usp=sharing

Webui core settings

https://drive.google.com/file/d/1j5OvKc4Y6fyGnvjZfT4UspVGQSGzQuqc/view?usp=drive_link

Console logs

Already up to date.
venv "E:\DEFORUM\stable-diffusion-webui-directml\venv\Scripts\Python.exe"
fatal: No names found, cannot describe anything.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.5.1
Commit hash: b180d1df30125ed606f94a779536f2dfb8aca74a


Launching Web UI with arguments:
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
2023-08-10 02:22:14,497 - ControlNet - INFO - ControlNet v1.1.237
ControlNet preprocessor location: E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-controlnet\annotator\downloads
2023-08-10 02:22:14,579 - ControlNet - INFO - ControlNet v1.1.237
Loading weights [879db523c3] from E:\DEFORUM\stable-diffusion-webui-directml\models\Stable-diffusion\dreamshaper_8.safetensors
*Deforum ControlNet support: enabled*
Creating model from config: E:\DEFORUM\stable-diffusion-webui-directml\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 12.1s (launcher: 1.3s, import torch: 4.5s, import gradio: 1.2s, setup paths: 1.6s, other imports: 1.8s, list SD models: 0.2s, load scripts: 0.8s, create ui: 0.4s, gradio launch: 0.3s).
DiffusionWrapper has 859.52 M params.
Applying attention optimization: InvokeAI... done.
Model loaded in 4.2s (load weights from disk: 0.6s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.5s, move model to device: 2.1s, calculate empty prompt: 0.1s).
started run_deforum
times_to_run: 1
Deforum extension for auto1111 webui
Git commit: ff0680bb
Starting job task(vvbsc33qytsrqt0)-0...
Saving animation frames to:
E:\DEFORUM\stable-diffusion-webui-directml\outputs/img2img-images\Deforum_20230810022355
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Animation frame: 0/120
Seed: 3690456440
Prompt: tiny cute bunny, vibrant diffraction, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│   0   │ 0  │ 0  │1.75│ 0  │ 0  │ 0  │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [00:40<00:00,  1.60s/it]
Animation frame: 2/120  █▊                                                            | 25/556 [00:37<13:06,  1.48s/it]
Creating in-between cadence frame: 0; tween:0.50;

*START OF TRACEBACK*
Traceback (most recent call last):
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\run_deforum.py", line 94, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\render.py", line 305, in render_animation
    depth = depth_model.predict(turbo_next_image, anim_args.midas_weight, root.half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth.py", line 88, in predict
    depth_tensor = self.midas_depth.predict(prev_img_cv2, half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth_midas.py", line 60, in predict
    midas_depth = self.midas_model.forward(sample)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 166, in forward
    return super().forward(x).squeeze(dim=1)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 114, in forward
    layers = self.forward_transformer(self.pretrained, x)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 13, in forward_vit
    return forward_adapted_unflatten(pretrained, x, "forward_flex")
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\utils.py", line 86, in forward_adapted_unflatten
    exec(f"glob = pretrained.model.{function_name}(x)")
  File "<string>", line 1, in <module>
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 47, in forward_flex
    x = self.patch_embed.proj(x).flatten(2).transpose(1, 2)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions-builtin\Lora\networks.py", line 376, in network_Conv2d_forward
    return torch.nn.Conv2d_forward_before_network(self, input)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
    return F.conv2d(input, weight, bias, self.stride,
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 39, in <lambda>
    setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: forward(op, args, kwargs))
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 13, in forward
    return op(*args, **kwargs)
RuntimeError: Input type (float) and bias type (struct c10::Half) should be the same
*END OF TRACEBACK*

User friendly error message:
Error: Input type (float) and bias type (struct c10::Half) should be the same. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \.
Deforum progress:   4%|██▊                                                            | 25/556 [00:39<13:53,  1.57s/it]

Additional information

No response

@cyberbadger6969 cyberbadger6969 added the bug Something isn't working label Aug 9, 2023
@IsmaelBMAT
Copy link

did you fix it?

@cyberbadger6969
Copy link
Author

no

@cyberbadger6969
Copy link
Author

Win11
RADEON 6800 XT
Python3.10.6

@Inflamery
Copy link

Screenshot_20231025_220256_Chrome
How to fix this? SD using CPU instead of GPU?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants