Does it only support multiple devices and not support acceleration for a single device? I reported an error when using Colab in Controlnet and IP adapter

[libai-lab]

AssertionError Traceback (most recent call last)
in <cell line: 21>()
19
20 control_image.save("control.png")
---> 21 async_diff = AsyncDiff(pipe, model_n=2, stride=1, time_shift=False)
22
23 async_diff.reset_state(warm_up=1)

/content/AsyncDiff/src/async_sd.py in init(self, pipeline, model_n, stride, warm_up, time_shift)
46 def init(self, pipeline, model_n=2, stride=1, warm_up=1, time_shift=False):
47 dist.init_process_group("nccl")
---> 48 if not dist.get_rank(): assert model_n + stride - 1 == dist.get_world_size(), "[ERROR]: The strategy is not compatible with the number of devices. (model_n + stride - 1) should be equal to world_size."
49 assert stride==1 or stride==2, "[ERROR]: The stride should be set as 1 or 2"
50 self.model_n = model_n

AssertionError: [ERROR]: The strategy is not compatible with the number of devices. (model_n + stride - 1) should be equal to world_size.

from AsyncDiff.src.async_sd import AsyncDiff

start_time=time.time()
image = load_image("https://img0.baidu.com/it/u=1483900031,3964539741&fm=253&fmt=auto&app=138&f=JPEG?w=751&h=500")

ip_image = load_image("https://replicate.delivery/pbxt/Kc2uOvUQ0sVmT6ALE7MIBwOAXlQ6kqBGc2XOz54oKVO2NxvF/style.jpg")

image_orig = image

image = np.array(image)

low_threshold = 100
high_threshold = 200

image = cv2.Canny(image, low_threshold, high_threshold)
image = image[:, :, None]
image = np.concatenate([image, image, image], axis=2)
control_image = Image.fromarray(image)

control_image.save("control.png")
async_diff = AsyncDiff(pipe, model_n=2, stride=1, time_shift=False)

async_diff.reset_state(warm_up=1)
image = pipe(
prompt="a nice room, best quality, highres, wallpaper,",
image=image_orig,
control_image=control_image,
negative_prompt="(low quality, bad quality, worst quality:1.2)",
ip_adapter_image=ip_image,
num_inference_steps=20,
guidance_scale=8,
controlnet_conditioning_scale=0.6,
guess_mode=False,
strength=1.0,
generator=generator,
).images[0]

image.save('./image/dreamshaper8.png')
end_time=time.time()
print("时间",end_time-start_time)

[czg1225]

Hi @libai-lab ,
As a distributed acceleration strategy, AsyncDiff currently does not support single-device acceleration. We may add support for single-device acceleration in the future.