type
status
date
slug
summary
tags
category
icon
password
Property
Aug 25, 2023 05:15 PM
URL
1. 基本说明
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fbb35c3ec-3868-4fab-9215-67cc936f324c%2FUntitled.png?table=block&id=65a6573c-4a13-41e2-b0cd-f8f98f07cc7c&t=65a6573c-4a13-41e2-b0cd-f8f98f07cc7c&width=1696&cache=v2)
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fb0a18e4d-b4ae-44e6-93ca-f03b278330ec%2FUntitled.png?table=block&id=361e6e83-0f9a-45f3-8838-55ee49433f37&t=361e6e83-0f9a-45f3-8838-55ee49433f37&width=528&cache=v2)
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fc4da1ec0-a326-4aef-9874-d06f1da3893d%2FUntitled.png?table=block&id=7d415962-6101-4596-9c97-7f4170718a8d&t=7d415962-6101-4596-9c97-7f4170718a8d&width=576&cache=v2)
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F77f76b5c-c57d-4ffc-b6b2-5756b9ba50c8%2FUntitled.png?table=block&id=c6ca347b-05a4-47c5-8176-2036b5ffbb88&t=c6ca347b-05a4-47c5-8176-2036b5ffbb88&width=528&cache=v2)
2. 五大常用模型
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F3378d0e0-1f70-465b-8ecd-59400fc93953%2FUntitled.png?table=block&id=54aa46c1-3d23-4e0e-9352-4a9981917940&t=54aa46c1-3d23-4e0e-9352-4a9981917940&width=1712&cache=v2)
2.1 openpose
openpose 是对人物的刻画
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Ff231eade-30d6-4489-9a2b-2b8a76422be0%2FUntitled.png?table=block&id=bcc5d079-ca9e-4c51-89a6-d25b8040103a&t=bcc5d079-ca9e-4c51-89a6-d25b8040103a&width=384&cache=v2)
图中的类似于很奇怪的颜色就是刻画这个人的根本部分
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F6417fc6a-480c-42e1-a8dd-af5c6eb119e8%2FUntitled.png?table=block&id=992a1d58-fd56-44e3-9f2d-971bcf73c766&t=992a1d58-fd56-44e3-9f2d-971bcf73c766&width=384&cache=v2)
2.2 depth
这个的重点在于对于场景的描述还原, 尤其是富有空间感的, 多层次场景
![越黑的地方离你越远, 越白的地方离你越近, 所以也叫做深度图](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fe36431d9-6591-4d37-b13f-6560f979c3b9%2FUntitled.png?table=block&id=60ae6fac-1beb-4068-9b99-e4b683356925&t=60ae6fac-1beb-4068-9b99-e4b683356925&width=528&cache=v2)
可以使用这种方法来对人物的动作进行还原, 但是这种方法有个不好的地方就是不利于二次创作
2.3 canny
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F5e9a0b9a-b62d-43e7-8681-442571f589ea%2FUntitled.png?table=block&id=c21aa68c-0218-4650-9e54-ace50a212f9b&t=c21aa68c-0218-4650-9e54-ace50a212f9b&width=432&cache=v2)
看见没说白了就是绘制出图片的轮廓
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F6283a491-8e74-4882-b609-f68f6099d766%2FUntitled.png?table=block&id=b3733350-fae4-4bea-a060-4d9cc4394216&t=b3733350-fae4-4bea-a060-4d9cc4394216&width=528&cache=v2)
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F2e975858-4fc8-4af5-b51d-a5a450030da0%2FUntitled.png?table=block&id=3648ead8-c552-4c0a-8bee-327a293a4f71&t=3648ead8-c552-4c0a-8bee-327a293a4f71&width=576&cache=v2)
这里有三个参数,下面我们用日服的 “苍老师” 来举例子说明,说明他们的区别
2.3.1 flag_preprocessor_resolution
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F72783870-0d92-44a2-aa97-300a814539ce%2FUntitled.png?table=block&id=ac1d0330-ac8b-4068-a31d-f20a6aa88700&t=ac1d0330-ac8b-4068-a31d-f20a6aa88700&width=576&cache=v2)
2.3.2 Canny Low Threshold
生成线稿的最低阈值,也就是控制最低采样深度
![可以看到随着最低采样值的升高, 感觉细节越来越少了.](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fbe7b8450-5d66-441e-bdef-91584a7af98e%2FUntitled.png?table=block&id=a2a65f38-57fc-4b20-86bb-124eabeb0ba2&t=a2a65f38-57fc-4b20-86bb-124eabeb0ba2&width=576&cache=v2)
2.3.3 Canny High Threshold:
生成线稿的最高阈值,也就是控制最高采样深度
![可以看到随着最低采样值的升高, 感觉细节越来越少了.](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F0aecf519-01ef-498d-aeed-47f7ebd43445%2FUntitled.png?table=block&id=489d7e9c-7de7-4a28-996e-76e91fbb0fc6&t=489d7e9c-7de7-4a28-996e-76e91fbb0fc6&width=576&cache=v2)
GPT-4 解释
- Canny Low Threshold(低阈值): 这个值决定了什么样的强度变化才足以成为边缘。如果这个值较高,只有在颜色变化非常明显的地方才会被视为边缘。这就好比在一幅画中只关注颜色变化非常突出的地方,而忽略掉那些颜色变化较温和的线条。
- Canny High Threshold(高阈值): 这个值用于确认真实的边缘。如果这个值较高,只有那些颜色变化非常剧烈的地方才会被确立为真实的边缘。这就好比在一幅画中只关注那些非常鲜明和显眼的线条。
2.3.4 softedge
2.3.5 scribble
3. 其他
3.2 control model
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fdd5ac467-9c41-466e-9dff-63174f47c0cb%2FUntitled.png?table=block&id=bf6a28f9-6801-4f66-9358-9fd61469548a&t=bf6a28f9-6801-4f66-9358-9fd61469548a&width=432&cache=v2)
均衡: 都参考一下
更注重提示饲:就是更加注重我们的提示词
更倾向于让Control Net由发挥:就是多参考我们的 controlnet
3.1 图片缩放模型
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F75b2a714-a115-4662-9221-7cb25f9131dc%2FUntitled.png?table=block&id=803d1c32-c5a5-4be0-bba9-34bcaacb0509&t=803d1c32-c5a5-4be0-bba9-34bcaacb0509&width=432&cache=v2)
![notion image](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F91d920c1-7492-4601-829b-d60c98b635c5%2FUntitled.png?table=block&id=7d9b84f3-6fc1-48b8-93f9-40c20c9d4b35&t=7d9b84f3-6fc1-48b8-93f9-40c20c9d4b35&width=576&cache=v2)
5. 参考教程
- 作者:我心永恒
- 链接:https://wxyhgk.com/article/sd-controlnet
- 声明:本文采用 CC BY-NC-SA 4.0 许可协议,转载请注明出处。