kilian89 commited on
Commit
1fee7da
·
verified ·
1 Parent(s): 17cde70

Rename custom_nodes/ComfyUI_UltimateSDUpscale/README.md to custom_nodes/ComfyUI_UltimateSDUpscale/

Browse files
custom_nodes/{ComfyUI_UltimateSDUpscale/README.md → ComfyUI_UltimateSDUpscale} RENAMED
File without changes
custom_nodes/ComfyUI_UltimateSDUpscale/LICENSE DELETED
@@ -1,674 +0,0 @@
1
- GNU GENERAL PUBLIC LICENSE
2
- Version 3, 29 June 2007
3
-
4
- Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
5
- Everyone is permitted to copy and distribute verbatim copies
6
- of this license document, but changing it is not allowed.
7
-
8
- Preamble
9
-
10
- The GNU General Public License is a free, copyleft license for
11
- software and other kinds of works.
12
-
13
- The licenses for most software and other practical works are designed
14
- to take away your freedom to share and change the works. By contrast,
15
- the GNU General Public License is intended to guarantee your freedom to
16
- share and change all versions of a program--to make sure it remains free
17
- software for all its users. We, the Free Software Foundation, use the
18
- GNU General Public License for most of our software; it applies also to
19
- any other work released this way by its authors. You can apply it to
20
- your programs, too.
21
-
22
- When we speak of free software, we are referring to freedom, not
23
- price. Our General Public Licenses are designed to make sure that you
24
- have the freedom to distribute copies of free software (and charge for
25
- them if you wish), that you receive source code or can get it if you
26
- want it, that you can change the software or use pieces of it in new
27
- free programs, and that you know you can do these things.
28
-
29
- To protect your rights, we need to prevent others from denying you
30
- these rights or asking you to surrender the rights. Therefore, you have
31
- certain responsibilities if you distribute copies of the software, or if
32
- you modify it: responsibilities to respect the freedom of others.
33
-
34
- For example, if you distribute copies of such a program, whether
35
- gratis or for a fee, you must pass on to the recipients the same
36
- freedoms that you received. You must make sure that they, too, receive
37
- or can get the source code. And you must show them these terms so they
38
- know their rights.
39
-
40
- Developers that use the GNU GPL protect your rights with two steps:
41
- (1) assert copyright on the software, and (2) offer you this License
42
- giving you legal permission to copy, distribute and/or modify it.
43
-
44
- For the developers' and authors' protection, the GPL clearly explains
45
- that there is no warranty for this free software. For both users' and
46
- authors' sake, the GPL requires that modified versions be marked as
47
- changed, so that their problems will not be attributed erroneously to
48
- authors of previous versions.
49
-
50
- Some devices are designed to deny users access to install or run
51
- modified versions of the software inside them, although the manufacturer
52
- can do so. This is fundamentally incompatible with the aim of
53
- protecting users' freedom to change the software. The systematic
54
- pattern of such abuse occurs in the area of products for individuals to
55
- use, which is precisely where it is most unacceptable. Therefore, we
56
- have designed this version of the GPL to prohibit the practice for those
57
- products. If such problems arise substantially in other domains, we
58
- stand ready to extend this provision to those domains in future versions
59
- of the GPL, as needed to protect the freedom of users.
60
-
61
- Finally, every program is threatened constantly by software patents.
62
- States should not allow patents to restrict development and use of
63
- software on general-purpose computers, but in those that do, we wish to
64
- avoid the special danger that patents applied to a free program could
65
- make it effectively proprietary. To prevent this, the GPL assures that
66
- patents cannot be used to render the program non-free.
67
-
68
- The precise terms and conditions for copying, distribution and
69
- modification follow.
70
-
71
- TERMS AND CONDITIONS
72
-
73
- 0. Definitions.
74
-
75
- "This License" refers to version 3 of the GNU General Public License.
76
-
77
- "Copyright" also means copyright-like laws that apply to other kinds of
78
- works, such as semiconductor masks.
79
-
80
- "The Program" refers to any copyrightable work licensed under this
81
- License. Each licensee is addressed as "you". "Licensees" and
82
- "recipients" may be individuals or organizations.
83
-
84
- To "modify" a work means to copy from or adapt all or part of the work
85
- in a fashion requiring copyright permission, other than the making of an
86
- exact copy. The resulting work is called a "modified version" of the
87
- earlier work or a work "based on" the earlier work.
88
-
89
- A "covered work" means either the unmodified Program or a work based
90
- on the Program.
91
-
92
- To "propagate" a work means to do anything with it that, without
93
- permission, would make you directly or secondarily liable for
94
- infringement under applicable copyright law, except executing it on a
95
- computer or modifying a private copy. Propagation includes copying,
96
- distribution (with or without modification), making available to the
97
- public, and in some countries other activities as well.
98
-
99
- To "convey" a work means any kind of propagation that enables other
100
- parties to make or receive copies. Mere interaction with a user through
101
- a computer network, with no transfer of a copy, is not conveying.
102
-
103
- An interactive user interface displays "Appropriate Legal Notices"
104
- to the extent that it includes a convenient and prominently visible
105
- feature that (1) displays an appropriate copyright notice, and (2)
106
- tells the user that there is no warranty for the work (except to the
107
- extent that warranties are provided), that licensees may convey the
108
- work under this License, and how to view a copy of this License. If
109
- the interface presents a list of user commands or options, such as a
110
- menu, a prominent item in the list meets this criterion.
111
-
112
- 1. Source Code.
113
-
114
- The "source code" for a work means the preferred form of the work
115
- for making modifications to it. "Object code" means any non-source
116
- form of a work.
117
-
118
- A "Standard Interface" means an interface that either is an official
119
- standard defined by a recognized standards body, or, in the case of
120
- interfaces specified for a particular programming language, one that
121
- is widely used among developers working in that language.
122
-
123
- The "System Libraries" of an executable work include anything, other
124
- than the work as a whole, that (a) is included in the normal form of
125
- packaging a Major Component, but which is not part of that Major
126
- Component, and (b) serves only to enable use of the work with that
127
- Major Component, or to implement a Standard Interface for which an
128
- implementation is available to the public in source code form. A
129
- "Major Component", in this context, means a major essential component
130
- (kernel, window system, and so on) of the specific operating system
131
- (if any) on which the executable work runs, or a compiler used to
132
- produce the work, or an object code interpreter used to run it.
133
-
134
- The "Corresponding Source" for a work in object code form means all
135
- the source code needed to generate, install, and (for an executable
136
- work) run the object code and to modify the work, including scripts to
137
- control those activities. However, it does not include the work's
138
- System Libraries, or general-purpose tools or generally available free
139
- programs which are used unmodified in performing those activities but
140
- which are not part of the work. For example, Corresponding Source
141
- includes interface definition files associated with source files for
142
- the work, and the source code for shared libraries and dynamically
143
- linked subprograms that the work is specifically designed to require,
144
- such as by intimate data communication or control flow between those
145
- subprograms and other parts of the work.
146
-
147
- The Corresponding Source need not include anything that users
148
- can regenerate automatically from other parts of the Corresponding
149
- Source.
150
-
151
- The Corresponding Source for a work in source code form is that
152
- same work.
153
-
154
- 2. Basic Permissions.
155
-
156
- All rights granted under this License are granted for the term of
157
- copyright on the Program, and are irrevocable provided the stated
158
- conditions are met. This License explicitly affirms your unlimited
159
- permission to run the unmodified Program. The output from running a
160
- covered work is covered by this License only if the output, given its
161
- content, constitutes a covered work. This License acknowledges your
162
- rights of fair use or other equivalent, as provided by copyright law.
163
-
164
- You may make, run and propagate covered works that you do not
165
- convey, without conditions so long as your license otherwise remains
166
- in force. You may convey covered works to others for the sole purpose
167
- of having them make modifications exclusively for you, or provide you
168
- with facilities for running those works, provided that you comply with
169
- the terms of this License in conveying all material for which you do
170
- not control copyright. Those thus making or running the covered works
171
- for you must do so exclusively on your behalf, under your direction
172
- and control, on terms that prohibit them from making any copies of
173
- your copyrighted material outside their relationship with you.
174
-
175
- Conveying under any other circumstances is permitted solely under
176
- the conditions stated below. Sublicensing is not allowed; section 10
177
- makes it unnecessary.
178
-
179
- 3. Protecting Users' Legal Rights From Anti-Circumvention Law.
180
-
181
- No covered work shall be deemed part of an effective technological
182
- measure under any applicable law fulfilling obligations under article
183
- 11 of the WIPO copyright treaty adopted on 20 December 1996, or
184
- similar laws prohibiting or restricting circumvention of such
185
- measures.
186
-
187
- When you convey a covered work, you waive any legal power to forbid
188
- circumvention of technological measures to the extent such circumvention
189
- is effected by exercising rights under this License with respect to
190
- the covered work, and you disclaim any intention to limit operation or
191
- modification of the work as a means of enforcing, against the work's
192
- users, your or third parties' legal rights to forbid circumvention of
193
- technological measures.
194
-
195
- 4. Conveying Verbatim Copies.
196
-
197
- You may convey verbatim copies of the Program's source code as you
198
- receive it, in any medium, provided that you conspicuously and
199
- appropriately publish on each copy an appropriate copyright notice;
200
- keep intact all notices stating that this License and any
201
- non-permissive terms added in accord with section 7 apply to the code;
202
- keep intact all notices of the absence of any warranty; and give all
203
- recipients a copy of this License along with the Program.
204
-
205
- You may charge any price or no price for each copy that you convey,
206
- and you may offer support or warranty protection for a fee.
207
-
208
- 5. Conveying Modified Source Versions.
209
-
210
- You may convey a work based on the Program, or the modifications to
211
- produce it from the Program, in the form of source code under the
212
- terms of section 4, provided that you also meet all of these conditions:
213
-
214
- a) The work must carry prominent notices stating that you modified
215
- it, and giving a relevant date.
216
-
217
- b) The work must carry prominent notices stating that it is
218
- released under this License and any conditions added under section
219
- 7. This requirement modifies the requirement in section 4 to
220
- "keep intact all notices".
221
-
222
- c) You must license the entire work, as a whole, under this
223
- License to anyone who comes into possession of a copy. This
224
- License will therefore apply, along with any applicable section 7
225
- additional terms, to the whole of the work, and all its parts,
226
- regardless of how they are packaged. This License gives no
227
- permission to license the work in any other way, but it does not
228
- invalidate such permission if you have separately received it.
229
-
230
- d) If the work has interactive user interfaces, each must display
231
- Appropriate Legal Notices; however, if the Program has interactive
232
- interfaces that do not display Appropriate Legal Notices, your
233
- work need not make them do so.
234
-
235
- A compilation of a covered work with other separate and independent
236
- works, which are not by their nature extensions of the covered work,
237
- and which are not combined with it such as to form a larger program,
238
- in or on a volume of a storage or distribution medium, is called an
239
- "aggregate" if the compilation and its resulting copyright are not
240
- used to limit the access or legal rights of the compilation's users
241
- beyond what the individual works permit. Inclusion of a covered work
242
- in an aggregate does not cause this License to apply to the other
243
- parts of the aggregate.
244
-
245
- 6. Conveying Non-Source Forms.
246
-
247
- You may convey a covered work in object code form under the terms
248
- of sections 4 and 5, provided that you also convey the
249
- machine-readable Corresponding Source under the terms of this License,
250
- in one of these ways:
251
-
252
- a) Convey the object code in, or embodied in, a physical product
253
- (including a physical distribution medium), accompanied by the
254
- Corresponding Source fixed on a durable physical medium
255
- customarily used for software interchange.
256
-
257
- b) Convey the object code in, or embodied in, a physical product
258
- (including a physical distribution medium), accompanied by a
259
- written offer, valid for at least three years and valid for as
260
- long as you offer spare parts or customer support for that product
261
- model, to give anyone who possesses the object code either (1) a
262
- copy of the Corresponding Source for all the software in the
263
- product that is covered by this License, on a durable physical
264
- medium customarily used for software interchange, for a price no
265
- more than your reasonable cost of physically performing this
266
- conveying of source, or (2) access to copy the
267
- Corresponding Source from a network server at no charge.
268
-
269
- c) Convey individual copies of the object code with a copy of the
270
- written offer to provide the Corresponding Source. This
271
- alternative is allowed only occasionally and noncommercially, and
272
- only if you received the object code with such an offer, in accord
273
- with subsection 6b.
274
-
275
- d) Convey the object code by offering access from a designated
276
- place (gratis or for a charge), and offer equivalent access to the
277
- Corresponding Source in the same way through the same place at no
278
- further charge. You need not require recipients to copy the
279
- Corresponding Source along with the object code. If the place to
280
- copy the object code is a network server, the Corresponding Source
281
- may be on a different server (operated by you or a third party)
282
- that supports equivalent copying facilities, provided you maintain
283
- clear directions next to the object code saying where to find the
284
- Corresponding Source. Regardless of what server hosts the
285
- Corresponding Source, you remain obligated to ensure that it is
286
- available for as long as needed to satisfy these requirements.
287
-
288
- e) Convey the object code using peer-to-peer transmission, provided
289
- you inform other peers where the object code and Corresponding
290
- Source of the work are being offered to the general public at no
291
- charge under subsection 6d.
292
-
293
- A separable portion of the object code, whose source code is excluded
294
- from the Corresponding Source as a System Library, need not be
295
- included in conveying the object code work.
296
-
297
- A "User Product" is either (1) a "consumer product", which means any
298
- tangible personal property which is normally used for personal, family,
299
- or household purposes, or (2) anything designed or sold for incorporation
300
- into a dwelling. In determining whether a product is a consumer product,
301
- doubtful cases shall be resolved in favor of coverage. For a particular
302
- product received by a particular user, "normally used" refers to a
303
- typical or common use of that class of product, regardless of the status
304
- of the particular user or of the way in which the particular user
305
- actually uses, or expects or is expected to use, the product. A product
306
- is a consumer product regardless of whether the product has substantial
307
- commercial, industrial or non-consumer uses, unless such uses represent
308
- the only significant mode of use of the product.
309
-
310
- "Installation Information" for a User Product means any methods,
311
- procedures, authorization keys, or other information required to install
312
- and execute modified versions of a covered work in that User Product from
313
- a modified version of its Corresponding Source. The information must
314
- suffice to ensure that the continued functioning of the modified object
315
- code is in no case prevented or interfered with solely because
316
- modification has been made.
317
-
318
- If you convey an object code work under this section in, or with, or
319
- specifically for use in, a User Product, and the conveying occurs as
320
- part of a transaction in which the right of possession and use of the
321
- User Product is transferred to the recipient in perpetuity or for a
322
- fixed term (regardless of how the transaction is characterized), the
323
- Corresponding Source conveyed under this section must be accompanied
324
- by the Installation Information. But this requirement does not apply
325
- if neither you nor any third party retains the ability to install
326
- modified object code on the User Product (for example, the work has
327
- been installed in ROM).
328
-
329
- The requirement to provide Installation Information does not include a
330
- requirement to continue to provide support service, warranty, or updates
331
- for a work that has been modified or installed by the recipient, or for
332
- the User Product in which it has been modified or installed. Access to a
333
- network may be denied when the modification itself materially and
334
- adversely affects the operation of the network or violates the rules and
335
- protocols for communication across the network.
336
-
337
- Corresponding Source conveyed, and Installation Information provided,
338
- in accord with this section must be in a format that is publicly
339
- documented (and with an implementation available to the public in
340
- source code form), and must require no special password or key for
341
- unpacking, reading or copying.
342
-
343
- 7. Additional Terms.
344
-
345
- "Additional permissions" are terms that supplement the terms of this
346
- License by making exceptions from one or more of its conditions.
347
- Additional permissions that are applicable to the entire Program shall
348
- be treated as though they were included in this License, to the extent
349
- that they are valid under applicable law. If additional permissions
350
- apply only to part of the Program, that part may be used separately
351
- under those permissions, but the entire Program remains governed by
352
- this License without regard to the additional permissions.
353
-
354
- When you convey a copy of a covered work, you may at your option
355
- remove any additional permissions from that copy, or from any part of
356
- it. (Additional permissions may be written to require their own
357
- removal in certain cases when you modify the work.) You may place
358
- additional permissions on material, added by you to a covered work,
359
- for which you have or can give appropriate copyright permission.
360
-
361
- Notwithstanding any other provision of this License, for material you
362
- add to a covered work, you may (if authorized by the copyright holders of
363
- that material) supplement the terms of this License with terms:
364
-
365
- a) Disclaiming warranty or limiting liability differently from the
366
- terms of sections 15 and 16 of this License; or
367
-
368
- b) Requiring preservation of specified reasonable legal notices or
369
- author attributions in that material or in the Appropriate Legal
370
- Notices displayed by works containing it; or
371
-
372
- c) Prohibiting misrepresentation of the origin of that material, or
373
- requiring that modified versions of such material be marked in
374
- reasonable ways as different from the original version; or
375
-
376
- d) Limiting the use for publicity purposes of names of licensors or
377
- authors of the material; or
378
-
379
- e) Declining to grant rights under trademark law for use of some
380
- trade names, trademarks, or service marks; or
381
-
382
- f) Requiring indemnification of licensors and authors of that
383
- material by anyone who conveys the material (or modified versions of
384
- it) with contractual assumptions of liability to the recipient, for
385
- any liability that these contractual assumptions directly impose on
386
- those licensors and authors.
387
-
388
- All other non-permissive additional terms are considered "further
389
- restrictions" within the meaning of section 10. If the Program as you
390
- received it, or any part of it, contains a notice stating that it is
391
- governed by this License along with a term that is a further
392
- restriction, you may remove that term. If a license document contains
393
- a further restriction but permits relicensing or conveying under this
394
- License, you may add to a covered work material governed by the terms
395
- of that license document, provided that the further restriction does
396
- not survive such relicensing or conveying.
397
-
398
- If you add terms to a covered work in accord with this section, you
399
- must place, in the relevant source files, a statement of the
400
- additional terms that apply to those files, or a notice indicating
401
- where to find the applicable terms.
402
-
403
- Additional terms, permissive or non-permissive, may be stated in the
404
- form of a separately written license, or stated as exceptions;
405
- the above requirements apply either way.
406
-
407
- 8. Termination.
408
-
409
- You may not propagate or modify a covered work except as expressly
410
- provided under this License. Any attempt otherwise to propagate or
411
- modify it is void, and will automatically terminate your rights under
412
- this License (including any patent licenses granted under the third
413
- paragraph of section 11).
414
-
415
- However, if you cease all violation of this License, then your
416
- license from a particular copyright holder is reinstated (a)
417
- provisionally, unless and until the copyright holder explicitly and
418
- finally terminates your license, and (b) permanently, if the copyright
419
- holder fails to notify you of the violation by some reasonable means
420
- prior to 60 days after the cessation.
421
-
422
- Moreover, your license from a particular copyright holder is
423
- reinstated permanently if the copyright holder notifies you of the
424
- violation by some reasonable means, this is the first time you have
425
- received notice of violation of this License (for any work) from that
426
- copyright holder, and you cure the violation prior to 30 days after
427
- your receipt of the notice.
428
-
429
- Termination of your rights under this section does not terminate the
430
- licenses of parties who have received copies or rights from you under
431
- this License. If your rights have been terminated and not permanently
432
- reinstated, you do not qualify to receive new licenses for the same
433
- material under section 10.
434
-
435
- 9. Acceptance Not Required for Having Copies.
436
-
437
- You are not required to accept this License in order to receive or
438
- run a copy of the Program. Ancillary propagation of a covered work
439
- occurring solely as a consequence of using peer-to-peer transmission
440
- to receive a copy likewise does not require acceptance. However,
441
- nothing other than this License grants you permission to propagate or
442
- modify any covered work. These actions infringe copyright if you do
443
- not accept this License. Therefore, by modifying or propagating a
444
- covered work, you indicate your acceptance of this License to do so.
445
-
446
- 10. Automatic Licensing of Downstream Recipients.
447
-
448
- Each time you convey a covered work, the recipient automatically
449
- receives a license from the original licensors, to run, modify and
450
- propagate that work, subject to this License. You are not responsible
451
- for enforcing compliance by third parties with this License.
452
-
453
- An "entity transaction" is a transaction transferring control of an
454
- organization, or substantially all assets of one, or subdividing an
455
- organization, or merging organizations. If propagation of a covered
456
- work results from an entity transaction, each party to that
457
- transaction who receives a copy of the work also receives whatever
458
- licenses to the work the party's predecessor in interest had or could
459
- give under the previous paragraph, plus a right to possession of the
460
- Corresponding Source of the work from the predecessor in interest, if
461
- the predecessor has it or can get it with reasonable efforts.
462
-
463
- You may not impose any further restrictions on the exercise of the
464
- rights granted or affirmed under this License. For example, you may
465
- not impose a license fee, royalty, or other charge for exercise of
466
- rights granted under this License, and you may not initiate litigation
467
- (including a cross-claim or counterclaim in a lawsuit) alleging that
468
- any patent claim is infringed by making, using, selling, offering for
469
- sale, or importing the Program or any portion of it.
470
-
471
- 11. Patents.
472
-
473
- A "contributor" is a copyright holder who authorizes use under this
474
- License of the Program or a work on which the Program is based. The
475
- work thus licensed is called the contributor's "contributor version".
476
-
477
- A contributor's "essential patent claims" are all patent claims
478
- owned or controlled by the contributor, whether already acquired or
479
- hereafter acquired, that would be infringed by some manner, permitted
480
- by this License, of making, using, or selling its contributor version,
481
- but do not include claims that would be infringed only as a
482
- consequence of further modification of the contributor version. For
483
- purposes of this definition, "control" includes the right to grant
484
- patent sublicenses in a manner consistent with the requirements of
485
- this License.
486
-
487
- Each contributor grants you a non-exclusive, worldwide, royalty-free
488
- patent license under the contributor's essential patent claims, to
489
- make, use, sell, offer for sale, import and otherwise run, modify and
490
- propagate the contents of its contributor version.
491
-
492
- In the following three paragraphs, a "patent license" is any express
493
- agreement or commitment, however denominated, not to enforce a patent
494
- (such as an express permission to practice a patent or covenant not to
495
- sue for patent infringement). To "grant" such a patent license to a
496
- party means to make such an agreement or commitment not to enforce a
497
- patent against the party.
498
-
499
- If you convey a covered work, knowingly relying on a patent license,
500
- and the Corresponding Source of the work is not available for anyone
501
- to copy, free of charge and under the terms of this License, through a
502
- publicly available network server or other readily accessible means,
503
- then you must either (1) cause the Corresponding Source to be so
504
- available, or (2) arrange to deprive yourself of the benefit of the
505
- patent license for this particular work, or (3) arrange, in a manner
506
- consistent with the requirements of this License, to extend the patent
507
- license to downstream recipients. "Knowingly relying" means you have
508
- actual knowledge that, but for the patent license, your conveying the
509
- covered work in a country, or your recipient's use of the covered work
510
- in a country, would infringe one or more identifiable patents in that
511
- country that you have reason to believe are valid.
512
-
513
- If, pursuant to or in connection with a single transaction or
514
- arrangement, you convey, or propagate by procuring conveyance of, a
515
- covered work, and grant a patent license to some of the parties
516
- receiving the covered work authorizing them to use, propagate, modify
517
- or convey a specific copy of the covered work, then the patent license
518
- you grant is automatically extended to all recipients of the covered
519
- work and works based on it.
520
-
521
- A patent license is "discriminatory" if it does not include within
522
- the scope of its coverage, prohibits the exercise of, or is
523
- conditioned on the non-exercise of one or more of the rights that are
524
- specifically granted under this License. You may not convey a covered
525
- work if you are a party to an arrangement with a third party that is
526
- in the business of distributing software, under which you make payment
527
- to the third party based on the extent of your activity of conveying
528
- the work, and under which the third party grants, to any of the
529
- parties who would receive the covered work from you, a discriminatory
530
- patent license (a) in connection with copies of the covered work
531
- conveyed by you (or copies made from those copies), or (b) primarily
532
- for and in connection with specific products or compilations that
533
- contain the covered work, unless you entered into that arrangement,
534
- or that patent license was granted, prior to 28 March 2007.
535
-
536
- Nothing in this License shall be construed as excluding or limiting
537
- any implied license or other defenses to infringement that may
538
- otherwise be available to you under applicable patent law.
539
-
540
- 12. No Surrender of Others' Freedom.
541
-
542
- If conditions are imposed on you (whether by court order, agreement or
543
- otherwise) that contradict the conditions of this License, they do not
544
- excuse you from the conditions of this License. If you cannot convey a
545
- covered work so as to satisfy simultaneously your obligations under this
546
- License and any other pertinent obligations, then as a consequence you may
547
- not convey it at all. For example, if you agree to terms that obligate you
548
- to collect a royalty for further conveying from those to whom you convey
549
- the Program, the only way you could satisfy both those terms and this
550
- License would be to refrain entirely from conveying the Program.
551
-
552
- 13. Use with the GNU Affero General Public License.
553
-
554
- Notwithstanding any other provision of this License, you have
555
- permission to link or combine any covered work with a work licensed
556
- under version 3 of the GNU Affero General Public License into a single
557
- combined work, and to convey the resulting work. The terms of this
558
- License will continue to apply to the part which is the covered work,
559
- but the special requirements of the GNU Affero General Public License,
560
- section 13, concerning interaction through a network will apply to the
561
- combination as such.
562
-
563
- 14. Revised Versions of this License.
564
-
565
- The Free Software Foundation may publish revised and/or new versions of
566
- the GNU General Public License from time to time. Such new versions will
567
- be similar in spirit to the present version, but may differ in detail to
568
- address new problems or concerns.
569
-
570
- Each version is given a distinguishing version number. If the
571
- Program specifies that a certain numbered version of the GNU General
572
- Public License "or any later version" applies to it, you have the
573
- option of following the terms and conditions either of that numbered
574
- version or of any later version published by the Free Software
575
- Foundation. If the Program does not specify a version number of the
576
- GNU General Public License, you may choose any version ever published
577
- by the Free Software Foundation.
578
-
579
- If the Program specifies that a proxy can decide which future
580
- versions of the GNU General Public License can be used, that proxy's
581
- public statement of acceptance of a version permanently authorizes you
582
- to choose that version for the Program.
583
-
584
- Later license versions may give you additional or different
585
- permissions. However, no additional obligations are imposed on any
586
- author or copyright holder as a result of your choosing to follow a
587
- later version.
588
-
589
- 15. Disclaimer of Warranty.
590
-
591
- THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
592
- APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
593
- HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
594
- OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
595
- THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
596
- PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
597
- IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
598
- ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
599
-
600
- 16. Limitation of Liability.
601
-
602
- IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
603
- WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
604
- THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
605
- GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
606
- USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
607
- DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
608
- PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
609
- EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
610
- SUCH DAMAGES.
611
-
612
- 17. Interpretation of Sections 15 and 16.
613
-
614
- If the disclaimer of warranty and limitation of liability provided
615
- above cannot be given local legal effect according to their terms,
616
- reviewing courts shall apply local law that most closely approximates
617
- an absolute waiver of all civil liability in connection with the
618
- Program, unless a warranty or assumption of liability accompanies a
619
- copy of the Program in return for a fee.
620
-
621
- END OF TERMS AND CONDITIONS
622
-
623
- How to Apply These Terms to Your New Programs
624
-
625
- If you develop a new program, and you want it to be of the greatest
626
- possible use to the public, the best way to achieve this is to make it
627
- free software which everyone can redistribute and change under these terms.
628
-
629
- To do so, attach the following notices to the program. It is safest
630
- to attach them to the start of each source file to most effectively
631
- state the exclusion of warranty; and each file should have at least
632
- the "copyright" line and a pointer to where the full notice is found.
633
-
634
- <one line to give the program's name and a brief idea of what it does.>
635
- Copyright (C) <year> <name of author>
636
-
637
- This program is free software: you can redistribute it and/or modify
638
- it under the terms of the GNU General Public License as published by
639
- the Free Software Foundation, either version 3 of the License, or
640
- (at your option) any later version.
641
-
642
- This program is distributed in the hope that it will be useful,
643
- but WITHOUT ANY WARRANTY; without even the implied warranty of
644
- MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
645
- GNU General Public License for more details.
646
-
647
- You should have received a copy of the GNU General Public License
648
- along with this program. If not, see <https://www.gnu.org/licenses/>.
649
-
650
- Also add information on how to contact you by electronic and paper mail.
651
-
652
- If the program does terminal interaction, make it output a short
653
- notice like this when it starts in an interactive mode:
654
-
655
- <program> Copyright (C) <year> <name of author>
656
- This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
657
- This is free software, and you are welcome to redistribute it
658
- under certain conditions; type `show c' for details.
659
-
660
- The hypothetical commands `show w' and `show c' should show the appropriate
661
- parts of the General Public License. Of course, your program's commands
662
- might be different; for a GUI interface, you would use an "about box".
663
-
664
- You should also get your employer (if you work as a programmer) or school,
665
- if any, to sign a "copyright disclaimer" for the program, if necessary.
666
- For more information on this, and how to apply and follow the GNU GPL, see
667
- <https://www.gnu.org/licenses/>.
668
-
669
- The GNU General Public License does not permit incorporating your program
670
- into proprietary programs. If your program is a subroutine library, you
671
- may consider it more useful to permit linking proprietary applications with
672
- the library. If this is what you want to do, use the GNU Lesser General
673
- Public License instead of this License. But first, please read
674
- <https://www.gnu.org/licenses/why-not-lgpl.html>.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/__init__.py DELETED
@@ -1,39 +0,0 @@
1
- import sys
2
- import os
3
- repo_dir = os.path.dirname(os.path.realpath(__file__))
4
- sys.path.insert(0, repo_dir)
5
- original_modules = sys.modules.copy()
6
-
7
- # Place aside potentially conflicting modules
8
- modules_used = [
9
- "modules",
10
- "modules.devices",
11
- "modules.images",
12
- "modules.processing",
13
- "modules.scripts",
14
- "modules.shared",
15
- "modules.upscaler",
16
- "utils",
17
- ]
18
- original_imported_modules = {}
19
- for module in modules_used:
20
- if module in sys.modules:
21
- original_imported_modules[module] = sys.modules.pop(module)
22
-
23
- # Proceed with node setup
24
- from .nodes import NODE_CLASS_MAPPINGS, NODE_DISPLAY_NAME_MAPPINGS
25
- __all__ = ["NODE_CLASS_MAPPINGS", "NODE_DISPLAY_NAME_MAPPINGS"]
26
-
27
- # Clean up imports
28
- # Remove repo directory from path
29
- sys.path.remove(repo_dir)
30
- # Remove any new modules
31
- modules_to_remove = []
32
- for module in sys.modules:
33
- if module not in original_modules:
34
- modules_to_remove.append(module)
35
- for module in modules_to_remove:
36
- del sys.modules[module]
37
-
38
- # Restore original modules
39
- sys.modules.update(original_imported_modules)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/gradio.py DELETED
@@ -1 +0,0 @@
1
- # Empty gradio module for the ultimate-upscale.py import because gradio is not needed
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/devices.py DELETED
@@ -1,2 +0,0 @@
1
- def torch_gc():
2
- pass
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/images.py DELETED
@@ -1,8 +0,0 @@
1
- from PIL import Image
2
-
3
-
4
- def flatten(img, bgcolor):
5
- # Replace transparency with bgcolor
6
- if img.mode in ("RGB"):
7
- return img
8
- return Image.alpha_composite(Image.new("RGBA", img.size, bgcolor), img).convert("RGB")
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/processing.py DELETED
@@ -1,163 +0,0 @@
1
- from PIL import Image, ImageFilter
2
- import torch
3
- import math
4
- from nodes import common_ksampler, VAEEncode, VAEDecode, VAEDecodeTiled
5
- from utils import pil_to_tensor, tensor_to_pil, get_crop_region, expand_crop, crop_cond
6
- from modules import shared
7
-
8
- if (not hasattr(Image, 'Resampling')): # For older versions of Pillow
9
- Image.Resampling = Image
10
-
11
-
12
- class StableDiffusionProcessing:
13
-
14
- def __init__(self, init_img, model, positive, negative, vae, seed, steps, cfg, sampler_name, scheduler, denoise, upscale_by, uniform_tile_mode, tiled_decode):
15
- # Variables used by the USDU script
16
- self.init_images = [init_img]
17
- self.image_mask = None
18
- self.mask_blur = 0
19
- self.inpaint_full_res_padding = 0
20
- self.width = init_img.width
21
- self.height = init_img.height
22
-
23
- # ComfyUI Sampler inputs
24
- self.model = model
25
- self.positive = positive
26
- self.negative = negative
27
- self.vae = vae
28
- self.seed = seed
29
- self.steps = steps
30
- self.cfg = cfg
31
- self.sampler_name = sampler_name
32
- self.scheduler = scheduler
33
- self.denoise = denoise
34
-
35
- # Variables used only by this script
36
- self.init_size = init_img.width, init_img.height
37
- self.upscale_by = upscale_by
38
- self.uniform_tile_mode = uniform_tile_mode
39
- self.tiled_decode = tiled_decode
40
- self.vae_decoder = VAEDecode()
41
- self.vae_encoder = VAEEncode()
42
- self.vae_decoder_tiled = VAEDecodeTiled()
43
-
44
- # Other required A1111 variables for the USDU script that is currently unused in this script
45
- self.extra_generation_params = {}
46
-
47
-
48
- class Processed:
49
-
50
- def __init__(self, p: StableDiffusionProcessing, images: list, seed: int, info: str):
51
- self.images = images
52
- self.seed = seed
53
- self.info = info
54
-
55
- def infotext(self, p: StableDiffusionProcessing, index):
56
- return None
57
-
58
-
59
- def fix_seed(p: StableDiffusionProcessing):
60
- pass
61
-
62
-
63
- def process_images(p: StableDiffusionProcessing) -> Processed:
64
- # Where the main image generation happens in A1111
65
-
66
- # Setup
67
- image_mask = p.image_mask.convert('L')
68
- init_image = p.init_images[0]
69
-
70
- # Locate the white region of the mask outlining the tile and add padding
71
- crop_region = get_crop_region(image_mask, p.inpaint_full_res_padding)
72
-
73
- if p.uniform_tile_mode:
74
- # Expand the crop region to match the processing size ratio and then resize it to the processing size
75
- x1, y1, x2, y2 = crop_region
76
- crop_width = x2 - x1
77
- crop_height = y2 - y1
78
- crop_ratio = crop_width / crop_height
79
- p_ratio = p.width / p.height
80
- if crop_ratio > p_ratio:
81
- target_width = crop_width
82
- target_height = round(crop_width / p_ratio)
83
- else:
84
- target_width = round(crop_height * p_ratio)
85
- target_height = crop_height
86
- crop_region, _ = expand_crop(crop_region, image_mask.width, image_mask.height, target_width, target_height)
87
- tile_size = p.width, p.height
88
- else:
89
- # Uses the minimal size that can fit the mask, minimizes tile size but may lead to image sizes that the model is not trained on
90
- x1, y1, x2, y2 = crop_region
91
- crop_width = x2 - x1
92
- crop_height = y2 - y1
93
- target_width = math.ceil(crop_width / 8) * 8
94
- target_height = math.ceil(crop_height / 8) * 8
95
- crop_region, tile_size = expand_crop(crop_region, image_mask.width,
96
- image_mask.height, target_width, target_height)
97
-
98
- # Blur the mask
99
- if p.mask_blur > 0:
100
- image_mask = image_mask.filter(ImageFilter.GaussianBlur(p.mask_blur))
101
-
102
- # Crop the images to get the tiles that will be used for generation
103
- tiles = [img.crop(crop_region) for img in shared.batch]
104
-
105
- # Assume the same size for all images in the batch
106
- initial_tile_size = tiles[0].size
107
-
108
- # Resize if necessary
109
- for i, tile in enumerate(tiles):
110
- if tile.size != tile_size:
111
- tiles[i] = tile.resize(tile_size, Image.Resampling.LANCZOS)
112
-
113
- # Crop conditioning
114
- positive_cropped = crop_cond(p.positive, crop_region, p.init_size, init_image.size, tile_size)
115
- negative_cropped = crop_cond(p.negative, crop_region, p.init_size, init_image.size, tile_size)
116
-
117
- # Encode the image
118
- batched_tiles = torch.cat([pil_to_tensor(tile) for tile in tiles], dim=0)
119
- (latent,) = p.vae_encoder.encode(p.vae, batched_tiles)
120
-
121
- # Generate samples
122
- (samples,) = common_ksampler(p.model, p.seed, p.steps, p.cfg, p.sampler_name,
123
- p.scheduler, positive_cropped, negative_cropped, latent, denoise=p.denoise)
124
-
125
- # Decode the sample
126
- if not p.tiled_decode:
127
- (decoded,) = p.vae_decoder.decode(p.vae, samples)
128
- else:
129
- print("[USDU] Using tiled decode")
130
- (decoded,) = p.vae_decoder_tiled.decode(p.vae, samples, 512) # Default tile size is 512
131
-
132
- # Convert the sample to a PIL image
133
- tiles_sampled = [tensor_to_pil(decoded, i) for i in range(len(decoded))]
134
-
135
- for i, tile_sampled in enumerate(tiles_sampled):
136
- init_image = shared.batch[i]
137
-
138
- # Resize back to the original size
139
- if tile_sampled.size != initial_tile_size:
140
- tile_sampled = tile_sampled.resize(initial_tile_size, Image.Resampling.LANCZOS)
141
-
142
-
143
- # Put the tile into position
144
- image_tile_only = Image.new('RGBA', init_image.size)
145
- image_tile_only.paste(tile_sampled, crop_region[:2])
146
-
147
- # Add the mask as an alpha channel
148
- # Must make a copy due to the possibility of an edge becoming black
149
- temp = image_tile_only.copy()
150
- temp.putalpha(image_mask)
151
- image_tile_only.paste(temp, image_tile_only)
152
-
153
- # Add back the tile to the initial image according to the mask in the alpha channel
154
- result = init_image.convert('RGBA')
155
- result.alpha_composite(image_tile_only)
156
-
157
- # Convert back to RGB
158
- result = result.convert('RGB')
159
-
160
- shared.batch[i] = result
161
-
162
- processed = Processed(p, [shared.batch[0]], p.seed, None)
163
- return processed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/scripts.py DELETED
@@ -1,2 +0,0 @@
1
- class Script:
2
- pass
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/shared.py DELETED
@@ -1,24 +0,0 @@
1
- class Options:
2
- img2img_background_color = "#ffffff" # Set to white for now
3
-
4
-
5
- class State:
6
- interrupted = False
7
-
8
- def begin(self):
9
- pass
10
-
11
- def end(self):
12
- pass
13
-
14
-
15
- opts = Options()
16
- state = State()
17
-
18
- # Will only ever hold 1 upscaler
19
- sd_upscalers = [None]
20
- # The upscaler usable by ComfyUI nodes
21
- actual_upscaler = None
22
-
23
- # Batch of images to upscale
24
- batch = None
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/modules/upscaler.py DELETED
@@ -1,30 +0,0 @@
1
- from PIL import Image
2
- from utils import tensor_to_pil, pil_to_tensor
3
- from comfy_extras.nodes_upscale_model import ImageUpscaleWithModel
4
- from modules import shared
5
-
6
- if (not hasattr(Image, 'Resampling')): # For older versions of Pillow
7
- Image.Resampling = Image
8
-
9
-
10
- class Upscaler:
11
-
12
- def _upscale(self, img: Image, scale):
13
- if (shared.actual_upscaler is None):
14
- return img.resize((img.width * scale, img.height * scale), Image.Resampling.NEAREST)
15
- tensor = pil_to_tensor(img)
16
- image_upscale_node = ImageUpscaleWithModel()
17
- (upscaled,) = image_upscale_node.upscale(shared.actual_upscaler, tensor)
18
- return tensor_to_pil(upscaled)
19
-
20
- def upscale(self, img: Image, scale, selected_model: str = None):
21
- shared.batch = [self._upscale(img, scale) for img in shared.batch]
22
- return shared.batch[0]
23
-
24
-
25
- class UpscalerData:
26
- name = ""
27
- data_path = ""
28
-
29
- def __init__(self):
30
- self.scaler = Upscaler()
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/nodes.py DELETED
@@ -1,191 +0,0 @@
1
- # ComfyUI Node for Ultimate SD Upscale by Coyote-A: https://github.com/Coyote-A/ultimate-upscale-for-automatic1111
2
-
3
- import torch
4
- import comfy
5
- from usdu_patch import usdu
6
- from utils import tensor_to_pil, pil_to_tensor
7
- from modules.processing import StableDiffusionProcessing
8
- import modules.shared as shared
9
- from modules.upscaler import UpscalerData
10
-
11
- MAX_RESOLUTION = 8192
12
- # The modes available for Ultimate SD Upscale
13
- MODES = {
14
- "Linear": usdu.USDUMode.LINEAR,
15
- "Chess": usdu.USDUMode.CHESS,
16
- "None": usdu.USDUMode.NONE,
17
- }
18
- # The seam fix modes
19
- SEAM_FIX_MODES = {
20
- "None": usdu.USDUSFMode.NONE,
21
- "Band Pass": usdu.USDUSFMode.BAND_PASS,
22
- "Half Tile": usdu.USDUSFMode.HALF_TILE,
23
- "Half Tile + Intersections": usdu.USDUSFMode.HALF_TILE_PLUS_INTERSECTIONS,
24
- }
25
-
26
-
27
- def USDU_base_inputs():
28
- return [
29
- ("image", ("IMAGE",)),
30
- # Sampling Params
31
- ("model", ("MODEL",)),
32
- ("positive", ("CONDITIONING",)),
33
- ("negative", ("CONDITIONING",)),
34
- ("vae", ("VAE",)),
35
- ("upscale_by", ("FLOAT", {"default": 2, "min": 0.05, "max": 4, "step": 0.05})),
36
- ("seed", ("INT", {"default": 0, "min": 0, "max": 0xffffffffffffffff})),
37
- ("steps", ("INT", {"default": 20, "min": 1, "max": 10000, "step": 1})),
38
- ("cfg", ("FLOAT", {"default": 8.0, "min": 0.0, "max": 100.0})),
39
- ("sampler_name", (comfy.samplers.KSampler.SAMPLERS,)),
40
- ("scheduler", (comfy.samplers.KSampler.SCHEDULERS,)),
41
- ("denoise", ("FLOAT", {"default": 0.2, "min": 0.0, "max": 1.0, "step": 0.01})),
42
- # Upscale Params
43
- ("upscale_model", ("UPSCALE_MODEL",)),
44
- ("mode_type", (list(MODES.keys()),)),
45
- ("tile_width", ("INT", {"default": 512, "min": 64, "max": MAX_RESOLUTION, "step": 8})),
46
- ("tile_height", ("INT", {"default": 512, "min": 64, "max": MAX_RESOLUTION, "step": 8})),
47
- ("mask_blur", ("INT", {"default": 8, "min": 0, "max": 64, "step": 1})),
48
- ("tile_padding", ("INT", {"default": 32, "min": 0, "max": MAX_RESOLUTION, "step": 8})),
49
- # Seam fix params
50
- ("seam_fix_mode", (list(SEAM_FIX_MODES.keys()),)),
51
- ("seam_fix_denoise", ("FLOAT", {"default": 1.0, "min": 0.0, "max": 1.0, "step": 0.01})),
52
- ("seam_fix_width", ("INT", {"default": 64, "min": 0, "max": MAX_RESOLUTION, "step": 8})),
53
- ("seam_fix_mask_blur", ("INT", {"default": 8, "min": 0, "max": 64, "step": 1})),
54
- ("seam_fix_padding", ("INT", {"default": 16, "min": 0, "max": MAX_RESOLUTION, "step": 8})),
55
- # Misc
56
- ("force_uniform_tiles", ("BOOLEAN", {"default": True})),
57
- ("tiled_decode", ("BOOLEAN", {"default": False})),
58
- ]
59
-
60
-
61
- def prepare_inputs(required: list, optional: list = None):
62
- inputs = {}
63
- if required:
64
- inputs["required"] = {}
65
- for name, type in required:
66
- inputs["required"][name] = type
67
- if optional:
68
- inputs["optional"] = {}
69
- for name, type in optional:
70
- inputs["optional"][name] = type
71
- return inputs
72
-
73
-
74
- def remove_input(inputs: list, input_name: str):
75
- for i, (n, _) in enumerate(inputs):
76
- if n == input_name:
77
- del inputs[i]
78
- break
79
-
80
-
81
- def rename_input(inputs: list, old_name: str, new_name: str):
82
- for i, (n, t) in enumerate(inputs):
83
- if n == old_name:
84
- inputs[i] = (new_name, t)
85
- break
86
-
87
-
88
- class UltimateSDUpscale:
89
- @classmethod
90
- def INPUT_TYPES(s):
91
- return prepare_inputs(USDU_base_inputs())
92
-
93
- RETURN_TYPES = ("IMAGE",)
94
- FUNCTION = "upscale"
95
- CATEGORY = "image/upscaling"
96
-
97
- def upscale(self, image, model, positive, negative, vae, upscale_by, seed,
98
- steps, cfg, sampler_name, scheduler, denoise, upscale_model,
99
- mode_type, tile_width, tile_height, mask_blur, tile_padding,
100
- seam_fix_mode, seam_fix_denoise, seam_fix_mask_blur,
101
- seam_fix_width, seam_fix_padding, force_uniform_tiles, tiled_decode):
102
- #
103
- # Set up A1111 patches
104
- #
105
-
106
- # Upscaler
107
- # An object that the script works with
108
- shared.sd_upscalers[0] = UpscalerData()
109
- # Where the actual upscaler is stored, will be used when the script upscales using the Upscaler in UpscalerData
110
- shared.actual_upscaler = upscale_model
111
-
112
- # Set the batch of images
113
- shared.batch = [tensor_to_pil(image, i) for i in range(len(image))]
114
-
115
- # Processing
116
- sdprocessing = StableDiffusionProcessing(
117
- tensor_to_pil(image), model, positive, negative, vae,
118
- seed, steps, cfg, sampler_name, scheduler, denoise, upscale_by, force_uniform_tiles, tiled_decode
119
- )
120
-
121
- #
122
- # Running the script
123
- #
124
- script = usdu.Script()
125
- processed = script.run(p=sdprocessing, _=None, tile_width=tile_width, tile_height=tile_height,
126
- mask_blur=mask_blur, padding=tile_padding, seams_fix_width=seam_fix_width,
127
- seams_fix_denoise=seam_fix_denoise, seams_fix_padding=seam_fix_padding,
128
- upscaler_index=0, save_upscaled_image=False, redraw_mode=MODES[mode_type],
129
- save_seams_fix_image=False, seams_fix_mask_blur=seam_fix_mask_blur,
130
- seams_fix_type=SEAM_FIX_MODES[seam_fix_mode], target_size_type=2,
131
- custom_width=None, custom_height=None, custom_scale=upscale_by)
132
-
133
- # Return the resulting images
134
- images = [pil_to_tensor(img) for img in shared.batch]
135
- tensor = torch.cat(images, dim=0)
136
- return (tensor,)
137
-
138
-
139
- class UltimateSDUpscaleNoUpscale:
140
- @classmethod
141
- def INPUT_TYPES(s):
142
- required = USDU_base_inputs()
143
- remove_input(required, "upscale_model")
144
- remove_input(required, "upscale_by")
145
- rename_input(required, "image", "upscaled_image")
146
- return prepare_inputs(required)
147
-
148
- RETURN_TYPES = ("IMAGE",)
149
- FUNCTION = "upscale"
150
- CATEGORY = "image/upscaling"
151
-
152
- def upscale(self, upscaled_image, model, positive, negative, vae, seed,
153
- steps, cfg, sampler_name, scheduler, denoise,
154
- mode_type, tile_width, tile_height, mask_blur, tile_padding,
155
- seam_fix_mode, seam_fix_denoise, seam_fix_mask_blur,
156
- seam_fix_width, seam_fix_padding, force_uniform_tiles, tiled_decode):
157
-
158
- shared.sd_upscalers[0] = UpscalerData()
159
- shared.actual_upscaler = None
160
- shared.batch = [tensor_to_pil(upscaled_image, i) for i in range(len(upscaled_image))]
161
- sdprocessing = StableDiffusionProcessing(
162
- tensor_to_pil(upscaled_image), model, positive, negative, vae,
163
- seed, steps, cfg, sampler_name, scheduler, denoise, 1, force_uniform_tiles, tiled_decode
164
- )
165
-
166
- script = usdu.Script()
167
- processed = script.run(p=sdprocessing, _=None, tile_width=tile_width, tile_height=tile_height,
168
- mask_blur=mask_blur, padding=tile_padding, seams_fix_width=seam_fix_width,
169
- seams_fix_denoise=seam_fix_denoise, seams_fix_padding=seam_fix_padding,
170
- upscaler_index=0, save_upscaled_image=False, redraw_mode=MODES[mode_type],
171
- save_seams_fix_image=False, seams_fix_mask_blur=seam_fix_mask_blur,
172
- seams_fix_type=SEAM_FIX_MODES[seam_fix_mode], target_size_type=2,
173
- custom_width=None, custom_height=None, custom_scale=1)
174
-
175
- images = [pil_to_tensor(img) for img in shared.batch]
176
- tensor = torch.cat(images, dim=0)
177
- return (tensor,)
178
-
179
-
180
- # A dictionary that contains all nodes you want to export with their names
181
- # NOTE: names should be globally unique
182
- NODE_CLASS_MAPPINGS = {
183
- "UltimateSDUpscale": UltimateSDUpscale,
184
- "UltimateSDUpscaleNoUpscale": UltimateSDUpscaleNoUpscale
185
- }
186
-
187
- # A dictionary that contains the friendly/humanly readable titles for the nodes
188
- NODE_DISPLAY_NAME_MAPPINGS = {
189
- "UltimateSDUpscale": "Ultimate SD Upscale",
190
- "UltimateSDUpscaleNoUpscale": "Ultimate SD Upscale (No Upscale)"
191
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/repositories/__init__.py DELETED
@@ -1,14 +0,0 @@
1
- import os
2
- import sys
3
- import importlib.util
4
-
5
- repositories_path = os.path.dirname(os.path.realpath(__file__))
6
-
7
- # Import the script
8
- script_name = os.path.join("scripts", "ultimate-upscale")
9
- repo_name = "ultimate_sd_upscale"
10
- script_path = os.path.join(repositories_path, repo_name, f"{script_name}.py")
11
- spec = importlib.util.spec_from_file_location(script_name, script_path)
12
- ultimate_upscale = importlib.util.module_from_spec(spec)
13
- sys.modules[script_name] = ultimate_upscale
14
- spec.loader.exec_module(ultimate_upscale)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/repositories/ultimate_sd_upscale/.gitignore DELETED
@@ -1 +0,0 @@
1
- .vscode
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/repositories/ultimate_sd_upscale/LICENSE DELETED
@@ -1,674 +0,0 @@
1
- GNU GENERAL PUBLIC LICENSE
2
- Version 3, 29 June 2007
3
-
4
- Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
5
- Everyone is permitted to copy and distribute verbatim copies
6
- of this license document, but changing it is not allowed.
7
-
8
- Preamble
9
-
10
- The GNU General Public License is a free, copyleft license for
11
- software and other kinds of works.
12
-
13
- The licenses for most software and other practical works are designed
14
- to take away your freedom to share and change the works. By contrast,
15
- the GNU General Public License is intended to guarantee your freedom to
16
- share and change all versions of a program--to make sure it remains free
17
- software for all its users. We, the Free Software Foundation, use the
18
- GNU General Public License for most of our software; it applies also to
19
- any other work released this way by its authors. You can apply it to
20
- your programs, too.
21
-
22
- When we speak of free software, we are referring to freedom, not
23
- price. Our General Public Licenses are designed to make sure that you
24
- have the freedom to distribute copies of free software (and charge for
25
- them if you wish), that you receive source code or can get it if you
26
- want it, that you can change the software or use pieces of it in new
27
- free programs, and that you know you can do these things.
28
-
29
- To protect your rights, we need to prevent others from denying you
30
- these rights or asking you to surrender the rights. Therefore, you have
31
- certain responsibilities if you distribute copies of the software, or if
32
- you modify it: responsibilities to respect the freedom of others.
33
-
34
- For example, if you distribute copies of such a program, whether
35
- gratis or for a fee, you must pass on to the recipients the same
36
- freedoms that you received. You must make sure that they, too, receive
37
- or can get the source code. And you must show them these terms so they
38
- know their rights.
39
-
40
- Developers that use the GNU GPL protect your rights with two steps:
41
- (1) assert copyright on the software, and (2) offer you this License
42
- giving you legal permission to copy, distribute and/or modify it.
43
-
44
- For the developers' and authors' protection, the GPL clearly explains
45
- that there is no warranty for this free software. For both users' and
46
- authors' sake, the GPL requires that modified versions be marked as
47
- changed, so that their problems will not be attributed erroneously to
48
- authors of previous versions.
49
-
50
- Some devices are designed to deny users access to install or run
51
- modified versions of the software inside them, although the manufacturer
52
- can do so. This is fundamentally incompatible with the aim of
53
- protecting users' freedom to change the software. The systematic
54
- pattern of such abuse occurs in the area of products for individuals to
55
- use, which is precisely where it is most unacceptable. Therefore, we
56
- have designed this version of the GPL to prohibit the practice for those
57
- products. If such problems arise substantially in other domains, we
58
- stand ready to extend this provision to those domains in future versions
59
- of the GPL, as needed to protect the freedom of users.
60
-
61
- Finally, every program is threatened constantly by software patents.
62
- States should not allow patents to restrict development and use of
63
- software on general-purpose computers, but in those that do, we wish to
64
- avoid the special danger that patents applied to a free program could
65
- make it effectively proprietary. To prevent this, the GPL assures that
66
- patents cannot be used to render the program non-free.
67
-
68
- The precise terms and conditions for copying, distribution and
69
- modification follow.
70
-
71
- TERMS AND CONDITIONS
72
-
73
- 0. Definitions.
74
-
75
- "This License" refers to version 3 of the GNU General Public License.
76
-
77
- "Copyright" also means copyright-like laws that apply to other kinds of
78
- works, such as semiconductor masks.
79
-
80
- "The Program" refers to any copyrightable work licensed under this
81
- License. Each licensee is addressed as "you". "Licensees" and
82
- "recipients" may be individuals or organizations.
83
-
84
- To "modify" a work means to copy from or adapt all or part of the work
85
- in a fashion requiring copyright permission, other than the making of an
86
- exact copy. The resulting work is called a "modified version" of the
87
- earlier work or a work "based on" the earlier work.
88
-
89
- A "covered work" means either the unmodified Program or a work based
90
- on the Program.
91
-
92
- To "propagate" a work means to do anything with it that, without
93
- permission, would make you directly or secondarily liable for
94
- infringement under applicable copyright law, except executing it on a
95
- computer or modifying a private copy. Propagation includes copying,
96
- distribution (with or without modification), making available to the
97
- public, and in some countries other activities as well.
98
-
99
- To "convey" a work means any kind of propagation that enables other
100
- parties to make or receive copies. Mere interaction with a user through
101
- a computer network, with no transfer of a copy, is not conveying.
102
-
103
- An interactive user interface displays "Appropriate Legal Notices"
104
- to the extent that it includes a convenient and prominently visible
105
- feature that (1) displays an appropriate copyright notice, and (2)
106
- tells the user that there is no warranty for the work (except to the
107
- extent that warranties are provided), that licensees may convey the
108
- work under this License, and how to view a copy of this License. If
109
- the interface presents a list of user commands or options, such as a
110
- menu, a prominent item in the list meets this criterion.
111
-
112
- 1. Source Code.
113
-
114
- The "source code" for a work means the preferred form of the work
115
- for making modifications to it. "Object code" means any non-source
116
- form of a work.
117
-
118
- A "Standard Interface" means an interface that either is an official
119
- standard defined by a recognized standards body, or, in the case of
120
- interfaces specified for a particular programming language, one that
121
- is widely used among developers working in that language.
122
-
123
- The "System Libraries" of an executable work include anything, other
124
- than the work as a whole, that (a) is included in the normal form of
125
- packaging a Major Component, but which is not part of that Major
126
- Component, and (b) serves only to enable use of the work with that
127
- Major Component, or to implement a Standard Interface for which an
128
- implementation is available to the public in source code form. A
129
- "Major Component", in this context, means a major essential component
130
- (kernel, window system, and so on) of the specific operating system
131
- (if any) on which the executable work runs, or a compiler used to
132
- produce the work, or an object code interpreter used to run it.
133
-
134
- The "Corresponding Source" for a work in object code form means all
135
- the source code needed to generate, install, and (for an executable
136
- work) run the object code and to modify the work, including scripts to
137
- control those activities. However, it does not include the work's
138
- System Libraries, or general-purpose tools or generally available free
139
- programs which are used unmodified in performing those activities but
140
- which are not part of the work. For example, Corresponding Source
141
- includes interface definition files associated with source files for
142
- the work, and the source code for shared libraries and dynamically
143
- linked subprograms that the work is specifically designed to require,
144
- such as by intimate data communication or control flow between those
145
- subprograms and other parts of the work.
146
-
147
- The Corresponding Source need not include anything that users
148
- can regenerate automatically from other parts of the Corresponding
149
- Source.
150
-
151
- The Corresponding Source for a work in source code form is that
152
- same work.
153
-
154
- 2. Basic Permissions.
155
-
156
- All rights granted under this License are granted for the term of
157
- copyright on the Program, and are irrevocable provided the stated
158
- conditions are met. This License explicitly affirms your unlimited
159
- permission to run the unmodified Program. The output from running a
160
- covered work is covered by this License only if the output, given its
161
- content, constitutes a covered work. This License acknowledges your
162
- rights of fair use or other equivalent, as provided by copyright law.
163
-
164
- You may make, run and propagate covered works that you do not
165
- convey, without conditions so long as your license otherwise remains
166
- in force. You may convey covered works to others for the sole purpose
167
- of having them make modifications exclusively for you, or provide you
168
- with facilities for running those works, provided that you comply with
169
- the terms of this License in conveying all material for which you do
170
- not control copyright. Those thus making or running the covered works
171
- for you must do so exclusively on your behalf, under your direction
172
- and control, on terms that prohibit them from making any copies of
173
- your copyrighted material outside their relationship with you.
174
-
175
- Conveying under any other circumstances is permitted solely under
176
- the conditions stated below. Sublicensing is not allowed; section 10
177
- makes it unnecessary.
178
-
179
- 3. Protecting Users' Legal Rights From Anti-Circumvention Law.
180
-
181
- No covered work shall be deemed part of an effective technological
182
- measure under any applicable law fulfilling obligations under article
183
- 11 of the WIPO copyright treaty adopted on 20 December 1996, or
184
- similar laws prohibiting or restricting circumvention of such
185
- measures.
186
-
187
- When you convey a covered work, you waive any legal power to forbid
188
- circumvention of technological measures to the extent such circumvention
189
- is effected by exercising rights under this License with respect to
190
- the covered work, and you disclaim any intention to limit operation or
191
- modification of the work as a means of enforcing, against the work's
192
- users, your or third parties' legal rights to forbid circumvention of
193
- technological measures.
194
-
195
- 4. Conveying Verbatim Copies.
196
-
197
- You may convey verbatim copies of the Program's source code as you
198
- receive it, in any medium, provided that you conspicuously and
199
- appropriately publish on each copy an appropriate copyright notice;
200
- keep intact all notices stating that this License and any
201
- non-permissive terms added in accord with section 7 apply to the code;
202
- keep intact all notices of the absence of any warranty; and give all
203
- recipients a copy of this License along with the Program.
204
-
205
- You may charge any price or no price for each copy that you convey,
206
- and you may offer support or warranty protection for a fee.
207
-
208
- 5. Conveying Modified Source Versions.
209
-
210
- You may convey a work based on the Program, or the modifications to
211
- produce it from the Program, in the form of source code under the
212
- terms of section 4, provided that you also meet all of these conditions:
213
-
214
- a) The work must carry prominent notices stating that you modified
215
- it, and giving a relevant date.
216
-
217
- b) The work must carry prominent notices stating that it is
218
- released under this License and any conditions added under section
219
- 7. This requirement modifies the requirement in section 4 to
220
- "keep intact all notices".
221
-
222
- c) You must license the entire work, as a whole, under this
223
- License to anyone who comes into possession of a copy. This
224
- License will therefore apply, along with any applicable section 7
225
- additional terms, to the whole of the work, and all its parts,
226
- regardless of how they are packaged. This License gives no
227
- permission to license the work in any other way, but it does not
228
- invalidate such permission if you have separately received it.
229
-
230
- d) If the work has interactive user interfaces, each must display
231
- Appropriate Legal Notices; however, if the Program has interactive
232
- interfaces that do not display Appropriate Legal Notices, your
233
- work need not make them do so.
234
-
235
- A compilation of a covered work with other separate and independent
236
- works, which are not by their nature extensions of the covered work,
237
- and which are not combined with it such as to form a larger program,
238
- in or on a volume of a storage or distribution medium, is called an
239
- "aggregate" if the compilation and its resulting copyright are not
240
- used to limit the access or legal rights of the compilation's users
241
- beyond what the individual works permit. Inclusion of a covered work
242
- in an aggregate does not cause this License to apply to the other
243
- parts of the aggregate.
244
-
245
- 6. Conveying Non-Source Forms.
246
-
247
- You may convey a covered work in object code form under the terms
248
- of sections 4 and 5, provided that you also convey the
249
- machine-readable Corresponding Source under the terms of this License,
250
- in one of these ways:
251
-
252
- a) Convey the object code in, or embodied in, a physical product
253
- (including a physical distribution medium), accompanied by the
254
- Corresponding Source fixed on a durable physical medium
255
- customarily used for software interchange.
256
-
257
- b) Convey the object code in, or embodied in, a physical product
258
- (including a physical distribution medium), accompanied by a
259
- written offer, valid for at least three years and valid for as
260
- long as you offer spare parts or customer support for that product
261
- model, to give anyone who possesses the object code either (1) a
262
- copy of the Corresponding Source for all the software in the
263
- product that is covered by this License, on a durable physical
264
- medium customarily used for software interchange, for a price no
265
- more than your reasonable cost of physically performing this
266
- conveying of source, or (2) access to copy the
267
- Corresponding Source from a network server at no charge.
268
-
269
- c) Convey individual copies of the object code with a copy of the
270
- written offer to provide the Corresponding Source. This
271
- alternative is allowed only occasionally and noncommercially, and
272
- only if you received the object code with such an offer, in accord
273
- with subsection 6b.
274
-
275
- d) Convey the object code by offering access from a designated
276
- place (gratis or for a charge), and offer equivalent access to the
277
- Corresponding Source in the same way through the same place at no
278
- further charge. You need not require recipients to copy the
279
- Corresponding Source along with the object code. If the place to
280
- copy the object code is a network server, the Corresponding Source
281
- may be on a different server (operated by you or a third party)
282
- that supports equivalent copying facilities, provided you maintain
283
- clear directions next to the object code saying where to find the
284
- Corresponding Source. Regardless of what server hosts the
285
- Corresponding Source, you remain obligated to ensure that it is
286
- available for as long as needed to satisfy these requirements.
287
-
288
- e) Convey the object code using peer-to-peer transmission, provided
289
- you inform other peers where the object code and Corresponding
290
- Source of the work are being offered to the general public at no
291
- charge under subsection 6d.
292
-
293
- A separable portion of the object code, whose source code is excluded
294
- from the Corresponding Source as a System Library, need not be
295
- included in conveying the object code work.
296
-
297
- A "User Product" is either (1) a "consumer product", which means any
298
- tangible personal property which is normally used for personal, family,
299
- or household purposes, or (2) anything designed or sold for incorporation
300
- into a dwelling. In determining whether a product is a consumer product,
301
- doubtful cases shall be resolved in favor of coverage. For a particular
302
- product received by a particular user, "normally used" refers to a
303
- typical or common use of that class of product, regardless of the status
304
- of the particular user or of the way in which the particular user
305
- actually uses, or expects or is expected to use, the product. A product
306
- is a consumer product regardless of whether the product has substantial
307
- commercial, industrial or non-consumer uses, unless such uses represent
308
- the only significant mode of use of the product.
309
-
310
- "Installation Information" for a User Product means any methods,
311
- procedures, authorization keys, or other information required to install
312
- and execute modified versions of a covered work in that User Product from
313
- a modified version of its Corresponding Source. The information must
314
- suffice to ensure that the continued functioning of the modified object
315
- code is in no case prevented or interfered with solely because
316
- modification has been made.
317
-
318
- If you convey an object code work under this section in, or with, or
319
- specifically for use in, a User Product, and the conveying occurs as
320
- part of a transaction in which the right of possession and use of the
321
- User Product is transferred to the recipient in perpetuity or for a
322
- fixed term (regardless of how the transaction is characterized), the
323
- Corresponding Source conveyed under this section must be accompanied
324
- by the Installation Information. But this requirement does not apply
325
- if neither you nor any third party retains the ability to install
326
- modified object code on the User Product (for example, the work has
327
- been installed in ROM).
328
-
329
- The requirement to provide Installation Information does not include a
330
- requirement to continue to provide support service, warranty, or updates
331
- for a work that has been modified or installed by the recipient, or for
332
- the User Product in which it has been modified or installed. Access to a
333
- network may be denied when the modification itself materially and
334
- adversely affects the operation of the network or violates the rules and
335
- protocols for communication across the network.
336
-
337
- Corresponding Source conveyed, and Installation Information provided,
338
- in accord with this section must be in a format that is publicly
339
- documented (and with an implementation available to the public in
340
- source code form), and must require no special password or key for
341
- unpacking, reading or copying.
342
-
343
- 7. Additional Terms.
344
-
345
- "Additional permissions" are terms that supplement the terms of this
346
- License by making exceptions from one or more of its conditions.
347
- Additional permissions that are applicable to the entire Program shall
348
- be treated as though they were included in this License, to the extent
349
- that they are valid under applicable law. If additional permissions
350
- apply only to part of the Program, that part may be used separately
351
- under those permissions, but the entire Program remains governed by
352
- this License without regard to the additional permissions.
353
-
354
- When you convey a copy of a covered work, you may at your option
355
- remove any additional permissions from that copy, or from any part of
356
- it. (Additional permissions may be written to require their own
357
- removal in certain cases when you modify the work.) You may place
358
- additional permissions on material, added by you to a covered work,
359
- for which you have or can give appropriate copyright permission.
360
-
361
- Notwithstanding any other provision of this License, for material you
362
- add to a covered work, you may (if authorized by the copyright holders of
363
- that material) supplement the terms of this License with terms:
364
-
365
- a) Disclaiming warranty or limiting liability differently from the
366
- terms of sections 15 and 16 of this License; or
367
-
368
- b) Requiring preservation of specified reasonable legal notices or
369
- author attributions in that material or in the Appropriate Legal
370
- Notices displayed by works containing it; or
371
-
372
- c) Prohibiting misrepresentation of the origin of that material, or
373
- requiring that modified versions of such material be marked in
374
- reasonable ways as different from the original version; or
375
-
376
- d) Limiting the use for publicity purposes of names of licensors or
377
- authors of the material; or
378
-
379
- e) Declining to grant rights under trademark law for use of some
380
- trade names, trademarks, or service marks; or
381
-
382
- f) Requiring indemnification of licensors and authors of that
383
- material by anyone who conveys the material (or modified versions of
384
- it) with contractual assumptions of liability to the recipient, for
385
- any liability that these contractual assumptions directly impose on
386
- those licensors and authors.
387
-
388
- All other non-permissive additional terms are considered "further
389
- restrictions" within the meaning of section 10. If the Program as you
390
- received it, or any part of it, contains a notice stating that it is
391
- governed by this License along with a term that is a further
392
- restriction, you may remove that term. If a license document contains
393
- a further restriction but permits relicensing or conveying under this
394
- License, you may add to a covered work material governed by the terms
395
- of that license document, provided that the further restriction does
396
- not survive such relicensing or conveying.
397
-
398
- If you add terms to a covered work in accord with this section, you
399
- must place, in the relevant source files, a statement of the
400
- additional terms that apply to those files, or a notice indicating
401
- where to find the applicable terms.
402
-
403
- Additional terms, permissive or non-permissive, may be stated in the
404
- form of a separately written license, or stated as exceptions;
405
- the above requirements apply either way.
406
-
407
- 8. Termination.
408
-
409
- You may not propagate or modify a covered work except as expressly
410
- provided under this License. Any attempt otherwise to propagate or
411
- modify it is void, and will automatically terminate your rights under
412
- this License (including any patent licenses granted under the third
413
- paragraph of section 11).
414
-
415
- However, if you cease all violation of this License, then your
416
- license from a particular copyright holder is reinstated (a)
417
- provisionally, unless and until the copyright holder explicitly and
418
- finally terminates your license, and (b) permanently, if the copyright
419
- holder fails to notify you of the violation by some reasonable means
420
- prior to 60 days after the cessation.
421
-
422
- Moreover, your license from a particular copyright holder is
423
- reinstated permanently if the copyright holder notifies you of the
424
- violation by some reasonable means, this is the first time you have
425
- received notice of violation of this License (for any work) from that
426
- copyright holder, and you cure the violation prior to 30 days after
427
- your receipt of the notice.
428
-
429
- Termination of your rights under this section does not terminate the
430
- licenses of parties who have received copies or rights from you under
431
- this License. If your rights have been terminated and not permanently
432
- reinstated, you do not qualify to receive new licenses for the same
433
- material under section 10.
434
-
435
- 9. Acceptance Not Required for Having Copies.
436
-
437
- You are not required to accept this License in order to receive or
438
- run a copy of the Program. Ancillary propagation of a covered work
439
- occurring solely as a consequence of using peer-to-peer transmission
440
- to receive a copy likewise does not require acceptance. However,
441
- nothing other than this License grants you permission to propagate or
442
- modify any covered work. These actions infringe copyright if you do
443
- not accept this License. Therefore, by modifying or propagating a
444
- covered work, you indicate your acceptance of this License to do so.
445
-
446
- 10. Automatic Licensing of Downstream Recipients.
447
-
448
- Each time you convey a covered work, the recipient automatically
449
- receives a license from the original licensors, to run, modify and
450
- propagate that work, subject to this License. You are not responsible
451
- for enforcing compliance by third parties with this License.
452
-
453
- An "entity transaction" is a transaction transferring control of an
454
- organization, or substantially all assets of one, or subdividing an
455
- organization, or merging organizations. If propagation of a covered
456
- work results from an entity transaction, each party to that
457
- transaction who receives a copy of the work also receives whatever
458
- licenses to the work the party's predecessor in interest had or could
459
- give under the previous paragraph, plus a right to possession of the
460
- Corresponding Source of the work from the predecessor in interest, if
461
- the predecessor has it or can get it with reasonable efforts.
462
-
463
- You may not impose any further restrictions on the exercise of the
464
- rights granted or affirmed under this License. For example, you may
465
- not impose a license fee, royalty, or other charge for exercise of
466
- rights granted under this License, and you may not initiate litigation
467
- (including a cross-claim or counterclaim in a lawsuit) alleging that
468
- any patent claim is infringed by making, using, selling, offering for
469
- sale, or importing the Program or any portion of it.
470
-
471
- 11. Patents.
472
-
473
- A "contributor" is a copyright holder who authorizes use under this
474
- License of the Program or a work on which the Program is based. The
475
- work thus licensed is called the contributor's "contributor version".
476
-
477
- A contributor's "essential patent claims" are all patent claims
478
- owned or controlled by the contributor, whether already acquired or
479
- hereafter acquired, that would be infringed by some manner, permitted
480
- by this License, of making, using, or selling its contributor version,
481
- but do not include claims that would be infringed only as a
482
- consequence of further modification of the contributor version. For
483
- purposes of this definition, "control" includes the right to grant
484
- patent sublicenses in a manner consistent with the requirements of
485
- this License.
486
-
487
- Each contributor grants you a non-exclusive, worldwide, royalty-free
488
- patent license under the contributor's essential patent claims, to
489
- make, use, sell, offer for sale, import and otherwise run, modify and
490
- propagate the contents of its contributor version.
491
-
492
- In the following three paragraphs, a "patent license" is any express
493
- agreement or commitment, however denominated, not to enforce a patent
494
- (such as an express permission to practice a patent or covenant not to
495
- sue for patent infringement). To "grant" such a patent license to a
496
- party means to make such an agreement or commitment not to enforce a
497
- patent against the party.
498
-
499
- If you convey a covered work, knowingly relying on a patent license,
500
- and the Corresponding Source of the work is not available for anyone
501
- to copy, free of charge and under the terms of this License, through a
502
- publicly available network server or other readily accessible means,
503
- then you must either (1) cause the Corresponding Source to be so
504
- available, or (2) arrange to deprive yourself of the benefit of the
505
- patent license for this particular work, or (3) arrange, in a manner
506
- consistent with the requirements of this License, to extend the patent
507
- license to downstream recipients. "Knowingly relying" means you have
508
- actual knowledge that, but for the patent license, your conveying the
509
- covered work in a country, or your recipient's use of the covered work
510
- in a country, would infringe one or more identifiable patents in that
511
- country that you have reason to believe are valid.
512
-
513
- If, pursuant to or in connection with a single transaction or
514
- arrangement, you convey, or propagate by procuring conveyance of, a
515
- covered work, and grant a patent license to some of the parties
516
- receiving the covered work authorizing them to use, propagate, modify
517
- or convey a specific copy of the covered work, then the patent license
518
- you grant is automatically extended to all recipients of the covered
519
- work and works based on it.
520
-
521
- A patent license is "discriminatory" if it does not include within
522
- the scope of its coverage, prohibits the exercise of, or is
523
- conditioned on the non-exercise of one or more of the rights that are
524
- specifically granted under this License. You may not convey a covered
525
- work if you are a party to an arrangement with a third party that is
526
- in the business of distributing software, under which you make payment
527
- to the third party based on the extent of your activity of conveying
528
- the work, and under which the third party grants, to any of the
529
- parties who would receive the covered work from you, a discriminatory
530
- patent license (a) in connection with copies of the covered work
531
- conveyed by you (or copies made from those copies), or (b) primarily
532
- for and in connection with specific products or compilations that
533
- contain the covered work, unless you entered into that arrangement,
534
- or that patent license was granted, prior to 28 March 2007.
535
-
536
- Nothing in this License shall be construed as excluding or limiting
537
- any implied license or other defenses to infringement that may
538
- otherwise be available to you under applicable patent law.
539
-
540
- 12. No Surrender of Others' Freedom.
541
-
542
- If conditions are imposed on you (whether by court order, agreement or
543
- otherwise) that contradict the conditions of this License, they do not
544
- excuse you from the conditions of this License. If you cannot convey a
545
- covered work so as to satisfy simultaneously your obligations under this
546
- License and any other pertinent obligations, then as a consequence you may
547
- not convey it at all. For example, if you agree to terms that obligate you
548
- to collect a royalty for further conveying from those to whom you convey
549
- the Program, the only way you could satisfy both those terms and this
550
- License would be to refrain entirely from conveying the Program.
551
-
552
- 13. Use with the GNU Affero General Public License.
553
-
554
- Notwithstanding any other provision of this License, you have
555
- permission to link or combine any covered work with a work licensed
556
- under version 3 of the GNU Affero General Public License into a single
557
- combined work, and to convey the resulting work. The terms of this
558
- License will continue to apply to the part which is the covered work,
559
- but the special requirements of the GNU Affero General Public License,
560
- section 13, concerning interaction through a network will apply to the
561
- combination as such.
562
-
563
- 14. Revised Versions of this License.
564
-
565
- The Free Software Foundation may publish revised and/or new versions of
566
- the GNU General Public License from time to time. Such new versions will
567
- be similar in spirit to the present version, but may differ in detail to
568
- address new problems or concerns.
569
-
570
- Each version is given a distinguishing version number. If the
571
- Program specifies that a certain numbered version of the GNU General
572
- Public License "or any later version" applies to it, you have the
573
- option of following the terms and conditions either of that numbered
574
- version or of any later version published by the Free Software
575
- Foundation. If the Program does not specify a version number of the
576
- GNU General Public License, you may choose any version ever published
577
- by the Free Software Foundation.
578
-
579
- If the Program specifies that a proxy can decide which future
580
- versions of the GNU General Public License can be used, that proxy's
581
- public statement of acceptance of a version permanently authorizes you
582
- to choose that version for the Program.
583
-
584
- Later license versions may give you additional or different
585
- permissions. However, no additional obligations are imposed on any
586
- author or copyright holder as a result of your choosing to follow a
587
- later version.
588
-
589
- 15. Disclaimer of Warranty.
590
-
591
- THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
592
- APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
593
- HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
594
- OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
595
- THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
596
- PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
597
- IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
598
- ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
599
-
600
- 16. Limitation of Liability.
601
-
602
- IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
603
- WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
604
- THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
605
- GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
606
- USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
607
- DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
608
- PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
609
- EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
610
- SUCH DAMAGES.
611
-
612
- 17. Interpretation of Sections 15 and 16.
613
-
614
- If the disclaimer of warranty and limitation of liability provided
615
- above cannot be given local legal effect according to their terms,
616
- reviewing courts shall apply local law that most closely approximates
617
- an absolute waiver of all civil liability in connection with the
618
- Program, unless a warranty or assumption of liability accompanies a
619
- copy of the Program in return for a fee.
620
-
621
- END OF TERMS AND CONDITIONS
622
-
623
- How to Apply These Terms to Your New Programs
624
-
625
- If you develop a new program, and you want it to be of the greatest
626
- possible use to the public, the best way to achieve this is to make it
627
- free software which everyone can redistribute and change under these terms.
628
-
629
- To do so, attach the following notices to the program. It is safest
630
- to attach them to the start of each source file to most effectively
631
- state the exclusion of warranty; and each file should have at least
632
- the "copyright" line and a pointer to where the full notice is found.
633
-
634
- ultimate-upscale-for-automatic1111
635
- Copyright (C) 2023 Mirzam
636
-
637
- This program is free software: you can redistribute it and/or modify
638
- it under the terms of the GNU General Public License as published by
639
- the Free Software Foundation, either version 3 of the License, or
640
- (at your option) any later version.
641
-
642
- This program is distributed in the hope that it will be useful,
643
- but WITHOUT ANY WARRANTY; without even the implied warranty of
644
- MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
645
- GNU General Public License for more details.
646
-
647
- You should have received a copy of the GNU General Public License
648
- along with this program. If not, see <https://www.gnu.org/licenses/>.
649
-
650
- Also add information on how to contact you by electronic and paper mail.
651
-
652
- If the program does terminal interaction, make it output a short
653
- notice like this when it starts in an interactive mode:
654
-
655
- <program> Copyright (C) 2023 Mirzam
656
- This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
657
- This is free software, and you are welcome to redistribute it
658
- under certain conditions; type `show c' for details.
659
-
660
- The hypothetical commands `show w' and `show c' should show the appropriate
661
- parts of the General Public License. Of course, your program's commands
662
- might be different; for a GUI interface, you would use an "about box".
663
-
664
- You should also get your employer (if you work as a programmer) or school,
665
- if any, to sign a "copyright disclaimer" for the program, if necessary.
666
- For more information on this, and how to apply and follow the GNU GPL, see
667
- <https://www.gnu.org/licenses/>.
668
-
669
- The GNU General Public License does not permit incorporating your program
670
- into proprietary programs. If your program is a subroutine library, you
671
- may consider it more useful to permit linking proprietary applications with
672
- the library. If this is what you want to do, use the GNU Lesser General
673
- Public License instead of this License. But first, please read
674
- <https://www.gnu.org/licenses/why-not-lgpl.html>.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/repositories/ultimate_sd_upscale/README.md DELETED
@@ -1,43 +0,0 @@
1
- # Ultimate SD Upscale extension for [AUTOMATIC1111 Stable Diffusion web UI](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
2
- Now you have the opportunity to use a large denoise (0.3-0.5) and not spawn many artifacts. Works on any video card, since you can use a 512x512 tile size and the image will converge.
3
-
4
- News channel: https://t.me/usdunews
5
-
6
- # Instructions
7
- All instructions can be found on the project's [wiki](https://github.com/Coyote-A/ultimate-upscale-for-automatic1111/wiki).
8
-
9
- # Examples
10
- More on [wiki page](https://github.com/Coyote-A/ultimate-upscale-for-automatic1111/wiki/Examples)
11
-
12
- <details>
13
- <summary>E1</summary>
14
- Original image
15
-
16
- ![Original](https://i.imgur.com/J8mRYOD.png)
17
-
18
- 2k upscaled. **Tile size**: 512, **Padding**: 32, **Mask blur**: 16, **Denoise**: 0.4
19
- ![2k upscale](https://i.imgur.com/0aKua4r.png)
20
- </details>
21
-
22
- <details>
23
- <summary>E2</summary>
24
- Original image
25
-
26
- ![Original](https://i.imgur.com/aALNI2w.png)
27
-
28
- 2k upscaled. **Tile size**: 768, **Padding**: 55, **Mask blur**: 20, **Denoise**: 0.35
29
- ![2k upscale](https://i.imgur.com/B5PHz0J.png)
30
-
31
- 4k upscaled. **Tile size**: 768, **Padding**: 55, **Mask blur**: 20, **Denoise**: 0.35
32
- ![4k upscale](https://i.imgur.com/tIUQ7TJ.jpg)
33
- </details>
34
-
35
- <details>
36
- <summary>E3</summary>
37
- Original image
38
-
39
- ![Original](https://i.imgur.com/AGtszA8.png)
40
-
41
- 4k upscaled. **Tile size**: 768, **Padding**: 55, **Mask blur**: 20, **Denoise**: 0.4
42
- ![4k upscale](https://i.imgur.com/LCYLfCs.jpg)
43
- </details>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/repositories/ultimate_sd_upscale/scripts/ultimate-upscale.py DELETED
@@ -1,557 +0,0 @@
1
- import math
2
- import gradio as gr
3
- from PIL import Image, ImageDraw, ImageOps
4
- from modules import processing, shared, images, devices, scripts
5
- from modules.processing import StableDiffusionProcessing
6
- from modules.processing import Processed
7
- from modules.shared import opts, state
8
- from enum import Enum
9
-
10
- class USDUMode(Enum):
11
- LINEAR = 0
12
- CHESS = 1
13
- NONE = 2
14
-
15
- class USDUSFMode(Enum):
16
- NONE = 0
17
- BAND_PASS = 1
18
- HALF_TILE = 2
19
- HALF_TILE_PLUS_INTERSECTIONS = 3
20
-
21
- class USDUpscaler():
22
-
23
- def __init__(self, p, image, upscaler_index:int, save_redraw, save_seams_fix, tile_width, tile_height) -> None:
24
- self.p:StableDiffusionProcessing = p
25
- self.image:Image = image
26
- self.scale_factor = math.ceil(max(p.width, p.height) / max(image.width, image.height))
27
- self.upscaler = shared.sd_upscalers[upscaler_index]
28
- self.redraw = USDURedraw()
29
- self.redraw.save = save_redraw
30
- self.redraw.tile_width = tile_width if tile_width > 0 else tile_height
31
- self.redraw.tile_height = tile_height if tile_height > 0 else tile_width
32
- self.seams_fix = USDUSeamsFix()
33
- self.seams_fix.save = save_seams_fix
34
- self.seams_fix.tile_width = tile_width if tile_width > 0 else tile_height
35
- self.seams_fix.tile_height = tile_height if tile_height > 0 else tile_width
36
- self.initial_info = None
37
- self.rows = math.ceil(self.p.height / self.redraw.tile_height)
38
- self.cols = math.ceil(self.p.width / self.redraw.tile_width)
39
-
40
- def get_factor(self, num):
41
- # Its just return, don't need elif
42
- if num == 1:
43
- return 2
44
- if num % 4 == 0:
45
- return 4
46
- if num % 3 == 0:
47
- return 3
48
- if num % 2 == 0:
49
- return 2
50
- return 0
51
-
52
- def get_factors(self):
53
- scales = []
54
- current_scale = 1
55
- current_scale_factor = self.get_factor(self.scale_factor)
56
- while current_scale_factor == 0:
57
- self.scale_factor += 1
58
- current_scale_factor = self.get_factor(self.scale_factor)
59
- while current_scale < self.scale_factor:
60
- current_scale_factor = self.get_factor(self.scale_factor // current_scale)
61
- scales.append(current_scale_factor)
62
- current_scale = current_scale * current_scale_factor
63
- if current_scale_factor == 0:
64
- break
65
- self.scales = enumerate(scales)
66
-
67
- def upscale(self):
68
- # Log info
69
- print(f"Canva size: {self.p.width}x{self.p.height}")
70
- print(f"Image size: {self.image.width}x{self.image.height}")
71
- print(f"Scale factor: {self.scale_factor}")
72
- # Check upscaler is not empty
73
- if self.upscaler.name == "None":
74
- self.image = self.image.resize((self.p.width, self.p.height), resample=Image.LANCZOS)
75
- return
76
- # Get list with scale factors
77
- self.get_factors()
78
- # Upscaling image over all factors
79
- for index, value in self.scales:
80
- print(f"Upscaling iteration {index+1} with scale factor {value}")
81
- self.image = self.upscaler.scaler.upscale(self.image, value, self.upscaler.data_path)
82
- # Resize image to set values
83
- self.image = self.image.resize((self.p.width, self.p.height), resample=Image.LANCZOS)
84
-
85
- def setup_redraw(self, redraw_mode, padding, mask_blur):
86
- self.redraw.mode = USDUMode(redraw_mode)
87
- self.redraw.enabled = self.redraw.mode != USDUMode.NONE
88
- self.redraw.padding = padding
89
- self.p.mask_blur = mask_blur
90
-
91
- def setup_seams_fix(self, padding, denoise, mask_blur, width, mode):
92
- self.seams_fix.padding = padding
93
- self.seams_fix.denoise = denoise
94
- self.seams_fix.mask_blur = mask_blur
95
- self.seams_fix.width = width
96
- self.seams_fix.mode = USDUSFMode(mode)
97
- self.seams_fix.enabled = self.seams_fix.mode != USDUSFMode.NONE
98
-
99
- def save_image(self):
100
- if type(self.p.prompt) != list:
101
- images.save_image(self.image, self.p.outpath_samples, "", self.p.seed, self.p.prompt, opts.samples_format, info=self.initial_info, p=self.p)
102
- else:
103
- images.save_image(self.image, self.p.outpath_samples, "", self.p.seed, self.p.prompt[0], opts.samples_format, info=self.initial_info, p=self.p)
104
-
105
- def calc_jobs_count(self):
106
- redraw_job_count = (self.rows * self.cols) if self.redraw.enabled else 0
107
- seams_job_count = 0
108
- if self.seams_fix.mode == USDUSFMode.BAND_PASS:
109
- seams_job_count = self.rows + self.cols - 2
110
- elif self.seams_fix.mode == USDUSFMode.HALF_TILE:
111
- seams_job_count = self.rows * (self.cols - 1) + (self.rows - 1) * self.cols
112
- elif self.seams_fix.mode == USDUSFMode.HALF_TILE_PLUS_INTERSECTIONS:
113
- seams_job_count = self.rows * (self.cols - 1) + (self.rows - 1) * self.cols + (self.rows - 1) * (self.cols - 1)
114
-
115
- state.job_count = redraw_job_count + seams_job_count
116
-
117
- def print_info(self):
118
- print(f"Tile size: {self.redraw.tile_width}x{self.redraw.tile_height}")
119
- print(f"Tiles amount: {self.rows * self.cols}")
120
- print(f"Grid: {self.rows}x{self.cols}")
121
- print(f"Redraw enabled: {self.redraw.enabled}")
122
- print(f"Seams fix mode: {self.seams_fix.mode.name}")
123
-
124
- def add_extra_info(self):
125
- self.p.extra_generation_params["Ultimate SD upscale upscaler"] = self.upscaler.name
126
- self.p.extra_generation_params["Ultimate SD upscale tile_width"] = self.redraw.tile_width
127
- self.p.extra_generation_params["Ultimate SD upscale tile_height"] = self.redraw.tile_height
128
- self.p.extra_generation_params["Ultimate SD upscale mask_blur"] = self.p.mask_blur
129
- self.p.extra_generation_params["Ultimate SD upscale padding"] = self.redraw.padding
130
-
131
- def process(self):
132
- state.begin()
133
- self.calc_jobs_count()
134
- self.result_images = []
135
- if self.redraw.enabled:
136
- self.image = self.redraw.start(self.p, self.image, self.rows, self.cols)
137
- self.initial_info = self.redraw.initial_info
138
- self.result_images.append(self.image)
139
- if self.redraw.save:
140
- self.save_image()
141
-
142
- if self.seams_fix.enabled:
143
- self.image = self.seams_fix.start(self.p, self.image, self.rows, self.cols)
144
- self.initial_info = self.seams_fix.initial_info
145
- self.result_images.append(self.image)
146
- if self.seams_fix.save:
147
- self.save_image()
148
- state.end()
149
-
150
- class USDURedraw():
151
-
152
- def init_draw(self, p, width, height):
153
- p.inpaint_full_res = True
154
- p.inpaint_full_res_padding = self.padding
155
- p.width = math.ceil((self.tile_width+self.padding) / 64) * 64
156
- p.height = math.ceil((self.tile_height+self.padding) / 64) * 64
157
- mask = Image.new("L", (width, height), "black")
158
- draw = ImageDraw.Draw(mask)
159
- return mask, draw
160
-
161
- def calc_rectangle(self, xi, yi):
162
- x1 = xi * self.tile_width
163
- y1 = yi * self.tile_height
164
- x2 = xi * self.tile_width + self.tile_width
165
- y2 = yi * self.tile_height + self.tile_height
166
-
167
- return x1, y1, x2, y2
168
-
169
- def linear_process(self, p, image, rows, cols):
170
- mask, draw = self.init_draw(p, image.width, image.height)
171
- for yi in range(rows):
172
- for xi in range(cols):
173
- if state.interrupted:
174
- break
175
- draw.rectangle(self.calc_rectangle(xi, yi), fill="white")
176
- p.init_images = [image]
177
- p.image_mask = mask
178
- processed = processing.process_images(p)
179
- draw.rectangle(self.calc_rectangle(xi, yi), fill="black")
180
- if (len(processed.images) > 0):
181
- image = processed.images[0]
182
-
183
- p.width = image.width
184
- p.height = image.height
185
- self.initial_info = processed.infotext(p, 0)
186
-
187
- return image
188
-
189
- def chess_process(self, p, image, rows, cols):
190
- mask, draw = self.init_draw(p, image.width, image.height)
191
- tiles = []
192
- # calc tiles colors
193
- for yi in range(rows):
194
- for xi in range(cols):
195
- if state.interrupted:
196
- break
197
- if xi == 0:
198
- tiles.append([])
199
- color = xi % 2 == 0
200
- if yi > 0 and yi % 2 != 0:
201
- color = not color
202
- tiles[yi].append(color)
203
-
204
- for yi in range(len(tiles)):
205
- for xi in range(len(tiles[yi])):
206
- if state.interrupted:
207
- break
208
- if not tiles[yi][xi]:
209
- tiles[yi][xi] = not tiles[yi][xi]
210
- continue
211
- tiles[yi][xi] = not tiles[yi][xi]
212
- draw.rectangle(self.calc_rectangle(xi, yi), fill="white")
213
- p.init_images = [image]
214
- p.image_mask = mask
215
- processed = processing.process_images(p)
216
- draw.rectangle(self.calc_rectangle(xi, yi), fill="black")
217
- if (len(processed.images) > 0):
218
- image = processed.images[0]
219
-
220
- for yi in range(len(tiles)):
221
- for xi in range(len(tiles[yi])):
222
- if state.interrupted:
223
- break
224
- if not tiles[yi][xi]:
225
- continue
226
- draw.rectangle(self.calc_rectangle(xi, yi), fill="white")
227
- p.init_images = [image]
228
- p.image_mask = mask
229
- processed = processing.process_images(p)
230
- draw.rectangle(self.calc_rectangle(xi, yi), fill="black")
231
- if (len(processed.images) > 0):
232
- image = processed.images[0]
233
-
234
- p.width = image.width
235
- p.height = image.height
236
- self.initial_info = processed.infotext(p, 0)
237
-
238
- return image
239
-
240
- def start(self, p, image, rows, cols):
241
- self.initial_info = None
242
- if self.mode == USDUMode.LINEAR:
243
- return self.linear_process(p, image, rows, cols)
244
- if self.mode == USDUMode.CHESS:
245
- return self.chess_process(p, image, rows, cols)
246
-
247
- class USDUSeamsFix():
248
-
249
- def init_draw(self, p):
250
- self.initial_info = None
251
- p.width = math.ceil((self.tile_width+self.padding) / 64) * 64
252
- p.height = math.ceil((self.tile_height+self.padding) / 64) * 64
253
-
254
- def half_tile_process(self, p, image, rows, cols):
255
-
256
- self.init_draw(p)
257
- processed = None
258
-
259
- gradient = Image.linear_gradient("L")
260
- row_gradient = Image.new("L", (self.tile_width, self.tile_height), "black")
261
- row_gradient.paste(gradient.resize(
262
- (self.tile_width, self.tile_height//2), resample=Image.BICUBIC), (0, 0))
263
- row_gradient.paste(gradient.rotate(180).resize(
264
- (self.tile_width, self.tile_height//2), resample=Image.BICUBIC),
265
- (0, self.tile_height//2))
266
- col_gradient = Image.new("L", (self.tile_width, self.tile_height), "black")
267
- col_gradient.paste(gradient.rotate(90).resize(
268
- (self.tile_width//2, self.tile_height), resample=Image.BICUBIC), (0, 0))
269
- col_gradient.paste(gradient.rotate(270).resize(
270
- (self.tile_width//2, self.tile_height), resample=Image.BICUBIC), (self.tile_width//2, 0))
271
-
272
- p.denoising_strength = self.denoise
273
- p.mask_blur = self.mask_blur
274
-
275
- for yi in range(rows-1):
276
- for xi in range(cols):
277
- if state.interrupted:
278
- break
279
- p.width = self.tile_width
280
- p.height = self.tile_height
281
- p.inpaint_full_res = True
282
- p.inpaint_full_res_padding = self.padding
283
- mask = Image.new("L", (image.width, image.height), "black")
284
- mask.paste(row_gradient, (xi*self.tile_width, yi*self.tile_height + self.tile_height//2))
285
-
286
- p.init_images = [image]
287
- p.image_mask = mask
288
- processed = processing.process_images(p)
289
- if (len(processed.images) > 0):
290
- image = processed.images[0]
291
-
292
- for yi in range(rows):
293
- for xi in range(cols-1):
294
- if state.interrupted:
295
- break
296
- p.width = self.tile_width
297
- p.height = self.tile_height
298
- p.inpaint_full_res = True
299
- p.inpaint_full_res_padding = self.padding
300
- mask = Image.new("L", (image.width, image.height), "black")
301
- mask.paste(col_gradient, (xi*self.tile_width+self.tile_width//2, yi*self.tile_height))
302
-
303
- p.init_images = [image]
304
- p.image_mask = mask
305
- processed = processing.process_images(p)
306
- if (len(processed.images) > 0):
307
- image = processed.images[0]
308
-
309
- p.width = image.width
310
- p.height = image.height
311
- if processed is not None:
312
- self.initial_info = processed.infotext(p, 0)
313
-
314
- return image
315
-
316
- def half_tile_process_corners(self, p, image, rows, cols):
317
- fixed_image = self.half_tile_process(p, image, rows, cols)
318
- processed = None
319
- self.init_draw(p)
320
- gradient = Image.radial_gradient("L").resize(
321
- (self.tile_width, self.tile_height), resample=Image.BICUBIC)
322
- gradient = ImageOps.invert(gradient)
323
- p.denoising_strength = self.denoise
324
- #p.mask_blur = 0
325
- p.mask_blur = self.mask_blur
326
-
327
- for yi in range(rows-1):
328
- for xi in range(cols-1):
329
- if state.interrupted:
330
- break
331
- p.width = self.tile_width
332
- p.height = self.tile_height
333
- p.inpaint_full_res = True
334
- p.inpaint_full_res_padding = 0
335
- mask = Image.new("L", (fixed_image.width, fixed_image.height), "black")
336
- mask.paste(gradient, (xi*self.tile_width + self.tile_width//2,
337
- yi*self.tile_height + self.tile_height//2))
338
-
339
- p.init_images = [fixed_image]
340
- p.image_mask = mask
341
- processed = processing.process_images(p)
342
- if (len(processed.images) > 0):
343
- fixed_image = processed.images[0]
344
-
345
- p.width = fixed_image.width
346
- p.height = fixed_image.height
347
- if processed is not None:
348
- self.initial_info = processed.infotext(p, 0)
349
-
350
- return fixed_image
351
-
352
- def band_pass_process(self, p, image, cols, rows):
353
-
354
- self.init_draw(p)
355
- processed = None
356
-
357
- p.denoising_strength = self.denoise
358
- p.mask_blur = 0
359
-
360
- gradient = Image.linear_gradient("L")
361
- mirror_gradient = Image.new("L", (256, 256), "black")
362
- mirror_gradient.paste(gradient.resize((256, 128), resample=Image.BICUBIC), (0, 0))
363
- mirror_gradient.paste(gradient.rotate(180).resize((256, 128), resample=Image.BICUBIC), (0, 128))
364
-
365
- row_gradient = mirror_gradient.resize((image.width, self.width), resample=Image.BICUBIC)
366
- col_gradient = mirror_gradient.rotate(90).resize((self.width, image.height), resample=Image.BICUBIC)
367
-
368
- for xi in range(1, rows):
369
- if state.interrupted:
370
- break
371
- p.width = self.width + self.padding * 2
372
- p.height = image.height
373
- p.inpaint_full_res = True
374
- p.inpaint_full_res_padding = self.padding
375
- mask = Image.new("L", (image.width, image.height), "black")
376
- mask.paste(col_gradient, (xi * self.tile_width - self.width // 2, 0))
377
-
378
- p.init_images = [image]
379
- p.image_mask = mask
380
- processed = processing.process_images(p)
381
- if (len(processed.images) > 0):
382
- image = processed.images[0]
383
- for yi in range(1, cols):
384
- if state.interrupted:
385
- break
386
- p.width = image.width
387
- p.height = self.width + self.padding * 2
388
- p.inpaint_full_res = True
389
- p.inpaint_full_res_padding = self.padding
390
- mask = Image.new("L", (image.width, image.height), "black")
391
- mask.paste(row_gradient, (0, yi * self.tile_height - self.width // 2))
392
-
393
- p.init_images = [image]
394
- p.image_mask = mask
395
- processed = processing.process_images(p)
396
- if (len(processed.images) > 0):
397
- image = processed.images[0]
398
-
399
- p.width = image.width
400
- p.height = image.height
401
- if processed is not None:
402
- self.initial_info = processed.infotext(p, 0)
403
-
404
- return image
405
-
406
- def start(self, p, image, rows, cols):
407
- if USDUSFMode(self.mode) == USDUSFMode.BAND_PASS:
408
- return self.band_pass_process(p, image, rows, cols)
409
- elif USDUSFMode(self.mode) == USDUSFMode.HALF_TILE:
410
- return self.half_tile_process(p, image, rows, cols)
411
- elif USDUSFMode(self.mode) == USDUSFMode.HALF_TILE_PLUS_INTERSECTIONS:
412
- return self.half_tile_process_corners(p, image, rows, cols)
413
- else:
414
- return image
415
-
416
- class Script(scripts.Script):
417
- def title(self):
418
- return "Ultimate SD upscale"
419
-
420
- def show(self, is_img2img):
421
- return is_img2img
422
-
423
- def ui(self, is_img2img):
424
-
425
- target_size_types = [
426
- "From img2img2 settings",
427
- "Custom size",
428
- "Scale from image size"
429
- ]
430
-
431
- seams_fix_types = [
432
- "None",
433
- "Band pass",
434
- "Half tile offset pass",
435
- "Half tile offset pass + intersections"
436
- ]
437
-
438
- redrow_modes = [
439
- "Linear",
440
- "Chess",
441
- "None"
442
- ]
443
-
444
- info = gr.HTML(
445
- "<p style=\"margin-bottom:0.75em\">Will upscale the image depending on the selected target size type</p>")
446
-
447
- with gr.Row():
448
- target_size_type = gr.Dropdown(label="Target size type", choices=[k for k in target_size_types], type="index",
449
- value=next(iter(target_size_types)))
450
-
451
- custom_width = gr.Slider(label='Custom width', minimum=64, maximum=8192, step=64, value=2048, visible=False, interactive=True)
452
- custom_height = gr.Slider(label='Custom height', minimum=64, maximum=8192, step=64, value=2048, visible=False, interactive=True)
453
- custom_scale = gr.Slider(label='Scale', minimum=1, maximum=16, step=0.01, value=2, visible=False, interactive=True)
454
-
455
- gr.HTML("<p style=\"margin-bottom:0.75em\">Redraw options:</p>")
456
- with gr.Row():
457
- upscaler_index = gr.Radio(label='Upscaler', choices=[x.name for x in shared.sd_upscalers],
458
- value=shared.sd_upscalers[0].name, type="index")
459
- with gr.Row():
460
- redraw_mode = gr.Dropdown(label="Type", choices=[k for k in redrow_modes], type="index", value=next(iter(redrow_modes)))
461
- tile_width = gr.Slider(minimum=0, maximum=2048, step=64, label='Tile width', value=512)
462
- tile_height = gr.Slider(minimum=0, maximum=2048, step=64, label='Tile height', value=0)
463
- mask_blur = gr.Slider(label='Mask blur', minimum=0, maximum=64, step=1, value=8)
464
- padding = gr.Slider(label='Padding', minimum=0, maximum=128, step=1, value=32)
465
- gr.HTML("<p style=\"margin-bottom:0.75em\">Seams fix:</p>")
466
- with gr.Row():
467
- seams_fix_type = gr.Dropdown(label="Type", choices=[k for k in seams_fix_types], type="index", value=next(iter(seams_fix_types)))
468
- seams_fix_denoise = gr.Slider(label='Denoise', minimum=0, maximum=1, step=0.01, value=0.35, visible=False, interactive=True)
469
- seams_fix_width = gr.Slider(label='Width', minimum=0, maximum=128, step=1, value=64, visible=False, interactive=True)
470
- seams_fix_mask_blur = gr.Slider(label='Mask blur', minimum=0, maximum=64, step=1, value=4, visible=False, interactive=True)
471
- seams_fix_padding = gr.Slider(label='Padding', minimum=0, maximum=128, step=1, value=16, visible=False, interactive=True)
472
- gr.HTML("<p style=\"margin-bottom:0.75em\">Save options:</p>")
473
- with gr.Row():
474
- save_upscaled_image = gr.Checkbox(label="Upscaled", value=True)
475
- save_seams_fix_image = gr.Checkbox(label="Seams fix", value=False)
476
-
477
- def select_fix_type(fix_index):
478
- all_visible = fix_index != 0
479
- mask_blur_visible = fix_index == 2 or fix_index == 3
480
- width_visible = fix_index == 1
481
-
482
- return [gr.update(visible=all_visible),
483
- gr.update(visible=width_visible),
484
- gr.update(visible=mask_blur_visible),
485
- gr.update(visible=all_visible)]
486
-
487
- seams_fix_type.change(
488
- fn=select_fix_type,
489
- inputs=seams_fix_type,
490
- outputs=[seams_fix_denoise, seams_fix_width, seams_fix_mask_blur, seams_fix_padding]
491
- )
492
-
493
- def select_scale_type(scale_index):
494
- is_custom_size = scale_index == 1
495
- is_custom_scale = scale_index == 2
496
-
497
- return [gr.update(visible=is_custom_size),
498
- gr.update(visible=is_custom_size),
499
- gr.update(visible=is_custom_scale),
500
- ]
501
-
502
- target_size_type.change(
503
- fn=select_scale_type,
504
- inputs=target_size_type,
505
- outputs=[custom_width, custom_height, custom_scale]
506
- )
507
-
508
- return [info, tile_width, tile_height, mask_blur, padding, seams_fix_width, seams_fix_denoise, seams_fix_padding,
509
- upscaler_index, save_upscaled_image, redraw_mode, save_seams_fix_image, seams_fix_mask_blur,
510
- seams_fix_type, target_size_type, custom_width, custom_height, custom_scale]
511
-
512
- def run(self, p, _, tile_width, tile_height, mask_blur, padding, seams_fix_width, seams_fix_denoise, seams_fix_padding,
513
- upscaler_index, save_upscaled_image, redraw_mode, save_seams_fix_image, seams_fix_mask_blur,
514
- seams_fix_type, target_size_type, custom_width, custom_height, custom_scale):
515
-
516
- # Init
517
- processing.fix_seed(p)
518
- devices.torch_gc()
519
-
520
- p.do_not_save_grid = True
521
- p.do_not_save_samples = True
522
- p.inpaint_full_res = False
523
-
524
- p.inpainting_fill = 1
525
- p.n_iter = 1
526
- p.batch_size = 1
527
-
528
- seed = p.seed
529
-
530
- # Init image
531
- init_img = p.init_images[0]
532
- if init_img == None:
533
- return Processed(p, [], seed, "Empty image")
534
- init_img = images.flatten(init_img, opts.img2img_background_color)
535
-
536
- #override size
537
- if target_size_type == 1:
538
- p.width = custom_width
539
- p.height = custom_height
540
- if target_size_type == 2:
541
- p.width = math.ceil((init_img.width * custom_scale) / 64) * 64
542
- p.height = math.ceil((init_img.height * custom_scale) / 64) * 64
543
-
544
- # Upscaling
545
- upscaler = USDUpscaler(p, init_img, upscaler_index, save_upscaled_image, save_seams_fix_image, tile_width, tile_height)
546
- upscaler.upscale()
547
-
548
- # Drawing
549
- upscaler.setup_redraw(redraw_mode, padding, mask_blur)
550
- upscaler.setup_seams_fix(seams_fix_padding, seams_fix_denoise, seams_fix_mask_blur, seams_fix_width, seams_fix_type)
551
- upscaler.print_info()
552
- upscaler.add_extra_info()
553
- upscaler.process()
554
- result_images = upscaler.result_images
555
-
556
- return Processed(p, result_images, seed, upscaler.initial_info if upscaler.initial_info is not None else "")
557
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/usdu_patch.py DELETED
@@ -1,66 +0,0 @@
1
- # Make some patches to the script
2
- from repositories import ultimate_upscale as usdu
3
- import modules.shared as shared
4
- import math
5
- from PIL import Image
6
-
7
-
8
- if (not hasattr(Image, 'Resampling')): # For older versions of Pillow
9
- Image.Resampling = Image
10
-
11
- #
12
- # Instead of using multiples of 64, use multiples of 8
13
- #
14
-
15
- # Upscaler
16
- old_init = usdu.USDUpscaler.__init__
17
-
18
-
19
- def new_init(self, p, image, upscaler_index, save_redraw, save_seams_fix, tile_width, tile_height):
20
- p.width = math.ceil((image.width * p.upscale_by) / 8) * 8
21
- p.height = math.ceil((image.height * p.upscale_by) / 8) * 8
22
- old_init(self, p, image, upscaler_index, save_redraw, save_seams_fix, tile_width, tile_height)
23
-
24
-
25
- usdu.USDUpscaler.__init__ = new_init
26
-
27
- # Redraw
28
- old_setup_redraw = usdu.USDURedraw.init_draw
29
-
30
-
31
- def new_setup_redraw(self, p, width, height):
32
- mask, draw = old_setup_redraw(self, p, width, height)
33
- p.width = math.ceil((self.tile_width + self.padding) / 8) * 8
34
- p.height = math.ceil((self.tile_height + self.padding) / 8) * 8
35
- return mask, draw
36
-
37
-
38
- usdu.USDURedraw.init_draw = new_setup_redraw
39
-
40
- # Seams fix
41
- old_setup_seams_fix = usdu.USDUSeamsFix.init_draw
42
-
43
-
44
- def new_setup_seams_fix(self, p):
45
- old_setup_seams_fix(self, p)
46
- p.width = math.ceil((self.tile_width + self.padding) / 8) * 8
47
- p.height = math.ceil((self.tile_height + self.padding) / 8) * 8
48
-
49
-
50
- usdu.USDUSeamsFix.init_draw = new_setup_seams_fix
51
-
52
-
53
- #
54
- # Make the script upscale on a batch of images instead of one image
55
- #
56
-
57
- old_upscale = usdu.USDUpscaler.upscale
58
-
59
-
60
- def new_upscale(self):
61
- old_upscale(self)
62
- shared.batch = [self.image] + \
63
- [img.resize((self.p.width, self.p.height), resample=Image.LANCZOS) for img in shared.batch[1:]]
64
-
65
-
66
- usdu.USDUpscaler.upscale = new_upscale
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
custom_nodes/ComfyUI_UltimateSDUpscale/utils.py DELETED
@@ -1,460 +0,0 @@
1
- import numpy as np
2
- from PIL import Image, ImageFilter
3
- import torch
4
- import torch.nn.functional as F
5
- from torchvision.transforms import GaussianBlur
6
- import math
7
-
8
- if (not hasattr(Image, 'Resampling')): # For older versions of Pillow
9
- Image.Resampling = Image
10
-
11
- BLUR_KERNEL_SIZE = 15
12
-
13
-
14
- def tensor_to_pil(img_tensor, batch_index=0):
15
- # Takes an image in a batch in the form of a tensor of shape [batch_size, channels, height, width]
16
- # and returns an PIL Image with the corresponding mode deduced by the number of channels
17
-
18
- # Take the image in the batch given by batch_index
19
- img_tensor = img_tensor[batch_index].unsqueeze(0)
20
- i = 255. * img_tensor.cpu().numpy()
21
- img = Image.fromarray(np.clip(i, 0, 255).astype(np.uint8).squeeze())
22
- return img
23
-
24
-
25
- def pil_to_tensor(image):
26
- # Takes a PIL image and returns a tensor of shape [1, height, width, channels]
27
- image = np.array(image).astype(np.float32) / 255.0
28
- image = torch.from_numpy(image).unsqueeze(0)
29
- if len(image.shape) == 3: # If the image is grayscale, add a channel dimension
30
- image = image.unsqueeze(-1)
31
- return image
32
-
33
-
34
- def controlnet_hint_to_pil(tensor, batch_index=0):
35
- return tensor_to_pil(tensor.movedim(1, -1), batch_index)
36
-
37
-
38
- def pil_to_controlnet_hint(img):
39
- return pil_to_tensor(img).movedim(-1, 1)
40
-
41
-
42
- def crop_tensor(tensor, region):
43
- # Takes a tensor of shape [batch_size, height, width, channels] and crops it to the given region
44
- x1, y1, x2, y2 = region
45
- return tensor[:, y1:y2, x1:x2, :]
46
-
47
-
48
- def resize_tensor(tensor, size, mode="nearest-exact"):
49
- # Takes a tensor of shape [B, C, H, W] and resizes
50
- # it to a shape of [B, C, size[0], size[1]] using the given mode
51
- return torch.nn.functional.interpolate(tensor, size=size, mode=mode)
52
-
53
-
54
- def get_crop_region(mask, pad=0):
55
- # Takes a black and white PIL image in 'L' mode and returns the coordinates of the white rectangular mask region
56
- # Should be equivalent to the get_crop_region function from https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob/master/modules/masking.py
57
- coordinates = mask.getbbox()
58
- if coordinates is not None:
59
- x1, y1, x2, y2 = coordinates
60
- else:
61
- x1, y1, x2, y2 = mask.width, mask.height, 0, 0
62
- # Apply padding
63
- x1 = max(x1 - pad, 0)
64
- y1 = max(y1 - pad, 0)
65
- x2 = min(x2 + pad, mask.width)
66
- y2 = min(y2 + pad, mask.height)
67
- return fix_crop_region((x1, y1, x2, y2), (mask.width, mask.height))
68
-
69
-
70
- def fix_crop_region(region, image_size):
71
- # Remove the extra pixel added by the get_crop_region function
72
- image_width, image_height = image_size
73
- x1, y1, x2, y2 = region
74
- if x2 < image_width:
75
- x2 -= 1
76
- if y2 < image_height:
77
- y2 -= 1
78
- return x1, y1, x2, y2
79
-
80
-
81
- def expand_crop(region, width, height, target_width, target_height):
82
- '''
83
- Expands a crop region to a specified target size.
84
- :param region: A tuple of the form (x1, y1, x2, y2) denoting the upper left and the lower right points
85
- of the rectangular region. Expected to have x2 > x1 and y2 > y1.
86
- :param width: The width of the image the crop region is from.
87
- :param height: The height of the image the crop region is from.
88
- :param target_width: The desired width of the crop region.
89
- :param target_height: The desired height of the crop region.
90
- '''
91
- x1, y1, x2, y2 = region
92
- actual_width = x2 - x1
93
- actual_height = y2 - y1
94
- # target_width = math.ceil(actual_width / 8) * 8
95
- # target_height = math.ceil(actual_height / 8) * 8
96
-
97
- # Try to expand region to the right of half the difference
98
- width_diff = target_width - actual_width
99
- x2 = min(x2 + width_diff // 2, width)
100
- # Expand region to the left of the difference including the pixels that could not be expanded to the right
101
- width_diff = target_width - (x2 - x1)
102
- x1 = max(x1 - width_diff, 0)
103
- # Try the right again
104
- width_diff = target_width - (x2 - x1)
105
- x2 = min(x2 + width_diff, width)
106
-
107
- # Try to expand region to the bottom of half the difference
108
- height_diff = target_height - actual_height
109
- y2 = min(y2 + height_diff // 2, height)
110
- # Expand region to the top of the difference including the pixels that could not be expanded to the bottom
111
- height_diff = target_height - (y2 - y1)
112
- y1 = max(y1 - height_diff, 0)
113
- # Try the bottom again
114
- height_diff = target_height - (y2 - y1)
115
- y2 = min(y2 + height_diff, height)
116
-
117
- return (x1, y1, x2, y2), (target_width, target_height)
118
-
119
-
120
- def resize_region(region, init_size, resize_size):
121
- # Resize a crop so that it fits an image that was resized to the given width and height
122
- x1, y1, x2, y2 = region
123
- init_width, init_height = init_size
124
- resize_width, resize_height = resize_size
125
- x1 = math.floor(x1 * resize_width / init_width)
126
- x2 = math.ceil(x2 * resize_width / init_width)
127
- y1 = math.floor(y1 * resize_height / init_height)
128
- y2 = math.ceil(y2 * resize_height / init_height)
129
- return (x1, y1, x2, y2)
130
-
131
-
132
- def pad_image(image, left_pad, right_pad, top_pad, bottom_pad, fill=False, blur=False):
133
- '''
134
- Pads an image with the given number of pixels on each side and fills the padding with data from the edges.
135
- :param image: A PIL image
136
- :param left_pad: The number of pixels to pad on the left side
137
- :param right_pad: The number of pixels to pad on the right side
138
- :param top_pad: The number of pixels to pad on the top side
139
- :param bottom_pad: The number of pixels to pad on the bottom side
140
- :param blur: Whether to blur the padded edges
141
- :return: A PIL image with size (image.width + left_pad + right_pad, image.height + top_pad + bottom_pad)
142
- '''
143
- left_edge = image.crop((0, 1, 1, image.height - 1))
144
- right_edge = image.crop((image.width - 1, 1, image.width, image.height - 1))
145
- top_edge = image.crop((1, 0, image.width - 1, 1))
146
- bottom_edge = image.crop((1, image.height - 1, image.width - 1, image.height))
147
- new_width = image.width + left_pad + right_pad
148
- new_height = image.height + top_pad + bottom_pad
149
- padded_image = Image.new(image.mode, (new_width, new_height))
150
- padded_image.paste(image, (left_pad, top_pad))
151
- if fill:
152
- for i in range(left_pad):
153
- edge = left_edge.resize(
154
- (1, new_height - i * (top_pad + bottom_pad) // left_pad), resample=Image.Resampling.NEAREST)
155
- padded_image.paste(edge, (i, i * top_pad // left_pad))
156
- for i in range(right_pad):
157
- edge = right_edge.resize(
158
- (1, new_height - i * (top_pad + bottom_pad) // right_pad), resample=Image.Resampling.NEAREST)
159
- padded_image.paste(edge, (new_width - 1 - i, i * top_pad // right_pad))
160
- for i in range(top_pad):
161
- edge = top_edge.resize(
162
- (new_width - i * (left_pad + right_pad) // top_pad, 1), resample=Image.Resampling.NEAREST)
163
- padded_image.paste(edge, (i * left_pad // top_pad, i))
164
- for i in range(bottom_pad):
165
- edge = bottom_edge.resize(
166
- (new_width - i * (left_pad + right_pad) // bottom_pad, 1), resample=Image.Resampling.NEAREST)
167
- padded_image.paste(edge, (i * left_pad // bottom_pad, new_height - 1 - i))
168
- if blur and not (left_pad == right_pad == top_pad == bottom_pad == 0):
169
- padded_image = padded_image.filter(ImageFilter.GaussianBlur(BLUR_KERNEL_SIZE))
170
- padded_image.paste(image, (left_pad, top_pad))
171
- return padded_image
172
-
173
-
174
- def pad_image2(image, left_pad, right_pad, top_pad, bottom_pad, fill=False, blur=False):
175
- '''
176
- Pads an image with the given number of pixels on each side and fills the padding with data from the edges.
177
- Faster than pad_image, but only pads with edge data in straight lines.
178
- :param image: A PIL image
179
- :param left_pad: The number of pixels to pad on the left side
180
- :param right_pad: The number of pixels to pad on the right side
181
- :param top_pad: The number of pixels to pad on the top side
182
- :param bottom_pad: The number of pixels to pad on the bottom side
183
- :param blur: Whether to blur the padded edges
184
- :return: A PIL image with size (image.width + left_pad + right_pad, image.height + top_pad + bottom_pad)
185
- '''
186
- left_edge = image.crop((0, 1, 1, image.height - 1))
187
- right_edge = image.crop((image.width - 1, 1, image.width, image.height - 1))
188
- top_edge = image.crop((1, 0, image.width - 1, 1))
189
- bottom_edge = image.crop((1, image.height - 1, image.width - 1, image.height))
190
- new_width = image.width + left_pad + right_pad
191
- new_height = image.height + top_pad + bottom_pad
192
- padded_image = Image.new(image.mode, (new_width, new_height))
193
- padded_image.paste(image, (left_pad, top_pad))
194
- if fill:
195
- if left_pad > 0:
196
- padded_image.paste(left_edge.resize((left_pad, new_height), resample=Image.Resampling.NEAREST), (0, 0))
197
- if right_pad > 0:
198
- padded_image.paste(right_edge.resize((right_pad, new_height),
199
- resample=Image.Resampling.NEAREST), (new_width - right_pad, 0))
200
- if top_pad > 0:
201
- padded_image.paste(top_edge.resize((new_width, top_pad), resample=Image.Resampling.NEAREST), (0, 0))
202
- if bottom_pad > 0:
203
- padded_image.paste(bottom_edge.resize((new_width, bottom_pad),
204
- resample=Image.Resampling.NEAREST), (0, new_height - bottom_pad))
205
- if blur and not (left_pad == right_pad == top_pad == bottom_pad == 0):
206
- padded_image = padded_image.filter(ImageFilter.GaussianBlur(BLUR_KERNEL_SIZE))
207
- padded_image.paste(image, (left_pad, top_pad))
208
- return padded_image
209
-
210
-
211
- def pad_tensor(tensor, left_pad, right_pad, top_pad, bottom_pad, fill=False, blur=False):
212
- '''
213
- Pads an image tensor with the given number of pixels on each side and fills the padding with data from the edges.
214
- :param tensor: A tensor of shape [B, H, W, C]
215
- :param left_pad: The number of pixels to pad on the left side
216
- :param right_pad: The number of pixels to pad on the right side
217
- :param top_pad: The number of pixels to pad on the top side
218
- :param bottom_pad: The number of pixels to pad on the bottom side
219
- :param blur: Whether to blur the padded edges
220
- :return: A tensor of shape [B, H + top_pad + bottom_pad, W + left_pad + right_pad, C]
221
- '''
222
- batch_size, channels, height, width = tensor.shape
223
- h_pad = left_pad + right_pad
224
- v_pad = top_pad + bottom_pad
225
- new_width = width + h_pad
226
- new_height = height + v_pad
227
-
228
- # Create empty image
229
- padded = torch.zeros((batch_size, channels, new_height, new_width), dtype=tensor.dtype)
230
-
231
- # Copy the original image into the centor of the padded tensor
232
- padded[:, :, top_pad:top_pad + height, left_pad:left_pad + width] = tensor
233
-
234
- # Duplicate the edges of the original image into the padding
235
- if top_pad > 0:
236
- padded[:, :, :top_pad, :] = padded[:, :, top_pad:top_pad + 1, :] # Top edge
237
- if bottom_pad > 0:
238
- padded[:, :, -bottom_pad:, :] = padded[:, :, -bottom_pad - 1:-bottom_pad, :] # Bottom edge
239
- if left_pad > 0:
240
- padded[:, :, :, :left_pad] = padded[:, :, :, left_pad:left_pad + 1] # Left edge
241
- if right_pad > 0:
242
- padded[:, :, :, -right_pad:] = padded[:, :, :, -right_pad - 1:-right_pad] # Right edge
243
-
244
- return padded
245
-
246
-
247
- def resize_and_pad_image(image, width, height, fill=False, blur=False):
248
- '''
249
- Resizes an image to the given width and height and pads it to the given width and height.
250
- :param image: A PIL image
251
- :param width: The width of the resized image
252
- :param height: The height of the resized image
253
- :param fill: Whether to fill the padding with data from the edges
254
- :param blur: Whether to blur the padded edges
255
- :return: A PIL image of size (width, height)
256
- '''
257
- width_ratio = width / image.width
258
- height_ratio = height / image.height
259
- if height_ratio > width_ratio:
260
- resize_ratio = width_ratio
261
- else:
262
- resize_ratio = height_ratio
263
- resize_width = round(image.width * resize_ratio)
264
- resize_height = round(image.height * resize_ratio)
265
- resized = image.resize((resize_width, resize_height), resample=Image.Resampling.LANCZOS)
266
- # Pad the sides of the image to get the image to the desired size that wasn't covered by the resize
267
- horizontal_pad = (width - resize_width) // 2
268
- vertical_pad = (height - resize_height) // 2
269
- result = pad_image2(resized, horizontal_pad, horizontal_pad, vertical_pad, vertical_pad, fill, blur)
270
- result = result.resize((width, height), resample=Image.Resampling.LANCZOS)
271
- return result, (horizontal_pad, vertical_pad)
272
-
273
-
274
- def resize_and_pad_tensor(tensor, width, height, fill=False, blur=False):
275
- '''
276
- Resizes an image tensor to the given width and height and pads it to the given width and height.
277
- :param tensor: A tensor of shape [B, H, W, C]
278
- :param width: The width of the resized image
279
- :param height: The height of the resized image
280
- :param fill: Whether to fill the padding with data from the edges
281
- :param blur: Whether to blur the padded edges
282
- :return: A tensor of shape [B, height, width, C]
283
- '''
284
- # Resize the image to the closest size that maintains the aspect ratio
285
- width_ratio = width / tensor.shape[3]
286
- height_ratio = height / tensor.shape[2]
287
- if height_ratio > width_ratio:
288
- resize_ratio = width_ratio
289
- else:
290
- resize_ratio = height_ratio
291
- resize_width = round(tensor.shape[3] * resize_ratio)
292
- resize_height = round(tensor.shape[2] * resize_ratio)
293
- resized = F.interpolate(tensor, size=(resize_height, resize_width), mode='nearest-exact')
294
- # Pad the sides of the image to get the image to the desired size that wasn't covered by the resize
295
- horizontal_pad = (width - resize_width) // 2
296
- vertical_pad = (height - resize_height) // 2
297
- result = pad_tensor(resized, horizontal_pad, horizontal_pad, vertical_pad, vertical_pad, fill, blur)
298
- result = F.interpolate(result, size=(height, width), mode='nearest-exact')
299
- return result
300
-
301
-
302
- def crop_controlnet(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad):
303
- if "control" not in cond_dict:
304
- return
305
- c = cond_dict["control"]
306
- controlnet = c.copy()
307
- cond_dict["control"] = controlnet
308
- while c is not None:
309
- # hint is shape (B, C, H, W)
310
- hint = controlnet.cond_hint_original
311
- resized_crop = resize_region(region, canvas_size, hint.shape[:-3:-1])
312
- hint = crop_tensor(hint.movedim(1, -1), resized_crop).movedim(-1, 1)
313
- hint = resize_tensor(hint, tile_size[::-1])
314
- controlnet.cond_hint_original = hint
315
- c = c.previous_controlnet
316
- controlnet.set_previous_controlnet(c.copy() if c is not None else None)
317
- controlnet = controlnet.previous_controlnet
318
-
319
-
320
- def region_intersection(region1, region2):
321
- """
322
- Returns the coordinates of the intersection of two rectangular regions.
323
- :param region1: A tuple of the form (x1, y1, x2, y2) denoting the upper left and the lower right points
324
- of the first rectangular region. Expected to have x2 > x1 and y2 > y1.
325
- :param region2: The second rectangular region with the same format as the first.
326
- :return: A tuple of the form (x1, y1, x2, y2) denoting the rectangular intersection.
327
- None if there is no intersection.
328
- """
329
- x1, y1, x2, y2 = region1
330
- x1_, y1_, x2_, y2_ = region2
331
- x1 = max(x1, x1_)
332
- y1 = max(y1, y1_)
333
- x2 = min(x2, x2_)
334
- y2 = min(y2, y2_)
335
- if x1 >= x2 or y1 >= y2:
336
- return None
337
- return (x1, y1, x2, y2)
338
-
339
-
340
- def crop_gligen(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad):
341
- if "gligen" not in cond_dict:
342
- return
343
- type, model, cond = cond_dict["gligen"]
344
- if type != "position":
345
- from warnings import warn
346
- warn(f"Unknown gligen type {type}")
347
- return
348
- cropped = []
349
- for c in cond:
350
- emb, h, w, y, x = c
351
- # Get the coordinates of the box in the upscaled image
352
- x1 = x * 8
353
- y1 = y * 8
354
- x2 = x1 + w * 8
355
- y2 = y1 + h * 8
356
- gligen_upscaled_box = resize_region((x1, y1, x2, y2), init_size, canvas_size)
357
-
358
- # Calculate the intersection of the gligen box and the region
359
- intersection = region_intersection(gligen_upscaled_box, region)
360
- if intersection is None:
361
- continue
362
- x1, y1, x2, y2 = intersection
363
-
364
- # Offset the gligen box so that the origin is at the top left of the tile region
365
- x1 -= region[0]
366
- y1 -= region[1]
367
- x2 -= region[0]
368
- y2 -= region[1]
369
-
370
- # Add the padding
371
- x1 += w_pad
372
- y1 += h_pad
373
- x2 += w_pad
374
- y2 += h_pad
375
-
376
- # Set the new position params
377
- h = (y2 - y1) // 8
378
- w = (x2 - x1) // 8
379
- x = x1 // 8
380
- y = y1 // 8
381
- cropped.append((emb, h, w, y, x))
382
-
383
- cond_dict["gligen"] = (type, model, cropped)
384
-
385
-
386
- def crop_area(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad):
387
- if "area" not in cond_dict:
388
- return
389
-
390
- # Resize the area conditioning to the canvas size and confine it to the tile region
391
- h, w, y, x = cond_dict["area"]
392
- w, h, x, y = 8 * w, 8 * h, 8 * x, 8 * y
393
- x1, y1, x2, y2 = resize_region((x, y, x + w, y + h), init_size, canvas_size)
394
- intersection = region_intersection((x1, y1, x2, y2), region)
395
- if intersection is None:
396
- del cond_dict["area"]
397
- del cond_dict["strength"]
398
- return
399
- x1, y1, x2, y2 = intersection
400
-
401
- # Offset origin to the top left of the tile
402
- x1 -= region[0]
403
- y1 -= region[1]
404
- x2 -= region[0]
405
- y2 -= region[1]
406
-
407
- # Add the padding
408
- x1 += w_pad
409
- y1 += h_pad
410
- x2 += w_pad
411
- y2 += h_pad
412
-
413
- # Set the params for tile
414
- w, h = (x2 - x1) // 8, (y2 - y1) // 8
415
- x, y = x1 // 8, y1 // 8
416
-
417
- cond_dict["area"] = (h, w, y, x)
418
-
419
-
420
- def crop_mask(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad):
421
- if "mask" not in cond_dict:
422
- return
423
- mask_tensor = cond_dict["mask"] # (B, H, W)
424
- masks = []
425
- for i in range(mask_tensor.shape[0]):
426
- # Convert to PIL image
427
- mask = tensor_to_pil(mask_tensor, i) # W x H
428
-
429
- # Resize the mask to the canvas size
430
- mask = mask.resize(canvas_size, Image.Resampling.BICUBIC)
431
-
432
- # Crop the mask to the region
433
- mask = mask.crop(region)
434
-
435
- # Add padding
436
- mask, _ = resize_and_pad_image(mask, tile_size[0], tile_size[1], fill=True)
437
-
438
- # Resize the mask to the tile size
439
- if tile_size != mask.size:
440
- mask = mask.resize(tile_size, Image.Resampling.BICUBIC)
441
-
442
- # Convert back to tensor
443
- mask = pil_to_tensor(mask) # (1, H, W, 1)
444
- mask = mask.squeeze(-1) # (1, H, W)
445
- masks.append(mask)
446
-
447
- cond_dict["mask"] = torch.cat(masks, dim=0) # (B, H, W)
448
-
449
-
450
- def crop_cond(cond, region, init_size, canvas_size, tile_size, w_pad=0, h_pad=0):
451
- cropped = []
452
- for emb, x in cond:
453
- cond_dict = x.copy()
454
- n = [emb, cond_dict]
455
- crop_controlnet(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad)
456
- crop_gligen(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad)
457
- crop_area(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad)
458
- crop_mask(cond_dict, region, init_size, canvas_size, tile_size, w_pad, h_pad)
459
- cropped.append(n)
460
- return cropped