Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,89 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
tags:
|
| 6 |
+
- flux
|
| 7 |
+
- diffusers
|
| 8 |
+
- lora
|
| 9 |
+
- replicate
|
| 10 |
+
- image-generation
|
| 11 |
+
- flux-diffusers
|
| 12 |
+
- diffusers
|
| 13 |
+
- photo
|
| 14 |
+
- realism
|
| 15 |
+
- Surrealism
|
| 16 |
+
- illustration
|
| 17 |
+
- experimental
|
| 18 |
+
- character
|
| 19 |
+
- historical person
|
| 20 |
+
- poetry
|
| 21 |
+
- literature
|
| 22 |
+
- history
|
| 23 |
+
- archival
|
| 24 |
+
base_model: black-forest-labs/FLUX.1-dev
|
| 25 |
+
pipeline_tag: text-to-image
|
| 26 |
+
library_name: diffusers
|
| 27 |
+
emoji: 🔜
|
| 28 |
+
instance_prompt: >-
|
| 29 |
+
ERNST style transposed layered illustration, Neurealist textographic photo collage
|
| 30 |
+
widget:
|
| 31 |
+
- text: >-
|
| 32 |
+
RCA style agitprop poster, Neurealist textographic photo collage, MAYAK
|
| 33 |
+
style art by Mayakovsky
|
| 34 |
+
output:
|
| 35 |
+
url: LifeOkay3.png
|
| 36 |
+
- text: >-
|
| 37 |
+
film photograph portrait RCA style agitprop poster, Neurealist textographic
|
| 38 |
+
photo collage, MAYAK style art by Mayakovsky
|
| 39 |
+
output:
|
| 40 |
+
url: LifeOkay2.jpg
|
| 41 |
+
- text: >-
|
| 42 |
+
text: RCA style agitprop poster, Neurealist textographic photo collage,
|
| 43 |
+
MAYAK style art by Mayakovsky
|
| 44 |
+
output:
|
| 45 |
+
url: RcaMakeLifeOkay1.png
|
| 46 |
+
- text: >-
|
| 47 |
+
high definition award winning intricate dynamic photorealistic close up
|
| 48 |
+
photo portrait of RCA style agitprop poster, Neurealist textographic photo
|
| 49 |
+
collage, MAYAK style art by Mayakovsky
|
| 50 |
+
output:
|
| 51 |
+
url: MakeLifeCrop.jpg
|
| 52 |
+
- text: >-
|
| 53 |
+
high definition award winning intricate dynamic photorealistic close up
|
| 54 |
+
photo portrait of RCA style agitprop poster, Neurealist textographic photo
|
| 55 |
+
collage, MAYAK style art by Mayakovsky
|
| 56 |
+
output:
|
| 57 |
+
url: images/example_joimmx505.png
|
| 58 |
+
|
| 59 |
+
---
|
| 60 |
+
|
| 61 |
+
# NEUREALLY TRANSPOSED COLLAGE FLUX LoRA for Posters, Illustrations, Book Covers, Collage art, Pamphlets, and more. By SilverAgePoets.com
|
| 62 |
+
An Experimental Repo where we will be testing out differently scale-coproportioned LoRA variants, each merged from two of our trained LoRAs. <br>
|
| 63 |
+
Namely: <br>
|
| 64 |
+
Our **Neurealist Collage II**^ LoRA (the de-distilled-FLUX-finetuned variant). <br>
|
| 65 |
+
&
|
| 66 |
+
Our **Ernst's Transposed Surreal Collage**^ LoRA. <br>
|
| 67 |
+
|
| 68 |
+
^: **Neurealist Collage II***: fine-tuned over Genova Apex Dedistilled on a dataset wherein each image constitutes a vertically tiled 1x1 collaging, intentionally/conceptually compiled by us from landscape-format screenshots of a certain YouTube doc (with caption fragments) entitled "Why Are We So Confused?". Prior to getting cross-stacked in dialectic relation to one another, each image was tactically and mostly manually (not just i2i, etc) modified/detourned by us in a variety of ways, into what we might obscurely call, say, prepost-DAnaDAish/metoomoderny (anti?)memes or something like that... <br>
|
| 69 |
+
In short, **Neurealist Collage II** LoRA was fine-tuned on vertically stacked screen-shape artworks with textboxed captions. <br>
|
| 70 |
+
|
| 71 |
+
^^: **Ernst's Transposed Surreal Collage**: fine-tuned over Genova Apex Dedistilled on a dataset wherein each image constitutes a landscape-shaped overlay of two illustrations, each constituting a page from **Max Ernst**'s pioneering 1934 surrealist textographic collage-novel [Une semaine de bonté ("A Week of Kindness")](https://en.wikipedia.org/wiki/Une_semaine_de_bont%C3%A9). <br>
|
| 72 |
+
In fact, these opacity-overlays are screenshots from a batch/auto-colorized version of a long GIF-image-sequence of Ernst book pages in a randomized order (with some repetitions), with simple opacity-cross-shifting overlay transitions between them. As we predicted, the colorization model (locally-run **DeOldify**, video-variant) reacted in totally different ways to the same two images overlayed with a different opacity ratio. <br>
|
| 73 |
+
The result of this was a vastly diversified range of aesthetic effects and chromatic qualities among the colorized frames. A selection from among these frames was then used by us as a fine-tuning dataset for the Ernst LoRA (or LoRAs, since it already exists in a few variants). <br>
|
| 74 |
+
|
| 75 |
+
## Trigger words
|
| 76 |
+
You should use `ERNST style transposed layered illustration` or/and `Neurealist textographic photo collage' to summon the poet's latent spirit.
|
| 77 |
+
|
| 78 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
| 79 |
+
|
| 80 |
+
```py
|
| 81 |
+
from diffusers import AutoPipelineForText2Image
|
| 82 |
+
import torch
|
| 83 |
+
|
| 84 |
+
pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
|
| 85 |
+
pipeline.load_lora_weights('AlekseyCalvin/AlekseyCalvin/NeureallyTransposedCollage_LoRA_bySilverAgePoets', weight_name='NeuroTransposedCollageLoRA_Scaled1.5_2.safetensors')
|
| 86 |
+
image = pipeline('your prompt').images[0]
|
| 87 |
+
```
|
| 88 |
+
|
| 89 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|