KylianSu/vessel-bezier-retinal-weights

ST — Weights & Training Logs

Companion HuggingFace repo for the private GitHub source repo KylianSu/vessel-bezier-retinal.

This repo holds all weights, training logs, and reviewer-facing artifacts for the NeurIPS 2026 submission on Bezier-conditioned ControlNet + parameter-level counterfactual verification of vessel geometry → diabetic retinopathy (DR).

Layout

weights/
  sd21_lora_fundus_v2/                      <-  Paper-final LoRA (noise_offset=0.1, rank=64)
    pytorch_lora_weights.safetensors        51 MB
  sd21_lora_fundus_v1/                      <-  Earlier LoRA, kept for comparison
    pytorch_lora_weights.safetensors        51 MB

  controlnet_g3_bezier_v3/                  <-  Paper-final G3 (Bezier-hint) ControlNet
    best_controlnet.pth                     78 MB
    train.log + hint_preview_epoch*.png
  controlnet_g2_encoder_v2/                 <-  Paper-final G2 (z_spatial-hint) ControlNet
    best_controlnet.pth                     78 MB
    train.log
  controlnet_g3_bezier_v1_legacy/           <-  Earlier G3 versions (logs + previews only;
  controlnet_g3_bezier_v2_legacy/               weights already pruned during 2026-04-23 cleanup)

  clip_finetune/                            <-  BiomedCLIP two-stage finetune (Stage 2 final)
    20260326_041223/best_model.pth          748 MB
    train.log + history.json + config.json
  vessel_encoder_v2/                        <-  VesselEncoderV2 (z_tok / z_spatial producer)
    20260407_201552/best_encoder_v2.pth     382 MB
    train.log + history.json + config.json

  cls_binary_leakfree/                      <-  Downstream DR classifiers (leak-free baselines)
    baseline/best_model.pth                 30 MB    (EfficientNet-B2 @ 384)
    baseline_resnet50/best_model.pth        90 MB    (ResNet-50 @ 384)
    baseline_vitb16/best_model.pth          329 MB   (ViT-B/16 @ 384, low DR sensitivity)
    augmented_g{2,3}_{400,4k}[_10pct]/      Prompt-bug-era synth augmentation (retained for comparison)
  cls_binary_leakfree_pfix/                 <-  Prompt-fixed augmentation (paper §5.3 main table)
    aug_g{2,3}_{400,4k}[_10pct]_pfix/       8 variants, 30 MB each

experiment_E/                               <-  Track 4 DR-prompt main experiment
  hints/ + gen/                             hints + generated images for every start x config
  stage{1,2,3}*.csv + stems.json + causal_curves*.png
experiment_E_uncond/                        <-  Track 4 Uncond (paper's strongest Delta = +0.781 cohort)
  hints/ + gen/ + CSV + top-5 champion visualization

How to download

# Whole repo (~2.8 GB)
hf download KylianSu/vessel-bezier-retinal-weights --repo-type model --local-dir ./hf_weights

# Or a single subtree
hf download KylianSu/vessel-bezier-retinal-weights --include "weights/sd21_lora_fundus_v2/*" --local-dir ./hf_weights

How the code expects the files

After download, copy (or symlink) the relevant folders back under the code repo's train_logs/, cls_binary_leakfree/, cls_binary_leakfree_pfix/, experiment_E/, experiment_E_uncond/:

rsync -a hf_weights/weights/sd21_lora_fundus_v2/  $ST_BASE/train_logs/sd21_lora_fundus_v2/
rsync -a hf_weights/weights/controlnet_g3_bezier_v3/  $ST_BASE/train_logs/diffusion_sd21/20260415_140655_group3_bezier_v3/
# ... etc, matching paths referenced in scripts/*.sh

See the source repo's HANDOFF_MANIFEST.md §3 for the full reproducibility recipe.

Other artifacts you still need (not in this repo)

• Stable Diffusion 2.1 base (24 GB): https://huggingface.co/stabilityai/stable-diffusion-2-1-base
• BiomedCLIP pretrained (753 MB): https://huggingface.co/microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224
• EyePACS + APTOS + Messidor dataset (38 GB): Kaggle — see HANDOFF §2 for the bundle the authors used.

License

TBD — please contact the project owner (see GitHub repo) before any external redistribution.