Improve model card: Add pipeline tag, update license, and enrich content
#1
by
nielsr
HF Staff
- opened
README.md
CHANGED
@@ -1,5 +1,53 @@
|
|
1 |
---
|
2 |
-
license:
|
|
|
3 |
---
|
4 |
-
|
5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
pipeline_tag: image-to-3d
|
4 |
---
|
5 |
+
|
6 |
+
# Gaussian Splatting with Discretized SDF for Relightable Assets
|
7 |
+
|
8 |
+
This repository contains the official checkpoints for **DiscretizedSDF**, a novel method presented in the paper [Gaussian Splatting with Discretized SDF for Relightable Assets](https://huggingface.co/papers/2507.15629). This work will be presented at ICCV 2025.
|
9 |
+
|
10 |
+
DiscretizedSDF significantly advances 3D Gaussian splatting (3DGS) for inverse rendering, enabling the creation of high-quality relightable 3D assets. It addresses common challenges in applying geometry constraints to discrete Gaussian primitives and the high memory costs associated with continuous Signed Distance Fields (SDFs).
|
11 |
+
|
12 |
+
Key innovations include:
|
13 |
+
- **Discretized SDF**: A novel approach to represent continuous SDFs discretely, encoding sampled values within each Gaussian. This allows for efficient SDF rendering via splatting, bypassing costly ray tracing.
|
14 |
+
- **Projection-based Consistency Loss**: A unique regularization technique that projects Gaussians onto the SDF's zero-level set, ensuring geometric alignment with the splatted surface.
|
15 |
+
|
16 |
+
Thanks to these innovations, DiscretizedSDF achieves superior relighting quality without additional memory overhead compared to standard 3DGS, and it simplifies the training process by avoiding complex manual optimizations.
|
17 |
+
|
18 |
+
<p align="middle">
|
19 |
+
<img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/horse_golf.gif" width="30%"/><img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/angel_corridor.gif" width="30%"/><img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/potion_golf.gif" width="30%"/>
|
20 |
+
</p>
|
21 |
+
|
22 |
+
## Links
|
23 |
+
- π **Paper**: [Gaussian Splatting with Discretized SDF for Relightable Assets](https://huggingface.co/papers/2507.15629)
|
24 |
+
- π **Project Page**: [https://nk-cs-zzl.github.io/projects/dsdf/index.html](https://nk-cs-zzl.github.io/projects/dsdf/index.html)
|
25 |
+
- π» **GitHub Repository**: [https://github.com/NK-CS-ZZL/DiscretizedSDF](https://github.com/NK-CS-ZZL/DiscretizedSDF)
|
26 |
+
|
27 |
+
## Usage
|
28 |
+
For detailed installation instructions, environment setup, and information on training and evaluation, please refer to the [official GitHub repository](https://github.com/NK-CS-ZZL/DiscretizedSDF).
|
29 |
+
|
30 |
+
To run a quick relighting video demo with the provided checkpoints:
|
31 |
+
|
32 |
+
1. Clone the repository:
|
33 |
+
```bash
|
34 |
+
git clone https://github.com/NK-CS-ZZL/DiscretizedSDF.git
|
35 |
+
cd DiscretizedSDF
|
36 |
+
```
|
37 |
+
2. Follow the installation steps on the [GitHub repository's "Dependencies and Installation" section](https://github.com/NK-CS-ZZL/DiscretizedSDF#dependencies-and-installation) to set up the environment and dependencies.
|
38 |
+
3. Download pretrained models (e.g., from [HuggingFace](https://huggingface.co/lalala125/DiscreteSDF) as mentioned in the GitHub README) and place them in the `pretrained` folder.
|
39 |
+
4. Run the demo script:
|
40 |
+
```bash
|
41 |
+
sh demo.sh
|
42 |
+
```
|
43 |
+
|
44 |
+
## Citation
|
45 |
+
If you find our work useful for your research, please consider citing our paper:
|
46 |
+
```bibtex
|
47 |
+
@inproceedings{zhu_2025_dsdf,
|
48 |
+
title={Gaussian Splatting with Discretized SDF for Relightable Assets},
|
49 |
+
author={Zhu, Zuo-Liang and Yang, Jian and Wang, Beibei},
|
50 |
+
booktitle={Proceedings of IEEE International Conference on Computer Vision (ICCV)},
|
51 |
+
year={2025}
|
52 |
+
}
|
53 |
+
```
|