๐Ÿ“„

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

3.2. Diffusion-based Editing Guidance

1.
SDS loss
previous works
a.
ํ˜„์žฌ 3D ๋ชจ๋ธ์˜ ๋…ธ์ด์ง€ํ•œ ๋ Œ๋”๋ง + cond. โ†’ 2D diffusion ๋ชจ๋ธ โ†’ score
2.
Prompt๋กœ 2D ์ด๋ฏธ์ง€ ์ˆ˜์ •
previous works
a.
2D ์ด๋ฏธ์ง€ ๋ฐ์ดํ„ฐ์…‹ ํ•„์š”
i.
๋Œ€์ƒ ํ•˜๋‚˜์— ๋Œ€ํ•ด ๋ฐ”๋ผ๋ณด๋ฉด์„œ ๊ตฌํ˜• ๊ถค๋„๋กœ ๊ด€์ฐฐ์ž๊ฐ€ ์ฃผ์œ„๋ฅผ ๋Œ๋ฉฐ
b.
๋ชจ์€ ๋ฐ์ดํ„ฐ์…‹์„ ํ•™์Šต ํƒ€๊ฒŸ์œผ๋กœ 3D ๋ชจ๋ธ ์ˆ˜์ •
๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ๋”ฑํžˆ ์ƒˆ๋กœ์šด ๋ฐฉ๋ฒ•๋ก ์„ ์ œ์‹œํ•˜์ง€ ์•Š์Œ. ์œ„ 2๊ฐ€์ง€ ๋ฐฉ๋ฒ• ๋ชจ๋‘ ์ ์šฉ ๊ฐ€๋Šฅํ•œ ์ ์„ ์˜คํžˆ๋ ค ์žฅ์ ์œผ๋กœ ๋‚ด์„ธ์›€.
2D ๋””ํ“จ์ „ ๋ชจ๋ธ prior์—์„œ ๋ฝ‘๋Š”
editing loss = ๊ฐ€์ด๋˜์Šค โˆ‹\ni ๋ชจ๋ธ ํŒŒ๋ผ๋ฏธํ„ฐ; ๋ Œ๋” ์นด๋ฉ”๋ผ ํฌ์ฆˆ, ํ”„๋กฌํ”„ํŠธ

4.1. Gaussian Semantic Tracing

4.2. Hierarchical Gaussian Splatting

4.3. 3D Inpainting