From e8d2ad5b59d580144348e5567f2c8413e23f5f27 Mon Sep 17 00:00:00 2001 From: cvachha Date: Tue, 2 Jan 2024 00:35:03 -0800 Subject: [PATCH] page edits --- dreamcrafter_progress.md | 12 ++++++++---- nerfstudio_contributions.md | 3 ++- research.md | 4 ++-- 3 files changed, 12 insertions(+), 7 deletions(-) diff --git a/dreamcrafter_progress.md b/dreamcrafter_progress.md index 04504ce..d30c1cf 100644 --- a/dreamcrafter_progress.md +++ b/dreamcrafter_progress.md @@ -10,7 +10,7 @@ show_tile: false ## Overview -For my masters thesis, I am trying to create a system based on the proposal I made in 2022 [here](nerfenvironmentcreation.html). In my first semester (Fall 2023) of my 5th year masters program (1 yr program), two prototype systems were implemented which leverage NeRFs, 3DGS, and Stable Diffusion to create a VR interface for 3D photo-realistic content creation as part of a group I led for our final project in our VR/AR course. We call our system Dreamcrafter, a Virtual Reality 3D content generation and editing system Assisted by generative AI. Our system attempts to address the gap in HCI-VR research in generative AI tools by proposing a system that enhances the process of 3D environment creation and editing. +For my masters thesis, I am trying to create a system based on the proposal I made in 2022 [here](nerfenvironmentcreation.html). In my first semester (Fall 2023) of my 5th year masters program (1 yr program), two prototype systems were implemented which leverage NeRFs, 3DGS, and Stable Diffusion to create a VR interface for 3D photo-realistic content creation as part of a group I led for our final project in our VR/AR course. We call our system Dreamcrafter, a Virtual Reality 3D content generation and editing system assisted by generative AI. Our system attempts to address the gap in HCI-VR research in generative AI tools by proposing a system that enhances the process of 3D environment creation and editing. Integration of NeRF/3DGS and diffusion models into user-friendly platforms for 3D environment creation is still in its infancy. Editing of radiance fields and generative 3D objects is currently limited to text prompts or limited 2D interfaces. Current research in NeRFs and diffusion models is primarily on enhancing image/reconstruction quality, and we aim to address the noticeable lack of exploration in the application of user interfaces designed for editing and controllability of these models and novel 3D representations. @@ -21,18 +21,22 @@ Our current system is a proof-of-concept prototype which we developed within a m ## Prototype Demos Here are some demo videos of our prototype systems that demonstrate a basic version of some of the key features/interactions. -