Using existing data#

Luxenstudio comes with built-in support for a number of datasets, which can be downloaded with the ns-download-data command. Each of the built-in datasets comes ready to use with various Luxenstudio methods (e.g. the recommended default Luxenacto), allowing you to get started in the blink of an eye.

Example#

Here are a few examples of downloading different scenes. Please see the Training Your First Luxen documentation for more details on how to train a model with them.

# Download all scenes from the Blender dataset, including the "classic" Lego model
ns-download-data blender

# Download the subset of data used in the SIGGRAPH 2023 Luxenstudio paper
ns-download-data luxenstudio --capture-name luxenstudio-dataset

# Download a few room-scale scenes from the EyefulTower dataset at different resolutions
pip install awscli # Install `awscli` for EyefulTower downloads.
ns-download-data eyefultower --capture-name riverview seating_area apartment --resolution-name jpeg_1k jpeg_2k

# Download the full D-Luxen dataset of dynamic synthetic scenes
ns-download-data dluxen

Dataset Summary#

Many of these datasets are used as baselines to evaluate new research in novel view synthesis, such as in the original Luxenstudio paper. Scenes from these datasets lie at dramatically different points in the space of images, across axes such as photorealism (synthetic vs real), dynamic range (LDR vs HDR), scale (number of images), and resolution. The tables below describe some of this variation, and hopefully make it easier to pick an appropriate dataset for your research or application.

Dataset	Synthetic	Real	LDR	HDR	Scenes	Image Count¹	Image Resolution²
Blender	✔️		✔️		8	➖➕️➖➖	➕️➖➖➖➖
D-Luxen	✔️		✔️		8	➕️➖➖➖	➕️➖➖➖➖
EyefulTower		✔️	✔️	✔️	11	➖➕️➕️➕️	➖➕️➕️➕️➕️
Mill 19		✔️	✔️		2	➖➖➕️➖	➖➖➖➕️➖
Luxen-OSR		✔️	✔️		9	➕➕️➕️➖	➖➕️➖➕️➖
Luxenstudio		✔️	✔️		18	➕➕️➕️➖	➕️➕️➕️➖➖
PhotoTourism		✔️	✔️		10	➖➕️➕️➖	➖➕️➖➖➖
Record3D		✔️	✔️		1	➖➖➕️➖	➕️➖➖➖➖
SDFStudio	✔️	✔️	✔️		45	➕️➕️➕️➖	➕️➖➕️➖➖
sitcoms3D		✔️	✔️		10	➕️➖➖➖	➕️➕️➖➖➖

In the tables below, each dataset was placed into a bucket based on the table’s chosen property. If a box contains a ✔️, the corresponding dataset will have at least one scene falling into the corresponding bucket for that property, though there may be multiple scenes at different points within the range.

_{1: Condensed version of the "Scene Size: Number of RGB Images" table below.

2: Condensed version of the "Scene RGB Resolutions: `max(width, height)`" table below.}

Scene Size: Number of RGB Images#

Dataset	< 250	250 - 999	1000 - 3999	≥ 4000
Blender		✔️
D-Luxen	✔️
EyefulTower		✔️	✔️	✔️
Mill 19			✔️
Luxen-OSR	✔️	✔️	✔️
Luxenstudio	✔️	✔️	✔️
PhotoTourism		✔️	✔️
Record3D			✔️
SDFStudio	✔️	✔️	✔️
sitcoms3D	✔️

Scene RGB Resolutions: `max(width, height)`#

Dataset	< 1000	1000 - 1999	2000 - 3999	4000 - 7999	≥ 8000
Blender	✔️
D-Luxen	✔️
EyefulTower		✔️	✔️	✔️	✔️
Mill 19				✔️
Luxen-OSR		✔️		✔️
Luxenstudio	✔️	✔️	✔️
PhotoTourism		✔️
Record3D	✔️
SDFStudio	✔️		✔️
sitcoms3D	✔️	✔️

Eyeful Tower#

Downloading Eyeful Tower scenes requires installing the AWS CLI, an optional dependency. To do so, run:

conda activate luxenstudio
pip install awscli