Documentation

These are several programs that do single processing steps in the 3DLicorneA pipeline. Each program works independently, taking some input data and generating output data. Parameters are usually exchanged in JSON-based formats.

The programs are organized into categories, in the different subdirectories vsrs/, kinect/, etc. Each .py and each .cc file is one program. Only the C++ programs operate on the content of images. Some Python programs are scripts that call other programs on a set of inputs, to do batch operations. (For example, exporting an entire dataset to VSRS format).

Click links on left sidebar to see the documentation for the individual programs.

Tutorials

• Installation and usage - Build, install and execute the tools
• Kinect calibration - Calibrate Kinect intrinsics and reprojection
• Import from Kinect - Import dataset from Kinect
• Camera grid calibration - Calibration of camera poses on frontal plane using optical flow (report)
• Export to VSRS - Export dataset to VSRS
• Run VSRS experiments - Run VSRS and evaluate results

Tools categories

• Calibration - Calibration of camera intrinsics and extrinsics. Undistortion. Prefixed with cg_: Tools for camera grid extrinsic self-calibration method, for frontal cameras plane.
• Camera - Export and import of camera parameters. Transformations and visualization.
• Dataset - Manage dataset parameters, find missing and duplicate files, view dataset.
• Kinect - Connect to Kinect v2 camera. Intrinsic calibration using checkerboard patterns. Reprojection of depth maps.
• VSRS - Run VSRS once or automatically on a set of experiments. Evaluate PSNR results.
• Misc - Various other tools.

Data formats

• Dataset parameters - Indexing and file names of dataset
• Camera parameters - Array of intrinsic and extrinsic camera parameters
• Image correspondences - Corresponding feature points on many views
• Feature points - Set of points on a views
• Feature point slopes - Slope of the line that feature points form
• Straight depths - Planar depths of tracked features
• Reference views grid - Grid of reference view indices
• Relative camera positions - Positions of camera centers, relative to reference view
• Camera intrinsics - Camera matrix and distortion coefficients
• Object-image-correspondences - Corresponding points between 2D images and 3D objects
• Kinect reprojection parameters - Parameters to map Kinect depth pixels to color pixels
• VSRS experiments - List of view synthesis experiments
• View homographies - Homography matrices to apply to images

More

• Implementation details - Information about the C++ and Python implementations
• Epipolar lines report - How to compute epipolar lines from camera parameters
• Epipolar sketch - Interactive sketch showing epipolar lines
• FTV state of the art - Report about FTV state of the art (20 February 2016)
• Doxygen documentation - Doxygen documentation of C++ source code