Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications
Publication
, Conference
Tang, SJ; Cook, CB; Foust, J; Chen, H; Shi, H; Harfouche, M; Toth, C; Kuo, A; Horstmeyer, RW
Published in: Progress in Biomedical Optics and Imaging Proceedings of SPIE
March 6, 2026
Quantitative 3D imaging can supplement qualitative stereoscopic depth cues in microsurgical settings. Real-time feedback of quantitative 3D information is also important for applications in robotic surgery. Extending previous work on FiLMScope, we introduce a multicamera array capable of capturing up to 32 angular perspectives, each at video rate with >4K resolution. A novel, high throughput firmware and software pipeline processes a multigigabyte-per-second datastream to display 3D heightmaps at >4Hz. We introduce new insights such as inter-frame bootstrapping and system hyperparameter optimization to quickly route and display overlaid 3D imagery, towards enabling real-time clinician interaction.
Duke Scholars
Published In
Progress in Biomedical Optics and Imaging Proceedings of SPIE
DOI
EISSN
2410-9045
ISSN
1605-7422
Publication Date
March 6, 2026
Volume
13838
Citation
APA
Chicago
ICMJE
MLA
NLM
Tang, S. J., Cook, C. B., Foust, J., Chen, H., Shi, H., Harfouche, M., … Horstmeyer, R. W. (2026). Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications. In Progress in Biomedical Optics and Imaging Proceedings of SPIE (Vol. 13838). https://doi.org/10.1117/12.3097764
Tang, S. J., C. B. Cook, J. Foust, H. Chen, H. Shi, M. Harfouche, C. Toth, A. Kuo, and R. W. Horstmeyer. “Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications.” In Progress in Biomedical Optics and Imaging Proceedings of SPIE, Vol. 13838, 2026. https://doi.org/10.1117/12.3097764.
Tang SJ, Cook CB, Foust J, Chen H, Shi H, Harfouche M, et al. Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications. In: Progress in Biomedical Optics and Imaging Proceedings of SPIE. 2026.
Tang, S. J., et al. “Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications.” Progress in Biomedical Optics and Imaging Proceedings of SPIE, vol. 13838, 2026. Scopus, doi:10.1117/12.3097764.
Tang SJ, Cook CB, Foust J, Chen H, Shi H, Harfouche M, Toth C, Kuo A, Horstmeyer RW. Real-time 3D reconstruction and display of synchronized Fourier lightfield video for novel microsurgical applications. Progress in Biomedical Optics and Imaging Proceedings of SPIE. 2026.
Published In
Progress in Biomedical Optics and Imaging Proceedings of SPIE
DOI
EISSN
2410-9045
ISSN
1605-7422
Publication Date
March 6, 2026
Volume
13838