research-article

RTX-RSim: Accelerated Vulkan Room Response Simulation for Time-of-Flight Imaging

Authors:

Markus Wippler,

Robert Hranitzky,

Thomas FahringerAuthors Info & Claims

IWOCL '20: Proceedings of the International Workshop on OpenCL

Article No.: 17, Pages 1 - 11

https://doi.org/10.1145/3388333.3388662

Published: 27 April 2020 Publication History

Abstract

Time-of-Flight camera systems are an essential component in 3D scene analysis and reconstruction for many modern computer vision applications. The development and validation of such systems requires testing in a large variety of scenes and situations. Accurate room impulse response simulation greatly speeds up development and validation, as well as reducing its cost, but large computational overhead has so far limited its applicability.

While the overall algorithmic requirements of this simulation differ significantly from 3D rendering, the recently introduced hardware raytracing support in GPUs nonetheless provides an interesting new implementation option. In this paper, we present a new room impulse simulation method, implemented with Vulkan compute shaders and leveraging NVIDIA VKRay hardware raytracing. We also extend this method to asynchronous streaming in order to overcome the limitations of on-board GPU memory when simulating very large scenes.

Our implementation is, to the best of our knowledge, the first ever application of Vulkan hardware raytracing in a non-rendering simulation setting. Compared to a state-of-the-art multicore CPU implementation running on 12 CPU cores, we achieve an overall speedup of factor 20.9 when streaming is not required, and 17.6 with streaming, on a single consumer GPU.

References

[1]

P Bialas, P Sagało, and K Nowakowski. 2020. Simulating the J-PET Detector on NVidia Ray Tracing Hardware. Acta Physica Polonica B 51, 1 (2020).

[2]

Maria Rafaela Gkeka, Nikolaos Bellas, and Christos D Antonopoulos. 2019. Comparative Performance Analysis of Vulkan Implementations of Computational Applications. In Proceedings of the International Workshop on OpenCL. 1--1.

Digital Library

[3]

Andrew S Glassner. 1984. Space subdivision for fast ray tracing. IEEE Computer Graphics and applications 4, 10 (1984), 15--24.

[4]

Andrew S Glassner. 1989. An introduction to ray tracing. Elsevier.

[5]

Samuel I Gunadi and Pujianto Yugopuspito. 2018. Real-Time GPU-based SPH Fluid Simulation Using Vulkan and OpenGL Compute Shaders. In 2018 4th International Conference on Science and Technology (ICST). IEEE, 1--6.

[6]

Emanuel AP Habets. 2006. Room impulse response generator. Technische Universiteit Eindhoven, Tech. Rep 2, 2.4 (2006), 1.

[7]

Michal Hapala and Vlastimil Havran. 2011. Kd-tree traversal algorithms for ray tracing. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 199--213.

[8]

Alexander Hirsch and Peter Thoman. 2020. Running on Raygun. arXiv:cs.GR/2001.09792

[9]

Robert Hranitzky. 1997. A Scalable multi-DSP System for Room Impulse Resonse Simulation. Ph.D. Dissertation. Technical University of Graz.

[10]

Tero Karras and Timo Aila. 2013. Fast parallel construction of high-quality bounding volume hierarchies. In Proceedings of the 5th High-Performance Graphics Conference. ACM, 89--99.

Digital Library

[11]

John Kessenich, Boaz Ouriel, and R Krisch. 2018. SPIR-V Specification. Khronos Group 3 (2018).

[12]

Andreas Kolb, Erhardt Barth, Reinhard Koch, and Rasmus Larsen. 2010. Time-of-flight cameras in computer graphics. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 141--159.

[13]

Justin Lewis Salmon and Simon McIntosh Smith. 2019. Exploiting Hardware-Accelerated Ray Tracing for Monte Carlo Particle Transport with OpenMC. In 2019 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS).

[14]

Francisco J Lopez-Hernandez, Rafael Perez-Jimenez, and Asuncion Santamaria. 2000. Ray-tracing algorithms for fast calculation of the channel impulse response on diffuse IR wireless indoor channels. Optical engineering 39, 10 (2000), 2775--2781.

[15]

Cristobal A Navarro, Nancy Hitschfeld-Kahler, and Luis Mateu. 2014. A survey on parallel computing and its applications in data-parallel problems using GPU architectures. Communications in Computational Physics 15, 2 (2014), 285--329.

[16]

NVIDIA 2018. NVIDIA Turing GPU Architecture Whitepaper. NVIDIA. https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdf.

[17]

Steven G Parker, James Bigler, Andreas Dietrich, Heiko Friedrich, Jared Hoberock, David Luebke, David McAllister, Morgan McGuire, Keith Morley, Austin Robison, et al. 2010. OptiX: a general purpose ray tracing engine. Acm transactions on graphics (tog) 29, 4 (2010), 1--13.

[18]

Timothy J Purcell, Ian Buck, William R Mark, and Pat Hanrahan. 2005. Ray tracing on programmable graphics hardware. In ACM SIGGRAPH 2005 Courses. ACM, 268.

Digital Library

[19]

Silvestre Rodríguez Pérez, Rafael Pérez Jiménez, Francisco J López Hernández, Oswaldo B González Hernández, and Alejandro J Ayala Alfonso. 2002. Reflection model for calculation of the impulse response on IR-wireless indoor channels using ray-tracing algorithm. Microwave and optical technology letters 32, 4 (2002), 296--300.

[20]

VV Sanzharov, AI Gorbonosov, VA Frolov, and AG Voloboy. 2019. Examination of the Nvidia RTX. Technical Report.

[21]

Graham Sellers and John Kessenich. 2016. Vulkan programming guide: The official guide to learning vulkan. Addison-Wesley Professional.

[22]

Mattias Ulmstedt and Joacim Stålberg. 2019. GPU Accelerated Ray-tracing for Simulating Sound Propagation in Water. Master's thesis. Linköping University.

[23]

Michael Vorländer. 1989. Simulation of the transient and steady-state sound propagation in rooms using a new combined ray-tracing/image-source algorithm. The Journal of the Acoustical Society of America 86, 1 (1989), 172--178.

[24]

Ingo Wald, Will Usher, Nate Morrical, Laura Lediaev, and Valerio Pascucci. 2019. RTX Beyond Ray Tracing: Exploring the Use of Hardware Ray Tracing Cores for Tet-Mesh Point Location. Proceedings of High Performance Graphics (2019).

[25]

Eric Werness, Ashwin Lele, Robert Stepinski, et al. 2018. VK_NV_ray_tracing. NVIDIA. Vulkan 1.2 Specification, https://www.khronos.org/registry/vulkan/specs/1.2-extensions/html/vkspec.html#VK_NV_ray_tracing.

Cited By

Henneberg JSchuhknecht F(2023)RTIndeX: Exploiting Hardware-Accelerated GPU Raytracing for Database IndexingProceedings of the VLDB Endowment10.14778/3625054.362506316:13(4268-4281)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.14778/3625054.3625063
Yan ZWang HLiu XNing QLu Y(2022)Physics-Based TOF Imaging Simulation for Space Targets Based on Improved Path TracingRemote Sensing10.3390/rs1412286814:12(2868)Online publication date: 15-Jun-2022
https://doi.org/10.3390/rs14122868
Thoman PGogl DFahringer T(2021)Sylkan: Towards a Vulkan Compute Target Platform for SYCLProceedings of the 9th International Workshop on OpenCL10.1145/3456669.3456683(1-12)Online publication date: 27-Apr-2021
https://dl.acm.org/doi/10.1145/3456669.3456683

Index Terms

RTX-RSim: Accelerated Vulkan Room Response Simulation for Time-of-Flight Imaging
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Graphics processors
  2. Parallel computing methodologies
    1. Parallel algorithms
      1. Massively parallel algorithms
    2. Parallel programming languages
2. General and reference
  1. Cross-computing tools and techniques
    1. Performance

Recommendations

Sylkan: Towards a Vulkan Compute Target Platform for SYCL
IWOCL '21: Proceedings of the 9th International Workshop on OpenCL

SYCL is a modern high-level C++ programming interface which excels at expressing data parallelism for heterogeneous hardware platforms in a programmer-friendly way, and is standardized by the Khronos Group. The latest version of the standard, SYCL 2020, ...
A multi-GPU algorithm for large-scale neuronal networks

Large-scale simulations of parts of the brain using detailed neuronal models to improve our understanding of brain functions are becoming a reality with the usage of supercomputers and large clusters. However, the high acquisition and maintenance cost ...
Brook for GPUs: stream computing on graphics hardware
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

In this paper, we present Brook for GPUs, a system for general-purpose computation on programmable graphics hardware. Brook extends C to include simple data-parallel constructs, enabling the use of the GPU as a streaming co-processor. We present a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IWOCL '20: Proceedings of the International Workshop on OpenCL

April 2020

104 pages

ISBN:9781450375313

DOI:10.1145/3388333

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Khronos: Khronos Group
Codeplay: Codeplay Software Ltd.
Intel: Intel
The University of Bristol: The University of Bristol
Tech Univ of Munich: Technical University of Munich

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Austrian Science Fund

Conference

IWOCL '20

IWOCL '20: International Workshop on OpenCL

April 27 - 29, 2020

Munich, Germany

Acceptance Rates

IWOCL '20 Paper Acceptance Rate 21 of 30 submissions, 70%;

Overall Acceptance Rate 84 of 152 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
211
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Henneberg JSchuhknecht F(2023)RTIndeX: Exploiting Hardware-Accelerated GPU Raytracing for Database IndexingProceedings of the VLDB Endowment10.14778/3625054.362506316:13(4268-4281)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.14778/3625054.3625063
Yan ZWang HLiu XNing QLu Y(2022)Physics-Based TOF Imaging Simulation for Space Targets Based on Improved Path TracingRemote Sensing10.3390/rs1412286814:12(2868)Online publication date: 15-Jun-2022
https://doi.org/10.3390/rs14122868
Thoman PGogl DFahringer T(2021)Sylkan: Towards a Vulkan Compute Target Platform for SYCLProceedings of the 9th International Workshop on OpenCL10.1145/3456669.3456683(1-12)Online publication date: 27-Apr-2021
https://dl.acm.org/doi/10.1145/3456669.3456683
Thoman PWippler MHranitzky RGschwandtner PFahringer T(2021)Multi‐GPU room response simulation with hardware raytracingConcurrency and Computation: Practice and Experience10.1002/cpe.666334:4Online publication date: 12-Oct-2021
https://doi.org/10.1002/cpe.6663

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents