Table of Contents

1. Introduction
2. Measuring GPU Occupancy with Nsight Systems
3. Using Multiple Streams for Concurrent Execution
4. Calculating Average Percentage of SMs in Use
5. Example Workload Analysis
6. Conclusion

Introduction

• Nsight Systems can analyze GPU performance but doesn't show SM occupancy directly.

Measuring GPU Occupancy with Nsight Systems

• Nsight Systems can determine if kernels are executing on the GPU.

Using Multiple Streams for Concurrent Execution

• Multiple streams allow concurrent execution of different kernels on the GPU.

Calculating Average Percentage of SMs in Use

• SQL queries on SQLite files from Nsight Systems reports can extract needed data.

Example Workload Analysis

• Average percentage of SMs in use throughout the workload is calculated.

Conclusion

• While SMs may not be used at certain periods, overall GPU utilization is good.