Objective

It this lab you will implement three versions of matrix multiplication. The first implementation will be a C version that runs on the CPU, the second will be basic dense matrix multiplication routine written in CUDA, and the third will be a tiled dense matrix multiplication routine using shared memory.

This lab will be submitted as one zipped file through eclass. Details for submission are at the end of the lab.

Instructions

Edit the code where the TODOs are specified and perform the following:

• Allocate device memory
• Copy host memory to device
• Initialize thread block and kernel grid dimensions
• Invoke CUDA kernel
• Copy results from device to host
• Deallocate device memory
• Implement the CPU matrix-matrix multiplication routine
• Implement the basic GPU matrix-matrix multiplication routine
• Implement the matrix-matrix multiplication routine using shared memory and tiling

Local Setup Instructions

Steps:

1. Download Lab4.zip.
2. Unzip the file.
3. Open the Visual Studios Solution in Visual Studios 2013.
4. Build the project. Note the project has two configurations.
   1. Debug
   2. Submission

But make sure you have the Submission configuration selected when you finally submit.

5. Run the program by pressing the following button:

Make sure the Debug configuration is selected and the project you wish to run is selected in the Solution Explorer. To select the project just make sure you click on it before you run. The title of the program is printed at the top of the output console if you are unsure.

Running the program in Visual Studios will run one of the tests located in Dataset/Test.

Testing

To test run all tests located in Dataset/Test, first build the project with the Submission configuration selected. Make sure you see the Submission folder and all three executables are in the folder: CPU_MatMul.exe, GPU_MatMul.exe, and OPT_MatlMul.exe. If you are missing one of the executables because of build errors the test script should still work.

To run the tests, click on Testing_Script.bat. This will take a couple of seconds to run and the terminal should close when finished. The output is saved in Marks.js, but to view the calculated grade open Grade.html in a browser. If you make changes and rerun the tests, then make sure you reload Grade.html. You can double check with the timestamp at the top of the page.

In the test script if GPU_MatMul.exe fails then OPT_MatMul.exe will fail since the goal is to see the speed up between the basic matrix multiplication and the tiled matrix multiplication. See the Mark Breakdown for more information.