The benchmarking code used by Lambda Labs has been open-sourced, allowing anyone to reproduce the benchmarks or run their own. The results are published on this official page for the Lambda Community Benchmarks, and contributors can email their results to `
[email protected]` or tweet @LambdaAPI. The code includes a template to paste in and run, which outputs a table with specifications such as CPU, GPU, Tensorflow version, NVIDIA driver, CUDA, cuDNN, and Python versions. There are also tables showing the benchmark results for different models (resnet-50, resnet-152, inception-v3, vgg-vd-19, alexnet, and ssd-300) with input sizes, parameter memory, feature memory, and FLOPS values. The benchmarking is performed on various configurations of GPU, including NVIDIA GeForce GTX 1080 Ti and RTX 2080 Ti, and the results are compared across different models and configurations.