Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
benchmarking
benchmark
p5
bedrock
evaluation-metrics
sagemaker
g6
p4d
g5
foundation-models
inferentia
generative-ai
llama2
trainium
llama3
g6e
-
Updated
Nov 17, 2024 - Jupyter Notebook