baseten/dolphin_i4096_o1024_bs24_tp1_int8_weights_only-tllm_0.9.0.dev2024022000
Updated
AI & ML interests
None defined yet.
Recent Activity
View all activity
baseten/mixtral_i4096_o1024_bs64_tp2_int8_weights_only-tllm_0.9.0.dev2024022000
Updated
•
2
baseten/mixtral_i4096_o1024_bs24_tp1_int8_weights_only-tllm_0.9.0.dev2024022000
Updated
baseten/mixtral-tp2-032124
Updated
baseten/mixtral-tp8-032124
Updated
baseten/playground-v2.5-trt-8.6.1-variable-sizing-a100
Updated
baseten/playground-v2.5-trt-8.6.1-variable-sizing-h100-mig
Updated
baseten/playground-v2.5-trt-8.6.1-variable-sizing-h100
Updated
baseten/deepseek-tp1-rope
Updated
baseten/trtllm_llama70b_fp8_i1024_o1024_bs16_tp1
Updated
baseten/trtllm_llama70b_fp8_i1024_o1024_bs128_tp2
Updated
baseten/playground-v2.5-trt-8.6.1-1024x1024-a10g
Updated
baseten/playground-v2.5-trt-8.6.1-1024x1024-50-steps-h100
Updated
baseten/mistral_fp8_tp8_i2048_o2048_bs128-tllm_0.9.0.dev2024022000
Updated
baseten/trtllm_mistral_fp8_l4_i1024_o1024_bs64_0.9.0.dev2024022000
Updated
baseten/trtllm_mistral_fp8_l4_i2048_o2048_bs64_0.9.0.dev2024022000
Updated
baseten/trtllm-whisper-a10g-large-v2-1
Updated
baseten/trtllm-whisper-a10g-1
Updated
baseten/mistral_fp16_tp2_i4096_o4096_bs128-tllm_0.9.0.dev2024022000
Updated
baseten/mixtral_fp16_tp2_i2048_o2048_bs128-tllm_0.9.0.dev2024022000
Updated
baseten/mixtral_fp16_tp2_i2048_o2048_bs64-tllm_0.9.0.dev2024022000
Updated
baseten/trtllm_llama2-7b-fp8_h100_i2048_o2048_bs128
Updated
baseten/trtllm_llama2-7b-fp16_h100_i2048_o2048_bs128
Updated
baseten/trtllm_mistral_i2048_o2048_bs128
Updated
baseten/Gryphe_MythoMax-L2-13b_v0.7.1_H100-80GB-HBM3_fp8
Updated
baseten/trtllm_mistral_fp8_i2048_o2048_bs128
Updated
baseten/trtllm_mistral_fp8_i2048_o2048_bs32
Updated
baseten/trtllm_mistral_fp8_i1024_o1024_bs128
Updated
baseten/mistral_fp8_trtllm_i4096_o4096_bs8
Updated
baseten/specdec-draft-gpt2
Updated
•
3