bf16

Here is 1 public repository matching this topic...

Qwen2.5 inference runtime for Jetson Orin with BF16 Tensor Core and W8A16 CUDA kernel optimization.

cuda tensor-cores kv-cache int8-quantization bf16 jetson-orin llm-inference qwen2

Add a description, image, and links to the bf16 topic page so that developers can more easily learn about it.

To associate your repository with the bf16 topic, visit your repo's landing page and select "manage topics."