🚀 星宇智通 Compute Matrix 🔍 算力矩阵
🔍 Search 101,000 Tools... /
Tools Matrix
Home / Compute Matrix Directory

High-Performance Compute Tools Directory

🌟 All Disciplines 🧠 AI Models & VRAM Compute ⚡ Hardware Bottlenecks & Thermals 🏢 Data Center PUE & Cooling ☁️ Cloud GPU Lease vs On-Prem ROI 🛰️ Edge AI, Avionics & Robotics
💻 BGE-M3 Multilingual Embedding 567M (FP16 Uncompressed Native) on NVIDIA H100 80GB SXM5 VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in FP16 Uncompressed Native deployed on NVIDIA H100 80GB SXM5.
💻 BGE-M3 Multilingual Embedding 567M (BF16 Bfloat16 Mixed Precision) on NVIDIA H200 141GB HBM3e VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in BF16 Bfloat16 Mixed Precision deployed on NVIDIA H200 141GB HBM3e.
💻 BGE-M3 Multilingual Embedding 567M (FP8 Scaled Native Hopper) on NVIDIA B200 192GB Blackwell VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in FP8 Scaled Native Hopper deployed on NVIDIA B200 192GB Blackwell.
💻 BGE-M3 Multilingual Embedding 567M (INT8 SmoothQuant Precision) on NVIDIA A100 80GB PCIe VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in INT8 SmoothQuant Precision deployed on NVIDIA A100 80GB PCIe.
💻 BGE-M3 Multilingual Embedding 567M (AWQ 4-Bit Activation-Aware) on NVIDIA RTX 4090 24GB GDDR6X VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in AWQ 4-Bit Activation-Aware deployed on NVIDIA RTX 4090 24GB GDDR6X.
💻 BGE-M3 Multilingual Embedding 567M (GPTQ 4-Bit Second-Order) on NVIDIA L40S 48GB Ada Lovelace VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in GPTQ 4-Bit Second-Order deployed on NVIDIA L40S 48GB Ada Lovelace.
💻 BGE-M3 Multilingual Embedding 567M (GGUF Q4_K_M Medium Quant) on AMD Instinct MI300X 192GB VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for BGE-M3 Multilingual Embedding 567M quantized in GGUF Q4_K_M Medium Quant deployed on AMD Instinct MI300X 192GB.
💻 LLaVA-NeXT 72B Multimodal Vision (FP16 Uncompressed Native) on NVIDIA H100 80GB SXM5 VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in FP16 Uncompressed Native deployed on NVIDIA H100 80GB SXM5.
💻 LLaVA-NeXT 72B Multimodal Vision (BF16 Bfloat16 Mixed Precision) on NVIDIA H200 141GB HBM3e VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in BF16 Bfloat16 Mixed Precision deployed on NVIDIA H200 141GB HBM3e.
💻 LLaVA-NeXT 72B Multimodal Vision (FP8 Scaled Native Hopper) on NVIDIA B200 192GB Blackwell VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in FP8 Scaled Native Hopper deployed on NVIDIA B200 192GB Blackwell.
💻 LLaVA-NeXT 72B Multimodal Vision (INT8 SmoothQuant Precision) on NVIDIA A100 80GB PCIe VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in INT8 SmoothQuant Precision deployed on NVIDIA A100 80GB PCIe.
💻 LLaVA-NeXT 72B Multimodal Vision (AWQ 4-Bit Activation-Aware) on NVIDIA RTX 4090 24GB GDDR6X VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in AWQ 4-Bit Activation-Aware deployed on NVIDIA RTX 4090 24GB GDDR6X.
💻 LLaVA-NeXT 72B Multimodal Vision (GPTQ 4-Bit Second-Order) on NVIDIA L40S 48GB Ada Lovelace VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in GPTQ 4-Bit Second-Order deployed on NVIDIA L40S 48GB Ada Lovelace.
💻 LLaVA-NeXT 72B Multimodal Vision (GGUF Q4_K_M Medium Quant) on AMD Instinct MI300X 192GB VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for LLaVA-NeXT 72B Multimodal Vision quantized in GGUF Q4_K_M Medium Quant deployed on AMD Instinct MI300X 192GB.
💻 MiniCPM-V 2.6 8B Omni-Vision (FP16 Uncompressed Native) on NVIDIA H100 80GB SXM5 VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in FP16 Uncompressed Native deployed on NVIDIA H100 80GB SXM5.
💻 MiniCPM-V 2.6 8B Omni-Vision (BF16 Bfloat16 Mixed Precision) on NVIDIA H200 141GB HBM3e VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in BF16 Bfloat16 Mixed Precision deployed on NVIDIA H200 141GB HBM3e.
💻 MiniCPM-V 2.6 8B Omni-Vision (FP8 Scaled Native Hopper) on NVIDIA B200 192GB Blackwell VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in FP8 Scaled Native Hopper deployed on NVIDIA B200 192GB Blackwell.
💻 MiniCPM-V 2.6 8B Omni-Vision (INT8 SmoothQuant Precision) on NVIDIA A100 80GB PCIe VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in INT8 SmoothQuant Precision deployed on NVIDIA A100 80GB PCIe.
💻 MiniCPM-V 2.6 8B Omni-Vision (AWQ 4-Bit Activation-Aware) on NVIDIA RTX 4090 24GB GDDR6X VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in AWQ 4-Bit Activation-Aware deployed on NVIDIA RTX 4090 24GB GDDR6X.
💻 MiniCPM-V 2.6 8B Omni-Vision (GPTQ 4-Bit Second-Order) on NVIDIA L40S 48GB Ada Lovelace VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in GPTQ 4-Bit Second-Order deployed on NVIDIA L40S 48GB Ada Lovelace.
💻 MiniCPM-V 2.6 8B Omni-Vision (GGUF Q4_K_M Medium Quant) on AMD Instinct MI300X 192GB VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for MiniCPM-V 2.6 8B Omni-Vision quantized in GGUF Q4_K_M Medium Quant deployed on AMD Instinct MI300X 192GB.
💻 InternLM2.5 20B 1M Context (FP16 Uncompressed Native) on NVIDIA H100 80GB SXM5 VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in FP16 Uncompressed Native deployed on NVIDIA H100 80GB SXM5.
💻 InternLM2.5 20B 1M Context (BF16 Bfloat16 Mixed Precision) on NVIDIA H200 141GB HBM3e VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in BF16 Bfloat16 Mixed Precision deployed on NVIDIA H200 141GB HBM3e.
💻 InternLM2.5 20B 1M Context (FP8 Scaled Native Hopper) on NVIDIA B200 192GB Blackwell VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in FP8 Scaled Native Hopper deployed on NVIDIA B200 192GB Blackwell.
💻 InternLM2.5 20B 1M Context (INT8 SmoothQuant Precision) on NVIDIA A100 80GB PCIe VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in INT8 SmoothQuant Precision deployed on NVIDIA A100 80GB PCIe.
💻 InternLM2.5 20B 1M Context (AWQ 4-Bit Activation-Aware) on NVIDIA RTX 4090 24GB GDDR6X VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in AWQ 4-Bit Activation-Aware deployed on NVIDIA RTX 4090 24GB GDDR6X.
💻 InternLM2.5 20B 1M Context (GPTQ 4-Bit Second-Order) on NVIDIA L40S 48GB Ada Lovelace VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in GPTQ 4-Bit Second-Order deployed on NVIDIA L40S 48GB Ada Lovelace.
💻 InternLM2.5 20B 1M Context (GGUF Q4_K_M Medium Quant) on AMD Instinct MI300X 192GB VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for InternLM2.5 20B 1M Context quantized in GGUF Q4_K_M Medium Quant deployed on AMD Instinct MI300X 192GB.
💻 Baichuan-2 13B Enterprise Chinese (FP16 Uncompressed Native) on NVIDIA H100 80GB SXM5 VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for Baichuan-2 13B Enterprise Chinese quantized in FP16 Uncompressed Native deployed on NVIDIA H100 80GB SXM5.
💻 Baichuan-2 13B Enterprise Chinese (BF16 Bfloat16 Mixed Precision) on NVIDIA H200 141GB HBM3e VRAM & Throughput Calculator

Exact VRAM memory allocation, dynamic KV-cache requirements, and tensor parallelism slicing for Baichuan-2 13B Enterprise Chinese quantized in BF16 Bfloat16 Mixed Precision deployed on NVIDIA H200 141GB HBM3e.
← Previous Page Page 8 of 9 Next Page →