Provider Benchmark
Provider Benchmark posts from the AIHubMix team.
DeepSeek V4.1 Flash on Fireworks: empty stop replies, 3/9 cache hitsOn 2026-11-03/04, DeepSeek V4.1 Flash 1017 was run through the APB Full suite on five providers, all reached through AIHubMix with the same questions, parameters and request scripts. This APB Profile covers Fireworks only. The model is listed as DeepSeek V4.1 Flash 1017. Scores are Q 41.42, F 71.78, P 79.51, K 60.68 and R 100; the overall index is 64.10. This post reports scores only, with no ranking or provider recommendation. Q, F, P, K and R come first; the overall index is a summary number
DeepSeek V4.1 Flash on the official channel: 94.00 F, 15 invalid probesOn 2026-11-03/04, the APB Full suite ran against DeepSeek V4.1 Flash 1017 on five providers through AIHubMix. The same questions, parameters and request scripts were used for every provider; the five provider entries are on the models page. This APB Profile covers the DeepSeek official channel only. It is reached through AIHubMix's DeepSeek official supplier route, not a direct connection to DeepSeek's API. This post reports scores only, without ranking providers or recommending one: Q 42.45,
DeepSeek V4.1 Flash on Alibaba Cloud: 1.34s first token, 99.37 cacheOn 2026-11-03/04, the APB Full suite ran against DeepSeek V4.1 Flash 1017 on five providers through AIHubMix. The same model, questions, parameters and request scripts were used for every provider; the model is listed on the AIHubMix model page, and the five provider entries are on the models page. This APB Profile covers Alibaba Cloud only: what each section measured and what came back. This post reports scores without ranking providers or recommending one. Q, F, P, K and R come first; K is a
DeepSeek V4.1 Flash on Baidu: no available channel hits Q and POn 2026-11-03/04, DeepSeek V4.1 Flash 1017 was tested on five providers through AIHubMix with the APB Full suite: the same questions, parameters and request scripts each time. This APB Profile covers the Baidu run only, section by section. The numbers below are scores only, not a ranking or a provider recommendation. Q 38.00, F 88.39, P 37.77, K 68.85 and R 100 come first; the overall, 56.48, is a summary index with no confidence interval. The scoring rules are those of AIHubMix Provider Bench
DeepSeek V4.1 Flash on ByteDance: tool calls match, metering doesn'tOn 2026-11-03/04, DeepSeek V4.1 Flash 1017 was tested on five providers through AIHubMix with the APB Full suite: the same questions, parameters and request scripts each time. This APB Profile covers the ByteDance run only, section by section. The numbers below are scores, not a ranking or a provider recommendation. Q, F, P, K and R come first; the overall is a summary index, not a certification, and it has no confidence interval. The scoring rules are defined in AIHubMix Provider Benchmark St