Search results

Tool calls dropped: json_tools start marker never matches when the tokenizer merges the <tool_call> closing >

Status: Open.

#1335 In ml-explore/mlx-lm;

· snagnever opened on May 31, 2026

DeepSeek-V4 (Flash/Pro) on Apple Silicon: unbounded Metal residency growth during decode → [metal::malloc] Resource limit (499000) exceeded after ~11K tokens

Status: Open.

#1332 In ml-explore/mlx-lm;

· snagnever opened on May 31, 2026

mlx_lm.server returns 404 "list index out of range" on short prompts (TokenizerWrapper._find doesn't clamp negative start)

Status: Open.

#1326 In ml-explore/mlx-lm;

· snagnever opened on May 29, 2026

Feature Request: Expose ⁠--kv-bits⁠ and thinking parameters in ⁠mlx_lm.server⁠ for large model inference

Status: Open.

#1308 In ml-explore/mlx-lm;

· Wolfbane1 opened on May 24, 2026

Devstral-Small-2-24B-Instruct-2512 (MXFP4): model emits valid [TOOL_CALLS] markup but mlx_lm.server returns empty message

Status: Open.

#1307 In ml-explore/mlx-lm;

· aanjhan opened on May 24, 2026

Mlx qwopus model doesn't works

Status: Open.

#1304 In ml-explore/mlx-lm;

· Wolfbane1 opened on May 23, 2026

why is this mlx shit not maintained ?>??? there is so much stuff going on deepseek v4 mimo 2.5 and suport? nothing .... and people who want to contribute got ignored ...

Status: Open.

#1303 In ml-explore/mlx-lm;

· jonipupet opened on May 23, 2026

converted repos missing some eos ids for mlx-community/Ministral-3-3B-Instruct-2512-4bit, mlx-community/Qwen3.5-9B-MLX-4bit

Status: Open.

#1296 In ml-explore/mlx-lm;

· jrp2014 opened on May 21, 2026

feat: add tool parser support for Qwen 3.5/3.6 (non-Coder) models

Status: Open.

#1293 In ml-explore/mlx-lm;

· TinyWorkshopDesign opened on May 21, 2026

mlx_lm.server returns 1-token completions on Qwen3.6 MTP variants when system prompt is reused with a different user prompt

Status: Open.

#1292 In ml-explore/mlx-lm;

· druide67 opened on May 20, 2026

Can we add DeepSeek V4 to mlx_lm

Status: Open.

#1281 In ml-explore/mlx-lm;

· rajveer43 opened on May 17, 2026

Deterministic temp=0 generation differs across Apple Silicon targets

Status: Open.

#1280 In ml-explore/mlx-lm;

· ivanfioravanti opened on May 17, 2026