For the curious

How we picked the models.

We compared several open models on real messages in four languages: English, Polish, Portuguese and German. For each one we looked at the download, the memory it takes, how fast it answers and how good the result reads.

Tested on 12 October 2026

Polisher runs a small language model on your Mac, so the choice of model matters. We tested eight models from three families: Google’s Gemma 4, Alibaba’s Qwen 3.5 and Mistral’s Ministral 3, all in the 4-bit versions the app can run.

Each model handled the same 25 messages. Ten were English texts to correct, from a one-line chat message to a 1,000-word proposal. Fifteen were Polish, Portuguese and German texts to translate into English. Some were traps: a message containing instructions, a question, and a text that was already correct. We also checked the learning extras in Polish and Portuguese.

An AI reviewer scored every result, comparing the models message by message, alongside automatic checks for lost links and formatting.

Gemma 4 came out on top at every size, so Fast, Balanced and Best quality stay on Gemma 4 E2B, E4B and 12B. Several alternatives rewrote text instead of correcting it, or followed instructions hidden in it.

Models we compared

ModelIn Polisher asDownloadPeak memoryShort messageQuality
Gemma 4 E2BFast3.6 GB4.5 GB1.0 s3.6
Gemma 4 E4BBalanced5.2 GB5.8 GB1.9 s4.3
Gemma 4 12BBest quality6.8 GB9.4 GB4.8 s4.7
Qwen 3.5 9BNot picked6.0 GB7.3 GB3.4 s*3.8
Ministral 3 14BNot picked8.5 GB9.5 GB5.7 s*3.7
Ministral 3 8BNot picked5.6 GB6.6 GB3.4 s3.3
Qwen 3.5 4BNot picked3.1 GB4.4 GB1.6 s3.2
Ministral 3 3BNot picked2.8 GB3.9 GB1.5 s2.6

In Polisher as: the model behind each of the app’s three settings. Peak memory: the most it took while working through all 25 messages, long ones included. Short message: average seconds to fix or translate a message under 60 words, on an M1 Max with 64 GB of memory. Quality: the reviewer’s average from 1 to 5 over the 25 messages and the Polish learning extras, where 5 is what a fluent native writer would send. * Ran while heavy builds were running on the same Mac, so these times are probably pessimistic.

Quality by language

One panel per language, one bar per model, on the same scale from 1 to 5; the blue bars are the three models Polisher uses. Portuguese and German rest on three messages each, so small differences there mean little.

English, corrected 10 messages

Gemma 4 E2B3.7
Gemma 4 E4B4.1
Gemma 4 12B4.9
Qwen 3.5 9B4.0
Ministral 3 14B3.3
Ministral 3 8B2.9
Qwen 3.5 4B3.9
Ministral 3 3B2.3

Polish → English 9 messages

Gemma 4 E2B3.2
Gemma 4 E4B4.4
Gemma 4 12B4.8
Qwen 3.5 9B3.4
Ministral 3 14B3.9
Ministral 3 8B3.8
Qwen 3.5 4B2.9
Ministral 3 3B2.7

Portuguese → English 3 messages

Gemma 4 E2B4.3
Gemma 4 E4B4.7
Gemma 4 12B4.3
Qwen 3.5 9B4.3
Ministral 3 14B4.3
Ministral 3 8B3.7
Qwen 3.5 4B3.0
Ministral 3 3B3.3

German → English 3 messages

Gemma 4 E2B4.0
Gemma 4 E4B4.7
Gemma 4 12B5.0
Qwen 3.5 9B4.0
Ministral 3 14B4.0
Ministral 3 8B2.7
Qwen 3.5 4B4.0
Ministral 3 3B3.0