Translate Gemma models ship as open translation models from Google. Wiro lists three sizes: 4B, 12B, and 27B. This post runs a small 6-prompt test set and compares the raw outputs side by side.
Models tested:
- https://wiro.ai/models/google/translate-gemma-4b-it
- https://wiro.ai/models/google/translate-gemma-12b-it
- https://wiro.ai/models/google/translate-gemma-27b-it
Test setup
- Same 6 prompts for each model
- Explicit
sourceLngandtargetLngper prompt maxNewTokens=200for all runs
Speed snapshot (average per run)
| Model | Avg elapsed seconds (6 runs) |
|---|---|
| translate-gemma-4b-it | ~12s |
| translate-gemma-12b-it | ~18s |
| translate-gemma-27b-it | ~21s |
Prompt 1: Turkish checkout note (TR -> EN)
Input: Sepet tutari 1.249,90 TL. Kargo ucreti 79,90 TL. Teslimat tahmini 2-3 is gunu. Siparis notu: Kapiciya birakmayin.
| 4B | 12B | 27B |
|---|---|---|
Total cost: 1,249.90 TL. Shipping cost: 79.90 TL. Estimated delivery time: 2-3 business days. Order note: Do not leave at the door. |
The total amount in your cart is 1,249.90 TL. The shipping fee is 79.90 TL. Estimated delivery time is 2-3 business days. Order note: Please do not leave the package with the doorman. |
The cart total is 1,249.90 TL. The shipping fee is 79.90 TL. Estimated delivery time is 2-3 business days. Order note: Do not leave with the doorman. |
Prompt 2: Password reset message (EN -> TR)
Input: Your password reset link expires in 15 minutes. Do not share this code: {OTP}. If you did not request this, ignore this message.
| 4B | 12B | 27B |
|---|---|---|
Şifrenizi sıfırlama bağlantınız 15 dakika içinde sona erecektir. Bu kodu paylaşmayın: {OTP}. Eğer bu kodu talep etmediyseniz, bu mesajı görmezden gelin.
|
Şifrenizi sıfırlama bağlantınız 15 dakika sonra sona erecektir. Bu kodu kimseyle paylaşmayın: {OTP}. Eğer bu talebi siz yapmadıysanız, bu mesajı dikkate almayın.
|
Parola sıfırlama bağlantınız 15 dakika içinde sona erecektir. Bu kodu kimseyle paylaşmayın: {OTP}. Bu talebi siz yapmadıysanız, bu mesajı dikkate almayın.
|
Prompt 3: German ERP instruction (DE -> EN)
Input: Bitte pruefen Sie die Lieferantenerklaerung und die Seriennummern (SN: DE-77-2048) vor der Freigabe im ERP-System.
| 4B | 12B | 27B |
|---|---|---|
Please verify the supplier declaration and serial numbers (SN: DE-77-2048) before entering the data into the ERP system. |
Please verify the supplier's declaration and the serial numbers (SN: DE-77-2048) before approving the entry in the ERP system. |
Please check the supplier declaration and the serial numbers (SN: DE-77-2048) before releasing them in the ERP system. |
Prompt 4: Rescheduled meeting (ZH -> EN)
Input: 会议取消了, 新时间改到下周三上午十点. 请在今天下班前回复是否能参加.
| 4B | 12B | 27B |
|---|---|---|
The meeting has been canceled and rescheduled for Wednesday morning at 10:00 AM. Please let me know by the end of the day if you will be able to attend. |
The meeting has been canceled, and the new time is next Wednesday at 10:00 AM. Please reply before the end of the workday today to confirm your availability. |
The meeting has been canceled and rescheduled for next Wednesday at 10 a.m. Please reply by the end of the day to let us know if you can attend. |
Prompt 5: UI strings (EN -> ES)
Input: Add to cart | Checkout | Free shipping over $50 | Estimated delivery: 3-5 business days
| 4B | 12B | 27B |
|---|---|---|
Añadir al carrito | Proceder al pago | Envío gratuito a partir de 50 $ | Tiempo estimado de entrega: 3-5 días hábiles |
Añadir al carrito | Finalizar compra | Envío gratuito para pedidos superiores a 50 dólares | Plazo de entrega estimado: 3-5 días hábiles. |
Añadir al carrito | Finalizar compra | Envío gratuito para pedidos superiores a 50 $ | Plazo de entrega estimado: de 3 a 5 días hábiles. |
Prompt 6: Back in stock notification (FR -> EN)
Input: Ce produit est en rupture de stock, mais une nouvelle livraison arrive vendredi. Souhaitez-vous etre averti par email?
| 4B | 12B | 27B |
|---|---|---|
This product is currently out of stock, but a new shipment is arriving on Friday. Would you like to be notified by email when it's back in stock? |
This product is currently out of stock, but a new shipment is arriving on Friday. Would you like to be notified by email? |
This product is currently out of stock, but a new shipment is arriving on Friday. Would you like to be notified by email? |
Verdict
- All three models handled short, clean business text well.
- 12B and 27B tended to sound more natural on longer sentences.
- 4B stayed competitive on short UI strings and structured text.
