## Basic tool info Model name: wiro/chat Model description: Wiro LLM Conversational chat script! Runs every LLM with one tool. Model cover: https://cdn.wiro.ai/uploads/models/wiro-chat-cover.webp Model categories: - llm - persistent - tool - chat Model tags: - conversational - text-generation-inference - gemma2-chat - text generation - wiro-chat - question answer - chat - llama2-chat - llama3-chat Run Task Endpoint (POST): https://api.wiro.ai/v1/Run/wiro/chat Get Task Detail Endpoint (POST): https://api.wiro.ai/v1/Task/Detail ## Model Inputs: - name: selectedModel label: select-model help: select-model-help type: select default: "617" options: - value: "1936" label: unsloth/Qwen3.8-Flash-Next-GGUF description: Run Unsloth’s GGUF quantizations of Qwen 3.8 Flash Next for long-context chat and reasoning. Includes optional thinking mode plus sampling and stop controls. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","H200"] image: https://cdn.wiro.ai/uploads/models/unsloth-qwen3-8-flash-next-gguf-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"false","value":"false","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.15","value":"1.15","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "1935" label: Qwen/Qwen3.8-27B-Obliterated description: Refusal-reduced variant of Qwen 3.8 27B for long-context chat and coding. It can emit or hide thinking traces and supports tight decoding controls. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-8-27b-obliterated-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"false","value":"false","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.15","value":"1.15","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1925" label: Qwen/Qwen3.8-27B description: Qwen3.8-27B is a 27B-parameter chat model from Qwen with optional thinking traces and 262k native context for long-form coding, analysis, and agent workflows. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-8-27b-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1924" label: Qwen/Qwen3.8-27B-Uncensored description: Chat model based on Qwen 3.8 27B with refusal behavior reduced through direction removal. Its 262k context fits long documents, code, and chats. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-8-27b-uncensored-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1790" label: Qwen/Qwen3.6-27B description: Qwen3.6-27B is a 27B dense vision-language model from Qwen for agentic coding and reasoning. It supports 262K-token context and optional thinking traces in outputs. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-6-27b-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/qwen-qwen3-6-27b-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "1765" label: Qwen/Qwen3.5-4B-heretic description: Decensored Qwen3.5-4B checkpoint for long-context chat, coding, and analysis. Supports optional thinking traces and sampling controls for output style. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-4b-heretic-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1764" label: Qwen/Qwen3.5-9B-heretic description: A large language model optimized for chat interactions and logical reasoning tasks. Designed for developers and researchers. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-9b-heretic-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1763" label: Qwen/Qwen3.5-4B description: A compact yet capable LLM optimized for chat interactions and logical reasoning tasks. Designed for efficient deployment and accurate responses. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-4b-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1760" label: Qwen/Qwen3.5-9B description: A dense 9-billion parameter language model optimized for chat and reasoning tasks. Designed for efficient deployment and high-quality responses. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-9b-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1758" label: Qwen/Qwen3.5-27B-heretic description: A large language model optimized for chat interactions and reasoning tasks, designed for advanced users seeking powerful natural language processing capabilities. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-27b-heretic-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"select","class":"is-12","required":false,"rows":"0","id":"enableThinking","placeholder":"Thinking","label":"Thinking","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[{"value":"true","text":"True"},{"value":"false","text":"False"}],"note":""},{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1726" label: Qwen/Qwen3.5-27B description: Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning","quick-showcase","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-27b-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/qwen-qwen3-5-27b-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","value":"Explain the Second Law of Thermodynamics through the lens of information theory. How does the concept of entropy in a physical system relate to the 'noise' or 'uncertainty' in a data transmission?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "1695" label: zai-org/GLM-4.7-Flash description: A chat-based language model optimized for conversational AI tasks with support for custom prompts and session management. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/zai-org-glm-4-7-flash-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/zai-org-glm-4-7-flash-sample-2.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain quantum mechanics clearly and concisely.","value":"Explain quantum mechanics clearly and concisely.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "1566" label: openai/gpt-oss-20b description: OpenAI GPT-OSS-20B model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","rag","opeanai","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/openai-gpt-oss-20b-cover.webp marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Explain quantum mechanics clearly and concisely.","value":"Explain quantum mechanics clearly and concisely.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "1527" label: Qwen/Qwen3-30B-A3B-Thinking-2507 description: Qwen3-30B-A3B-Thinking-2507 model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","rag","qwen3","qwen3-reasoning","llm-reasoning","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-30B-A3B-Thinking-2507-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-30B-A3B-Thinking-2507-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about Turkey?","value":"Can you say something interesting about Turkey?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "1526" label: Qwen/Qwen3-32B description: Qwen3-32B model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","rag","qwen3","llm-reasoning","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-32B-cover.png marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something short and interesting about dogs?","value":"Can you say something short and interesting about dogs?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "1525" label: Qwen/Qwen3-30B-A3B description: Qwen3-30B-A3B model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","rag","qwen3","llm-reasoning","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-30B-A3B-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-30B-A3B-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Deed","label":"Deed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "1523" label: Qwen/Qwen3-Coder-30B-A3B-Instruct description: Qwen3-Coder-30B-A3B-Instruct model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","rag","qwen3"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-Coder-30B-A3B-Instruct-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen3-Coder-30B-A3B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you write basic Python code that displays 'Qwen3 is now on Wiro!'?","value":"Can you write basic Python code that displays 'Qwen3 is now on Wiro!'?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"User ID","label":"User ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"Session ID","label":"Session ID","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"System Prompt","label":"System Prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"Temperature","label":"Temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"Top P","label":"Top P","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"Top K","label":"Top K","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"Repetition Penalty","label":"Repetition Penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"Length Penalty","label":"Length Penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"Max Tokens","label":"Max Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"Min Tokens","label":"Min Tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"Min New Tokens","label":"Min New Tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"Stop Sequences","label":"Stop Sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"Seed","label":"Seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"Quantization","label":"Quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"Do Sample","label":"Do Sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "1141" label: AlicanKiraz0/SenecaLLM-x-QwQ-32B-Q8_Max-Version description: Mixed dataset LLM Information Security v1.5 - Incident Response v1.3.1 - Threat Hunting v1.3.2 - Ethical Exploit Development v2.0 - Purple Team Tactics v1.3 - Reverse Engineering v2.0 triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","bf16","qwen-gguf","checkpoint-file"] image: https://cdn.wiro.ai/uploads/models/AlicanKiraz0-SenecaLLM-x-QwQ-32B-Q8_Max-Version-cover.png samples: ["https://cdn.wiro.ai/uploads/models/AlicanKiraz0-SenecaLLM-x-QwQ-32B-Q8_Max-Version-sample-1.txt"] marketplace: 1 inspire: [{"prompt":"What are the critical steps in a penetration testing process for a web application?"},{"prompt":"What are the differences between symmetric and asymmetric encryption methods?"},{"prompt":"How does a Distributed Denial of Service (DDoS) attack work and how can it be mitigated?"},{"prompt":"What is SQL Injection and how can developers protect applications against it?"},{"prompt":"How does multi-factor authentication (MFA) enhance cybersecurity compared to single-factor authentication?"},{"prompt":"What are the key phases of a cyber incident response plan?"},{"prompt":"What are common techniques hackers use to bypass firewalls and intrusion detection systems?"},{"prompt":"How can organizations protect sensitive data when using public cloud services?"},{"prompt":"What is ransomware and what strategies can organizations implement to prevent and recover from ransomware attacks?"},{"prompt":"What are the main differences between white hat, black hat, and gray hat hackers?"}] parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are the critical steps in a penetration testing process for a web application?","value":"What are the critical steps in a penetration testing process for a web application?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "757" label: Qwen/Qwen2.5-14B-Instruct description: Qwen2.5-14B-Instruct is a large language model by Alibaba’s Qwen team, optimized for instruction-following tasks with 14 billion parameters. It offers strong reasoning, multilingual capabilities, and efficient performance, making it suitable for chatbots, content creation, and various AI-driven applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-14B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-14B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "756" label: Qwen/Qwen2.5-32B-Instruct description: Qwen2.5-32B-Instruct is a powerful large language model developed by Alibaba’s Qwen team, designed for instruction-following tasks with enhanced reasoning and natural language understanding capabilities. Optimized for efficiency and accuracy, it supports multi-turn conversations and complex queries, making it suitable for applications such as chatbots, content generation, and AI assistants. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-32B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-32B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "743" label: deepseek-ai/DeepSeek-R1-Distill-Qwen-32B description: DeepSeek-R1-Distill-Qwen-32B is a distilled version of the DeepSeek-R1 model with 32 billion parameters, leveraging the Qwen architecture to deliver high-quality language understanding and generation. Through knowledge distillation, it retains the strengths of larger models while offering improved efficiency and reduced computational requirements. This model is ideal for large-scale AI applications that demand robust performance with optimized resource utilization. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "742" label: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B description: DeepSeek-R1-Distill-Qwen-14B is a distilled version of the DeepSeek-R1 model, featuring 14 billion parameters. Built on the Qwen architecture, it utilizes advanced knowledge distillation techniques to achieve a balance between high performance and computational efficiency. This model is well-suited for a wide range of natural language processing tasks, providing accurate and context-aware responses while optimizing resource consumption for deployment in production environments. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "741" label: deepseek-ai/DeepSeek-R1-Distill-Llama-8B description: DeepSeek-R1-Distill-Llama-8B is a distilled version of the DeepSeek-R1 model based on the LLaMA architecture, featuring 8 billion parameters. It offers a balance between performance and efficiency by leveraging knowledge distillation techniques to reduce computational costs while maintaining high-quality language processing capabilities. This model is ideal for applications that require powerful text generation and understanding with optimized resource usage. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "740" label: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B description: DeepSeek-R1-Distill-Qwen-7B is a distilled version of the DeepSeek-R1 model with 7 billion parameters, designed to provide high-quality language understanding while optimizing efficiency. Leveraging advanced knowledge distillation techniques, it retains the core capabilities of larger models with improved speed and lower resource consumption. This model is well-suited for tasks requiring robust natural language processing while maintaining cost-effective deployment. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "739" label: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B description: DeepSeek-R1-Distill-Qwen-1.5B is a distilled version of the DeepSeek-R1 model, designed to offer a balance between efficiency and performance. With 1.5 billion parameters, it leverages knowledge distillation techniques to retain the capabilities of larger models while optimizing for faster inference and reduced resource consumption. Ideal for applications requiring high-quality language understanding with lower computational overhead. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag","llm-reasoning"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "735" label: utter-project/EuroLLM-9B-Instruct description: utter-project/EuroLLM-9B-Instruct is a 9 billion parameter multilingual AI model developed to understand and generate text across all European Union languages and additional relevant languages. It has been trained on a vast dataset of 4 trillion tokens and further fine-tuned on EuroBlocks to improve its performance in instruction-following and machine translation tasks. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","fp16","eurollm-chat","rag"] image: https://cdn.wiro.ai/uploads/models/utter-project-EuroLLM-9B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/utter-project-EuroLLM-9B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "734" label: utter-project/EuroLLM-1.7B-Instruct description: utter-project/EuroLLM-1.7B-Instruct is a 1.7 billion parameter multilingual AI model designed to understand and generate text in all European Union languages and additional relevant languages. It has been trained on 4 trillion tokens from diverse sources and further instruction-tuned on EuroBlocks to enhance its capabilities in general instruction-following and machine translation. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","eurollm-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/utter-project-EuroLLM-1.7B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/utter-project-EuroLLM-1.7B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "730" label: m42-health/Llama3-Med42-8B description: m42-health/Llama3-Med42-8B is an open-access clinical large language model fine-tuned by M42, based on LLaMA-3, with 8 billion parameters. It is designed to provide high-quality, reliable answers to medical queries, enhancing access to medical knowledge. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","llama3-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/m42-health-Llama3-Med42-8B-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/m42-health-Llama3-Med42-8B-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are the symptoms of diabetes?","value":"What are the symptoms of diabetes?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest medical assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don’t know the answer to a question, please don’t share false information.","value":"You are a helpful, respectful and honest medical assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don’t know the answer to a question, please don’t share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "728" label: meta-llama/Llama-3.2-3B-Instruct description: The Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out). The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","llama3-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/meta-llama-llama-3-2-3b-instruct-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/meta-llama-llama-3-2-3b-instruct-sample-2.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "726" label: meta-llama/CodeLlama-34b-Instruct-hf description: meta-llama/CodeLlama-34B-Instruct-hf is a 34 billion parameter instruction-tuned AI model developed by Meta, designed to provide advanced code generation, completion, and understanding capabilities across various programming languages, offering high accuracy and efficiency for complex coding tasks. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","llama2-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/meta-llama-CodeLlama-34b-Instruct-hf-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/meta-llama-CodeLlama-34b-Instruct-hf-sample-1.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you write a javascript function that detects positive numbers?","value":"Can you write a javascript function that detects positive numbers?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "725" label: meta-llama/CodeLlama-7b-Instruct-hf description: meta-llama/CodeLlama-7B-Instruct-hf is a 7 billion parameter instruction-tuned AI model developed by Meta, designed to assist with code generation, completion, and understanding across multiple programming languages with high efficiency and accuracy. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","llama2-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/meta-llama-CodeLlama-7b-Instruct-hf-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you write a javascript function that detects positive numbers?","value":"Can you write a javascript function that detects positive numbers?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "720" label: internlm/internlm3-8b-instruct description: InternLM3 has open-sourced an 8-billion parameter instruction model, InternLM3-8B-Instruct, designed for general-purpose usage and advanced reasoning. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","internlm3-chat","rag"] image: https://cdn.wiro.ai/uploads/models/internlm-internlm3-8b-instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/internlm-internlm3-8b-instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "719" label: CohereForAI/aya-expanse-8b description: Aya Expanse 8B is an open-weight research release of a model with highly advanced multilingual capabilities. It focuses on pairing a highly performant pre-trained Command family of models with the result of a year’s dedicated research from Cohere For AI, including data arbitrage, multilingual preference training, safety tuning, and model merging. The result is a powerful multilingual large language model. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","fp16","aya-expanse-chat","rag"] image: https://cdn.wiro.ai/uploads/models/CohereForAI-aya-expanse-8b-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/CohereForAI-aya-expanse-8b-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "717" label: mistralai/Mistral-Nemo-Instruct-2407 description: The Mistral-Nemo-Instruct-2407 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-Nemo-Base-2407. Trained jointly by Mistral AI and NVIDIA, it significantly outperforms existing models smaller or similar in size. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","mistral-chat","bf16","rag","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/mistralai-Mistral-Nemo-Instruct-2407-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/mistralai-Mistral-Nemo-Instruct-2407-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "716" label: HuggingFaceTB/SmolLM2-1.7B-Instruct description: HuggingFaceTB/SmolLM2-1.7B-Instruct is a 1.7 billion parameter instruction-tuned AI language model designed to provide efficient and accurate responses for a wide range of tasks while maintaining a lightweight and accessible architecture. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","smollm2-chat","rag"] image: https://cdn.wiro.ai/uploads/models/HuggingFaceTB-SmolLM2-1.7B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/HuggingFaceTB-SmolLM2-1.7B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "714" label: mistralai/Mathstral-7B-v0.1 description: mistralai/Mathstral-7B-v0.1 is a 7 billion parameter AI model optimized for mathematical reasoning and problem-solving, designed to deliver precise and efficient solutions across a variety of mathematical domains. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","mistral-chat","fp32","rag"] image: https://cdn.wiro.ai/uploads/models/mistralai-Mathstral-7B-v0.1-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/mistralai-Mathstral-7B-v0.1-sample-1.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","value":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "713" label: deepseek-ai/deepseek-math-7b-instruct description: deepseek-ai/deepseek-math-7b-instruct is a 7 billion parameter AI model specifically designed to excel in mathematical reasoning and problem-solving tasks, providing accurate and detailed step-by-step solutions. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","deepseek-chat","rag"] image: https://cdn.wiro.ai/uploads/models/deepseek-ai-deepseek-math-7b-instruct-cover.jpg marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","value":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "712" label: microsoft/Phi-3.5-mini-instruct description: microsoft/Phi-3.5-mini-instruct is a lightweight AI language model optimized for instruction-based tasks, offering efficient performance and high-quality responses with a compact architecture. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","phi3.5-chat","rag"] image: https://cdn.wiro.ai/uploads/models/microsoft-Phi-3.5-mini-instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/microsoft-Phi-3.5-mini-instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "711" label: Qwen/Qwen2.5-3B-Instruct description: Qwen/Qwen2.5-3B-Instruct is a powerful 3 billion parameter AI language model designed to deliver high-quality, human-like responses across a wide range of natural language processing tasks. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-3B-Instruct-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-3B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "710" label: Qwen/Qwen2.5-0.5B-Instruct description: Qwen/Qwen2.5-0.5B-Instruct is a compact 500 million parameter AI language model optimized for generating human-like responses and assisting with various natural language understanding tasks. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-0.5B-Instruct-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-0.5B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "709" label: Qwen/Qwen2.5-1.5B-Instruct description: Qwen/Qwen2.5-1.5B-Instruct is a 1.5 billion parameter AI language model designed to generate human-like responses based on user inputs. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-1.5B-Instruct-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-1.5B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "692" label: Qwen/Qwen2-7B-Instruct description: Qwen2-7B-Instruct is a versatile large language model with 7 billion parameters, optimized for instruction-following tasks. It delivers high performance in natural language understanding, content generation, and complex reasoning, making it ideal for a wide range of AI-driven applications, from chatbots to educational tools. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2-7B-Instruct-cover.jpeg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2-7B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "691" label: Qwen/Qwen2.5-Math-7B-Instruct description: Qwen2.5-Math-7B-Instruct is a large language model with 7 billion parameters, specialized in advanced mathematical problem-solving and reasoning. It is fine-tuned for instruction-based tasks and excels in fields like algebra, calculus, and quantitative analysis, making it suitable for research, education, and technical applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Math-7B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Math-7B-Instruct-sample-2.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","value":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "690" label: Qwen/Qwen2.5-Math-1.5B-Instruct description: Qwen2.5-Math-1.5B-Instruct is a math-specialized large language model with 1.5 billion parameters, fine-tuned for solving complex mathematical problems and handling instruction-based tasks. It excels in areas like algebra, calculus, and numerical reasoning, making it ideal for educational tools and research applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Math-1.5B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Math-1.5B-Instruct-sample-1.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","value":"Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "689" label: Qwen/Qwen2.5-Coder-7B-Instruct description: Qwen2.5-Coder-7B-Instruct is a specialized large language model with 7 billion parameters, designed for code understanding and generation. Fine-tuned for instruction-based tasks, it supports multiple programming languages, making it ideal for coding assistance, code completion, and educational applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Coder-7B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Coder-7B-Instruct-sample-1.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you write a javascript function that detects positive numbers?","value":"Can you write a javascript function that detects positive numbers?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "688" label: Qwen/Qwen1.5-0.5B-Chat description: Qwen1.5-0.5B-Chat is a lightweight conversational AI model with 500 million parameters, designed for efficient and interactive chat-based applications. Despite its smaller size, it offers fast performance and reliable natural language understanding, making it ideal for real-time AI interactions on resource-constrained systems. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen1.5-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen1.5-0.5B-Chat-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen1.5-0.5B-Chat-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "686" label: microsoft/phi-4 description: PHI-4 by Microsoft is an advanced large language model designed for precise natural language understanding and generation. It offers robust performance in complex conversational AI and NLP tasks, making it well-suited for enterprise and research applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","phi4-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/microsoft-phi-4-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/microsoft-phi-4-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "685" label: Qwen/Qwen2.5-Coder-32B-Instruct description: Qwen2.5-Coder-32B-Instruct is a powerful code-focused large language model with 32 billion parameters, fine-tuned for coding and instruction-based tasks. It excels in code generation, code completion, and understanding complex programming instructions across multiple languages. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Coder-32B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-Coder-32B-Instruct-sample-1.png"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you write a javascript function that detects positive numbers?","value":"Can you write a javascript function that detects positive numbers?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "684" label: google/gemma-2-2b-it description: Gemma-2-2B is a compact large language model by Google, featuring 2 billion parameters and optimized for instruction-based and multilingual tasks. It provides efficient natural language processing, making it suitable for a variety of AI-driven applications with lower computational requirements. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","gemma2-chat","bf16"] image: https://cdn.wiro.ai/uploads/models/google-gemma-2-2b-it-cover.png samples: ["https://cdn.wiro.ai/uploads/models/google-gemma-2-2b-it-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "683" label: google/gemma-2-9b-it description: Gemma-2-9B is an advanced large language model by Google, featuring 9 billion parameters and designed for multilingual and instruction-following tasks. It delivers high-quality performance in complex natural language understanding and generation across various domains. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","gemma2-chat","bf16"] image: https://cdn.wiro.ai/uploads/models/google-gemma-2-9b-it-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/google-gemma-2-9b-it-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "682" label: meta-llama/Meta-Llama-3-8B-Instruct description: Meta-Llama 3-8B-Instruct is a state-of-the-art large language model with 8 billion parameters, optimized for instruction-based tasks. It excels in understanding and generating natural language, making it ideal for a wide range of AI-driven applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","llama3-chat","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/meta-llama-meta-llama-3-8b-instruct-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/meta-llama-meta-llama-3-8b-instruct-sample-2.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "681" label: mistralai/Mistral-7B-Instruct-v0.3 description: Mistral-7B-Instruct-v0.3 is a highly efficient large language model with 7 billion parameters, fine-tuned for instruction-following tasks. It delivers strong performance across a range of applications, offering reliable responses and enhanced task comprehension. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","mistral-chat","bf16","rag","llm-tool-call"] image: https://cdn.wiro.ai/uploads/models/mistralai-Mistral-7B-Instruct-v0.3-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/mistralai-Mistral-7B-Instruct-v0.3-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}}]}] - value: "680" label: meta-llama/Llama-3.1-8B-Instruct description: Llama 3.1-8B-Instruct is an advanced large language model designed for instruction-based tasks and fine-tuned for improved user interaction. With 8 billion parameters, it offers enhanced accuracy and versatility across various AI applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","bf16","llama3-chat","rag"] image: https://cdn.wiro.ai/uploads/models/meta-llama-Llama-3.1-8B-Instruct-cover.jpg samples: ["https://cdn.wiro.ai/uploads/models/meta-llama-Llama-3.1-8B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "679" label: Qwen/Qwen2.5-7B-Instruct description: Qwen 2.5 is the large language model of Qwen, offering advanced natural language understanding and generation capabilities. It’s designed to handle complex tasks with high accuracy, making it ideal for diverse AI applications. triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","chat","checkpoint-folder","qwen2.5-chat","bf16","rag","llm-tool-call","llm-response-format"] image: https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-7B-Instruct-cover.png samples: ["https://cdn.wiro.ai/uploads/models/Qwen-Qwen2.5-7B-Instruct-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Can you say something interesting about the Eiffel Tower?","value":"Can you say something interesting about the Eiffel Tower?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"messages","placeholder":"[{\"role\":\"user\",\"content\":\"What is the weather in Istanbul?\"}]","label":"Messages","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Conversation messages or normalized Wiro message items. Use exactly one of messages or prompt, and clear prompt when using messages.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":4096,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":4096,"items":{"type":"object"}}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"10","id":"tools","placeholder":"[{\"type\":\"function\",\"function\":{\"name\":\"get_weather\",\"description\":\"Get weather\",\"parameters\":{\"type\":\"object\",\"properties\":{\"city\":{\"type\":\"string\"}},\"required\":[\"city\"]}}}]","label":"Tools","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"OpenAI-style or normalized Wiro function definitions. This provider does not support custom tools.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","maxItems":128,"x-wiro-tool-types":["function"],"items":{"type":"object","required":["type"],"properties":{"type":{"enum":["function"]}}}}},{"advanced":true,"quick":false,"type":"json","class":"is-6","required":false,"rows":"4","id":"tool_choice","placeholder":"\"auto\"","label":"Tool Choice","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Use \"auto\", \"none\", \"required\", or a named tool-choice object.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"oneOf":[{"enum":["auto","none","required"]},{"type":"object"}]}},{"advanced":true,"quick":false,"type":"checkbox","class":"is-6","required":false,"rows":"1","id":"parallel_tool_calls","placeholder":"","label":"Parallel Tool Calls","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Allow the model to return more than one tool call in a turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":null,"filter":[],"jsonschema":{"type":"boolean"}},{"advanced":true,"quick":false,"type":"text","class":"is-12","required":false,"rows":"1","id":"previousTaskToken","placeholder":"task-token","label":"Previous Task Token","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Pass the prior Run response's socketaccesstoken. Include toolOutputs for a tool-result continuation; otherwise send exactly one new prompt or messages value.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":256,"filter":[],"jsonschema":{"type":"string","pattern":"^[A-Za-z0-9_.:-]{1,256}$"}},{"advanced":true,"quick":false,"type":"json-array","class":"is-12","required":false,"rows":"8","id":"toolOutputs","placeholder":"[{\"call_id\":\"call_123\",\"output\":{\"temperature\":18}}]","label":"Tool Outputs","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Results for calls from previousTaskToken. Each call ID must match the authenticated stored turn.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":128,"filter":[],"jsonschema":{"type":"array","minItems":1,"maxItems":128,"items":{"type":"object","required":["call_id","output"],"properties":{"call_id":{"type":"string","minLength":1,"maxLength":256},"output":{},"is_error":{"type":"boolean"}},"additionalProperties":false}}},{"advanced":true,"quick":false,"type":"json","class":"is-12","required":false,"rows":"8","id":"response_format","placeholder":"{\"type\":\"json_object\"}","label":"Response Format","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Request one of the response formats explicitly audited for this model.","quickvalue":"","quickdefaultvalue":"","hidden":false,"maxinputlenght":1,"filter":[],"jsonschema":{"oneOf":[{"type":"object","required":["type"],"properties":{"type":{"const":"text"}},"additionalProperties":false},{"type":"object","required":["type"],"properties":{"type":{"const":"json_object"}},"additionalProperties":false}],"x-wiro-response-format-types":["json_object"],"x-wiro-json-schema-strict":false}}]}] - value: "676" label: wiro/wiroai-turkish-llm-8b description: Meet with Wiro AI's Turkish Large Language Model (LLM)! A robust language model with more Turkish language and culture support! triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","llama3-chat","chat","checkpoint-folder","bf16","rag"] image: https://cdn.wiro.ai/uploads/models/wiro-wiroai-turkish-llm-8b-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/wiro-wiroai-turkish-llm-8b-sample-1.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Türkiye'nin başkenti neresidir? 5 tane de Türkiye'den şehir ismi söyler misin?","value":"Türkiye'nin başkenti neresidir? 5 tane de Türkiye'den şehir ismi söyler misin?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "675" label: wiro/wiroai-turkish-llm-9b description: Meet with Wiro AI's Turkish Large Language Model (LLM)! A robust language model with more Turkish language and culture support! triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","gemma2-chat","chat","checkpoint-folder","bf16"] image: https://cdn.wiro.ai/uploads/models/wiro-wiroai-turkish-llm-9b-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/wiro-wiroai-turkish-llm-9b-sample-3.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"Türkiye'nin başkenti neresidir? 5 tane de Türkiye'den şehir ismi söyler misin?","value":"Türkiye'nin başkenti neresidir? 5 tane de Türkiye'den şehir ismi söyler misin?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - value: "617" label: meta-llama/Llama-2-7b-chat-hf description: triggerwords: [] generatesettings: [] categories: ["model","llm","persistent","llama2-chat","chat","checkpoint-folder","fp16","rag"] image: https://cdn.wiro.ai/uploads/models/meta-llama-llama-2-7b-chat-hf-cover.webp samples: ["https://cdn.wiro.ai/uploads/models/meta-llama-llama-2-7b-chat-hf-sample-2.txt"] marketplace: 1 parameters: [{"title":"","subtitle":"","items":[{"advanced":false,"type":"textarea","class":"is-12","required":true,"rows":"4","id":"prompt","placeholder":"prompt","label":"prompt","defaultvalue":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","value":"What are some interesting historical events that took place near the Tower of London, and how could they inspire a fictional story?","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Prompt to send to the model.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"user_id","placeholder":"user_id","label":"user_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID.","quick":true},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"session_id","placeholder":"session_id","label":"session_id","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session.","quick":true},{"advanced":true,"type":"textarea","class":"is-12","required":false,"rows":"4","id":"system_prompt","placeholder":"system_prompt","label":"system_prompt","defaultvalue":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","value":"You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"temperature","placeholder":"temperature","label":"temperature","defaultvalue":"0.7","value":"0.7","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"top_p","placeholder":"top_p","label":"top_p","defaultvalue":"0.95","value":"0.95","minvalue":"0","maxvalue":"1","incrementby":"0.01","optionsLoad":"","options":[],"note":"When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"top_k","placeholder":"top_k","label":"top_k","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"100","incrementby":"1","optionsLoad":"","options":[],"note":"When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"repetition_penalty","placeholder":"repetition_penalty","label":"repetition_penalty","defaultvalue":"1.0","value":"1.0","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output.","quick":false},{"advanced":true,"type":"float","class":"is-12","required":false,"rows":"0","id":"length_penalty","placeholder":"length_penalty","label":"length_penalty","defaultvalue":"1","value":"1","minvalue":"0","maxvalue":"5","incrementby":"0.01","optionsLoad":"","options":[],"note":"A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"max_tokens","placeholder":"max_tokens","label":"max_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"800000","incrementby":"1","optionsLoad":"","options":[],"note":"Maximum number of tokens to generate. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_tokens","placeholder":"min_tokens","label":"min_tokens","defaultvalue":"0","value":"0","minvalue":"0","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.","quick":false},{"advanced":true,"type":"number","class":"is-12","required":false,"rows":"0","id":"min_new_tokens","placeholder":"min_new_tokens","label":"min_new_tokens","defaultvalue":"-1","value":"-1","minvalue":"-1","maxvalue":"2048","incrementby":"1","optionsLoad":"","options":[],"note":"This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"stop_sequences","placeholder":"stop_sequences","label":"stop_sequences","defaultvalue":"","value":"","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''.","quick":false},{"advanced":true,"type":"text","class":"is-12","required":false,"rows":"0","id":"seed","placeholder":"seed","label":"seed","defaultvalue":"123456","value":"123456","minvalue":"0","maxvalue":"9999999","incrementby":"1","optionsLoad":"","options":[],"note":"seed-help"},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"quantization","placeholder":"quantization","label":"quantization","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower."},{"advanced":true,"type":"checkbox","class":"is-12","required":false,"rows":"0","id":"do_sample","placeholder":"do_sample","label":"do_sample","defaultvalue":"true","value":"true","minvalue":"","maxvalue":"","incrementby":"","optionsLoad":"","options":[],"note":"The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results."}]}] - name: selectedModelPrivate label: select-model-private help: select-model-private-help type: select default: "" options: - name: prompt label: prompt help: Prompt to send to the model. type: textarea default: - name: user_id label: user_id help: You can leave it blank. The user_id parameter is a unique identifier for the user. It is used to store and retrieve the chat history specific to that user. You should provide a value that uniquely identifies the user across different sessions. For example, it can be the user’s email address, username, or a system-generated ID. type: text default: - name: session_id label: session_id help: You can leave it blank. The session_id parameter represents a specific session for a user. It allows you to manage multiple sessions for the same user. If you want to maintain separate chat histories for different sessions of the same user, use a unique session_id for each session. If not specified or kept the same, the system will treat all interactions as part of the same session. type: text default: - name: system_prompt label: system_prompt help: System prompt to send to the model. This is prepended to the prompt and helps guide system behavior. type: textarea default: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information. - name: temperature label: temperature help: Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value. type: float default: 0.7 - name: top_p label: top_p help: When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens. type: float default: 0.95 - name: top_k label: top_k help: When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens. type: number default: 0 - name: repetition_penalty label: repetition_penalty help: It is a hyperparameter used to reduce the likelihood of the model generating repetitive text by applying a penalty to previously generated tokens, encouraging more diverse and coherent output. type: float default: 1.0 - name: length_penalty label: length_penalty help: A parameter that controls how long the outputs are. If < 1, the model will tend to generate shorter outputs, and > 1 will tend to generate longer outputs. type: float default: 1 - name: max_tokens label: max_tokens help: Use 0 to set max limit of the model. Maximum number of tokens to generate. A word is generally 2-3 tokens. type: number default: 0 - name: min_tokens label: min_tokens help: Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens. type: number default: 0 - name: min_new_tokens label: min_new_tokens help: This parameter has been renamed to min_tokens. min_new_tokens only exists for backwards compatibility purposes. We recommend you use min_tokens instead. Both may not be specified. type: number default: -1 - name: stop_sequences label: stop_sequences help: A semicolon-separated list of sequences to stop generation at. For example, ';' will stop generation at the first instance of 'end' or ''. type: text default: - name: seed label: seed help: seed-help type: text default: 123456 - name: quantization label: quantization help: Quantization is a technique that reduces the precision of model weights (e.g., from FP32 to INT8) to decrease memory usage and improve inference speed. When enabled (true), the model uses less VRAM, making it suitable for resource-constrained environments, but might slightly affect output quality. When disabled (false), the model runs at full precision, ensuring maximum accuracy but requiring more GPU memory and running slower. type: checkbox default: true - name: do_sample label: do_sample help: The do_sample parameter controls whether the model generates text deterministically or with randomness. For precise tasks like translations or code generation, set do_sample = false to ensure consistent and predictable outputs. For creative tasks like storytelling or poetry, set do_sample = true to allow the model to produce diverse and imaginative results. type: checkbox default: true ## Integration Header Prepare ```bash # Sign up Wiro dashboard and create project export YOUR_API_KEY="{{useSelectedProjectAPIKey}}"; export YOUR_API_SECRET="XXXXXXXXX"; # unix time or any random integer value export NONCE=$(date +%s); # hmac-SHA256 (YOUR_API_SECRET+Nonce) with YOUR_API_KEY export SIGNATURE="$(echo -n "${YOUR_API_SECRET}${NONCE}" | openssl dgst -sha256 -hmac "${YOUR_API_KEY}" | awk '{print $NF}')"; ``` ## Run Command - Make HTTP Post Request ```bash curl -X POST "https://api.wiro.ai/v1/Run/wiro/chat" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "selectedModel": "", "selectedModelPrivate": "", "prompt": "", "user_id": "", "session_id": "", "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. \nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.", "temperature": "0.7", "top_p": "0.95", "top_k": 0, "repetition_penalty": "1.0", "length_penalty": "1", "max_tokens": 0, "min_tokens": 0, "min_new_tokens": -1, "stop_sequences": "", "seed": "123456", "quantization": true, "do_sample": true, "callbackUrl": "You can provide a callback URL; Wiro will send a POST request to it when the task is completed." }'; ``` ## Run Command - Response ```json { "errors": [], "taskid": "2221", "socketaccesstoken": "eDcCm5yyUfIvMFspTwww49OUfgXkQt", "result": true } ``` ## Get Task Detail - Make HTTP Post Request with Task ID ```bash curl -X POST "https://api.wiro.ai/v1/Task/Detail" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "taskid": "2221" }'; ``` ## Get Task Detail - Make HTTP Post Request with Socket Access Token ```bash curl -X POST "https://api.wiro.ai/v1/Task/Detail" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "tasktoken": "eDcCm5yyUfIvMFspTwww49OUfgXkQt" }'; ``` ## Get Task Detail - Response ```json { "total": "1", "errors": [], "tasklist": [ { "id": "2221", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "socketaccesstoken": "eDcCm5yyUfIvMFspTwww49OUfgXkQt", "parameters": {}, "debugoutput": "", "debugerror": "", "starttime": "1734513809", "endtime": "1734513813", "elapsedseconds": "6.0000", "status": "task_postprocess_end", "createtime": "1734513807", "canceltime": "0", "assigntime": "1734513807", "accepttime": "1734513807", "preprocessstarttime": "1734513807", "preprocessendtime": "1734513807", "postprocessstarttime": "1734513813", "postprocessendtime": "1734513814", "totalcost": "0.003510000000", "chargedcost": "0.002808000000", "discountamount": "0.000702000000", "outputs": [ { "id": "6bc392c93856dfce3a7d1b4261e15af3", "name": "0.png", "contenttype": "image/png", "parentid": "6c1833f39da71e6175bf292b18779baf", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "size": "202472", "addedtime": "1734513812", "modifiedtime": "1734513812", "accesskey": "dFKlMApaSgMeHKsJyaDeKrefcHahUK", "url": "https://cdn1.wiro.ai/6a6af820-c5050aee-40bd7b83-a2e186c6-7f61f7da-3894e49c-fc0eeb66-9b500fe2/0.png" } ], "size": "202472" } ], "result": true } ``` totalcost is the list price. chargedcost is the amount actually billed after any discount (a store fee is included on store runs); discountamount is the discount. chargedcost is null until the charge is recorded (shortly after task_postprocess_end) and "0" for a failed or cancelled task. ## Kill Task - Make HTTP Post Request with Task ID ```bash curl -X POST "https://api.wiro.ai/v1/Task/Kill" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "taskid": "534574" }'; ``` ## Kill Task - Make HTTP Post Request with Socket Access Token ```bash curl -X POST "https://api.wiro.ai/v1/Task/Kill" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "socketaccesstoken": "ZpYote30on42O4jjHXNiKmrWAZqbRE" }'; ``` ## Kill Task - Response ```json { "errors": [], "tasklist": [ { "id": "534574", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "name": "", "socketaccesstoken": "ZpYote30on42O4jjHXNiKmrWAZqbRE", "parameters": { "inputImage": "https://api.wiro.ai/v1/File/mCmUXgZLG1FNjjjwmbtPFr2LVJA112/inputImage-6060136.png" }, "debugoutput": "", "debugerror": "", "starttime": "1734513809", "endtime": "1734513813", "elapsedseconds": "6.0000", "status": "task_cancel", "cps": "0.000585000000", "totalcost": "0.003510000000", "guestid": null, "projectid": "699", "modelid": "598", "description": "", "basemodelid": "0", "runtype": "model", "modelfolderid": "", "modelfileid": "", "callbackurl": "", "marketplaceid": null, "createtime": "1734513807", "canceltime": "0", "assigntime": "1734513807", "accepttime": "1734513807", "preprocessstarttime": "1734513807", "preprocessendtime": "1734513807", "postprocessstarttime": "1734513813", "postprocessendtime": "1734513814", "pexit": "0", "categories": "["tool","image-to-image","quick-showcase","compare-landscape"]", "outputs": [ { "id": "6bc392c93856dfce3a7d1b4261e15af3", "name": "0.png", "contenttype": "image/png", "parentid": "6c1833f39da71e6175bf292b18779baf", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "size": "202472", "addedtime": "1734513812", "modifiedtime": "1734513812", "accesskey": "dFKlMApaSgMeHKsJyaDeKrefcHahUK", "foldercount": "0", "filecount": "0", "ispublic": 0, "expiretime": null, "url": "https://cdn1.wiro.ai/6a6af820-c5050aee-40bd7b83-a2e186c6-7f61f7da-3894e49c-fc0eeb66-9b500fe2/0.png" } ], "size": "202472" } ], "result": true } ``` ## Cancel Task - Make HTTP Post Request (For tasks on queue) ```bash curl -X POST "https://api.wiro.ai/v1/Task/Cancel" -H "Content-Type: multipart/form-data" -H "x-api-key: ${YOUR_API_KEY}" -H "x-nonce: ${NONCE}" -H "x-signature: ${SIGNATURE}" -d '{ "taskid": "634574" }'; ``` ## Cancel Task - Response ```json { "errors": [], "tasklist": [ { "id": "634574", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "name": "", "socketaccesstoken": "ZpYote30on42O4jjHXNiKmrWAZqbRE", "parameters": { "inputImage": "https://api.wiro.ai/v1/File/mCmUXgZLG1FNjjjwmbtPFr2LVJA112/inputImage-6060136.png" }, "debugoutput": "", "debugerror": "", "starttime": "1734513809", "endtime": "1734513813", "elapsedseconds": "6.0000", "status": "task_cancel", "cps": "0.000585000000", "totalcost": "0.003510000000", "guestid": null, "projectid": "699", "modelid": "598", "description": "", "basemodelid": "0", "runtype": "model", "modelfolderid": "", "modelfileid": "", "callbackurl": "", "marketplaceid": null, "createtime": "1734513807", "canceltime": "0", "assigntime": "1734513807", "accepttime": "1734513807", "preprocessstarttime": "1734513807", "preprocessendtime": "1734513807", "postprocessstarttime": "1734513813", "postprocessendtime": "1734513814", "pexit": "0", "categories": "["tool","image-to-image","quick-showcase","compare-landscape"]", "outputs": [ { "id": "6bc392c93856dfce3a7d1b4261e15af3", "name": "0.png", "contenttype": "image/png", "parentid": "6c1833f39da71e6175bf292b18779baf", "uuid": "15bce51f-442f-4f44-a71d-13c6374a62bd", "size": "202472", "addedtime": "1734513812", "modifiedtime": "1734513812", "accesskey": "dFKlMApaSgMeHKsJyaDeKrefcHahUK", "foldercount": "0", "filecount": "0", "ispublic": 0, "expiretime": null, "url": "https://cdn1.wiro.ai/6a6af820-c5050aee-40bd7b83-a2e186c6-7f61f7da-3894e49c-fc0eeb66-9b500fe2/0.png" } ], "size": "202472" } ], "result": true } ``` ## Task Status Information This section defines the possible task status values returned by the API when polling for task completion. ### Completed Task Statuses (Polling can stop) These indicate that the task has reached a terminal state — either success or failure. Once any of these is received, polling should stop. - task_postprocess_end : Task completed successfully and post-processing is done. - task_cancel : Task was cancelled by the user or system. ### Running Task Statuses (Continue polling) These statuses indicate that the task is still in progress. Polling should continue if one of these is returned. - task_queue : Task is waiting in the queue. - task_accept : Task has been accepted for processing. - task_assign : Task is being assigned to a worker. - task_preprocess_start : Preprocessing is starting. - task_preprocess_end : Preprocessing is complete. - task_start : Task execution has started. - task_output : Output is being generated.