# Writing prompt w12: two-sentence summary of a library notice, answered by fifteen AI models Canonical: https://theagenticweekly.com/tests/writing-prompt-w12 · Last verified: 2026-10-26 · Published: 2026-10-26 · Author: Agentic Weekly (operated independently from Texas, US) · Evidence: Tested by us on 2026-10-26 (America/Chicago): open-weight models run locally on a CPU-only machine, outputs rated by a separate model (Mistral 7B Instruct v0.3) that is not a writer in this test. Indicative results, not a benchmark, and not a statement about any vendor's hosted models. > Prompt w12 (summary) was answered 3 times by each of 15 models. This page lists every output, the rater's rubric scores and whether each output passed the format rule (exactly 2 sentences). Best mean rubric score on this prompt: Llama 3.2 3B. ## Summary The prompt, sent unchanged to every model as the only message ``` Summarize the following announcement in exactly two sentences. Do not add facts that are not in the text. Text: "The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March. Staff will not lose their jobs: the two people who ran the desks will move to a new help point on the first floor, where they will teach visitors to use the kiosks and run weekly digital-skills classes. Borrowing limits stay at 10 books per card, and late fees remain 25 cents a day. The library says the change should cut queue times, which averaged 6 minutes on Saturdays last year, and free up about 20 staff hours a week for programmes." ``` Format rule checked by code: exactly 2 sentences. The rater was also given these facts to check against: Facts in the source: kiosks replace staffed desks on 3 March; the two desk staff keep their jobs and move to a first-floor help point; they will teach visitors and run weekly digital-skills classes; limits stay at 10 books and late fees stay at 25 cents a day; Saturday queues averaged 6 minutes last year; about 20 staff hours a week are freed for programmes. Table: Per-model summary for w12 (3 runs each) | Model | Mean rubric score (1 to 5) | Format rule passed | |---|---|---| | Llama 3.2 1B | 4.67 | 3 of 3 | | Phi-3.5 mini | 4.60 | 3 of 3 | | Llama 3.2 3B | 4.73 | 3 of 3 | | Gemma 2 2B | 4.60 | 3 of 3 | | Gemma 3 1B | 4.53 | 3 of 3 | | SmolLM2 1.7B | 4.60 | 0 of 3 | | Qwen2.5 7B | 4.60 | 3 of 3 | | Qwen2.5 3B | 4.60 | 3 of 3 | | Qwen2.5 1.5B | 4.40 | 0 of 3 | | Qwen3 0.6B (non-thinking) | 4.67 | 2 of 3 | | Qwen2.5 0.5B | 4.40 | 1 of 3 | | Falcon3 3B | 4.53 | 3 of 3 | | Granite 3.3 2B | 4.60 | 3 of 3 | | Qwen3 1.7B (non-thinking) | 4.60 | 3 of 3 | | TinyLlama 1.1B Chat | 4.47 | 0 of 3 | ## Llama 3.2 1B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 5, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks in March, with the two staff members who currently run the desks moving to a new help point on the first floor to teach visitors. Borrowing limits and late fees will remain unchanged. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on March 3. The two library staff members who currently run the desks will be relocated to a new help point, where they will teach visitors and lead digital-skills classes. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will be switching to self-service kiosks for checkout desks by March 3, with two staff members moving to a new help point on the first floor. The library claims the change will cut queue times, free up staff time, and reduce late fees by 25 cents per day. ``` ## Phi-3.5 mini: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition from staffed checkout desks to self-service kiosks on March 3, with staff reassigned to a help point and digital-skills classes. The change aims to reduce queue times and allocate approximately 20 staff hours weekly to programming. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition from staffed checkout desks to self-service kiosks on March 3rd, with affected staff reassigned to a new help point and digital-skills classes. This change aims to reduce queue times and allocate approximately 20 staff hours weekly for programming. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition from staffed checkout desks to self-service kiosks starting March 3rd, with displaced staff reassigned to a new help point and digital-skills classes. The change aims to reduce queue times and allocate roughly 20 staff hours weekly to programming. ``` ## Llama 3.2 3B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks starting March 3. The staff will be reassigned to a new help point on the first floor, where they will teach visitors to use the kiosks and run classes. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 5, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on March 3, replacing staffed checkout desks. The library staff who previously ran the desks will move to a new help point to teach visitors how to use the kiosks and run digital-skills classes. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 5, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March. Staff will not lose their jobs and will instead work at a new help point on the first floor, teaching visitors to use the kiosks and running digital-skills classes. ``` ## Gemma 2 2B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks for checkout starting March 3rd. Staff will be reassigned to a new help point to assist patrons with the new system and offer digital-skills classes. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks for checkout on March 3rd. Staff will relocate to a help point to assist patrons with the new system and offer digital-skills classes. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition from staffed checkout desks to self-service kiosks on March 3rd. This change will free up staff hours for programs and cut waiting times for patrons. ``` ## Gemma 3 1B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 2 sentences (wanted 2) ``` The Marlow Street Library is transitioning to self-service kiosks starting March 3rd, eliminating staffed checkout desks. This change will reduce wait times and free up staff time for educational programs. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will be transitioning to self-service kiosks starting March 3rd, replacing staffed checkout desks. This change will maintain borrowing limits and late fees while reducing staff workload and freeing up valuable time for library programs. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will be transitioning to self-service kiosks starting March 3rd, replacing staffed checkout desks. This change will maintain borrowing limits and late fees while freeing up staff time for digital skills instruction. ``` ## SmolLM2 1.7B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 3 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks on March 3rd, while staff will relocate to a new help point on the first floor to provide assistance with the new system. Despite the change, two staff members will retain their positions, focusing on teaching visitors and running digital-skills classes. The library aims to reduce queue times and free up staff hours for programs. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 3 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks on 3 March, with two staff members transitioning to a new help point on the first floor. Borrowing limits will remain at 10 books per card, and late fees will be 25 cents per day. The library anticipates reduced queue times and increased staff hours for programs. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 3 sentences (wanted 2) ``` The Marlow Street Library will replace staff-run checkout desks with self-service kiosks starting March 3, with two staff members transitioning to a new help point on the first floor to teach visitors and lead digital-skills classes. The borrowing limit remains at 10 items per card, and late fees remain at 25 cents per day. The change is expected to reduce queue times and free up staff time for programs. ``` ## Qwen2.5 7B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on March 3, relocating two current staff members to a new help point on the first floor to assist visitors. This change aims to reduce queue times and free up约20 staff hours weekly for programmes, while borrowing limits and late fees remain unchanged. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on 3 March, with staff redirected to a new help point on the first floor to assist visitors and teach digital skills. This change aims to reduce queue times and free up about 20 staff hours weekly for programmes, while borrowing limits and late fees remain unchanged. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks on March 3rd, with staff who previously manned the checkout desks moving to a new help point on the first floor to assist visitors and teach digital skills. This change is expected to reduce queue times and free up approximately 20 staff hours weekly for other programs. ``` ## Qwen2.5 3B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` On March 3rd, the Marlow Street Library will transition to self-service kiosks, with staff relocating to a new help point to assist patrons and teach digital skills, while borrowing limits and late fees remain unchanged. This update aims to reduce queue times and allow staff to dedicate more time to programming. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` On March 3rd, the Marlow Street Library will transition to self-service kiosks for checking out books, with staff relocating to a new help point to assist patrons and teach digital skills. Borrowing limits and late fees will remain the same, and the change is expected to reduce queue times and allow staff to focus more on programming. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` On March 3rd, the Marlow Street Library will transition to self-service kiosks for checkout operations, with staff relocating to a help point to assist visitors and teach digital skills, while borrowing limits and late fees remain unchanged. The shift aims to reduce queue times and enable staff to focus more on programming. ``` ## Qwen2.5 1.5B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 1 sentence (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks starting March 3, reducing queue times and freeing up staff hours for other programs. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 3 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on March 3rd, with two staff moving to a help point and teaching others. Borrowing limits remain the same, but late fees will increase to 25 cents a day. Queue times will be reduced and staff hours freed up for programming. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 4 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on March 3rd. Two staff members will move to a new help point and teach visitors to use the kiosks. Borrowing limits remain the same and late fees are 25 cents a day. Queue times should be cut and staff hours can be free up. ``` ## Qwen3 0.6B (non-thinking): all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 5, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on 3 March, replacing staffed checkout desks. Staff will move to a new help point on the first floor to teach visitors and run weekly digital-skills classes. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on 3 March, allowing staff to move to a new help point on the first floor, where they will teach visitors and run digital-skills classes. The library aims to reduce queue times and free up staff hours. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 4 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March, with staff not losing their jobs. The two people who ran the desks will move to a new help point on the first floor, teaching visitors and offering weekly digital-skills classes. Borrowing limits remain at 10 books per card, with late fees unchanged at 25 cents a day. The library aims to cut queue times, freeing up about 20 staff hours a week for programs. ``` ## Qwen2.5 0.5B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 1 sentence (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on March 3rd to cut queue times and free up staff hours for programmes. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on 3 March, replacing staffed checkout desks. The number of books borrowed per card will remain 10, and the late fee will be 25 cents a day. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 1 sentence (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March, with no job loss. ``` ## Falcon3 3B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 3. Format: 2 sentences (wanted 2) ``` Marlow Street Library will transition to self-service kiosks on 3 March. Staff members running the desks will be reassigned to teach kiosk usage and digital skills. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks on 3 March, with staff redeployed to teach usage and conduct skills classes. Borrowing limits and late fees remain unchanged, aiming to reduce queue times and free up staff hours for additional programs. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will transition to self-service kiosks on 3 March, with staff redeployed to a new help point on the first floor to assist with kiosk usage and digital skills training. Borrowing limits and late fees remain unchanged, while the change aims to reduce queue times and free up staff hours for additional programs. ``` ## Granite 3.3 2B: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` Marlow Street Library will implement self-service kiosks on 3 March, with staff reassigned to a new help point for kiosk guidance and digital-skills classes, ensuring no job losses. The library anticipates reduced queue times and increased staff availability for programs. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` Marlow Street Library will implement self-service kiosks on 3 March, replacing staffed checkout desks, but the two former desk staff will relocate to the first floor to assist with kiosk usage and offer digital-skills classes. Borrowing limits will remain at 10 books per card, and late fees will stay at 25 cents per day, with the change expected to reduce queue times and free up staff for additional programming. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` Marlow Street Library will transition to self-service kiosks on 3 March, replacing staffed checkout desks, while the two previous desk staff members will reassign to a new help point for kiosk usage and digital skills instruction. This change aims to reduce queue times and free up staff time for additional programs, with borrowing limits and late fees remaining unchanged at 10 books per card and 25 cents per day, respectively. ``` ## Qwen3 1.7B (non-thinking): all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March, with staff moving to a new help point to teach visitors how to use the kiosks and run digital-skills classes. Borrowing limits and late fees remain the same, and the change is expected to reduce queue times and free up staff hours for programs. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on 3 March, with staff moving to a new help point to teach visitors how to use the kiosks and run digital-skills classes. The change is expected to reduce queue times and free up 20 staff hours per week for programs. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 2 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks starting 3 March, with staff moving to a new help point to teach users how to use the kiosks and run digital-skills classes. The change aims to reduce queue times and free up staff hours for programs. ``` ## TinyLlama 1.1B Chat: all 3 outputs Run 1: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 4 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on March 3. The staff will not lose their jobs, and two people who ran the desks will move to a new help desk on the first floor to teach visitors how to use the kiosks and offer digital-skills classes. Borrowing limits remain at 10 books per card, and late fees remain at 25 cents per day. The change should cut queue times, with an average of 6 minutes on Saturday afternoons last year, and free up about 20 staff hours a week for programming. ``` Run 2: Clarity 5, Accuracy to the prompt 5, Concision 5, Tone 4, Originality 4. Format: 4 sentences (wanted 2) ``` The Marlow Street Library will switch to self-service kiosks on 3 March, with no staff lost. Two people who ran the desks will move to a new help point on the first floor, where they will teach visitors how to use the kiosks and run digital-skills classes. Borrowing limits remain at 10 books per card, and late fees remain at 25 cents per day. The library expects the switch to reduce queue times, which averaged 6 minutes on Saturday evenings last year, and to free up about 20 staff hours a week for programmes. ``` Run 3: Clarity 5, Accuracy to the prompt 5, Concision 4, Tone 4, Originality 3. Format: 4 sentences (wanted 2) ``` The Marlow Street Library will switch from staffed checkout desks to self-service kiosks on March 3, with the two people who ran the desks being relocated to a new help desk on the first floor. While they will not lose their jobs, two new staff members will be hired to teach visitors how to use the kiosks and run weekly digital-skills classes. Borrowing limits remain at 10 books per card, and late fees remain at 25 cents per day. The change aims to reduce waiting times for customers and free up about 20 staff hours a week for library programming. ``` ## Related - [Writing test hub](https://theagenticweekly.com/tests/writing) - [Writing leaderboard](https://theagenticweekly.com/tests/writing-leaderboard) - [Instruction-following test](https://theagenticweekly.com/tests/instruction-following) - [Methodology and testing rig](https://theagenticweekly.com/methodology#testing-rig) ## How to cite Agentic Weekly, "Writing prompt w12: two-sentence summary of a library notice, answered by fifteen AI models", last updated 2026-10-26, https://theagenticweekly.com/tests/writing-prompt-w12