LLMs can write and answer quizzes – but aren't quite ready to disrupt trivia night

Singapore News News

LLMs can write and answer quizzes – but aren't quite ready to disrupt trivia night
Singapore Latest News,Singapore Headlines
  • 📰 TheRegister
  • ⏱ Reading Time:
  • 63 sec. here
  • 3 min. at publisher
  • 📊 Quality Score:
  • News: 29%
  • Publisher: 61%

Feed AutoQuizzer a URL and it will use LLaMa-3 to make a decent multiple-choice test

A developer has put large language models to the test, literally, by creating AutoQuizzer – a tool that creates quizzes from text on web pages.

In our testing, it only took a second or two to create a quiz, which users can complete themselves or hand back to be answered by the AI system. When the app itself takes the quiz, you have the option to force it into a"closed book exam" mode, in which the model relies just on the page topic, the questions, and any information it was trained on to pick an answer. Alternatively, the AI can be allowed to consider the top three Google search results regarding the topic of the web page.

Other small LLMs didn't pan out."I tried Phi-3-mini by Microsoft because it has very good performance on benchmarks, despite its small size: it has fewer than 4 billion parameters. Compared to LLaMa-3, it failed to produce valid JSON, and the quiz questions sometimes were too easy or poorly created," Fiorucci said.

We did find some quirks. Some questions had duplicated or very similar answer choices, or answers that didn't completely address the question.relocation opportunities to Chinese employees prompted the AI to ask:"What is the reason for the increased tariffs on electric vehicles in China, according to the article?" The correct answer was:"Due to US President Joe Biden's decision.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

TheRegister /  🏆 67. in UK

Singapore Latest News, Singapore Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

UK inertia on LLMs and copyright is 'de facto endorsement'UK inertia on LLMs and copyright is 'de facto endorsement'Lords committee slams government response to complaints from creators
Read more »

Intel, Ampere show running LLMs on CPUs isn't as crazy as it soundsIntel, Ampere show running LLMs on CPUs isn't as crazy as it soundsIf you lower you expectations, of course. Think more Llama2-7B, less GPT-4
Read more »

Dear Stack Overflow denizens, thanks for helping train OpenAI's billion-dollar LLMsDear Stack Overflow denizens, thanks for helping train OpenAI's billion-dollar LLMsMicrosoft-backed super-lab gets access to answers – and code forum gets its own AI
Read more »

Today’s AI models are impressive. Teams of them will be formidableToday’s AI models are impressive. Teams of them will be formidableWorking together will make LLMs more capable and intelligent—for good and ill
Read more »

Meet Pi-CARD: Serving up a digital assistant on Raspberry PiMeet Pi-CARD: Serving up a digital assistant on Raspberry PiLLMs running on a dedicated card: The final frontier as hacker makes it so
Read more »

How to get fertilizer and feed animals in LEGO FortniteHow to get fertilizer and feed animals in LEGO FortniteLearn how to get fertilizer from animals in LEGO Fortnite and build farms. Fertilizers are easy to find and you will need to feed animals.
Read more »



Render Time: 2025-08-27 22:13:12