Skip to content Skip to sidebar Skip to footer

Researchers from China Propose ALCUNA: A Groundbreaking Artificial Intelligence Benchmark for Evaluating Large-Scale Language Models on New Knowledge Integration

Evaluating large-scale language models (LLMs) in handling new knowledge is challenging. Researchers from Peking University introduced KnowGen, a method to generate new knowledge by modifying existing entity attributes and relationships. A benchmark called ALCUNA assesses LLMs’ abilities in knowledge understanding and differentiation. Their study reveals that LLMs often struggle with reasoning about new versus internal…

2023-24 Takeda Fellows: Advancing research at the intersection of AI and health | MIT News

The School of Engineering has selected 13 new Takeda Fellows for the 2023-24 academic year. With support from Takeda, the graduate students will conduct pathbreaking research ranging from remote health monitoring for virtual clinical trials to ingestible devices for at-home, long-term diagnostics. Now in its fourth year, the MIT-Takeda Program, a collaboration between MIT’s School…