Upgrade your membership plan for the full website experience.
View Membership Plans
July 5, 2024

Singapore Launches One of the World’s First LLM Evaluation Toolkits

atxsummit singapore
July 5, 2024

On May 31, the Singapore Ministry of Communications and Information launched the open-beta AI Verify Project Moonshot (“Project Moonshot”) during the 2024 Asia Tech x Singapore (ATxSG) conference to advance AI safety and security through providing baselines for integrated benchmarking, red teaming, and testing. As one of the world’s first large language models (LLMs) evaluation toolkits, this open-source toolkit aims to enable businesses to better assess their applications against specific benchmarks, such as understanding of local languages and cultural contexts. The tool also employs attack modules to test whether applications can be manipulated into “misbehaving,” such as producing violent content and making inappropriate statements. Project Moonshot was developed by the AI Verify Foundation and the Infocomm Media Development Authority (IMDA). They worked closely with industry partners including IBM, DataRobot, Singtel, and Temasek to ensure its alignment with industry needs. This marks a key step towards Singapore’s continued efforts to play a role in the development of global AI standards.

Join the Council to continue reading this article
Enhance your business impact in Southeast Asia: Become a member of the US-ASEAN Business Council and tap into a network of possibilities.
Free Related Articles

Membership Plans

Corporate Council

Corporate membership provides general advocacy support, access to all country- and industry-specific updates, and access to most Council events.

  • Business missions to all 10 ASEAN markets which engage governments at the highest levels.
  • Off-the-record roundtables and policy briefings with senior government leaders in ASEAN and the U.S.
  • On-the-ground support for promoting your positions/policy priorities with policy makers.
  • Industry-specific, country-specific, cross-sector and regional advocacy through committees that target their engagement based on member priorities.
  • Advocacy on your behalf in situations where your company should not be directly identified or is unable to be present.

Chairman’s Council

Corporate membership provides general advocacy support, access to all country- and industry-specific updates, and access to most Council events.

  • All Corporate benefits.
  • Assistance with resolving company-specific trade or investment issues through our six regional offices and U.S.-based staff.
  • Develop effective advocacy strategies to impact policy concerns.
  • Identification of, and engagement with appropriate policy influencers to impact policy concerns.
  • Assistance in conducting follow-up after engaging government leaders (can include providing officials with additional materials, setting up meetings with their staff, getting a readout of the government’s reaction to the discussion).
  • Support for developing arguments that will resonate with target stakeholders.
  • Leading and setting the agenda and policy priorities of the Country and Industry Committees.