In a statement, IMDA and AI Verify Foundation said the initiative also showed that human experts were essential at every stage of testing, from designing the right tests to interpreting test results.
While the technology may improve in the future, a human touch is still needed for now, said Mr Shameek.
“The technology is not good enough for us to blindly trust and say it’s working,” he said.
A report detailing the findings is available on AI Verify Foundation’s website.
In line with the pilot, a testing starter kit for Gen AI applications has also been developed, serving as a set of voluntary guidelines for businesses that want to responsibly adopt Gen AI.
“It draws on insights from the Global AI Assurance Pilot, tapping the experience of practitioners to ensure the guidance is practical and useful,” said Mr Tan.
He added that the kit includes emerging best practices and methodologies for testing Gen AI applications, as well as practical guidance on how to conduct such testing.
The guidelines will be complemented by testing tools to help developers conduct these tests, which will be made progressively available via IMDA and AI Verify Foundation’s Project Moonshot, a toolkit targeted at AI app developers.
IMDA is conducting a four-week public consultation on the starter kit, which can be found online. The consultation will end on 25 June. Feedback can be emailed to aigov@imda.gov.sg with the e-mail header “Comments on the draft Starter Kit for Safety Testing of LLM-Based Applications”.
Mr Tan also announced that AI Singapore (AISG) – a national initiative to build the Republic’s capabilities in AI – will sign a memorandum of understanding with the United Nations Development Programme (UNDP) to advance AI literacy in developing countries.
This partnership will see AISG’s AI for Good programme, launched in 2024 to bolster national AI capabilities, expand to an international scale, he said.
“AISG and UNDP will explore initial AI for Good pilots in Southeast Asia, the Caribbean and the Pacific Islands, so that we can support more inclusive participation in AI-driven growth together,” he added.
Source: The Straits Times © SPH Media Limited. Permission required for reproduction.