18 Apr 2024

Measurement problem in AI

There are significant challenges in accurately measuring the capabilities and risks of artificial intelligence models. The current methods of A.I. assessment, are problematic due to inconsistencies in testing methods and the inclusion of test content in A.I. training data. This results in unreliable measurements that can neither be compared effectively across different models nor provide a true indication of an A.I. system's abilities or safety. The lack of standardized testing and independent auditing means companies are essentially self-evaluating, which can lead to biased assertions of performance and safety. Researchers and government entities are urged to develop new, rigorous ways to assess A.I., as the technology's influence and integration in society grow. Source: https://www.nytimes.com/2024/04/15/technology/ai-models-measurement.html


This marketing document has been issued by Bank Syz Ltd. It is not intended for distribution to, publication, provision or use by individuals or legal entities that are citizens of or reside in a state, country or jurisdiction in which applicable laws and regulations prohibit its distribution, publication, provision or use. It is not directed to any person or entity to whom it would be illegal to send such marketing material. This document is intended for informational purposes only and should not be construed as an offer, solicitation or recommendation for the subscription, purchase, sale or safekeeping of any security or financial instrument or for the engagement in any other transaction, as the provision of any investment advice or service, or as a contractual document. Nothing in this document constitutes an investment, legal, tax or accounting advice or a representation that any investment or strategy is suitable or appropriate for an investor's particular and individual circumstances, nor does it constitute a personalized investment advice for any investor. This document reflects the information, opinions and comments of Bank Syz Ltd. as of the date of its publication, which are subject to change without notice. The opinions and comments of the authors in this document reflect their current views and may not coincide with those of other Syz Group entities or third parties, which may have reached different conclusions. The market valuations, terms and calculations contained herein are estimates only. The information provided comes from sources deemed reliable, but Bank Syz Ltd. does not guarantee its completeness, accuracy, reliability and actuality. Past performance gives no indication of nor guarantees current or future results. Bank Syz Ltd. accepts no liability for any loss arising from the use of this document.

Read More

Investing with intelligence

Our latest research, commentary and market outlooks