Anthropic, an organization that does analysis into AI security, is looking for proposals on methods to guage superior studying fashions.
The speedy progress of AI means there are new AI suppliers and fashions on a regular basis. Each main tech firm has its personal mannequin, whereas there are dozens extra smaller ones as nicely. That signifies that the trade has a rising benchmarking downside, making it robust to precisely consider how nicely an AI mannequin performs.
Not solely is it onerous to state how efficient a mannequin is, nevertheless it’s additionally onerous to guage the dangers concerned with AI security. Anthropic is looking for proposals to plug this hole in AI analysis.
“Growing high-quality, safety-relevant evaluations stays difficult, and the demand is outpacing the availability,” the corporate writes. “To handle this, in the present day we’re introducing a brand new initiative to fund evaluations developed by third-party organizations that may successfully measure superior capabilities in AI fashions.”
The primary focus of the proposals must be centered round: AI Security Degree assessments; superior functionality and security metrics; and infrastructure, instruments, and strategies for creating evaluations. There must be particulars on checks that may assess an AI mannequin’s skill to perform duties starting from cyberattacks, engaged on weapons of mass destruction, together with nuclear weapons, and creating deepfakes or misinformation).
The way to submit a proposal on AI security analysis
You’ll be able to learn extra particulars on every of the sections that Anthropic is looking for proposals on and submit a proposal on the analysis firm’s web site. The group is reviewing submissions on a rolling foundation and can comply with up with choose proposals to debate subsequent steps.
Anthropic has allotted numerous ranges of funding to assist get these analysis choices to their subsequent levels, in addition to providing the chance to speak instantly with specialists from throughout their in-house analysis and security groups.
Featured picture: Ideogram
The put up AI security and analysis firm Anthropic requires proposals to guage superior fashions appeared first on ReadWrite.
