英偉達推出“護欄”軟件以防止AI模型失控
英偉達(NVDA.US)的強大芯片爲人工智能(AI)的繁榮奠定了基礎。然而,隨着ChatGPT等生成式AI的出現,越來越多用戶在享受便利的同時發現,AI模型有時會出現“幻覺”,即說出錯誤的事實、涉及有害的話題或導致安全風險。智通財經APP獲悉,爲了解決這一問題,英偉達在週二發佈了一款名爲NeMo Guardrails的新軟件,該軟件能夠爲AI模型設置安全“護欄”,避免AI輸出一些不良的內容。
資料顯示,NeMo Guardrails是一個軟件層,位於用戶和AI模型之間,可以在模型輸出不良內容之前進行攔截和修改。例如,如果用戶需要一個針對特定方向的AI,就可以利用該軟件來限制AI至輸出對應方面的內容,而不談論不相關的話題。
此外,該軟件還能夠利用一個AI模型檢測另一個AI模型,如果兩個模型輸出的答案不一致,軟件將直接輸出“我不知道”的回答。通過這種方式,人工智能“胡說八道”的情況會得到有效降低,一些可能存在危險的回覆也能夠被直接攔截。
英偉達應用研究副總裁Jonathan Cohen表示:“每個人都意識到生成式大語言模型的力量,以一種安全可靠的方式部署它們非常重要。”英偉達將NeMo Guardrails作爲開源軟件提供,並將持續對其進行更新。
Follow us
Find us on
Facebook,
Twitter ,
Instagram, and
YouTube or frequent updates on all things investing.Have a financial topic you would like to discuss? Head over to the
uSMART Community to share your thoughts and insights about the market! Click the picture below to download and explore uSMART app!

Disclaimers
uSmart Securities Limited (“uSmart”) is based on its internal research and public third party information in preparation of this article. Although uSmart uses its best endeavours to ensure the content of this article is accurate, uSmart does not guarantee the accuracy, timeliness or completeness of the information of this article and is not responsible for any views/opinions/comments in this article. Opinions, forecasts and estimations reflect uSmart’s assessment as of the date of this article and are subject to change. uSmart has no obligation to notify you or anyone of any such changes. You must make independent analysis and judgment on any matters involved in this article. uSmart and any directors, officers, employees or agents of uSmart will not be liable for any loss or damage suffered by any person in reliance on any representation or omission in the content of this article. The content of the article is for reference only and does not constitute any offer, solicitation, recommendation, opinion or guarantee of any securities, virtual assets, financial products or instruments. Regulatory authorities may restrict the trading of virtual asset-related ETFs to only investors who meet specified requirements. Any calculations or images in the article are for illustrative purposes only.
Investment involves risks and the value and income from securities may rise or fall. Past performance is not indicative of future performance. Please carefully consider your personal risk tolerance, and consult independent professional advice if necessary.