You are browsing the Hong Kong website, Regulated by Hong Kong SFC (CE number: BJA907). Investment is risky and you must be cautious when entering the market.
螞蟻集團自研GMLake被PyTorch集成 可提升33%GPU可用顯存
阿思達克 01-17 10:00
內媒報道,近日螞蟻集團向自研的GPU顯存+傳輸優化開源項目GLake上集成一種高效的動態顯存組合技術框架——GMLake,同時宣布GMLake已被深度學習主流框架PyTorch集成,對上層模型代碼和框架代碼完全透明,模型不需要修改任何代碼即可使用。 據悉,GMLake能夠在大模型訓練、推理框架底層以及系統層對顯存和傳輸進行一體優化,將碎片化的顯存靈活拼接,最高提高33%的GPU可用顯存,使顯存使用更為高效。 運用GMLake對典型大模型如GPT、GLM、Vicuna等進行詳細評測,最高擴大約33%的可用顯存,即在80GB的A100 GPU上節省約25GB的顯存,訓練吞吐提高最多4倍。
Follow us
Find us on Facebook, Twitter , Instagram, and YouTube or frequent updates on all things investing.Have a financial topic you would like to discuss? Head over to the uSMART Community to share your thoughts and insights about the market! Click the picture below to download and explore uSMART app!
Disclaimers
uSmart Securities Limited (“uSmart”) is based on its internal research and public third party information in preparation of this article. Although uSmart uses its best endeavours to ensure the content of this article is accurate, uSmart does not guarantee the accuracy, timeliness or completeness of the information of this article and is not responsible for any views/opinions/comments in this article. Opinions, forecasts and estimations reflect uSmart’s assessment as of the date of this article and are subject to change. uSmart has no obligation to notify you or anyone of any such changes. You must make independent analysis and judgment on any matters involved in this article. uSmart and any directors, officers, employees or agents of uSmart will not be liable for any loss or damage suffered by any person in reliance on any representation or omission in the content of this article. The content of the article is for reference only and does not constitute any offer, solicitation, recommendation, opinion or guarantee of any securities, virtual assets, financial products or instruments. Regulatory authorities may restrict the trading of virtual asset-related ETFs to only investors who meet specified requirements. Any calculations or images in the article are for illustrative purposes only.
Investment involves risks and the value and income from securities may rise or fall. Past performance is not indicative of future performance. Please carefully consider your personal risk tolerance, and consult independent professional advice if necessary.
uSMART
Wealth Growth Made Easy
Open Account