{"id":804,"date":"2023-12-19T08:20:00","date_gmt":"2023-12-19T08:20:00","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2023\/12\/19\/unveiling-salesforces-blueprint-for-sustainable-ai-where-responsibility-meets-innovation\/"},"modified":"2023-12-19T08:20:00","modified_gmt":"2023-12-19T08:20:00","slug":"unveiling-salesforces-blueprint-for-sustainable-ai-where-responsibility-meets-innovation","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2023\/12\/19\/unveiling-salesforces-blueprint-for-sustainable-ai-where-responsibility-meets-innovation\/","title":{"rendered":"Unveiling Salesforce\u2019s Blueprint for Sustainable AI: Where Responsibility Meets Innovation"},"content":{"rendered":"

Salesforce is guided by its core values<\/a> of trust, customer success, innovation, equality, and sustainability. These values are reflected in its commitment to responsibly develop<\/a> and deploy new technologies like generative AI on behalf of stakeholders<\/a> \u2014 from shareholders to customers to the planet.<\/p>\n

The Large Language Models (LLMs) that power generative AI require enormous compute resources<\/a> to function, resulting in negative environmental impacts like carbon emissions, water depletion, and resource extraction within the supply chain. As the world sets \u201cemissions and temperature records, which intensify extreme weather events and other climate impacts<\/a> across the globe,\u201d the need to reduce planet warming emissions has never been more dire. At a time when every additional ton of carbon emitted matters, the development of AI technologies should not exceed planetary boundaries<\/a>.<\/p>\n

While the hypothetical long-term sustainability benefits of AI are significant, with the potential to reduce global emissions 5 to 10% by 2030<\/a>, Salesforce also remains focused on minimizing environmental impacts in the short term.<\/p>\n

Boris shares his view on sustainability and explains his sustainability role at Salesforce.<\/em><\/p>\n

Read on to learn about Salesforce\u2019s strategies for creating sustainable AI, developed as a collaboration between the AI Research, Sustainability, and Office of Ethical and Humane Use teams.<\/p>\n

Optimizing models<\/h4>\n

The energy needed to train a model depends on the number of its parameters and the size of the training data. For the last few years, the trend has been to significantly increase both factors, resulting in exponential growth (750x growth every 2 years) in energy requirements for transformers, the leading LLM architecture. In fact, this trend seems to be dwarfing Moore\u2019s Law<\/a>, suggesting that hardware efficiency improvements alone won\u2019t keep up with increased computational demand.<\/p>\n

The amount of compute needed to train various models as compared to Moore\u2019s Law. <\/em>Source: Amir Gholami<\/em><\/a><\/p>\n

Though there has been a trend toward large, general-purpose models, is it really necessary to write code with the same model that can create Shakespearean sonnets? Salesforce AI Research<\/a> remains focused on developing domain-specific models, customized to their intended applications.<\/p>\n

For example, the team\u2019s CodeGen<\/a> model, initially released in 2022, was one of the first LLMs to allow users to \u201ctranslate\u201d natural language, such as English, into programming languages, such as Python. The latest version \u2013 CodeGen 2.5<\/a> \u2013 has been optimized for efficiency through multi-epoch training<\/a> and flash attention<\/a>. The result is a model that performs as well as<\/a> larger models at less than half the size<\/strong>. Besides being more sustainable, the team learned that smaller models are more cost effective, easier to fine-tune, and operate faster, improving the user experience.<\/p>\n

Utilizing efficient hardware<\/h4>\n

Once the model has been optimized, it\u2019s important to choose efficient hardware to train and deploy AI. AI hardware manufacturers frequently unveil new versions with substantial efficiency enhancements. Google\u2019s AI hardware, the Tensor Processor Unit (TPU)<\/a>, has become more efficient with each new generation, and Salesforce AI Research has leveraged these advancements for sustainability. The team\u2019s more recent models are trained on TPU v4, while some older models were trained on TPU v3. Google estimates that the newer TPU v4 is 2.7x more efficient<\/a> and the team\u2019s calculations have confirmed this claim, noting a 2.8x efficiency increase<\/strong> (measured by averaging the model parameters per training energy consumed). Furthermore, our initial tests have found that the brand new \u201cTPU v5p outperforms the previous generation TPU v4 by as much as 2x<\/a>\u201d.<\/p>\n

These efficiency increases are expected to continue. For example, Nvidia claims<\/a> that their forthcoming H200 GPUs will achieve 18x the performance of the A100 GPUs that are widely used today.<\/p>\n

Beyond the GPU\/TPU hardware specialized for AI, there is also progress in deploying AI on more traditional CPUs, found on consumer-grade computers. CodeGen 2.5 can be locally deployed<\/a> today, leading to decreased energy use, increased speed, enhanced security, and personalization.<\/p>\n

Prioritizing low-carbon data centers<\/h4>\n

Data centers\u2019 emissions vary widely as they are powered by local electric grids. Depending on the grids\u2019 reliance on fossil fuels, their carbon intensity can vary dramatically region by region (see graphic below).<\/p>\n

The varying carbon intensity of the world\u2019s electric grids (source: <\/em>electricitymaps.com<\/em><\/a>)<\/em><\/p>\n

With this in mind, it\u2019s important to be cognizant of what data centers are used to train and deploy AI. As a result of the AI Research team training its models in lower carbon data centers, Salesforce has reduced emissions by 68.8%1<\/strong> , avoiding 105 tons of carbon dioxide equivalents (tCO<\/strong><\/strong>2<\/strong>e)<\/strong> compared to the global average.<\/p>\n

Beyond AI model development: Sustainable AI techniques<\/h4>\n

The team\u2019s AI sustainability approach doesn\u2019t end with the development and deployment of models. As with all Salesforce products, they work to ensure that its products are designed with sustainability<\/a> at their core, from the architecture to the UX. For instance, when multiple AI models are available, we default to the most efficient and appropriate option for each use case.<\/p>\n

Additionally, prompt engineering techniques built into Prompt Builder<\/a> optimize customer satisfaction, cost, and environmental sustainability, ensuring our AI systems deliver top results with minimal resource usage. By caching both prompts and outputs to store and reuse responses for common queries, the team significantly cuts down on repetitive computations, speeding up response times and energy consumption. The team also incorporates mechanisms like usage tracking and rate limits into its Einstein 1 Platform<\/a> built on Hyperforce<\/a>, promoting mindful, responsible, and secure use of our AI systems.<\/p>\n

Measuring impact<\/h4>\n

Incorporating these strategies into the AI Research team\u2019s development approach has resulted in significantly lower-carbon AI models. To understand these impacts, the team calculated the energy and carbon emissions of model pre-training, by the far the most impactful AI model lifecycle stage:<\/p>\n

Salesforce AI Model Pre-Training Environmental Impacts<\/strong><\/p>\n

In aggregate, pre-training these models resulted in 48 tCO<\/strong><\/strong>2<\/strong>e<\/strong>: 11 times less than the emissions of GPT-3<\/a>. Beyond the training phase, the ongoing usage impact of our models has been disclosed in the Hugging Face<\/a> and ML.Energy<\/a> leaderboards.<\/p>\n

The team believes that transparency is key to Trusted AI<\/a> and remains dedicated to sharing its environmental impacts and lessons learned, hoping to see other actors in the AI ecosystem follow suit. To follow along as we progress on this journey, check out AI Research updates<\/a> and explore the models on Hugging Face<\/a> and GitHub<\/a>.<\/p>\n

A holistic approach to sustainability<\/h4>\n

Salesforce\u2019s commitment to sustainability is not just about reducing impact; it\u2019s about leveraging AI to create tangible environmental benefits. Innovations in AI are enhancing ESG reporting<\/a> within our Net Zero Cloud<\/a>, illustrating the growing intersection between technology and corporate sustainability. CodeGen, which powers Einstein for Developers<\/a> and Einstein for Flow<\/a>, enhances code efficiency, with third-party research indicating a 2.5x improvement<\/a>. This enhanced efficiency extends to Salesforce\u2019s customers as well, with AI-powered tools enabling them to analyze and automatically reduce the carbon emissions of their Apex code.<\/p>\n

Additionally, environment is a key focus area<\/a> for the AI Research team. They are pioneering AI for Global Climate Cooperation<\/a>, using AI to craft negotiation protocols and climate agreements that could shape future environmental policies. Also, its ProGen<\/a> AI language model, designed to generate new artificial proteins, is making strides in the development of compostable materials from carrot starches. Another notable project is SharkEye<\/a>, which employs AI to detect great white sharks, contributing to a vital database for scientists, conservationists, and local communities.<\/p>\n

\n

Learn more<\/h3>\n

Check out this blog<\/a> to dive deeper into how Salesforce responsibly develops AI.<\/p>\n

Stay connected \u2014 join our Talent Community<\/a>!<\/p>\n

Check out our Technology and Product teams<\/a> to learn how you can get involved.<\/p>\n<\/div>\n

___________________________________<\/p>\n

1 Salesforce model pre-training weighted aggregate carbon factor is 136 gCO2e\/kWh. 68.8% reduction is compared to the 436 gCO2e\/kWh global average (source<\/a>). 105 tCO2e avoidance is compared to the global average.
2 Energy is calculated by multiplying Training Time, processor TDP (used for conservative assumption, provided by processor manufacturer), and data center PUE (provided by data center owner).
3 Carbon is calculated by multiplying energy by electric grid carbon intensity (provided by data center owner).
4 Carbon emissions due to electricity only. While embodied carbon data is not currently provided by manufacturers, we hope to expand the calculation scope in the future.
5 Through a combination of renewable energy procurement and high-quality carbon credits, all residual emissions are entirely offset by Salesforce and\/or our suppliers.<\/p>\n

The post Unveiling Salesforce\u2019s Blueprint for Sustainable AI: Where Responsibility Meets Innovation<\/a> appeared first on Salesforce Engineering Blog<\/a>.<\/p>\n

Read More<\/a><\/p>","protected":false},"excerpt":{"rendered":"

Salesforce is guided by its core values of trust, customer success, innovation, equality, and sustainability. These values are reflected in its commitment to responsibly develop and deploy new technologies like generative AI on behalf of stakeholders \u2014 from shareholders to customers to the planet. The Large Language Models (LLMs) that power generative AI require enormous… Continue reading Unveiling Salesforce\u2019s Blueprint for Sustainable AI: Where Responsibility Meets Innovation<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[7],"tags":[],"class_list":["post-804","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":785,"url":"https:\/\/fde.cat\/index.php\/2023\/11\/07\/einstein-for-flow-bringing-ai-innovation-to-the-next-generation-of-automation\/","url_meta":{"origin":804,"position":0},"title":"Einstein for Flow: Bringing AI Innovation to the Next Generation of Automation","date":"November 7, 2023","format":false,"excerpt":"By Vera Vetter, Zeyuan Chen, Ran Xu, and Scott Nyberg In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional journeys that have shaped Salesforce Engineering leaders. Meet Vera Vetter, Product Management Director for Salesforce AI Research and a co-Product Manager for Einstein for Flow, a game-changing AI product that\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":870,"url":"https:\/\/fde.cat\/index.php\/2024\/05\/23\/hyperforce-behind-the-scenes-ushering-in-a-new-age-of-ai-driven-cloud-scalability\/","url_meta":{"origin":804,"position":1},"title":"Hyperforce Behind the Scenes: Ushering in a New Age of AI-Driven Cloud Scalability","date":"May 23, 2024","format":false,"excerpt":"In our latest edition of our \u201cEngineering Energizers\u201d Q&A series, we meet Paul Constantinides, Executive Vice President of Engineering. With an extensive history in the technology industry, and a 20-year career at Salesforce, Paul leads the Hyperforce Platform Services team and is responsible for developing Hyperforce, Salesforce\u2019s public cloud-native architecture\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":724,"url":"https:\/\/fde.cat\/index.php\/2023\/06\/12\/ai-data-crm-chief-engineering-officers-innovative-insights-for-a-competitive-edge\/","url_meta":{"origin":804,"position":2},"title":"AI + Data + CRM: Chief Engineering Officer\u2019s Innovative Insights for a Competitive Edge","date":"June 12, 2023","format":false,"excerpt":"Written by Srini Tallapragada and Dylan DeSimone In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. In this special edition, we meet Srini Tallapragada, President and Chief Engineering Officer for Salesforce. In his role, Srini leads the global engineering team to\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":878,"url":"https:\/\/fde.cat\/index.php\/2024\/06\/12\/maintaining-large-scale-ai-capacity-at-meta\/","url_meta":{"origin":804,"position":3},"title":"Maintaining large-scale AI capacity at Meta","date":"June 12, 2024","format":false,"excerpt":"Meta is currently operating many data centers with GPU training clusters across the world. Our data centers are the backbone of our operations, meticulously designed to support the scaling demands of compute and storage. A year ago, however, as the industry reached a critical inflection point due to the rise\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":866,"url":"https:\/\/fde.cat\/index.php\/2024\/05\/15\/revealing-einsteins-blueprint-for-creating-the-new-unified-ai-platform-from-siloed-legacy-stacks\/","url_meta":{"origin":804,"position":4},"title":"Revealing Einstein\u2019s Blueprint for Creating the New, Unified AI Platform from Siloed Legacy Stacks","date":"May 15, 2024","format":false,"excerpt":"In our insightful \u201cEngineering Energizers\u201d Q&A series, we delve into the inspiring journeys of engineering leaders who have achieved remarkable success in their specific domains. Today, we meet Indira Iyer, Senior Vice President of Salesforce Engineering, leading Salesforce Einstein development. Her team\u2019s mission is to build Salesforce\u2019s next-gen AI Platform,\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":789,"url":"https:\/\/fde.cat\/index.php\/2023\/10\/17\/how-the-einstein-team-operationalizes-ai-models-at-lightning-speed-and-massive-scale-2\/","url_meta":{"origin":804,"position":5},"title":"How the Einstein Team Operationalizes AI Models at Lightning Speed and Massive Scale","date":"October 17, 2023","format":false,"excerpt":"By Yuliya Feldman and Scott Nyberg In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. Meet Yuliya Feldman, a Software Engineering Architect at Salesforce. Yuliya works on Salesforce Einstein\u2019s Machine Learning Services team, responsible for operationalizing AI models, which serve as\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/804","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=804"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/804\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=804"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=804"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=804"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}