{"id":813,"date":"2024-01-16T17:43:40","date_gmt":"2024-01-16T17:43:40","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2024\/01\/16\/inside-ai-research-conquering-complex-challenges-to-power-next-generation-innovations\/"},"modified":"2024-01-16T17:43:40","modified_gmt":"2024-01-16T17:43:40","slug":"inside-ai-research-conquering-complex-challenges-to-power-next-generation-innovations","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2024\/01\/16\/inside-ai-research-conquering-complex-challenges-to-power-next-generation-innovations\/","title":{"rendered":"Inside AI Research: Conquering Complex Challenges to Power Next Generation Innovations"},"content":{"rendered":"

By Yingbo Zhou and Scott Nyberg<\/em><\/p>\n

In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. Meet Yingbo Zhou, a Senior Director of Research for Salesforce AI Research<\/a>, where he leads his team to advance AI \u2014 focusing on the fields of natural language processing and software intelligence.<\/p>\n

Read on to learn the risks his team faces in engineering new AI solutions, their biggest technical challenge, how Yingbo drives scale for his team and much more\u2026<\/p>\n

What is your AI team\u2019s mission?<\/strong><\/p>\n

Our team has two primary areas of focus: natural language processing and software intelligence. Both areas aim to aggregate efficient and effective representations from data to improve performance across various tasks. Our ultimate goal is to advance the state of the art in these areas and democratize AI, making it accessible and beneficial to everyone.<\/p>\n

My team built and open-sourced the CodeGen<\/a> large language model (LLM), which serves as the backbone for Einstein for Developers<\/a>. We also collaborated with other teams to bring Salesforce\u2019s foundational LLM \u2014 XGen<\/a> to life.<\/p>\n

Yingbo dives deeper into his team.<\/em><\/p>\n

What risks does your team face in engineering AI solutions?<\/strong><\/p>\n

One risk is the generation of incorrect or misleading information by LLMs. To address this, we employ modeling techniques and focus on grounded generation, providing the model with background information to support its responses. This reduces the likelihood of generating misleading content.<\/p>\n

We also prioritize reliability by collaborating closely with product teams, gathering user feedback, and improving data collection to train models on relevant information.<\/p>\n

Additionally, we guard against over-engineering, which creates unnecessary complexity in product design instead of focusing on users\u2019 needs. This is achieved by aligning our approach with customer needs and priorities through customer feedback sessions and user studies.<\/p>\n

What was the biggest technical challenge your team has faced and how did they overcome it?<\/strong><\/p>\n

One of the biggest technical challenges we faced was with our incubation project, CodeGenie \u2014 an autocompletion tool to improve internal developer productivity. Initially, the product appeared fine from a development perspective, but user feedback was disappointing as users were not very satisfied with the suggestions that the product provided.<\/p>\n

To overcome this challenge, we partnered closely with other teams inside Salesforce and gathered detailed feedback. This collaboration helped us identify areas for improvement in both modeling and user experience. We also partnered with an engineering team to enhance the product engineering, which helped our team to focus on improving the model\u2019s performance. Last but not least, we received assistance from user experience researchers who conducted more user interviews, which delivered insights on how customers used the tool and their pain points.<\/p>\n

After a year of dedicated effort, we have seen significant improvements, in terms of product output quality measured in terms of product metrics and adoption. This experience taught us the importance of collaboration, user-centric design, and continuous iteration to overcome technical challenges and deliver a better product.<\/p>\n

A look at CodeGenie.<\/em><\/p>\n

How does your team address AI issues such as noisy user data feedback?<\/strong><\/p>\n

My team understands that users\u2019 roles and preferences can change over time, making it challenging to draw meaningful conclusions in a short amount of time. In other words, using raw user feedback data to iterate on product design is a slow process. To address this, we have constructed a benchmark that closely resembles the targeted use case to allow faster product iteration.<\/p>\n

By leveraging this benchmark, we can overcome the noise in user data and make informed improvements fast. This approach, combined with our ongoing collaboration with other teams and our commitment to academic rigor, helps us navigate challenges and make progress in our AI research and product development journey.<\/p>\n

How do you drive scale for your AI team?<\/strong><\/p>\n

To drive scale, we focus on automating repetitive tasks or processes \u2014 significantly reducing development time and increasing efficiency. For example, we automate tasks like data preprocessing, which saves time and ensures consistency.<\/p>\n

We are also automating the model evaluation process, enabling non-technical stakeholders to explore and interact with our models easily. This bridges the communication gap and enables others to understand and utilize our work more effectively.<\/p>\n

Additionally, we create common repositories within our team, such as libraries and documentation, to leverage existing work, drive cross-project collaboration, and accelerate development.<\/p>\n

Lastly, we have regular team meetings where we share our progress and insights. These meetings foster an open and collaborative environment, maximizing productivity and leveraging collective knowledge and resources.<\/p>\n

Yingbo shares why his role excites him.<\/em><\/p>\n

What have you learned about leadership since joining Salesforce?<\/strong><\/p>\n

Initially, I viewed leadership as primarily managing people and tasks. However, I have learned it is more than that \u2014 it is about treating team members as unique individuals, valuing their contributions, believing in their abilities, and building trust to create a meaningful work environment.<\/p>\n

Ultimately, the most significant learning that I have is the importance of empowering people to do their best work and helping them overcome any challenges they may face.<\/p>\n

\n

Learn more<\/strong><\/p>\n

Hungry for more AI stories? Read this blog<\/a> to learn how Salesforce\u2019s AI Research team built XGen, a series of groundbreaking LLMs of different sizes that support distinct use cases, spanning sales, service, and more.<\/p>\n

Stay connected \u2014 join our Talent Community<\/a>!<\/p>\n

Check out our Technology and Product teams<\/a> to learn how you can get involved.<\/p>\n<\/div>\n

The post Inside AI Research: Conquering Complex Challenges to Power Next Generation Innovations<\/a> appeared first on Salesforce Engineering Blog<\/a>.<\/p>\n

Read More<\/a><\/p>","protected":false},"excerpt":{"rendered":"

By Yingbo Zhou and Scott Nyberg In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. Meet Yingbo Zhou, a Senior Director of Research for Salesforce AI Research, where he leads his team to advance AI \u2014 focusing on the fields of natural language processing and software… Continue reading Inside AI Research: Conquering Complex Challenges to Power Next Generation Innovations<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[7],"tags":[],"class_list":["post-813","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":751,"url":"https:\/\/fde.cat\/index.php\/2023\/08\/22\/how-is-einstein-gpt-shaping-the-future-of-salesforce-development-and-unleashing-developer-productivity\/","url_meta":{"origin":813,"position":0},"title":"How is Einstein GPT Shaping the Future of Salesforce Development and Unleashing Developer Productivity?","date":"August 22, 2023","format":false,"excerpt":"By Yingbo Zhou and Scott Nyberg In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. Meet Yingbo Zhou, a Senior Director of Research for Salesforce AI Research, where he leads the team to develop the model for Einstein GPT for Developers\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":791,"url":"https:\/\/fde.cat\/index.php\/2023\/08\/22\/how-is-einstein-shaping-the-future-of-salesforce-development-and-unleashing-developer-productivity\/","url_meta":{"origin":813,"position":1},"title":"How is Einstein Shaping the Future of Salesforce Development and Unleashing Developer Productivity?","date":"August 22, 2023","format":false,"excerpt":"By Yingbo Zhou and Scott Nyberg In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. Meet Yingbo Zhou, a Senior Director of Research for Salesforce AI Research, where he leads the team to develop the model for Einstein for Developers, a\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":856,"url":"https:\/\/fde.cat\/index.php\/2024\/04\/18\/in-their-own-words-15-salesforce-engineering-innovators-discuss-the-art-of-problem-solving\/","url_meta":{"origin":813,"position":2},"title":"In Their Own Words: 15 Salesforce Engineering Innovators Discuss the Art of Problem Solving","date":"April 18, 2024","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d series, we explore the problem-solving skills of engineering leaders. In this special edition, we caught up with some of the brightest minds from Salesforce Engineering across India, Argentina, and the U.S, and met a few new innovators who the Engineering Blog will feature soon. Join us\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":283,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/ai-research-to-production-with-einstein-reply-recommendations\/","url_meta":{"origin":813,"position":3},"title":"AI Research to Production with Einstein Reply Recommendations","date":"August 31, 2021","format":false,"excerpt":"We all know that AI is here and it\u2019s quickly changing our lives. However, the impacts of AI are unevenly distributed and it favors those with \u201cmore data,\u201d leaving those with \u201cfew data\u201d behind. This runs counter to our Salesforce core values of Customer Success and Equality, so we set\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":700,"url":"https:\/\/fde.cat\/index.php\/2023\/04\/11\/3-ways-salesforce-takes-ai-research-to-the-next-level\/","url_meta":{"origin":813,"position":4},"title":"3 Ways Salesforce Takes AI Research to the Next Level","date":"April 11, 2023","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d Q&A series, we examine the life experiences and career paths that have shaped Salesforce engineering leaders. Meet Shelby Heinecke, a research manager for the Salesforce AI team. Shelby leads her diverse team on a variety of projects, ranging from identity resolution to recommendation systems to conversational\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":461,"url":"https:\/\/fde.cat\/index.php\/2021\/09\/08\/building-a-language-agnostic-neural-machine-translation-system\/","url_meta":{"origin":813,"position":5},"title":"Building a Language-Agnostic Neural Machine Translation System","date":"September 8, 2021","format":false,"excerpt":"Why Machine Translation At Salesforce, our goal in introducing machine translation was to increase scalability and better serve our international customers. Advantages include: Innovating and acquiring know-how internallyReducing translation time by enhancing translators\u2019 productivityIncreasing content freshness by publishing more frequent\u00a0updatesReinvesting savings into high-value content and\u00a0products When we explored commercially available\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/813","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=813"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/813\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=813"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=813"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=813"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}