{"id":692,"date":"2023-03-22T00:21:49","date_gmt":"2023-03-22T00:21:49","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2023\/03\/22\/how-is-indias-brilliant-big-data-processing-team-engineering-salesforce-data-cloud\/"},"modified":"2023-03-22T00:21:49","modified_gmt":"2023-03-22T00:21:49","slug":"how-is-indias-brilliant-big-data-processing-team-engineering-salesforce-data-cloud","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2023\/03\/22\/how-is-indias-brilliant-big-data-processing-team-engineering-salesforce-data-cloud\/","title":{"rendered":"How is India\u2019s Brilliant Big Data Processing Team Engineering Salesforce Data Cloud?"},"content":{"rendered":"

In our \u201cEngineering Energizers\u201d Q&A series, we examine the life experiences and career paths that have shaped Salesforce engineering leaders. Meet Archana Kumari, one of Salesforce\u2019s first India-based woman engineering leaders. In her role, Archana leads Salesforce India\u2019s Data Cloud big data processing compute layer team \u2014<\/em> charged with providing the tremendous processing power that supports 6.3 million Data Cloud<\/a>-related tasks per month (and growing).<\/p>\n

What would people be surprised to learn about your team in India?<\/strong><\/p>\n

I lead a team of problem solvers, who happen to be engineers. No matter the assignment, they are very passionate about solving problems and always perform at a very high level. For example, about a year and a half ago, they tackled a highly complex big data processing task, charged to orchestrate the migration of nearly 50 terabytes customer data from Salesforce Datoroma to Salesforce Data Cloud\u2019s data lake \u2014<\/em> a storage layer that houses customer data. This is the bottom-most layer of Data Cloud, a next-generation platform that harmonizes customer data in real time.<\/p>\n

The data migration effort was key to Data Cloud\u2019s launch success \u2014 <\/em>ensuring every customer component transferred over and functioned properly following the move. To achieve this, the team built a robust, resilient and performant big data processing compute system, in concert with understanding the whole ecosystem and coordinating across more than 20 teams \u2014<\/em> catering to different use cases, resolving ambiguities and keeping everyone on the same page.<\/p>\n

Operating under a strict deadline, the team only had a few months to build the migration orchestration which could facilitate data migration. That proved difficult because the team had no prior experience in big data processing and had just joined Salesforce.<\/p>\n

By selecting the correct compute and choosing the optimum orchestration tool that supported data migration at massive scale, the team radically reduced their learning curve and produced results much faster than anyone anticipated. So, they are very special engineers.<\/p>\n

The team currently remains laser-focused on managing Data Cloud<\/a>\u2019s tier-zero layer, also known as a compute layer, that provides the necessary on-demand big data capabilities and infrastructures to address various compute needs of internal Salesforce Data Cloud teams. This involves data ingestion, processing, massaging, and interpretation \u2014<\/em> enabling information to be segmented and activated for our customers. This layer is the heart of Data Cloud.<\/p>\n

The compute layer team is responsible for multiple big data processing tasks, ranging from connection to activation.<\/em><\/p>\n

How would you describe the engineering culture in India at Salesforce?<\/strong><\/p>\n

Our culture really embraces diversity and our value of equality. During my days being a developer at previous companies, I always wanted to work in a diverse environment, which was missing.<\/p>\n

It is different at Salesforce. My team has great gender diversity \u2014<\/em> 40% of our teammates are women. And as an interesting aside, I was one of the first female senior engineering managers hired in India.<\/p>\n

My team spans regions across India \u2014<\/em> each with its own unique culture. We respect everyone\u2019s traditions, which creates a sense of belongingness where we are all part of the same family and stand up for each other.<\/p>\n

Additionally, everyone is equally empowered to express their diverse opinion without a fear of being judged. People come from diverse backgrounds, which delivers different perspectives, thoughts, ideas, and creative inputs. Our team understands this well, respects every individual, and makes them feel included.<\/p>\n

What have you learned about leadership since joining Salesforce?<\/strong><\/p>\n

At my previous company, as a leader, I provided solutions to team members who struggled. Here at Salesforce, I have learned to pivot, refraining from simply giving a solution. Instead, I enable and motivate my team to solve their own problems \u2014<\/em> reporting their outcome to me afterwards.<\/p>\n

What does this discussion look like? When employees feel challenged, I ask them to define their problem together with their proposed solution. Sometimes the issue requires more discussion, so I will ask them a series of questions that are designed to help them better visualize the issue at hand.<\/p>\n

While high-performing seasoned professionals require far less direction, less experienced employees may get stuck during our Q&A session, where I offer them hints to help them arrive at a solution.<\/p>\n

Archana shares the top engineering challenges that keep her up at night.<\/em><\/p>\n

What about your job motivates you the most?<\/strong><\/p>\n

It gives me an immense sense of happiness to motivate and enable others. I think I have correctly set the vision and the purpose for my team and we are seeing the results.<\/p>\n

Archana explains how Salesforce inspires her.<\/em><\/p>\n

Also, everyone is unique and has a lot of potential. How do I nurture them to reach their potential? Watching them grow so much \u2014 <\/em>in just one and a half years since our team\u2019s inception \u2014<\/em> gives me great satisfaction.<\/p>\n

Additionally, there are many challenges to solve and those unknowns are really exciting because every step matters and every step uncovers something new. And that is how you connect the dots. So, working with ambiguity is my favorite thing nowadays. When you know everything there is no fun. Learning and adapting to solve problems \u2014 <\/em>that is where the fun starts.<\/p>\n

Learn more<\/h3>\n

Stay connected \u2013 join our Talent Community<\/a>!<\/p>\n

Check out our Technology and Product teams<\/a> to learn how you can get involved.<\/p>\n

The post How is India\u2019s Brilliant Big Data Processing Team Engineering Salesforce Data Cloud?<\/a> appeared first on Salesforce Engineering Blog<\/a>.<\/p>\n

Read More<\/a><\/p>","protected":false},"excerpt":{"rendered":"

In our \u201cEngineering Energizers\u201d Q&A series, we examine the life experiences and career paths that have shaped Salesforce engineering leaders. Meet Archana Kumari, one of Salesforce\u2019s first India-based woman engineering leaders. In her role, Archana leads Salesforce India\u2019s Data Cloud big data processing compute layer team \u2014 charged with providing the tremendous processing power that… Continue reading How is India\u2019s Brilliant Big Data Processing Team Engineering Salesforce Data Cloud?<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[7],"tags":[],"class_list":["post-692","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":694,"url":"https:\/\/fde.cat\/index.php\/2023\/03\/23\/big-data-processing-driving-data-migration-for-salesforce-data-cloud\/","url_meta":{"origin":692,"position":0},"title":"Big Data Processing: Driving Data Migration for Salesforce Data Cloud","date":"March 23, 2023","format":false,"excerpt":"The tsunami of data \u2014 set to exceed 180 zettabytes by 2025 \u2014 places significant pressure on companies. Simply having access to customer information is not enough \u2014 companies must also analyze and refine the data to find actionable pieces that power new business. As businesses collect these volumes of\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":712,"url":"https:\/\/fde.cat\/index.php\/2023\/05\/09\/automation-engineering-secrets-revealed-slashing-customer-processing-time-from-hours-to-seconds\/","url_meta":{"origin":692,"position":1},"title":"Automation Engineering Secrets Revealed: Slashing Customer Processing Time from Hours to Seconds","date":"May 9, 2023","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d Q&A series, we examine the professional life experiences that have shaped Salesforce Engineering leaders. In this special edition, we meet Pratima Shukla, a software engineering manager based in Bangalore, India. In her role, Pratima leads Salesforce India\u2019s Industries Cloud Public Sector Solution (PSS) team, where she\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":860,"url":"https:\/\/fde.cat\/index.php\/2024\/04\/24\/inside-data-clouds-secret-formula-for-processing-one-quadrillion-records-monthly\/","url_meta":{"origin":692,"position":2},"title":"Inside Data Cloud\u2019s Secret Formula for Processing One Quadrillion Records Monthly","date":"April 24, 2024","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d Q&A series, we explore the inspiring journeys of engineering leaders who have significantly advanced their fields. Today, we meet Soumya KV, who spearheads the development of the Data Cloud\u2019s internal apps layer at Salesforce. Her India-based team specializes in advanced data segmentation and activation, enabling tailored\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":896,"url":"https:\/\/fde.cat\/index.php\/2024\/07\/16\/the-unstructured-data-dilemma-how-data-cloud-handles-250-trillion-transactions-weekly\/","url_meta":{"origin":692,"position":3},"title":"The Unstructured Data Dilemma: How Data Cloud Handles 250 Trillion Transactions Weekly","date":"July 16, 2024","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d Q&A series, we delve into the journeys of engineering leaders who have made notable strides in their areas of expertise. This edition features Adithya Vishwanath, Vice President of Software Engineering at Salesforce. He leads the Data Cloud team, a pivotal platform that integrates diverse data sources,\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":696,"url":"https:\/\/fde.cat\/index.php\/2023\/04\/04\/video-meet-5-salesforce-engineers-who-are-innovating-the-future\/","url_meta":{"origin":692,"position":4},"title":"[video] Meet 5 Salesforce Engineers Who Are Innovating the Future","date":"April 4, 2023","format":false,"excerpt":"In our \u201cEngineering Energizers\u201d Q&A series, we examine the life experiences and career paths that have shaped Salesforce engineering leaders. This special edition connects five of the best and brightest minds within Salesforce Engineering and across the world including India, Argentina, and the U.S., chronicling their quest to innovate the\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":283,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/ai-research-to-production-with-einstein-reply-recommendations\/","url_meta":{"origin":692,"position":5},"title":"AI Research to Production with Einstein Reply Recommendations","date":"August 31, 2021","format":false,"excerpt":"We all know that AI is here and it\u2019s quickly changing our lives. However, the impacts of AI are unevenly distributed and it favors those with \u201cmore data,\u201d leaving those with \u201cfew data\u201d behind. This runs counter to our Salesforce core values of Customer Success and Equality, so we set\u2026","rel":"","context":"In "Technology"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=692"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/692\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}