Company
Date Published
Author
Ravin Thambapillai
Word count
1442
Language
English
Hacker News points
None

Summary

Credal has been working with a large software company to deploy Large Language Models (LLMs) in their sales call data. The goal was to get more visibility into the signal that sales teams were getting from these calls, especially around new product offerings. Credal's solution involved connecting data from various systems, including Chorus for recording sales conversations and Snowflake for storing contextual data from Salesforce. The company used Credal's Snowflake Connector to make this connection easy, allowing any approved LLM to access the data on behalf of an authorized user. To manage permissions, they used row-level access policies in Snowflake, which provided a single column with a list of OKTA group IDs defining who should have access to the data. Credal also implemented intelligent retrieval strategies, such as pinning documents and using reranking and hybrid search, to improve the effectiveness of the LLMs. By connecting structured data to LLMs, companies can unlock more complex use cases and move away from toy chatbots into high-value business applications.