SkyPoint: How to Train Your LLM Dragon

Skypoint, an AI solutions provider for the senior care industry, has successfully implemented generative AI applications using retrieval augmented generation (RAG) techniques. The company's AI application allows healthcare providers instant access to public and private data, improving patient care by streamlining administrative processes and providing conversational AI. Skypoint uses a combination of structured and unstructured data stored in its lakehouse and DataStax Astra DB with vector search. Advanced RAG techniques are employed to improve answer quality and reduce hallucinations. The application also integrates few-shot prompting for generating SQL statements from natural language queries, improving performance by using the vector store as an LLM cache. Skypoint's approach involves focusing on real-world use cases, progressive implementation, user education and training, and planning for future capabilities of generative AI.