/plushcap/analysis/supabase/supabase-mozilla-llamafile-in-supabase-edge-functions

Mozilla Llamafile in Supabase Edge Functions

What's this blog post about?

Supabase has added support for Mozilla Llamafile, an Inference Server that can be used with Edge Functions. Llamafile allows users to distribute and run Language Models with a single file, running locally on most computers without installation. It also provides a local web UI chat server and an OpenAI API compatible server now integrated with Supabase Edge Functions. Users can find examples of how to use Llamafile with functions-js on GitHub. Instructions for getting started are provided, including setting up a new Supabase project locally and calling Llamafile with functions-js or the OpenAI Deno SDK. Deploying a Llamafile and Supabase Edge Functions is also covered in the text.

Company
Supabase

Date published
Aug. 21, 2024

Author(s)
Thor Schaeff

Word count
579

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.