Secure your API with JWTs and ngrok’s API Gateway` is an article that discusses the importance of authentication when deploying large language models (LLMs) as a service, particularly in public-facing deployments. The author explores how traditional solutions like IP restrictions and ACLs are limited and require additional infrastructure, while also being prone to maintenance issues. They introduce ngrok's new developer-defined API Gateway, which allows for easy integration of JWT authentication, making it simple to secure APIs without the need for complex networking configurations or ongoing coordination with operations teams. The article provides a step-by-step guide on how to deploy an open-source LLM using SkyPilot and ngrok's API Gateway, including setting up authentication with Auth0 and fine-tuning the model using examples from SkyPilot.