Marek Zebrowski Blog https://zebrowski.dev/blog Marek Zebrowski Blog & Book resources en-us marek@zebrowski.com (Marek Zebrowski) marek@zebrowski.com (Marek Zebrowski) Fri, 05 Apr 2024 05:32:14 GMT https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama-pref Ollama Models via API to Production: Performance and Scaling https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama-pref This follow-up post builds on the previous article about creating a FastAPI wrapper for Ollama models. It explores what’s needed to move from a dev-friendly API to a more production-grade service, including API authentication, rate limiting, request validation, load balancing, and monitoring. FastAPI performance a concern? Read on to find out more! Fri, 05 Apr 2024 05:32:14 GMT marek@zebrowski.com (Marek Zebrowski) blogFastAPIAIOllamaPythonProduction https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama-series Ollama Models via API to Production : Series Page https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama-series This series of follow-up posts builds on the orginal article about creating a FastAPI wrapper for Ollama models. These posts explore what’s needed to move from a dev-friendly API to a more production-grade service, including API authentication, rate limiting, request validation, load balancing, and monitoring. Fri, 05 Apr 2024 01:32:14 GMT marek@zebrowski.com (Marek Zebrowski) blogFastAPIAIOllamaPythonProductionSeries https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama Ollama Models via API https://zebrowski.dev/blog/fastapiOllama/fastapi-ollama This blog post explains how to use FastAPI to create an API for Ollama models, enabling wider application access and enhanced security. It provides code examples for using ollama.generate() and ollama.chat() and discusses best practices for deployment. Tue, 19 Mar 2024 16:32:14 GMT marek@zebrowski.com (Marek Zebrowski) blogFastAPIAIOllamaPython