Hi
Yesterday I launched relay.app
Relay is a self-hostable LLM environment with support for OpenAI,
DeepSeek, Anthropic, xAI and zAI out of the box.
It has a minimal set of dependencies - built on Roda, Sequel, Falcon,
llm.rb, HTMX and web sockets.
It is intentionally simple to get started, you should be up and running
in under two minutes
gem install relay.app
relay setup
relay start
Check screenshots and more at GitHub - llmrb/relay.app: A self-hostable LLM environment you can configure in 2 minutes or less · GitHub
If you want an LLM you can extend, it's worth a look. You can drop your
own tools into ~/.relay/tools and have the LLM discover them automatically.
No LLM experience required.
Robert
···
______________________________________________
ruby-talk mailing list -- ruby-talk@ml.ruby-lang.org
To unsubscribe send an email to ruby-talk-leave@ml.ruby-lang.org
ruby-talk info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-talk.ml.ruby-lang.org/