Skip to main content

RCD LLM Service

The RCD LLM Service provides API access to open-weight large language models hosted locally on Clemson research computing infrastructure. It can also proxy selected OpenAI API requests for eligible users through an RLS-managed OpenAI gateway.

The service is available at llm.rcd.clemson.edu.

This LLM Service is in Beta

Please let us know if you run into any issues.

API-Only Service

The RCD LLM Service currently provides API access only. It does not currently provide a built-in web chat interface.

On-Campus or VPN Required

The service is currently accessible only from the Clemson network. If you are off campus, connect to the Clemson University VPN before using the service.

Screenshot of the RCD LLM Service dashboard

What the Service Provides​

  • OpenAI-compatible API access for locally hosted models
  • Selected OpenAI API access using an RLS API key and RLS-managed OpenAI credits
  • Self-service API key management
  • A live Models page so you can confirm currently available model names before connecting a client

Getting Started​

To begin using the service, make sure you have an active RCD LLM Service allocation in ColdFront. Then you can:

  1. Connect to the Clemson network or Clemson University VPN.
  2. Sign in to llm.rcd.clemson.edu and create an API key.
  3. Check the Available Models page for a model name.
  4. Connect a client using the Local Model API guide, the OpenAI API through RLS guide, or the Codex local model guide.

The API Keys page will not allow you to create a new key until your allocation is active on ColdFront.

Screenshot of the API Keys page showing the allocation requirement

Next Pages​

Need Help?​

If you have any questions or run into problems, please submit a support request or schedule office hours.