Skip to main content

RCD LLM Service

The RCD LLM Service provides API access to open-weight large language models hosted locally on Clemson research computing infrastructure.

The service is available at llm.rcd.clemson.edu.

This LLM Service is in Beta

Please let us know if you run into any issues.

API-Only Service

The RCD LLM Service currently provides API access only. It does not currently provide a built-in web chat interface.

On-Campus or VPN Required

The service is currently accessible only from the Clemson network. If you are off campus, connect to the Clemson University VPN before using the service.

Screenshot of the RCD LLM Service dashboard

What the Service Provides​

  • OpenAI-compatible API access for locally hosted models
  • Self-service API key management
  • A live Models page so you can confirm currently available model names before connecting a client

Getting Started​

To begin using the service, make sure you have an active RCD LLM Service allocation in ColdFront. Then you can:

  1. Connect to the Clemson network or Clemson University VPN.
  2. Sign in to llm.rcd.clemson.edu and create an API key.
  3. Check the Available Models page for a model name.
  4. Connect a client using the API usage guide or the Codex guide.

The API Keys page will not allow you to create a new key until your allocation is active on ColdFront.

Screenshot of the API Keys page showing the allocation requirement

Next Pages​

Need Help?​

If you have any questions or run into problems, please submit a support request or schedule office hours.