Artificial Intelligence

ARC offers on-prem Large Language Models (LLMs) for research, education, and administration. There are several ways to interact with LLMs in ARC:

• https://llm.arc.vt.edu offers a web interface to a selection of LLMs run by ARC.

• https://llm-api.arc.vt.edu offers API access to a selection of LLMs run by ARC.

• https://ood.arc.vt.edu offers a custom dedicated LLM via Open OnDemand.

We also provide guidance on using advanced tools:

• vLLM offers advanced custom deployment via personalized Slurm scripts.

• GitHub Copilot Chat provides seamless integration of VS Code with ARC’s LLMs using API keys.

If you have any questions about how ARC may support your AI needs, please contact us.