llm.arc.vt.edu

Description

https://llm.arc.vt.edu provides a web interface to a selection of LLMs hosted and run by ARC. It is based on the Open WebUI platform, and integrates several inference and integration capabilities, including retrieval-augmented generation (RAG), web search, vision, and image generation.

Access

  • All Virginia Tech students, faculty, and staff may access the service at https://llm.arc.vt.edu. No separate ARC account is required to use the web interface.

  • There is no charge to individual users for accessing the hosted models via the web interface.

  • Users may generate API keys through User profile > Settings > Account > API keys. Keys are unique to each user and must be kept confidential. Do not share your keys. See instructions on how to interact using API keys.

Restrictions

  • Data classification restriction. Researchers should not use this tool for high-risk data. The service is not approved for processing or storing sensitive or regulated data unless explicit, documented exception and additional protective controls are authorized by VT Privacy and Research Data Protection Program.

  • Users are subject to API and web interface limits to ensure fair usage: 60 requests per minute, 1000 requests per hour, and 2000 requests in a 3-hour sliding window.

Models

ARC currently runs three state-of-the-art models. ARC will add or remove models and scale instances dynamically to respond to user demand. You may select your preferred model at the top of the page.

  • Z.ai GLM-4.5-Air (see model card on Hugging Face). High-performance public model.

  • QuantTrio GLM-4.5V-AWQ (see model card on Hugging Face). GLM variant with vision capabilities.

  • OpenAI gpt-oss-120b (see model card on Hugging Face). OpenAI’s flagship public model.

Tools

  • Web search is enabled by default. This allows the model to decide if it wants to search for additional information online to provide a more accurate answer. You may disable web search by toggling the search the web function on Integrations > Tools > Search the web.

  • Image generation is disabled by default. You may enable image generation by toggling the image function on Integrations > Image. Images generation may take 10 seconds and it is based on FLUX.1-dev.

Security

This service is hosted entirely on-premises within the ARC infrastructure. No data is sent to any third party outside of the university. All user interactions are logged and preserved in compliance with VT IT Security Office Data Protection policies.

Disclaimer

ARC has implemented safeguards to mitigate the risk of generating unlawful, harmful, or otherwise inappropriate content. Despite these measures, LLMs may still produce inaccurate, misleading, biased, or harmful information. Use of this service is undertaken entirely at the user’s own discretion and risk. The service is provided “as is”, and, to the fullest extent permitted by applicable law, ARC and VT expressly disclaim all warranties, whether express or implied, as well as any liability for damages, losses, or adverse consequences that may result from the use of, or reliance upon, the outputs generated by the models. By using this service, the user acknowledges and accepts these conditions, and agrees to comply with all applicable terms and conditions governing the use of the hosted models, associated software, and underlying platforms.