Skip to main content

LM Studio Configuration

LM Studio is a desktop application that serves downloaded models through an OpenAI-compatible API. When connected to a managed Novaplan AI workspace, requests travel between the workspace and the LM Studio server. Coordinate the network route and data handling with Novaplan before using it.

Before you start

  1. Install LM Studio on the machine that will run the model.
  2. Download a model from the Discover tab.
  3. Open the Developer tab (called Local Server in older versions), load the model, and start the server.
  4. Note the port. LM Studio uses 1234 by default, so the server address is usually http://localhost:1234/v1.
The machine running LM Studio needs enough memory to hold the model. As a rough guide, a quantised 8-billion-parameter model needs about 8 GB of free RAM, and larger models need proportionally more.

Required Fields

Endpoint URL *

The address of the LM Studio server, including the /v1 path. Application default: http://host.docker.internal:1234/v1. Use this only if Novaplan confirms that the managed workspace can reach the LM Studio server through that hostname. Otherwise enter the server’s actual reachable URL. Your computer’s localhost address is not reachable from the managed workspace by default. If LM Studio runs on a different machine, enable Serve on Local Network in its server settings, otherwise it only accepts connections from its own host.

Model Name *

The model identifier shown in LM Studio’s server panel, for example lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF. You can list the exact identifiers the server is serving with:

Optional Fields

API Key

LM Studio does not check API keys. Leave this blank unless you have put the server behind a proxy that requires one, in which case enter the key that proxy expects.

Model Friendly Name

A label shown in the Novaplan AI interface so you can tell several configurations apart. If you leave it blank, the model name is used.

Context Length

The size of the model’s context window, in tokens. Novaplan AI uses this number to decide how much retrieved content it can safely include in a prompt. Set it to the value published for your model. If you leave it blank, Novaplan AI uses a conservative default.

Is Multimodal

Turn this on if the model accepts images as well as text. It is on by default.

Is Reasoning

Turn this on if the model performs extended reasoning before answering. It is on by default.

Troubleshooting

“Connection refused”. Check that LM Studio is serving the model and ask Novaplan to verify the endpoint from the managed workspace. Requests time out on the first message. LM Studio loads the model into memory on the first request, which can take a minute for a large model. Load the model in the Developer tab before using it from Novaplan AI. “Model not found”. The identifier does not match. Copy it from the curl output above rather than typing it by hand.