1. Installation

Run the following command:

curl -sSL https://www.anyway.dev/install.sh | sh
The two binaries anyd and any-cm are placed in .local/bin/anyway.

To check the version:

anyd --version
any-cm --version

2. Running Anyway

Anyway daemon (anyd) must be running on every GPU machine you want to manage. To do so, you just need to run the following command:

anyd [--port=9100]
Info: It listens on port 9100 by default. You can change this with the --port flag. Once running, it will accept commands from the Control Manager.

3. Running the Control Manager

Anyway Control Manager (any-cm) can run on a machine with or without GPU. It serves a browser-based User Interface that you use to manage your machine cluster.

any-cm [--port=3000]
Info: It runs on port 3000 by default. You can change this with the --port flag. The dashboard is accessible from any browser at http://<control-manager-ip>:3000. The Control Manager (any-cm) communicates with each Anyway process (anyd) running on your machines.
First run: On the very first start, an admin account, with user name admin and a random admin password is generated and printed to the console. Copy it before closing the terminal, you will need it to log in. You will be prompted to change it immediately after your first login.

4. Logging in

Open your browser and navigate to http://<control-manager-ip>:3000. You will be greeted by the login screen.

The Anyway Control Manager login page.

Use admin as the username and the password that was printed to the console when you first started any-cm. After logging in you will be asked to set a new permanent password.

First-login password change prompt.

You now have access to the Control Manager.

First view of the Control Manager.

5. Adding Machines

Before deploying any model, you need to register your GPU machines with the Control Manager. Each machine must be running anyd (see step 2).

1 In the dashboard, click on the Machines icon in the left sidebar, then click on in the top right corner.
The Machines panel.
2 Provide the IP address of the machine.
Machine registration form.

After adding your machines, they appear on the Machine view as follows (in the following screenshot, the IP addresses have been anonymized).

The Machines panel.
Info: You can add as many machines as needed. The Control Manager tracks available VRAM across all machines in real time and uses this information when deciding where to place new model deployments.

6. Deploying a Model

1 Click on the Deployment icon in the left sidebar, select the model to deploy in the list and click on the deploy button .
The Models panel.

The model is deploying....

The Models panel.

Then, deployed.

The Models panel.

In the Machine Panel, you can see the model being distributed over the machines.

The Machine panel.
Info: If the model is already downloaded on the machine disks, a green marker appears with the quantization level of the model. If it is not already downloaded, you can click on the download icon to download without deploying the model. If you try to deploy a model that isn't downloaded already, it will be downloaded automatically before deploying.

7. Viewing Statistics

Your Control Manager continuously collects GPU metrics from every registered machine (updated every second). You can view live and historical data from the Statistics panel.

The Statistics panel.

8. Managing Users

The Control Manager has a built-in user management system. As an administrator you can create additional accounts for colleagues who need access to the dashboard. You can create users with admin privileges or simple users who will not be able to add or remove machines. Simple users can deploy models on the available machines.

1 Click on the User management icon at the bottom of the sidebar.
The Users settings page.
2 You can also create a user. Click on the "Create User" button.
The Users settings page.

9. Updating

Updating Anyway uses the same installer as a fresh install. Run the command below, then restart anyd and any-cm:

curl -sSL https://www.anyway.dev/install.sh | sh

Need Help?

Email: contact@anyway.dev
Documentation: Additional resources and advanced configuration options available upon request.