Getting Started
Installation
Installation Steps
-
Obtain Required Files:
- Acquire the
jaxon_platform_$version.ziparchive from your designated contact at Jaxon. - Obtain an IBM Docker registry API key from Jaxon as well.
- Acquire the
-
Setup Environment:
- Log in to your Ubuntu machine.
- Create a directory named
jaxonin your home directory by executing:mkdir -p $HOME/jaxon
- Transfer the
jaxon_platform_$version.zipfile into the newly created$HOME/jaxondirectory.
-
Extract Deployment Files:
- Navigate to the
jaxondirectory:cd $HOME/jaxon
- Extract the contents of the
jaxon_platform_$version.zipfile:unzip -o jaxon_platform_$version.zip
- Navigate to the
-
LLM Configuration:
- Edit the
.llm_envfile located in the$HOME/jaxondirectory.- Add any environment key variables required by your LLM provider. For example, replace
<OPENAI_API_KEY>with a valid OpenAI API key.
- Add any environment key variables required by your LLM provider. For example, replace
- Edit
llm_config.ymlto expose any LLMs you want available for use.- Configure at least one chat model and one embedding model for the platform to function correctly.
model_nameis exposed to users in the guardrail configuration UI. This is a human-readable label.- Specific models and configuration options are available here.
- The Jaxon platform uses the LiteLLM proxy to decouple the guardrails from any single provider's LLM offerings.
- Edit the
-
Authenticate Docker:
- Authenticate against the IBM Docker Container Registry using the previously obtained API key:
docker login -u iamapikey -p <apikey> icr.io
- Replace
<apikey>with your IBM Docker registry API key.
- Authenticate against the IBM Docker Container Registry using the previously obtained API key:
-
Start the platform with Docker:
- Initiate the platform stack by executing:
docker compose up -d
- This action will pull the required platform containers from the IBM container registry and Docker Hub.
- Initiate the platform stack by executing:
-
Verify Stack Running:
- Confirm that the platform containers are up and running by executing the following command:
docker ps
- This command lists the active containers within the platform stack.
- Confirm that the platform containers are up and running by executing the following command:
Install the Jaxon Platform as a System Service
To automate platform startup, configure it to run as a system service:
-
Stop the Existing Stack:
- Navigate to the
jaxondirectory and execute:docker compose down
- Navigate to the
-
Service Configuration:
- Edit the
docker-compose-jaxon.servicefile in the$HOME/jaxondirectory. - Replace
/path/to/your/jaxon/directorywith the exact path, such as/home/my_user/jaxon.
- Edit the
-
Deploy the Service File:
- Copy the
docker-compose-jaxon.servicefile to the/etc/systemd/systemdirectory:sudo cp docker-compose-jaxon.service etc/systemd/system
- Copy the
-
Enable and Start the Service:
- Activate the service by executing:
sudo systemctl enable docker-compose-jaxon.service
- Start the service:
sudo systemctl start docker-compose-jaxon.service
- Activate the service by executing:
-
Service Status Verification:
- Verify the service's status using:
sudo systemctl status docker-compose-jaxon.service
-
The output should denote successful execution, analogous to:
Loaded: loaded (/etc/systemd/system/docker-compose-jaxon.service; enabled; vendor preset: enabled) Active: active (exited) since Mon 2025-03-24 19:45:58 UTC; 1 day 20h ago Process: 326018 ExecStart=/usr/bin/docker compose up -d (code=exited, status=0/SUCCESS) Main PID: 326018 (code=exited, status=0/SUCCESS) CPU: 309ms
- Verify the service's status using:
By following these steps, the Jaxon platform will be successfully installed and operable on your Ubuntu system. For additional support, consult your system administrator or designated contact. You can also reach out to us at support@jaxon.ai.
Next Steps
- Review the Platform Overview
- Work through the Tutorials
- Implement Guardrails for your own application.