Getting Started
Installation
Installation Steps
-
Obtain Required Files:
- Acquire the
jaxon_platform_$version.zip
archive from your designated contact at Jaxon. - Obtain an IBM Docker registry API key from Jaxon as well.
- Acquire the
-
Setup Environment:
- Log in to your Ubuntu machine.
- Create a directory named
jaxon
in your home directory by executing:mkdir -p $HOME/jaxon
- Transfer the
jaxon_platform_$version.zip
file into the newly created$HOME/jaxon
directory.
-
Extract Deployment Files:
- Navigate to the
jaxon
directory:cd $HOME/jaxon
- Extract the contents of the
jaxon_platform_$version.zip
file:unzip -o jaxon_platform_$version.zip
- Navigate to the
-
LLM Configuration:
- Edit the
.llm_env
file located in the$HOME/jaxon
directory.- Add any environment key variables required by your LLM provider. For example, replace
<OPENAI_API_KEY>
with a valid OpenAI API key.
- Add any environment key variables required by your LLM provider. For example, replace
- Edit
llm_config.yml
to expose any LLMs you want available for use.- It is required that a default model named
chat
be configured; you may use any model you like to take this role. model_name
is exposed to users in the guardrail configuration UI. This is a human-readable label.- Specific models and configuration options are available here.
- The Jaxon platform uses the LiteLLM proxy to decouple the guardrails from any single provider's LLM offerings.
- It is required that a default model named
- Edit the
-
Authenticate Docker:
- Authenticate against the IBM Docker Container Registry using the previously obtained API key:
docker login -u iamapikey -p <apikey> icr.io
- Replace
<apikey>
with your IBM Docker registry API key.
- Authenticate against the IBM Docker Container Registry using the previously obtained API key:
-
Start the platform with Docker:
- Initiate the platform stack by executing:
docker compose up -d
- This action will pull the required platform containers from the IBM container registry and Docker Hub.
- Initiate the platform stack by executing:
-
Verify Stack Running:
- Confirm that the platform containers are up and running by executing the following command:
docker ps
- This command lists the active containers within the platform stack.
- Confirm that the platform containers are up and running by executing the following command:
Install the Jaxon Platform as a System Service
To automate platform startup, configure it to run as a system service:
-
Stop the Existing Stack:
- Navigate to the
jaxon
directory and execute:docker compose down
- Navigate to the
-
Service Configuration:
- Edit the
docker-compose-jaxon.service
file in the$HOME/jaxon
directory. - Replace
/path/to/your/jaxon/directory
with the exact path, such as/home/my_user/jaxon
.
- Edit the
-
Deploy the Service File:
- Copy the
docker-compose-jaxon.service
file to the/etc/systemd/system
directory:sudo cp docker-compose-jaxon.service etc/systemd/system
- Copy the
-
Enable and Start the Service:
- Activate the service by executing:
sudo systemctl enable docker-compose-jaxon.service
- Start the service:
sudo systemctl start docker-compose-jaxon.service
- Activate the service by executing:
-
Service Status Verification:
- Verify the service's status using:
sudo systemctl status docker-compose-jaxon.service
-
The output should denote successful execution, analogous to:
Loaded: loaded (/etc/systemd/system/docker-compose-jaxon.service; enabled; vendor preset: enabled) Active: active (exited) since Mon 2025-03-24 19:45:58 UTC; 1 day 20h ago Process: 326018 ExecStart=/usr/bin/docker compose up -d (code=exited, status=0/SUCCESS) Main PID: 326018 (code=exited, status=0/SUCCESS) CPU: 309ms
- Verify the service's status using:
By following these steps, the Jaxon platform will be successfully installed and operable on your Ubuntu system. For additional support, consult your system administrator or designated contact. You can also reach out to us at support@jaxon.ai.
Next Steps
- Review the Platform Overview
- Work through the Tutorials
- Implement Guardrails for your own application.