Release Notes
Version 2.0.2.2
This release restores static API documentation views and adds a live API spec link for self-hosted users.
Documentation
- API Reference links: Restored static Swagger UI and ReDoc viewers on the API Reference page, and added a
/api/docslink that always serves the spec from your running platform deployment.
Bug Fixes
- API specification version: Updated the OpenAPI specification version number to match the current platform release.
Version 2.0.2
This release introduces comprehensive audit logging, a redesigned ruleset creation wizard, document editing capabilities, and enhanced data management features along with numerous bug fixes and UX improvements.
New Features
- Activity logging system: Added a unified activity tracking system with audit logs for all platform operations (document uploads, ruleset changes, run execution) and system logs for technical diagnostics. The new Activity page provides filterable, searchable logs with project-based access control and real-time updates.
- Document markdown editing: Documents can now be edited directly in the platform using a full-screen markdown editor with search functionality. The editor supports both read-only viewing and editing modes, with version control automatically creating new document versions when changes are saved.
- Document import enhancements: The document import interface now supports CSV files (each row becomes a document), has a unified import modal for all file types, and includes better validation with support for files up to 100MB and PDFs up to 5 pages with automatic OCR.
- Redesigned ruleset creation wizard: The ruleset creation process now uses a unified 8-step wizard supporting both policy-driven extraction and manual creation workflows. The wizard includes theme suggestion, background processing for long-running tasks, and improved progress tracking.
- Enhanced dataset management: Added CSV import for bulk document creation, automatic generation progress tracking, and improved organization of gold vs silver documents with better sorting and filtering.
Improvements
- Better navigation and project management: Projects are now sorted alphabetically, duplicate names are prevented, navigation guards warn before discarding unsaved work, and switching projects properly redirects from context-specific pages.
- Improved ruleset studio experience: Added resizable panels, DSAIL posture controls (optimistic/neutral/pessimistic), enhanced rule creation workflow, better error handling for empty rulesets, and improved validation feedback.
- Enhanced run management: Added click-to-copy for run IDs, better error messaging for timeouts and failures, improved result organization, and run type-aware tab switching after creation.
- UI consistency improvements: Updated all instances of "DSL" to "DSAIL" throughout the platform, standardized button terminology ("Create" instead of "New"), improved hover states and tooltips, and enhanced visual feedback with darker text colors for better readability.
- Performance and reliability: Implemented batch workflow throttling to prevent interactive runs from being blocked, improved certificate renewal robustness, better handling of concurrent operations, and enhanced error recovery mechanisms.
Bug Fixes
- Authentication and access control: Fixed OAuth callback handling that was causing state parameter issues, resolved login page avatar display problems, corrected group membership handling for new users, and improved session management.
- Document and dataset operations: Fixed file upload error handling for rejected files, corrected document name display by removing file extensions in most contexts, resolved issues with large document processing, and improved CSV import validation.
- Ruleset and run stability: Fixed rule creation workflow to immediately show new rules without requiring page refresh, resolved DSAIL validation for empty content, corrected variance calculation for multi-mode results, and improved workflow status tracking.
- Platform reliability: Enhanced mTLS certificate renewal to handle authentication errors gracefully, fixed database connection issues in logs when services are unavailable, resolved temporal workflow cleanup, and improved error propagation from background tasks.
API Changes
- Enhanced audit logging: Added project-based filtering to audit log endpoints and improved log entry metadata including project associations and operation context.
- Document management: Added new endpoints for markdown content retrieval and editing (
GET/PUT /{id}/versions/{ver}/markdown) and document renaming capabilities. - Run filtering: Added project-based filtering to runs API to ensure users only see runs for their selected project context.
- Authentication improvements: API now accepts Authentik API tokens directly as Bearer tokens, bypassing the complex OAuth2 client credentials flow and simplifying programmatic access.
Documentation
- Updated API documentation: Embedded interactive Swagger UI and ReDoc directly in platform documentation with version-aligned OpenAPI specifications and improved authentication examples.
- Enhanced concept guides: Updated all documentation to reflect the new wizard workflow, corrected terminology throughout (guardrails → rulesets, DSL → DSAIL), and added comprehensive tutorials including a new SEAD-4 security clearance tutorial.
- Improved getting started: Revised the getting started guide with current screenshots, updated workflow descriptions, and clearer step-by-step instructions for all platform features.
Version 2.0.1
Version 2.0.1 is a patch release focused on deployment flexibility, authorization hardening, UI reliability improvements, and new documentation.
Deployment & Infrastructure
- AWS Marketplace AMI: Production-ready AMI for one-click deployment via the AWS Marketplace.
- Automated Docs Publishing: Platform documentation at docs.jaxon.ai is now published automatically via pipeline or locally with
deployment/docs/publish_docs.sh.
Authorization & Security
- System Admin Group Protection: The
authentik Adminsgroup is now read-only in the platform — members can view but not create or modify assets, preventing accidental asset ownership by infrastructure administrators. - Dynamic Group Hierarchy: Replaced hardcoded group allowlist with a parent-group hierarchy for application access, allowing flexible team structures without code changes.
- Authentik Blueprint Fix: Added automatic Authentik worker restart after deployment health check to resolve user-group binding 403 errors on fresh deploys.
- Enhanced Network Security: Implemented mTLS (mutual TLS) authentication across all internal service communications for improved security isolation.
- Session Management: Improved logout handling and added idle timeout warnings with clean session termination.
Ruleset Improvements
- Publish Validation: Publishing a ruleset now validates that it contains at least one rule and all rules have DSL code, preventing incomplete rulesets from being frozen as published versions.
- Wizard Polling Reliability: Rewrote the rule extraction and DSL generation polling in the Ruleset Wizard to use a centralized
usePollerhook, eliminating race conditions and stale-state issues during long-running extraction workflows. - Activity Monitoring: Added real-time notifications and progress indicators for rule extraction and DSL generation workflows.
- Interactive Runs: Added support for interactive runs with parallelized processing and downloadable result files for batch operations.
- Variance Testing: Implemented variance test capabilities for comprehensive ruleset validation and analysis.
- Claims Management: Enhanced claims system with author tracking and duplicate prevention for audit consistency.
User Interface
- System Logs: New unified logging page with filterable audit trail showing platform activity, guardrail runs, and system events with expandable details and auto-refresh polling.
- Collapsible Sidebar: Made the navigation sidebar collapsible to maximize workspace area.
- Document Management: Added ability to upload and manage documents directly through the UI with improved text extraction for PDF and DOCX files.
- Datasets UI: New interface for managing datasets with full CRUD operations.
- Project Import/Export: Added functionality to import and export projects with proper handling of naming conflicts.
API Enhancements
- REST API Examples: Added code examples for creating runs via curl, Python, and JavaScript with proper authentication handling.
- DSAIL Validation: Added endpoint for validating DSAIL code syntax and structure.
- LLM Configuration: Expanded default model support including Google Gemini and additional Claude models.
- Text Extraction: New endpoint for extracting text from PDF and DOCX files.
Bug Fixes
- Project-Scoped Runs: Runs are now filtered by the active project, fixing an issue where the Runs page displayed data from other projects.
- Documents Page Deduplication: Resolved a duplication issue on the Documents page caused by a merge conflict.
- UI Build Dependencies: Fixed build failures by regenerating package-lock.json to include missing html-to-image dependency.
- Authentication Flow: Fixed routing issues when users are logged out and improved handling of authentication state transitions.
- Rule Edit Modal: Resolved issues preventing changes from being persisted in the edit guardrail window.
Documentation
- SEAD-4 Tutorial: New end-to-end tutorial walking through SEAD-4 compliance verification — from document upload through ruleset creation, testing, and variance analysis.
- Updated Screenshots: Refreshed all platform screenshots to reflect the current UI.
- Authentication Reference: Expanded documentation on the OAuth2/PKCE authentication flow and Authentik integration.
- API Reference: Updated API documentation with current endpoints and authentication examples.
- Best Practices: Updated guidance on variance testing and removed second-person phrasing for better clarity.
Version 2.0
Version 2.0 is a major platform update that simplifies the ruleset model, introduces AI-powered rule creation, and redesigns the user interface around a focused document verification workflow.
Simplified Ruleset Model
The platform now focuses exclusively on rulesets powered by DSAIL formal logic. The previous guardrail types (Consensus, Consistency Checking, Critique & Revise, Entailment, LLM-as-a-Judge, and Human Review as standalone) have been replaced by a unified Ruleset/Rule model. Every ruleset contains one or more rules, each encoding a single policy requirement as DSAIL code evaluated by an SMT solver for mathematically provable results.
Ruleset Creation Wizard
A new wizard extracts rules from policy documents automatically. Paste a compliance document or policy summary, and the wizard analyzes the text, identifies individual requirements, and generates both natural language rule descriptions and DSAIL formal logic code. This replaces the manual rule-by-rule configuration workflow.
Ruleset Studio
The integrated Ruleset Studio provides a unified environment for viewing and editing rules, DSAIL code, and extraction questions. Each rule's components are visible in context -- natural language text, formal logic, and the questions the platform uses to extract relevant information from documents.
REST API
A new REST API provides full programmatic access to all platform operations -- managing projects, documents, rulesets, datasets, and runs. Interactive API documentation is available at /api/docs (Swagger UI) and /api/redoc (ReDoc), generated automatically from the OpenAPI specification.
Redesigned Navigation
The interface is now sidebar-driven with four primary sections:
- Documents -- First-class document management with versioning and text content support
- Rulesets -- Create, view, and manage rulesets with the creation wizard and Ruleset Studio
- Datasets -- Organize test data and link documents for accuracy measurement
- Runs -- Unified testing interface with accuracy and variance testing capabilities
Documents
Documents are now a first-class entity with full versioning support. Create documents by pasting text directly or uploading files. Every edit creates a new immutable version, providing a complete audit trail.
Runs
The Runs interface replaces the previous Playground as the unified testing environment. Run rulesets against individual documents or entire datasets. Test types include:
- Single document tests -- Quick compliance verification against one document
- Accuracy tests -- Measure ruleset performance against gold-standard datasets with F1, Precision, and Recall metrics
- Variance tests -- Statistical analysis across multiple iterations to assess ruleset consistency
Previous Releases
Version 1.3.0
Dataset Management & Testing
-
Dataset Creation & Management: Comprehensive dataset system for organizing test data. Create datasets from scratch, import from CSV, or export to CSV for external analysis. Manual record editing with full CRUD operations.
-
Synthetic Data Generation: Parallel bulk generation of synthetic test records (1/10/100 at a time) using configurable LLMs. Advanced candidate scoring with D-score diversity metrics ensures high-quality, diverse training data. Background job processing with real-time progress tracking.
-
Test Execution Framework: Background test job system for running comprehensive accuracy and variance tests against datasets. Real-time progress monitoring with cancellation support. Jobs persist across navigation for long-running test suites.
Quality Assurance & Validation
-
Accuracy Testing: Evaluate ruleset performance against gold-standard datasets with detailed per-rule metrics including F1 score, Precision, and Recall. Overall ruleset scoring with confusion matrix analysis to identify systematic errors.
-
Variance Testing: Statistical variance analysis across multiple test iterations to measure ruleset consistency. Identify non-deterministic behavior patterns and evaluate reliability across different inputs and conditions.
-
Test Results Visualization: Interactive test result displays with sortable tables, per-rule performance breakdowns, and detailed accuracy metrics. Export test results for reporting and quality assurance workflows.
Enhanced User Experience
-
Record Management UI: Intuitive interface for viewing, adding, editing, and deleting dataset records with appropriate field validation.
-
Background Job Monitoring: Real-time status cards for generation and test jobs with progress bars, completion metrics, and cancel/done actions. Jobs continue running during navigation with persistent state.
-
Data Quality Tracking: Automatic labeling of records as Gold (uploaded/manual) or Silver (synthetic) quality for downstream filtering and weighted evaluation strategies.
Version 1.2.0
Authentication & Authorization
- Authentik Integration: Enterprise-grade authentication system with SSO support and comprehensive user management.
- Group-Based Access Control: Security groups function as teams that own assets at a project level, with flexible assignment based on organizational structure.
Configuration Management
- Version Control for Rulesets: Track changes to ruleset configurations with complete version history and ability to revert to previous versions.
Policy Rules Enhancements
- Verification Rulesets for Questions: Add secondary verification layer to Policy Rules questions, enabling configurable rulesets to validate LLM-generated answers for improved accuracy and reliability.
Version 1.1.2
Enhanced User Experience
- Sorting for Rulesets lists: Quickly organize items in the rulesets view.
Platform & Infrastructure
- Kafka Topic Creation Flow: Adjusted creation process to avoid topic creation bootstrapping issues.
- Kafka Image Update: Switched to the Apache-maintained image due to Bitnami deprecation.
Version 1.1.1
Enhanced User Experience
- Speech-to-Text Inputs for Textareas: Microphone-powered STT for textareas across the UI for faster, hands-free input.
AI-Powered Automation
- RAG-Based Pipeline for Policy to Rule Extraction: Retrieval-augmented option for converting policy documents into structured rules.
Expanded LLM Support
- Support for GPT-5: Configure and run rulesets with GPT-5.
Reliability & Quality
- Bug Fixes & UI/Usability Improvements: General stability enhancements and minor UI polish.
Version 1.1.0
Core Features
- Batch Processing: Enhanced Python client with support for batch request processing, enabling efficient bulk verification operations.
Client Library Improvements
- Pre-Flight Validation: Jaxon client validates target rulesets before execution, preventing wasted resources on invalid configurations.
- Enhanced Batch Processing: Improved batch operations that continue processing valid items while clearly identifying and logging validation failures.
Platform & Infrastructure
- Kubernetes Support: Full Kubernetes deployment support with Helm charts for production-scale orchestration and container management.
- Enhanced Python Client: Improved client library with batch processing capabilities.
Version 1.0.0
Core Features
- Rulesets: Verify LLM outputs with Policy Rules (Neurosymbolic) rulesets.
- Integrated Logging & Dashboard: Real-time dashboards for monitoring inference.
- LLM Generalization: LLM proxy for decoupled usage of major LLM providers.
APIs and Integrations
- Python Client: Installable Python client for direct integration into customer applications.