HyperOpt Viz Studio

A dynamic visualization tool for Hyperparameter Optimization (HPO) experiments. This tool allows you to interactively explore and replay the results of your optimization runs, supporting multiple experiments, tasks, methods, and individual runs.

Features

• Experiment Browser: Automatically detects and lists experiments from your experiment directory.
• Multi-Level Drill Down: Filter by Experiment -> Task -> Method -> Run.
• Interactive Visualization: Parallel Coordinates, Metric Charts, and Scatter Plots.
• Replay Mode: Watch the optimization process unfold step-by-step.
• Live Data: Connects to a backend server to fetch data dynamically.

Getting Started

This project consists of a Python backend (Flask) for data serving and a React frontend (Vite) for visualization. You need to run both.

1. Install Dependencies

Frontend:

npm install

Backend: Ensure you have flask installed:

pip install flask

2. Start the Application

You can start the backend and frontend in the background with the following commands. The Process IDs (PIDs) will be saved to backend.pid and frontend.pid, and the output logs will be saved to backend.log and frontend.log.

Step 1: Start the Backend Server This server scans your experiment directory (/home/hsuchen/HPOTuningAgent/exp) and serves the data via API.

nohup .venv/bin/python server.py > backend.log 2>&1 & echo $! > backend.pid

Server runs on http://0.0.0.0:5000

Step 2: Start the Frontend

nohup npm run dev > frontend.log 2>&1 & echo $! > frontend.pid

Frontend runs on http://0.0.0.0:3001

3. Stop the Application

To stop the running backend and frontend, use the following commands:

kill $(cat frontend.pid)
kill $(cat backend.pid)

4. Access the Tool

Open your browser and navigate to: http://140.113.110.78:3001

5. Usage

1. Select Experiment: Choose the experiment timestamp from the top-left dropdown.
2. Select Task: Choose the specific task (e.g., MLP-adam_breast_acc).
3. Select Method: Choose the optimization method (e.g., optuna, gemini).
4. Select Run: Choose All Runs to see aggregated results or a specific Run X to analyze a single execution.
5. Play/Pause: Use the playback controls to watch the optimization progress.