0.20.12

Backends

Crusoe

dstack now supports Crusoe as a backend, enabling VM-based provisioning with GPU instances. The backend supports both single-node and multi-node cluster provisioning with InfiniBand.

type: fleet
name: my-crusoe-fleet

backends: [crusoe]
resources:
  gpu: A100:8
nodes: 2
placement: cluster

Note

CPU instances, H200, B200, GB200, MI300X, MI355X and volumes support is coming soon.

UI

Launch wizard

The UI now includes a launch wizard that lets users create runs from pre-defined templates. Instead of writing YAML from
scratch, users can select a template, pick GPU resources, adjust settings, and review the final
configuration—all through a guided flow.

To enable the launch wizard, point the server to a templates repository:

$ DSTACK_SERVER_TEMPLATES_REPO=https://github.com/dstackai/dstack-templates dstack server

Templates are YAML files under .dstack/templates in the repo. Each template has type set to template, a unique name, a title, configurable parameters, and a configuration that defines the dstack run:

type: template
name: in-browser-ide

title: In-browser IDE
description: Access the instance using VS Code in the browser.

parameters:
  - type: name
  - type: resources
  - type: python_or_docker
  - type: repo
  - type: working_dir
    
  - type: env
    title: Password
    name: PASSWORD
    value: $random-password

configuration:
  type: service
  
  auth: false
  gateway: true
  https: auto

  env:
    - BIND_ADDR=0.0.0.0:8080
  commands:
    - |
      echo "Your password is $PASSWORD. Share it carefully as it grants full access to the IDE."
    - |
      curl -fsSL https://code-server.dev/install.sh | sh -s -- --method standalone --prefix /tmp/code-server
    - |
      /tmp/code-server/bin/code-server --bind-addr $BIND_ADDR --auth password --disable-telemetry --disable-update-check .
  port: 8080

  probes:
    - type: http
      url: /healthz

See dstack-templates for an example repository.

Note

The launch wizard is an experimental feature. Currently, templates are configured per server. Per-project templates configuration is coming soon.

Instances

The UI now has an Instance details page where you can view detailed information about an instance, including its events and inspect data. Instance names across the UI—including on Events pages—now link directly to this page.

What's changed

• Document Adding indexes by @r4victor in #3594
• [Blog] Model inference with Prefill-Decode disaggregation by @peterschmidt85 in #3595
• [runner] Drop buildLDLibraryPathEnv() by @un-def in #3593
• Fix mutually exclusive fields validation by @jvstme in #3598
• [Docs] PD disaggregation by @Bihan in #3592
• [Docs] Clarify how K8s resources and offers work by @un-def in #3565
• Allow https: auto for services by @peterschmidt85 in #3600
• Implement gateway pipeline by @r4victor in #3599
• Allow detecting whether service https is unset by @jvstme in #3601
• Implement volume pipeline by @r4victor in #3604
• [Website] Minor edits by @peterschmidt85 in #3609
• [Website] Add robots.txt and structured data by @peterschmidt85 in #3610
• Add templates API and launch wizard UI by @peterschmidt85 in #3605
• [UI] Include availability issues information to offer cards by @peterschmidt85 in #3607
• Fix SSH fleet with proxy_jump in-place update check by @un-def in #3612
• Bump gpuhunt==0.1.17 by @r4victor in #3615
• [UI] Add Instance details page by @peterschmidt85 in #3614
• Add Crusoe Cloud backend by @peterschmidt85 in #3602

Full changelog: 0.20.11...0.20.12