Add config keys for controlling public/private template secondary storage replica counts by Damans227 · Pull Request #12877 · apache/cloudstack

Damans227 · 2026-03-23T16:12:29Z

Description

Adds two new operator-level configuration keys to control the number of secondary storage copies made for public and private templates, decoupling replica count from template visibility.

public.template.secstorage.copy (default: 0 = all stores, preserving existing behavior)
private.template.secstorage.copy (default: 1, preserving existing behavior)

Doc PR: apache/cloudstack-documentation#643

Types of changes

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Major
Minor

How Has This Been Tested?

Unit tests in HypervisorTemplateAdapterTest covering the new replica-limit logic in isZoneAndImageStoreAvailable.
Manually verified on a zone with multiple secondary storage pools.

…rage replica counts

codecov · 2026-03-23T16:22:13Z

Codecov Report

❌ Patch coverage is 43.47826% with 13 lines in your changes missing coverage. Please review.
✅ Project coverage is 17.95%. Comparing base (b744824) to head (6dbeb52).
⚠️ Report is 99 commits behind head on main.

Files with missing lines	Patch %	Lines
.../com/cloud/template/HypervisorTemplateAdapter.java	0.00%	5 Missing ⚠️
...n/java/com/cloud/template/TemplateAdapterBase.java	61.53%	4 Missing and 1 partial ⚠️
...n/java/com/cloud/template/TemplateManagerImpl.java	0.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #12877      +/-   ##
============================================
- Coverage     18.02%   17.95%   -0.07%     
- Complexity    16450    16526      +76     
============================================
  Files          5968     6022      +54     
  Lines        537086   541393    +4307     
  Branches      65961    66347     +386     
============================================
+ Hits          96819    97218     +399     
- Misses       429347   433208    +3861     
- Partials      10920    10967      +47

Flag	Coverage Δ
uitests	`3.53% <ø> (-0.01%)`	⬇️
unittests	`19.11% <43.47%> (-0.09%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

…vate templates

Damans227 · 2026-03-23T16:48:59Z

@blueorangutan package

blueorangutan · 2026-03-23T16:50:05Z

@Damans227 a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2026-03-23T17:33:35Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 17224

Copilot

Pull request overview

This PR introduces new template-related configuration keys intended to control how many secondary storage replicas are created for public vs private templates, decoupling replication behavior from template visibility.

Changes:

Adds two new Zone-scoped ConfigKey<Integer> settings: public.template.secstorage.copy and private.template.secstorage.copy.
Reworks secondary storage allocation logic to enforce a per-zone replica limit using a zone→count map.
Updates unit tests to match the new method signatures/replica-limit behavior.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
`engine/components-api/src/main/java/com/cloud/template/TemplateManager.java`	Adds new Zone-scoped config keys for public/private template replica limits.
`server/src/main/java/com/cloud/template/TemplateManagerImpl.java`	Registers the new config keys via `getConfigKeys()`.
`server/src/main/java/com/cloud/template/TemplateAdapterBase.java`	Replaces zone-set visibility logic with zone copy counting + replica limit enforcement.
`server/src/main/java/com/cloud/template/HypervisorTemplateAdapter.java`	Threads replica-limit and zone copy count through template creation/allocation paths.
`server/src/test/java/com/cloud/template/HypervisorTemplateAdapterTest.java`	Updates tests for the new signatures and adds coverage for replica-limit behavior.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-03-25T16:17:19Z

    /**
     * If the template/ISO is marked as private, then it is allocated to a random secondary storage; otherwise, allocates to every storage pool in every zone given by the
     * {@link TemplateProfile#getZoneIdList()}.
     */
    protected void postUploadAllocation(List<DataStore> imageStores, VMTemplateVO template, List<TemplateOrVolumePostUploadCommand> payloads) {


This method JavaDoc no longer matches the behavior: allocation is now governed by replica-limit config keys (public/private can both be limited), not strictly by template visibility (private=random vs public=all). Please update the comment to reflect the new replica-limit semantics (and that the limits are zone-scoped).

Copilot · 2026-03-25T16:17:20Z

+    ConfigKey<Integer> PublicTemplateSecStorageCopy = new ConfigKey<Integer>("Advanced", Integer.class,
+            PublicTemplateSecStorageCopyCK, "0",
+            "Maximum number of secondary storage pools to which a public template is copied. " +
+            "0 means copy to all secondary storage pools (default behavior).",
+            true, ConfigKey.Scope.Zone);
+
+    ConfigKey<Integer> PrivateTemplateSecStorageCopy = new ConfigKey<Integer>("Advanced", Integer.class,
+            PrivateTemplateSecStorageCopyCK, "1",
+            "Maximum number of secondary storage pools to which a private template is copied. " +
+            "Default is 1 to preserve existing behavior.",
+            true, ConfigKey.Scope.Zone);


The config key descriptions don’t mention that the limits are evaluated per-zone (and the keys themselves are zone-scoped). Consider clarifying the wording (e.g., “per zone”) so operators understand how replica limits are applied across multiple zones/image stores.

…c values

Copilot

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 1 comment.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Damans227 · 2026-04-15T11:46:44Z

@blueorangutan package

blueorangutan · 2026-04-15T11:48:04Z

@Damans227 a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2026-04-15T12:47:54Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 17501

Add config keys for controlling public/private template secondary sto…

40b9e4d

…rage replica counts

Daman Arora added 2 commits March 23, 2026 12:36

Allow configurable secondary storage replica count for public and pri…

f997444

…vate templates

Add unit tests

0708236

DaanHoogland requested a review from Copilot March 25, 2026 16:12

Copilot started reviewing on behalf of DaanHoogland March 25, 2026 16:13 View session

Copilot AI reviewed Mar 25, 2026

View reviewed changes

winterhazel added this to the 4.23.0 milestone Mar 28, 2026

Damans227 mentioned this pull request Apr 15, 2026

Add documentation for Template replication on secondary storage apache/cloudstack-documentation#643

Open

Refactor secondary storage replica limit handling to use zone-specifi…

e5bfeab

…c values

Damans227 requested a review from sureshanaparti April 15, 2026 09:06

sureshanaparti reviewed Apr 15, 2026

View reviewed changes

Comment thread engine/components-api/src/main/java/com/cloud/template/TemplateManager.java Outdated

sureshanaparti reviewed Apr 15, 2026

View reviewed changes

Comment thread engine/components-api/src/main/java/com/cloud/template/TemplateManager.java Outdated

sureshanaparti reviewed Apr 15, 2026

View reviewed changes

Comment thread server/src/main/java/com/cloud/template/HypervisorTemplateAdapter.java Outdated

sureshanaparti reviewed Apr 15, 2026

View reviewed changes

Comment thread server/src/main/java/com/cloud/template/HypervisorTemplateAdapter.java Outdated

sureshanaparti requested a review from Copilot April 15, 2026 09:24

Copilot started reviewing on behalf of sureshanaparti April 15, 2026 09:25 View session

Copilot AI reviewed Apr 15, 2026

View reviewed changes

Comment thread server/src/main/java/com/cloud/template/TemplateAdapterBase.java Outdated

Refactor as per pr comments

6dbeb52

Damans227 requested a review from sureshanaparti April 16, 2026 06:33

Conversation

Damans227 commented Mar 23, 2026 • edited by sureshanaparti Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Types of changes

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

How Has This Been Tested?

Uh oh!

codecov bot commented Mar 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Damans227 commented Mar 23, 2026

Uh oh!

blueorangutan commented Mar 23, 2026

Uh oh!

blueorangutan commented Mar 23, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI Mar 25, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Copilot AI Mar 25, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Damans227 commented Apr 15, 2026

Uh oh!

blueorangutan commented Apr 15, 2026

Uh oh!

blueorangutan commented Apr 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Damans227 commented Mar 23, 2026 •

edited by sureshanaparti

Loading

codecov bot commented Mar 23, 2026 •

edited

Loading