Allocating guest IP for nic failed: Maximum No of IPs per NIC has been crossed

[anjanahkarthic]

problem

We tried to add a secondary IP to the VM, but we got an error saying that "Allocating guest IP for nic failed: Maximum No of IPs per NIC has been crossed"
Global setting value for vm.network.nic.max.secondary.ipaddresses = 256

versions

cloudstack version 4.20.0.0.

The steps to reproduce the bug

1. Created a VM with isolated network
2. Add 10 secondary IP to VM
3. Got issue while adding 11th IP

...

What to do about it?

Need to acquire secondary ip, set in the global settings of the cloudstack.

[kiranchavala]

Thanks @anjanahkarthic was able to reproduce the issue

Will mark it as a bug

cc @sureshanaparti @DaanHoogland

2025-07-22 04:48:31,416 DEBUG [c.c.a.ApiServlet] (qtp698741991-24933:[ctx-8b6321ae]) (logid:6c1cdb90) ===START===  10.0.3.251 -- GET  nicid=9eb9f1a3-9039-42bc-b901-1ef8d2aff008&command=addIpToNic&response=json&sessionkey=vBGYRnRmyxTCEhfzk8vR6A2OlLA
2025-07-22 04:48:31,416 DEBUG [c.c.a.ApiServlet] (qtp698741991-24933:[ctx-8b6321ae]) (logid:6c1cdb90) Two factor authentication is already verified for the user 2, so skipping
2025-07-22 04:48:31,420 DEBUG [c.c.a.ApiServer] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"c129a945-46b7-11f0-adf1-1e00280002c0"}]' is allowed to perform API calls: 0.0.0.0/0,::/0
2025-07-22 04:48:31,422 INFO  [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) Account for user id c12aab3e-46b7-11f0-adf1-1e00280002c0 is Root Admin or Domain Admin, all APIs are allowed.
2025-07-22 04:48:31,422 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker.
2025-07-22 04:48:31,422 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) API rate limiting is disabled. We will not use ApiRateLimitService.
2025-07-22 04:48:31,430 ERROR [c.c.n.NetworkServiceImpl] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) Maximum Number of Ips "vm.network.nic.max.secondary.ipaddresses = "10 per Nic has been crossed for the nic Nic {"broadcastUri":"vlan:\/\/2153","deviceId":0,"iPv4Address":"10.1.1.68","id":504,"instanceId":681,"reservationId":"40a6e090-afba-49b3-8d30-becc55f85bb7","uuid":"9eb9f1a3-9039-42bc-b901-1ef8d2aff008"}.
2025-07-22 04:48:31,440 INFO  [c.c.a.ApiServer] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) Allocating guest ip for nic failed : Maximum Number of Ips per Nic has been crossed.
2025-07-22 04:48:31,440 DEBUG [c.c.a.ApiServlet] (qtp698741991-24933:[ctx-8b6321ae, ctx-c6abd744]) (logid:6c1cdb90) ===END===  10.0.3.251 -- GET  nicid=9eb9f1a3-9039-42bc-b901-1ef8d2aff008&command=addIpToNic&response=json&sessionkey=vBGYRnRmyxTCEhfzk8vR6A2OlLA

[sureshanaparti]

@anjanahkarthic @kiranchavala It seems the value of the config is set to NULL in the db, can you set the value of the configuration 'vm.network.nic.max.secondary.ipaddresses' and restart the management server?

(localcloud) 🐱 > list configurations name=vm.network.nic.max.secondary.ipaddresses
{
  "configuration": [
    {
      "category": "NetworkManager",
      "component": "management-server",
      "defaultvalue": "256",
      "description": "Specify the number of secondary ip addresses per nic per vm",
      "displaytext": "Vm network nic max secondary ipaddresses",
      "group": "Compute",
      "isdynamic": false,
      "name": "vm.network.nic.max.secondary.ipaddresses",
      "subgroup": "Virtual Machine",
      "type": "Number"
    }
  ],
  "count": 1
}

mysql> SELECT * FROM cloud.configuration WHERE name LIKE '%vm.network.nic.max.secondary.ipaddresses%'\G;
*************************** 1. row ***************************
     category: NetworkManager
     instance: DEFAULT
    component: management-server
         name: vm.network.nic.max.secondary.ipaddresses
        value: NULL
  description: Specify the number of secondary ip addresses per nic per vm
default_value: 256
      updated: NULL
   is_dynamic: 0
     group_id: 3
  subgroup_id: 7
       parent: NULL
 display_text: Vm network nic max secondary ipaddresses
         kind: NULL
      options: NULL
        scope: 0
1 row in set (0.00 sec)

As per the code, if the value is not set, it takes default value as 10. The default value in the DB & code are not in sync, I'll check/fix that.

cloudstack/server/src/main/java/com/cloud/network/NetworkServiceImpl.java

Lines 910 to 915 in 23de6c7

	int maxAllowedIpsPerNic = NumbersUtil.parseInt(_configDao.getValue(Config.MaxNumberOfSecondaryIPsPerNIC.key()), 10);
	Long nicWiseIpCount = _nicSecondaryIpDao.countByNicId(nicId);
	if (nicWiseIpCount.intValue() >= maxAllowedIpsPerNic) {
	logger.error("Maximum Number of Ips \"vm.network.nic.max.secondary.ipaddresses = \"{} per Nic has been crossed for the nic {}.", maxAllowedIpsPerNic, nicVO);
	throw new InsufficientAddressCapacityException("Maximum Number of Ips per Nic has been crossed.", Nic.class, nicId);
	}