[Question] update from 3.1.9 to 3.4.0, master can't connect to worker

[hardstuding]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

When I update from 3.1.9 to 3.4.0, I can't select worker group.
All task run will raise an error
ERROR [WorkerGroupTaskDispatcher-1150] o.a.d.s.m.e.t.d.WorkerGroupDispatcher:[102] - Dispatch Task: 213244 failed will retry after: 1000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException: Dispatch task

I found that the default "dolphin.scheduler.network.interface.preferred" in worker-server/conf/common.properties maybe change, and I try to change the worker ip use UI or CONFIG.But when I create a task, I still can't select worker.

Also, I can't select task group as well.

When I update,"sh ./tools/bin/migrate-resource.sh" and "sh ./tools/bin/migrate-lineage.sh" will raise error,so I skip it.

My hdfs is using CDH6.3.2,I don't change the jar.Maybe it will case the issue?

Could anyone help?

What you expected to happen

I don't know,I try to change the ip,but no use

How to reproduce

update from 3.1.9 to 3.4.0,

Anything else

No response

Version

3.4.0

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[ruanwenjun]

Please provide more detail.

1. Can you see the worker at registry?
2. Does the worker is correctly at UI?
3. You cannot select worker or workergroup? task cannot directly use worker.

[hardstuding]

Please provide more detail.

1. Can you see the worker at registry?
2. Does the worker is correctly at UI?
3. You cannot select worker or workergroup? task cannot directly use worker.

1、yes, I can see
2、I change the ip, so it correct
3、yes, I can't select.When I run task,raise the error Dispatch Task: 213244 failed will retry after: 1000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException

[ruanwenjun]

@hardstuding

2、I change the ip, so it correct

You means the worker's network interface is incorrect? You can use dolphin.scheduler.network.interface.preferred to set the network interface. And please provide the full exception stack.

3、yes, I can't select.When I run task,raise the error Dispatch Task: 213244 failed will retry after: 1000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException

You means the worker is at workergroup, but the worker's address is incorrect, so the master cannot connect to the worker?

[hardstuding]

@hardstuding

2、I change the ip, so it correct

You means the worker's network interface is incorrect? You can use dolphin.scheduler.network.interface.preferred to set the network interface. And please provide the full exception stack.

3、yes, I can't select.When I run task,raise the error Dispatch Task: 213244 failed will retry after: 1000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException

You means the worker is at workergroup, but the worker's address is incorrect, so the master cannot connect to the worker?

2、yes, when I update to 3.4.0, the defualt dolphin.scheduler.network.interface.preferred changed, so I change the worker ip use ui.
this img is 3.1.9

after update to 3.4.0

I notice that some IPs change from startswith '10' to startswith '192', so I modify the ip to startswith '192'.
Also, I have attempted to keep the IP, otherwise modify dolphin.scheduler.network.interface.preferred=eh0

But, these two attempts finally don't work.

Full exception stack
[WI-0][TI-0] - 2026-02-28 18:24:31.140 INFO [TaskGroupCoordinator-Thread] o.a.d.s.m.e.TaskGroupCoordinator:[150] - Success amend TaskGroup useSize cost: 1/ms [WI-68239][TI-213225] - 2026-02-28 18:24:31.276 ERROR [WorkerGroupTaskDispatcher-1150] o.a.d.s.m.e.t.d.WorkerGroupDispatcher:[102] - Dispatch Task: 213225 failed will retry after: 9000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException: Dispatch task: 签到信息表to hive to 172.31.35.1:1234 failed at org.apache.dolphinscheduler.server.master.engine.task.client.PhysicalTaskExecutorClientDelegator.dispatch(PhysicalTaskExecutorClientDelegator.java:87) at org.apache.dolphinscheduler.server.master.engine.task.client.TaskExecutorClient.dispatch(TaskExecutorClient.java:54) at org.apache.dolphinscheduler.server.master.engine.task.dispatcher.WorkerGroupDispatcher.doDispatchTask(WorkerGroupDispatcher.java:94) at org.apache.dolphinscheduler.server.master.engine.task.dispatcher.WorkerGroupDispatcher.run(WorkerGroupDispatcher.java:79) Caused by: org.apache.dolphinscheduler.extract.base.exception.RemoteException: Call method to Host(ip=172.31.35.1, port=1234) failed at org.apache.dolphinscheduler.extract.base.client.NettyRemotingClient.sendSync(NettyRemotingClient.java:147) at org.apache.dolphinscheduler.extract.base.client.SyncClientMethodInvoker.invoke(SyncClientMethodInvoker.java:51) at org.apache.dolphinscheduler.extract.base.client.ClientInvocationHandler.invoke(ClientInvocationHandler.java:56) at com.sun.proxy.$Proxy208.dispatchTask(Unknown Source) at org.apache.dolphinscheduler.server.master.engine.task.client.PhysicalTaskExecutorClientDelegator.dispatch(PhysicalTaskExecutorClientDelegator.java:78) ... 3 common frames omitted Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: /172.31.35.1:1234 at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe$2.run(AbstractEpollChannel.java:576) at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:170) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at java.lang.Thread.run(Thread.java:750) [WI-0][TI-0] - 2026-02-28 18:24:36.149 INFO [TaskGroupCoordinator-Thread] o.a.d.s.m.e.TaskGroupCoordinator:[150] - Success amend TaskGroup useSize cost: 1/ms [WI-68242][TI-213226] - 2026-02-28 18:24:40.285 ERROR [WorkerGroupTaskDispatcher-1150] o.a.d.s.m.e.t.d.WorkerGroupDispatcher:[102] - Dispatch Task: 213226 failed will retry after: 10000/ms org.apache.dolphinscheduler.server.master.exception.dispatch.TaskDispatchException: Dispatch task: keep_cookies to 172.31.35.1:1234 failed

3、I modify the worker's address, so I think it is correct.
But there are only default I can select.

[ruanwenjun]

@hardstuding You need to check if the workergroup has been assigned to the project.

[hardstuding]

@hardstuding You need to check if the workergroup has been assigned to the project.

You mean that 3.4.0 add workergroup ”Permission Management“, I need to assign workergroup to project.
Let me try.