In windows ISO, you get an ESD file which is not the correct format for WDS, SCCM. You can use either DISM command or a third party software DISM++

Windows DISM command

First we check how many version in the ESP file:

Dism /Get-WimInfo /WimFile:install.esd

You will see something like:

Index:1

Name: windows 10 Home

.....

Index:2

Name: windows 10 Pro

....

Here I want to extract the windows 10 Pro out of the image, so I will select 2 for the /sourceIndex option.

User below command to convert it into WMI:

dish /export-image /SourceImageFile:install.esd /SourceIndex:2 /DestinationImageFile:install.wim /Compress:max /checkIntegrity
Tools:

DISM++ is a very powerful tool for image edit, you can do this conversion easily with it.

download it from: https://www.chuyu.me/en/index.html

Then go to File, WIM <–>ESD/SWM, choose the ESD file as input and specify the output path and name for WIM file.