laptop as headless server - much performance gain over direct use?

i have a desktop with AMD 5700xt, and laptop with integrated amd gpu + geforce4050. i've only really had luck with amuseAi on the desktop and am doing most of my work on the laptop as it performs better.

performance is pretty marginal, as you'd expect from a consumer grade laptop...

how much of a performance boost would i get by using the laptop as a headless server? i.e. install some headless minimal linux with no desktop, and literally only ml tools installed, and have a client on the desktop send jobs to it.