For a desktop yes. You can dock it and forget that it's not a regular Linux desktop. Especially if it means Python and JS, you don't need much power for that.
For a laptop not so much, because you'll need to bring screen+keyboard+mouse and everything to plug them so the portability aspect seriously suffers.
It's a bad idea because you can get a regular laptop and AR glasses just as light as those. Check nreal, rokid...
This way you can use the laptop as a regular laptop and the glasses with other devices.