Honestly your best bet is going for a well regarded standalone headphone and combine it with something like the Antlion Modmic. Add some cable ties (preferably the twisty ones, or velcro) so you’re only dealing with one wire effectively and you get the headset form factor with the flexibility of two separate devices.
I plan to use mine as my only computer once the growing pains/BSODs I’ve been having are figured out. Another nice benefit will be that it’s insanely efficient by comparison, drawing less under full load than your old CPU alone and far, far less under idle/light use conditions.
You can always add in an eGPU dock down the line if you want some more graphics power, too (though keep in mind that’s more viable for a current gen midrange card since the data bandwidth becomes more of a bottleneck toward high end cards). A nice benefit of that will be that you can dock up with only a single cable for graphics, power and peripherals, too, and so far with my GPD G1 (also AMD based), I’ve found I can just hotplug it without any issues which is super convenient - it may be a bit more convoluted if you’re running an Nvidia based card in your enclosure, but I can’t say for sure.