Benchmark 2.2.2 goes as far as ensuring that the X Windows server is actually uninstalled from your systems. Most servers are headless and it would be possible to do this—however, you would not do this for a workstation or for a system that performs remote desktop functions. 

Be sure to apply this benchmark to your servers, but only when you know it is safe to apply it.