Thank you for reporting a bug to Unity.
After reviewing the behavior, we've confirmed it aligns with the current design and intended use of the feature. We understand this may differ from your expectations or workflow.
We will close this case as 'As Designed.' If you have feedback on how the feature could better meet your needs, please let us know - we value your input and consider it in future improvements.
Additional info:
Hello! For now the intended behavior of sweep test is to sweep all shapes of the Rigidbody throughout the scene. We'll mark this as a request for improving the API. If you need to cast only some shapes simply looping over all the Collider components attached to the Rigidbody should suffice. (The same thing happens in our internal code).
Cheers,
AlexRvn.