CENMATE Aluminum 2 Bay Hard Drive Enclosure with Cooling Fan for 2.5“/3.5" SATA HDD/SSD with USB A/C 3.0, Support Hot Swappable, Tool-Free HDD Enclosure, DAS(NO RAID/NAS)

You're looking for an external case with a physical toggle-style on/off switch. Under $20: this GODO model, a brand name I'm not familiar with. $67: this Startech model, with good connectivity but that's a bit pricey $58: this Cenmate 2-bay DAS, still a bit pricey but at least you get 2 bays instead of one

https://www.amazon.com/Bay-Enclosure-Swappable-Expansion-Tool-Free/dp/B0DD3GSZBP/ref=sxin_17_pa_sp_search_thematic-asin_sspa?cv_ct_cx=2.5%2Binch%2Bdrive%2Benclosure%2Busb&sbo=RZvfv%2F%2FHxDF%2BO5021pAnSA%3D%3D&sr=1-4-9fb047b7-8fa5-469b-b7a3-6067b9412ad2-spons&aref=JW9AoEO7Zp&sp_csd=d2lkZ2V0TmFtZT1zcF9zZWFyY2hfdGhlbWF0aWM There are probably others, but your needs are indeed available all over. Disclaimer: I've never used this, I'm not recommending it specifically, it's just the first thing that popped up when I searched for "2.5 inch enclosure usb". This might well be the worst product available. No idea.