The Dimension 4100 is Dell's last system in the beige case they used for the second half of the 1990s. Compared to its predecessor the 440BX/slot 1 XPS Txxxsr series, switched to i815 chipset, upped the FSB to 133MHz, dropped ISA, added 4X AGP, upped the RAM to PC133 SDRAM but dropped the third slot to go with the i815 max of 512 megs of RAM.
The nice thing about the Dimension 4100 is that they seem to be plentiful on eBay. Hopefully you don't get an early builds as those had noise issues. And they are your typical late 1990s Dell - if you get the right model, no onboard sound, no onboard video, just discrete cards of at least reasonable quality. These are the systems that made Dell's reputation in the late 1990s.
Meanwhile, if you wanted an XPS Txxxr, well, good luck finding one. I have seen almost no Txxxr (coppermines) on eBay; there are some T500/T600 Katmais occasionally. Meanwhile the 4100s are in the 800/866/933MHz range which is a big improvement.
But, one of the things that make them much cheaper than 440BX systems is the lack of ISA slots. This is not a system you get for the best retro DOS experience. This is a system you get for an outstanding ~2000 Win98SE experience, maybe Win2000 except Win2000 is meh for games, early XP, etc.
As for the floppy situation, I'm pretty sure these only support one drive, and it probably has to be 3.5". If you want to play with 5.25" drives and software only found on 5.25" drives, that machine is at least... 4-6 years too new.