You can view the DS-2019 as more like a work permit. The visa lets you leave and re-enter the country.
Some European countries work in a comparable way where you don't need a visa at all (depending where you're from), but you can't stay unless you have a valid work permit.
It's a pretty weird system.