I've found good deals at online auctions. I picked up a 2/4 gig drive a few years ago I still use at home.
If you need something bigger, the DLT drives and AIT drives are the big mommas. They go for $500 or more used, but have capacities of 50 Gig or more per tape.
Under those are the exabyte VXA packet oriented drives which are kinda slow, but do 33 gigs native, and are designed to be readable even after catastrophies like dropping a tape in the toilet etc...
The used 8mm exabytes aren't a bad deal, and hold 7 to 20 gigs native, if I remember.
Then you're down to the 4mm drives which run 2/4/12 gigs native (DDS 1/2/3 respectively) I've used the 12 gigs, and while the drive failure rate was higher than I'd like, the drives worked well when they were actually running. That was when they first came out, so it's likely they're much more reliable now.
I use an exabyte 8mm 7Gig drive and it's quite nice and easy to use with linux (mt and tar are all I need)