Hi and welcome to the board!
some DVD players (really not many) will support computer video files, such as MPEG and even more rarely AVI. I doubt you will find one that supports Quicktime files, and in any case I think you're more looking for a general solution...

There are two solutions I can think about. One is to look if your DVD burning software (Nero, for instance) recognizes quicktime files. To do that, just try to create a video CD or video DVD, and insert the files. If all goes well, you'll be set. I believe you can create a basic menu, with thumbnails, using this feature.
One other solution would be to use Windows Movie Maker. Again this supposes the software recognizes the files. This software allows you to create continuous movies, with transitions, text introduction, music, etc. You can then export to CD or DVD, and the software will process the files as needed.
If those two methods don't work because the files are not recognized, simply use a Media converter to convert your files (ideally with batch processing, though for that you might have to get a paying software). I know Windows make some sort of Media Editor, there are probably many free or shareware programs out there.
I hope this helps!