That is really out of your control as all videos are pretty much big in file. Someone with dialup will have slow results no matter what they are doing. The only thing you can do as a designer is make the site work for what the standard user use as far as resolution, etc.
You can't make someone with low speed internet download/view a video faster then what their connection allows. You could try compressing the videos, but that means you have to do ALOT of work on your end to make those with low speed happy. The majority of users today have decent speeds and those are who you should be targeting.
JMO
i have full contol on every thing
on the server, website and all the videos
i can work on it on the server side
i can also work on it on the programming side
and last but not least on the videos side
do the math 1 + 2 + 3 = faster videos then before
i installed the ffmpeg and all the other stuff on the server and i'm studying right know the documentations for them to see how can i use them
also i'm looking on better template for the videos
http://support.microsoft.com/kb/285154also i'm looking for independent video player base on flash as a try to see how the videos will look like if i convert them to flash
so i'm working on it, and i think that i will find something make my visitors happy