[opensuse] Is it possible to limit the download speed fo Firefox?

older
[opensuse] Grub of a new install...

Carlos E. R.

14 Apr 2014 14 Apr '14

01:24

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, My internet bandwidth is only 1 Mbit/s. On the occasions when I have to use Firefox to download something large, that can take an hour, I can not do anything with Internet on any other thing on the machine during that time. Even DNS fails to respond. I prefer to use something like wget and limit its bandwidth, but some downloads have to be done directly by Firefox (like a youtube video). So... Can I limit the download speed used by Firefox, when downloading files? - -- Cheers Carlos E. R. (from 12.3 x86_64 "Dartmouth" at Telcontar) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) iEYEARECAAYFAlNLONkACgkQtTMYHG2NR9WMOQCghUwEN/AAdUEv4HfN5WeaB58V GfAAniKMIxduKH4CrEfyNzB5dZ8oq0z/ =ON8p -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Show replies by date

Basil Chupin

14 Apr 14 Apr

01:55

On 14/04/14 11:24, Carlos E. R. wrote:

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

Hi,

My internet bandwidth is only 1 Mbit/s. On the occasions when I have to use Firefox to download something large, that can take an hour, I can not do anything with Internet on any other thing on the machine during that time. Even DNS fails to respond.

I prefer to use something like wget and limit its bandwidth, but some downloads have to be done directly by Firefox (like a youtube video).

So... Can I limit the download speed used by Firefox, when downloading files?

I doubt it but what you could use is the extension called DownThemAll! which I always use when downloading. With DTA you can pause a download and then resume it. However, I have never used it for YouTube (for which I use DownloadHelper). BC -- Using openSUSE 13.1, KDE 4.12.4 & kernel 3.14.0-2 on a system with- AMD FX 8-core 3.6/4.2GHz processor 16GB PC14900/1866MHz Quad Channel RAM Gigabyte AMD3+ m/board; Gigabyte nVidia GTX660 GPU -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

03:38

On 2014-04-14 03:55, Basil Chupin wrote:

...

On 14/04/14 11:24, Carlos E. R. wrote:

...

...
So... Can I limit the download speed used by Firefox, when downloading files?

I doubt it but what you could use is the extension called DownThemAll! which I always use when downloading. With DTA you can pause a download and then resume it. However, I have never used it for YouTube (for which I use DownloadHelper).

I'm using "Flash Video Downloader" for youtube videos. I have used "DownThemAll!" in Windows, I don't know if they are compatible. I'll try. I have to use something to download videos from youtube, because trying to watch videos online is impossible with my internet speed: 1 Mbit/s is sufficiently "slow" to make video watching stutter intolerably. So instead I use the addon to download the file so that I can watch it later. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Basil Chupin

03:50

On 14/04/14 13:38, Carlos E. R. wrote:

...

On 2014-04-14 03:55, Basil Chupin wrote:

...
On 14/04/14 11:24, Carlos E. R. wrote:

...
...
So... Can I limit the download speed used by Firefox, when downloading files? I doubt it but what you could use is the extension called DownThemAll! which I always use when downloading. With DTA you can pause a download and then resume it. However, I have never used it for YouTube (for which I use DownloadHelper). I'm using "Flash Video Downloader" for youtube videos. I have used "DownThemAll!" in Windows, I don't know if they are compatible. I'll try.

As far as I am aware all versions of any Add-on are compatible (Windows, Linux, Apple) except, of course, they look different and possibly have the options shown in different locations :-) .

...

I have to use something to download videos from youtube, because trying to watch videos online is impossible with my internet speed: 1 Mbit/s is sufficiently "slow" to make video watching stutter intolerably.

So instead I use the addon to download the file so that I can watch it later.

I hardly ever watch them online. I start the video then start DownloadHelper and then pause the video; the video continues to be downloaded in the background. BC -- Using openSUSE 13.1, KDE 4.12.4 & kernel 3.14.0-2 on a system with- AMD FX 8-core 3.6/4.2GHz processor 16GB PC14900/1866MHz Quad Channel RAM Gigabyte AMD3+ m/board; Gigabyte nVidia GTX660 GPU -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

04:23

On 2014-04-14 05:50, Basil Chupin wrote:

...

On 14/04/14 13:38, Carlos E. R. wrote:

...
On 2014-04-14 03:55, Basil Chupin wrote:

...

...
I'm using "Flash Video Downloader" for youtube videos. I have used "DownThemAll!" in Windows, I don't know if they are compatible. I'll try.

As far as I am aware all versions of any Add-on are compatible (Windows, Linux, Apple) except, of course, they look different and possibly have the options shown in different locations :-) .

No, I mean if "DownThemAll!" works nicely with a flash download started with "Flash Video Downloader". I looked at the features page of "DownThemAll!", and what I gather is that it is an "aggressive" downloader, downloading several chunks simultaneously to increase speed. I want to decrease it.

...

I hardly ever watch them online. I start the video then start DownloadHelper and then pause the video; the video continues to be downloaded in the background.

With default FF, pause does not download it all entirely to local cache, it stops after a little while. You have to use some add-on. The procedure you describe is the same as I do with "Flash Video Downloader". The problem is telling it to go slower. But I have solved my problem with Carl suggestion, it works nicely. Of course, it has dozens of complicated CLI options... -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Basil Chupin

11:24

On 14/04/14 14:23, Carlos E. R. wrote:

...

On 2014-04-14 05:50, Basil Chupin wrote:

...
On 14/04/14 13:38, Carlos E. R. wrote:

...
On 2014-04-14 03:55, Basil Chupin wrote:

...
...
I'm using "Flash Video Downloader" for youtube videos. I have used "DownThemAll!" in Windows, I don't know if they are compatible. I'll try. As far as I am aware all versions of any Add-on are compatible (Windows, Linux, Apple) except, of course, they look different and possibly have the options shown in different locations :-) . No, I mean if "DownThemAll!" works nicely with a flash download started with "Flash Video Downloader".

I looked at the features page of "DownThemAll!", and what I gather is that it is an "aggressive" downloader, downloading several chunks simultaneously to increase speed. I want to decrease it.

I think that you misundestood this setting. You can set DTA to open several connections to the server from which you are downloading the file which speeds the whole download because the file is cached at your ISP's end as the bits arrive; the file bits are then sorted and integrated when sent to your computer to form the complete file. There is no way that you can get an increase of speed from the ISP to you - magic doesn't exist in the real world :-) .

...

I hardly ever watch them online. I start the video then start DownloadHelper and then pause the video; the video continues to be downloaded in the background. With default FF, pause does not download it all entirely to local cache, it stops after a little while. You have to use some add-on. The procedure you describe is the same as I do with "Flash Video Downloader". The problem is telling it to go slower.

But I have solved my problem with Carl suggestion, it works nicely. Of course, it has dozens of complicated CLI options...

Ah, that's good, and so it is all well with the world, eh? :-) BC -- Using openSUSE 13.1, KDE 4.12.4 & kernel 3.14.0-2 on a system with- AMD FX 8-core 3.6/4.2GHz processor 16GB PC14900/1866MHz Quad Channel RAM Gigabyte AMD3+ m/board; Gigabyte nVidia GTX660 GPU -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

12:05

On 2014-04-14 13:24, Basil Chupin wrote:

...

On 14/04/14 14:23, Carlos E. R. wrote:

...

...
I looked at the features page of "DownThemAll!", and what I gather is that it is an "aggressive" downloader, downloading several chunks simultaneously to increase speed. I want to decrease it.

I think that you misundestood this setting.

You can set DTA to open several connections to the server from which you are downloading the file which speeds the whole download because the file is cached at your ISP's end as the bits arrive; the file bits are then sorted and integrated when sent to your computer to form the complete file.

There is no way that you can get an increase of speed from the ISP to you - magic doesn't exist in the real world :-) .

I know that, I did not get confused. It is a similar trick as used by aria2c to download the opensuse DVD. The idea is that the upstream server limits the download speed to, say, 100 KB per connection. Your pipe is 10 MB, so you open 20 simultaneous connections to him, each downloading a different chunk of the same file. This is known as "aggressive downloading". aria2c does simultaneous downloads of different chunks of the same file from different servers (mirrors), so it is polite. http://www.downthemall.net/howto/features/ +++······················· Increase your download speed up to 400% DownThemAll features a smart download technique called ‘multipart download’. It splits files into multiple sections, which are downloaded simultaneously. This maximized use of bandwidth increases average download speed up to 400%. You can manually add or remove sections whenever you want during the download, and you can choose the maximum number of chunks every file is split into. ·······················++- I do not want an aggressive downloader. I want a very meek downloader.

...

...
But I have solved my problem with Carl suggestion, it works nicely. Of course, it has dozens of complicated CLI options...

Ah, that's good, and so it is all well with the world, eh? :-)

Sigh... unfortunately, it does not a continuous throttling, but a very coarse throttling. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Felix Miata

02:12

On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...

...some downloads have to be done directly by Firefox...

It's often possible to use wget by starting the download with FF, capturing the source URL from the FF download manager, feeding it to wget, then aborting the FF download. Before the "Preserve Download Modification Timestamp" extension existed, that's how I did a lot of downloading. Wget has an extension for OS/2 called Awget that allows wget to do the download by dragging the download URL to the desktop. Maybe that concept exists for Linux in some fashion as well? -- "The wise are known for their understanding, and pleasant words are persuasive." Proverbs 16:21 (New Living Translation) Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata *** http://fm.no-ip.com/ -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carl Hartung

02:38

On Sun, 13 Apr 2014 22:12:23 -0400 Felix Miata wrote:

...

On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...
...some downloads have to be done directly by Firefox...

It's often possible to use wget by starting the download with FF, capturing the source URL from the FF download manager, feeding it to wget, then aborting the FF download. Before the "Preserve Download Modification Timestamp" extension existed, that's how I did a lot of downloading.

Wget has an extension for OS/2 called Awget that allows wget to do the download by dragging the download URL to the desktop. Maybe that concept exists for Linux in some fashion as well?

There's an elegant cli solution for this called 'youtube-dl' http://rg3.github.io/youtube-dl/ "youtube-dl is a small command-line program to download videos from YouTube.com and a few more sites. It requires the Python interpreter (2.6, 2.7, or 3.3+), and it is not platform specific. It should work in your Unix box, in Windows or in Mac OS X. It is released to the public domain, which means you can modify it, redistribute it or use it however you like." Among the many, many options is "-r, --rate-limit" to limit maximum download rate in bytes per second (e.g. 50K or 4.2M) You can probe to discover available resolutions and file types, e.g.: ~> youtube-dl -F https://www.youtube.com/watch?v=rsL6mKxtOlQ [youtube] Setting language [youtube] rsL6mKxtOlQ: Downloading webpage [youtube] rsL6mKxtOlQ: Downloading video info webpage [youtube] rsL6mKxtOlQ: Extracting video information [info] Available formats for rsL6mKxtOlQ: format code extension resolution note 171 webm audio only DASH webm audio , audio@ 48k (worst) 140 m4a audio only DASH audio , audio@128k 160 mp4 192p DASH video 242 webm 240p DASH webm 133 mp4 240p DASH video 243 webm 360p DASH webm 134 mp4 360p DASH video 17 3gp 176x144 36 3gp 320x240 5 flv 400x240 43 webm 640x360 18 mp4 640x360 (best) Then select to download the 640x360 mp4 version like this: ~> youtube-dl -f 18 https://www.youtube.com/watch?v=rsL6mKxtOlQ Invoke 'youtube-dl --help' to view additional options. hth & regards, Carl -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

04:16

On 2014-04-14 04:38, Carl Hartung wrote:

...

On Sun, 13 Apr 2014 22:12:23 -0400 Felix Miata wrote:

...
On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...

There's an elegant cli solution for this called 'youtube-dl'

Interesting... I'll have to try that one. It is available on oss repo :-)

...

You can probe to discover available resolutions and file types, e.g.:

...

[info] Available formats for rsL6mKxtOlQ: format code extension resolution note 171 webm audio only DASH webm audio , audio@ 48k (worst) 140 m4a audio only DASH audio , audio@128k 160 mp4 192p DASH video

It does not say expected size, though... o can get that info with firefox, though. Ha, and FF does not say the resolution!

...

Then select to download the 640x360 mp4 version like this:

~> youtube-dl -f 18 https://www.youtube.com/watch?v=rsL6mKxtOlQ

Invoke 'youtube-dl --help' to view additional options.

Wonderful! And I can also tell it to download subtitles. And it does resume after interrupt! This is a jewel! :-) -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Carlos E. R.

11:53

On 2014-04-14 06:16, Carlos E. R. wrote:

...

On 2014-04-14 04:38, Carl Hartung wrote:

...

...
Invoke 'youtube-dl --help' to view additional options.

Wonderful! And I can also tell it to download subtitles. And it does resume after interrupt!

This is a jewel! :-)

I found a hurdle. Download Options: -r, --rate-limit LIMIT maximum download rate in bytes per second (e.g. 50K or 4.2M) Using "-r 50K" with several combinations does not limit speed to 50K, but rather to an average 50K by stopping it fully at intervals, then continuing at full speed. It says: [download] 25.5% of 455.72MiB at 66.10KiB/s ETA 01:27:38 But my gkrelm shows it going at either 0 or >100K, for several long seconds. And during full speed intervals, I can not send email, for instance. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Per Jessen

13:30

Carlos E. R. wrote:

...

On 2014-04-14 06:16, Carlos E. R. wrote:

...
On 2014-04-14 04:38, Carl Hartung wrote:

...
...
Invoke 'youtube-dl --help' to view additional options.

Wonderful! And I can also tell it to download subtitles. And it does resume after interrupt!

This is a jewel! :-)

I found a hurdle.

Download Options: -r, --rate-limit LIMIT maximum download rate in bytes per second (e.g. 50K or 4.2M)

Using "-r 50K" with several combinations does not limit speed to 50K, but rather to an average 50K by stopping it fully at intervals, then continuing at full speed.

That's a pity, it seemed like a god solution. I guess the rate-calculator has room for improvement. If you need this sort of rate limiting frequently, you could look at using 'tc' (traffic control) on your firewall. It's quite complex to set up, but it works very well. I used to use it for reserving bandwidth for VoIP. Another simple option is to see if TOS works for you: iptables -A PREROUTING -t mangle -p udp --dport 53 -j TOS --set-tos Minimize-Delay I've got that sort of thing in my firewall for dns and ssh, but I have never tried to see if it actually has any effect :-) -- Per Jessen, Zürich (16.0°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

ellanios82

13:57

On 04/14/2014 04:30 PM, Per Jessen wrote:

...

does not limit speed to 50K

- if one could find a torrent to handle download, then ones ISP would surely arrange to throttle ? .......... regards -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

14:08

On 2014-04-14 15:30, Per Jessen wrote:

...

Carlos E. R. wrote:

...
On 2014-04-14 06:16, Carlos E. R. wrote:

...
On 2014-04-14 04:38, Carl Hartung wrote:

...
...
Invoke 'youtube-dl --help' to view additional options.

...

...
Using "-r 50K" with several combinations does not limit speed to 50K, but rather to an average 50K by stopping it fully at intervals, then continuing at full speed.

That's a pity, it seemed like a god solution. I guess the rate-calculator has room for improvement.

Yep :-( OR, youtube can not be controlled otherwise... :-?

...

If you need this sort of rate limiting frequently, you could look at using 'tc' (traffic control) on your firewall. It's quite complex to set up, but it works very well. I used to use it for reserving bandwidth for VoIP.

Not frequently, no. But see later.

...

Another simple option is to see if TOS works for you:

iptables -A PREROUTING -t mangle -p udp --dport 53 -j TOS --set-tos Minimize-Delay

I've got that sort of thing in my firewall for dns and ssh, but I have never tried to see if it actually has any effect :-)

BUT, that would allow DNS traffic to work on my desktop, not on the rest of gadgets on the house. I would have to set that up in the router instead, and this is limited to what the manufacturer designed (it is a TP-LINK TD-W8970). I will try "trickle" combined with "youtube-dl". If that works it should be the easiest solution. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

David Haller

17 Apr 17 Apr

07:00

Hello, On Mon, 14 Apr 2014, Carlos E. R. wrote:

...

On 2014-04-14 06:16, Carlos E. R. wrote:

...
On 2014-04-14 04:38, Carl Hartung wrote:

...
Invoke 'youtube-dl --help' to view additional options. [..] Download Options: -r, --rate-limit LIMIT maximum download rate in bytes per second (e.g. 50K or 4.2M)

Using "-r 50K" with several combinations does not limit speed to 50K, but rather to an average 50K by stopping it fully at intervals, then continuing at full speed.

Try clive and tell it to use wget and add the --limit-rate option. ==== ~/.cliverc ==== --get-with 'wget --limit-rate=50k -O %n %u' ==== wget does limit the rate smoothly to within a few bytes ;) (clive looks for it's (user) config in: ~/.cliverc, ~/.clive/config and ~/.config/clive/config (in that order). HTH, -dnh -- Beka: Why is it that whenever I start to feel optimistic, you become a pessimist? Dylan: It's a little-know law of thermodynamics: the conservation of optimism. There's only so much to go around. Beka: In that case, it's simple. Lower your expectations. Dylan: You're right. -- Andromeda 1x22 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

11:55

On 2014-04-17 09:00, David Haller wrote:

...

Try clive and tell it to use wget and add the --limit-rate option.

Mmm, what is clive? http://clive.sourceforge.net/ clive is currently maintained only. Please see cclive, the rewrite of clive, which is a more active project. http://cclive.sourceforge.net/ +++························ cclive is a tool for downloading media from YouTube and similar websites. It has a low memory footprint compared to other existing tools. cclive works closely with the quvi project to work around to the flash technology that is being utilized by different media hosts to deliver the content. ························++- Both are available from the "home:dnh" repos (and packman), and quvi is at the "oss" repo (and packman). It is unclear if they can download subtitles.

...

==== ~/.cliverc ==== --get-with 'wget --limit-rate=50k -O %n %u' ====

wget does limit the rate smoothly to within a few bytes ;)

Yes, it does.

...

(clive looks for it's (user) config in:

~/.cliverc, ~/.clive/config and ~/.config/clive/config

(in that order).

I'll try, thanks. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

David Haller

20:41

Hello, On Thu, 17 Apr 2014, Carlos E. R. wrote:

...

On 2014-04-17 09:00, David Haller wrote:

...
Try clive and tell it to use wget and add the --limit-rate option.

Mmm, what is clive?

http://clive.sourceforge.net/

Yes.

...

clive is currently maintained only.

Works nicely here ;) I like clive esp. because it's written in perl and can be hacked on more easily ;)

...

http://cclive.sourceforge.net/

Should work also and even has a --throttle option/config. It throttles smoothly (if not very accurate '--throttle 50' resulted in ~46KB/s.

...

Both are available from the "home:dnh" repos (and packman), and quvi is at the "oss" repo (and packman). It is unclear if they can download subtitles.

Do you have a sample url? -dnh -- "Scope?" "Check." "Shields?" "Check." "Range finders?" "Check." "Rams?" "Check." "Baton, pepperspray, CS-gas?" "Check. Check. Check." "Remmy?" "Check." Ed: "Lipgloss?" Wordy: "Check." "Rookie?" "Check." "Let's keep the peace." -- Flashpoint 1x02 - First In Line -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

24 Apr 24 Apr

01:54

On 2014-04-17 22:41, David Haller wrote:

...

Hello,

On Thu, 17 Apr 2014, Carlos E. R. wrote:

...

...
clive is currently maintained only.

Works nicely here ;) I like clive esp. because it's written in perl and can be hacked on more easily ;)

I can not make it work: +++·······················

...

cer@AmonLanc:~> clive -F "https://www.youtube.com/watch?v=rsL6mKxtOlQ" Detect quvi from $PATH Check for quvi ...0.9.3 Copyright (C) 2012,2013 Toni Gundogdu quvi comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of quvi under the terms of the GNU Affero General Public License version 3 or later. For more information, see http://www.gnu.org/licenses/agpl.html.

To contact the developers, please mail to Detect a download command from $PATH Check for curl ...7.32.0 Checking ...error: `https://www.youtube.com/watch?v=rsL6mKxtOlQ' is not a quvi command. See 'quvi help'. cer@AmonLanc:~> ·······················++-

And that syntax is directly out of the man page. But cclive does, so the url is correct: +++·······················

...

cer@AmonLanc:~> cclive -F "https://www.youtube.com/watch?v=rsL6mKxtOlQ" Checking ... ....... ....... done. fmt05_240p|fmt17_144p|fmt18_360p|fmt36_240p|fmt43_360p : https://www.youtube.com/watch?v=rsL6mKxtOlQ cer@AmonLanc:~> ·······················++-

On my main computer I'm happy with trickle and youtube-dl, the combo solves all my problems. However, I often use an old laptop to do long downloads while my main computer is powered off (less electricity: 50W vs 200W). This laptop is 32 bit, and it happens that "trickle" is not available in 32 bit. Maybe I'll have a go at building it.

...

...
http://cclive.sourceforge.net/

Should work also and even has a --throttle option/config. It throttles smoothly (if not very accurate '--throttle 50' resulted in ~46KB/s.

...
Both are available from the "home:dnh" repos (and packman), and quvi is at the "oss" repo (and packman). It is unclear if they can download subtitles.

Do you have a sample url?

I don't have one right now with subtitles. Many report they have, but often they don't exist. Only "youtube-dl" is capable of getting them, apparently. I can use: youtube-dl --skip-download --write-sub --sub-lang 'en,es' \ -f FORMAT URL to get them, and clive to get the video at low speed. One further interesting feature of youtube-dl is this one: -U, --update update this program to latest version. Make sure that you have sufficient permissions (run with sudo if needed) -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

David Haller

18:24

Hello, On Thu, 24 Apr 2014, Carlos E. R. wrote:

...

On 2014-04-17 22:41, David Haller wrote:

...
On Thu, 17 Apr 2014, Carlos E. R. wrote:

...
clive is currently maintained only. Works nicely here ;) I like clive esp. because it's written in perl and can be hacked on more easily ;)

I can not make it work:

+++·······················

...
cer@AmonLanc:~> clive -F "https://www.youtube.com/watch?v=rsL6mKxtOlQ" Detect quvi from $PATH Check for quvi ...0.9.3 [..] Detect a download command from $PATH Check for curl ...7.32.0 Checking ...error: `https://www.youtube.com/watch?v=rsL6mKxtOlQ' is not a quvi command. See 'quvi help'. cer@AmonLanc:~> ·······················++-

And that syntax is directly out of the man page.

Works here: $ clive -F "https://www.youtube.com/watch?v=rsL6mKxtOlQ" Checking ...done. fmt05_240p|fmt17_144p|fmt18_360p|fmt36_240p|fmt43_360p : http://www.youtube.com/watch?v=rsL6mKxtOlQ $ rpm -q --qf '%{name}-%{version}-%{release} %{distribution}\n' \ clive quvi libquvi7 libquvi-scripts clive-2.3.3-3.1 home:dnh / openSUSE_12.1 quvi-0.4.2-2.1 home:dnh / openSUSE_12.1_Update_standard libquvi7-0.4.1-1.1 home:dnh / openSUSE_12.1_Update_standard libquvi-scripts-0.4.9-2.1 home:dnh / openSUSE_12.1_Update_standard Those should basically be the same as the ones on packman (or older 0.4x ones from multimedia:libs, the new 0.9x are changed significantly)

...

But cclive does, so the url is correct:

Use that then. Depending on libquvi-scripts, you have quite a varying selection of supported sites. youtube-dl seems to have supposedly support for other sites, but it won't work: Error: URL does not seem to be a youtube video URL. If it is, report a bug.

...

I don't have one right now with subtitles. Many report they have, but often they don't exist. Only "youtube-dl" is capable of getting them, apparently. I can use:

youtube-dl --skip-download --write-sub --sub-lang 'en,es' \

All those options are unsupported by "my" youtube-dl (just updated to 2014.03.07.1). What version do you have and from where? -dnh -- I could've, but soft Scottish female voices makes my knees weak and language switch had already been initiated. Thus, it would've been more trouble than it was wotrh, switching langauge back. //ingvar (hot-pluggable BrainOS language modules, new off the presses!) -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

14 Apr 14 Apr

03:44

On 2014-04-14 04:12, Felix Miata wrote:

...

On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...
...some downloads have to be done directly by Firefox...

It's often possible to use wget by starting the download with FF, capturing the source URL from the FF download manager, feeding it to wget, then aborting the FF download. Before the "Preserve Download Modification Timestamp" extension existed, that's how I did a lot of downloading.

Does not work. I get: wget: unable to resolve host address ‘r4---sn-h5q7enls.googlevideo.com’ As I said, name solving fails while the download is running... I don't know if the download would work at all if I can not even solve the name. But that's the name pasted from the link the download manager says it is using...

...

Wget has an extension for OS/2 called Awget that allows wget to do the download by dragging the download URL to the desktop. Maybe that concept exists for Linux in some fashion as well?

I have seen sometimes the default download manager that Firefox uses internally with something else. [...] Send of this very email failed: <2.6> 2014-04-14 05:22:16 Telcontar postfix 10725 - - NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 450 4.1.8 : Sender address rejected: Domain not found; from= to= proto=ESMTP helo=<[127.0.0.1]> My own postfix is unable to accept my own emails because it can not connect to the DNS and verify my own email address. That's my problem... I can not do *anything* while Firefox is downloading from youtube! And other machines on my local network fail, too. [...] One of the two videos I was downloading finished, so I could try with the second one. The name resolved, but wget can not cope: +++················ wget "http://r4---sn-h5q7enls.googlevideo.com/videoplayback... Cannot write to ‘videoplayback?sver=...mv=m&ratebypass=yes’ (File name too long). ················++- Obviously, that's not the name the resulting file should have. But I do not see how to tell wget to change the filename to something sensible... -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Rolf Muth

10:04

Hallo Carlos E. R., Am Montag, 14. April 2014 05:44 schrieb Carlos E. R.:

...

On 2014-04-14 04:12, Felix Miata wrote:

...
On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...
...some downloads have to be done directly by Firefox...

As I said, name solving fails while the download is running... I don't know if the download would work at all if I can not even solve the name. But that's the name pasted from the link the download manager says it is using...

I sometimes use nice ionice -c3 <program> Have a look an man nice ionice. -- Herzliche Grüße! Rolf Muth Meine Adressen dürfen nicht für Werbung verwendet werden! S/MIME Zertifikat 0x25F0E92D9AE21AE6

David T-G

10:38

Carlos, et al -- ...and then Carlos E. R. said... % ... % Cannot write to ?videoplayback?sver=...mv=m&ratebypass=yes? (File name % too long). % ················++- % % Obviously, that's not the name the resulting file should have. But I do % not see how to tell wget to change the filename to something sensible... C'mon, that's even in the help output! ;-) davidtg@u17383850:~> wget --help | egrep -i write -O, --output-document=FILE write documents to FILE. Use wget -O/path/to/file prot://url.to/down/load to specify your output file name. HTH & HAND :-D -- David T-G See http://justpickone.org/davidtg/email/ See http://justpickone.org/davidtg/tofu.txt

Carlos E. R.

11:34

On 2014-04-14 12:38, David T-G wrote:

...

Carlos, et al --

...and then Carlos E. R. said... % ... % Cannot write to ?videoplayback?sver=...mv=m&ratebypass=yes? (File name % too long). % ················++- % % Obviously, that's not the name the resulting file should have. But I do % not see how to tell wget to change the filename to something sensible...

C'mon, that's even in the help output! ;-)

davidtg@u17383850:~> wget --help | egrep -i write -O, --output-document=FILE write documents to FILE.

Use wget -O/path/to/file prot://url.to/down/load to specify your output file name.

I did not identify "documents" as the downloaded file. I think of "document", well... as documents. Papers. Text files. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

David T-G

15 Apr 15 Apr

01:18

New subject: wget -O (was "Re: [opensuse] Is it possible to limit ...")

Carlos, et al -- ...and then Carlos E. R. said... % % On 2014-04-14 12:38, David T-G wrote: % > ... % > davidtg@u17383850:~> wget --help | egrep -i write % > -O, --output-document=FILE write documents to FILE. ... % % I did not identify "documents" as the downloaded file. I think of % "document", well... as documents. Papers. Text files. Fair enough. I suspect that it originally meant an HTML document file, which is the sort of thing you'd likely see on the web and would want to download with wget, but since then times have changed to include these new-fangled video thingies (amongst other things) ;-) HAND :-D -- David T-G See http://justpickone.org/davidtg/email/ See http://justpickone.org/davidtg/tofu.txt

Linda Walsh

14 Apr 14 Apr

13:03

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Carlos E. R. wrote:

...

On 2014-04-14 04:12, Felix Miata wrote:

...
On 2014-04-14 03:24 (GMT+0200) Carlos E. R. composed:

...

Send of this very email failed:

<2.6> 2014-04-14 05:22:16 Telcontar postfix 10725 - - NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 450 4.1.8 : Sender address rejected: Domain not found; from= to= proto=ESMTP helo=<[127.0.0.1]>

...

My own postfix is unable to accept my own emails because it can not connect to the DNS and verify my own email address.

...

That's my problem... I can not do *anything* while Firefox is downloading from youtube!

---- Have you tried wondershaper? It does a fair job of prioritizing your network usage so things like DNS have priority over FF. You could route FF through squid so squid can set the TOS bits on all web traffic, to further the actions of wondershaper.

...

+++················ wget "http://r4---sn-h5q7enls.googlevideo.com/videoplayback...

Cannot write to ‘videoplayback?sver=...mv=m&ratebypass=yes’ (File name too long). ················++-

Have you tried specifying the file it should save to? i.e. the "-O" switch? saves the output in 1 file. (which is what you want for 1 movie download) -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

14:01

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-14 15:03, Linda Walsh wrote:

...

Carlos E. R. wrote:

...

...
That's my problem... I can not do *anything* while Firefox is downloading from youtube!

Have you tried wondershaper?

It does a fair job of prioritizing your network usage so things like DNS have priority over FF.

Maybe I should have a look at it... that would allow the PC doing the download to keep working, but not the rest of the gadgets in the house. I would have to do that on the router, but its controls are insufficient: IP Range: xxx -- xxx Port Range: xxx -- xxx Protocol: All/TCP/UDP Priority: 1..8 Min Rate(Kbps) Max Rate(Kbps) Upstream: XXX XXX Downstream: XXX XXX No way to differentiate youtube traffic. Except... perhaps let the download start, find the IP used, and then create the rule. Possible... cumbersome...

...

You could route FF through squid so squid can set the TOS bits on all web traffic, to further the actions of wondershaper.

There is a trick via setting the SGID of a binary to mark packages. But it would be the upload that I could control that way, not the download. :-?

...

...
+++················ wget "http://r4---sn-h5q7enls.googlevideo.com/videoplayback...

Cannot write to ‘videoplayback?sver=...mv=m&ratebypass=yes’ (File name too long). ················++-

Have you tried specifying the file it should save to? i.e. the "-O" switch?

I did not identify "-O" as the appropriate switch... O:-) This command is easier, it understand "youtube" directly: youtube-dl --write-sub --sub-lang 'en,es' -r 50K \ -f 135 http://www.youtube.com/watch?v=... Does the trick. Almost. It does not do a continuous download at 50K, but perhaps 15..20 seconds at full bandwidth, then 15..20 at full stop. As I assume that its programmer knows his job, then I have to conclude that youtube speed can not be controlled "normally"... :-? I should try perhaps "trickle" in combination with "youtube-dl". -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Per Jessen

14:19

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Carlos E. R. wrote:

...

On 2014-04-14 15:03, Linda Walsh wrote:

...
Carlos E. R. wrote:

...
...
That's my problem... I can not do *anything* while Firefox is downloading from youtube!

Have you tried wondershaper?

It does a fair job of prioritizing your network usage so things like DNS have priority over FF.

Maybe I should have a look at it... that would allow the PC doing the download to keep working, but not the rest of the gadgets in the house.

FYI, wondershaper uses tc.

...

...
You could route FF through squid so squid can set the TOS bits on all web traffic, to further the actions of wondershaper.

squid also has it's own traffic control. (delay_pools?)

...

Does the trick. Almost. It does not do a continuous download at 50K, but perhaps 15..20 seconds at full bandwidth, then 15..20 at full stop. As I assume that its programmer knows his job,

I wouldn't assume that. It's just a utility script. -- Per Jessen, Zürich (16.1°C) http://www.hostsuisse.com/ - dedicated server rental in Switzerland. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

14:27

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-14 16:01, Carlos E. R. wrote:

...

I should try perhaps "trickle" in combination with "youtube-dl".

Yes, it works better. trickle -d 50 youtube-dl --write-sub --sub-lang 'en,es' \ -f 135 http://www.youtube.com/watch?... ... [download] 2.5% of 455.72MiB at 63.26KiB/s ETA 01:59:54 It works similarly, goes full speed for a little while, then stops for another little while. But instead of going full for 20 seconds, it does so for something like a second or less, and it is fact configurable. This does allow my network to function. :-))) Wonderful! :-) (now I would like to have a fast and cheap Internet... O:-) ) -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Carlos E. R.

16:50

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-14 16:27, Carlos E. R. wrote:

...

On 2014-04-14 16:01, Carlos E. R. wrote:

...
I should try perhaps "trickle" in combination with "youtube-dl".

Yes, it works better.

trickle -d 50 youtube-dl --write-sub --sub-lang 'en,es' \ -f 135 http://www.youtube.com/watch?... ... [download] 2.5% of 455.72MiB at 63.26KiB/s ETA 01:59:54

It works similarly, goes full speed for a little while, then stops for another little while. But instead of going full for 20 seconds, it does so for something like a second or less, and it is fact configurable.

I found something out. The available format were: format code extension resolution note 171 webm audio only DASH webm audio , audio@ 48k (worst) 140 m4a audio only DASH audio , audio@128k 160 mp4 192p DASH video 242 webm 240p DASH webm 133 mp4 240p DASH video 243 webm 360p DASH webm 134 mp4 360p DASH video 244 webm 480p DASH webm 135 mp4 480p DASH video **** 247 webm 720p DASH webm 136 mp4 720p DASH video 17 3gp 176x144 36 3gp 320x240 5 flv 400x240 43 webm 640x360 18 mp4 640x360 22 mp4 1280x720 (best) I had chosen the 135 one, reasonable resolution and size. Well... xine fails to play it completely. Vlc can play it, but no sound. It even disables Pulse! mediainfo says: +++··························· General Complete name : *** Format : dash Codec ID : dash File size : 456 MiB Duration : 1h 23mn Overall bit rate : 761 Kbps Encoded date : UTC 2014- Tagged date : UTC 2014- Video ID : 1 Format : AVC Format/Info : Advanced Video Codec Format profile : Main@L3.0 Format settings, CABAC : Yes Format settings, ReFrames : 3 frames Codec ID : avc1 Codec ID/Info : Advanced Video Coding Duration : 1h 23mn Bit rate : 759 Kbps Width : 854 pixels Height : 480 pixels Display aspect ratio : 16:9 Frame rate mode : Constant Frame rate : 25.000 fps Color space : YUV Chroma subsampling : 4:2:0 Bit depth : 8 bits Scan type : Progressive Bits/(Pixel*Frame) : 0.074 Stream size : 454 MiB (100%) Encoded date : UTC 2014-04-08 03:35:22 Tagged date : UTC 2014-04-08 03:35:22 ···························++- Apparently, no sound info. Vlc info confirms it, no audio track. Well, the problem is, apparently, that "DASH" thing. The wikipedia explains it: http://en.wikipedia.org/wiki/Dynamic_Adaptive_Streaming_over_HTTP +++··························· Dynamic Adaptive Streaming over HTTP From Wikipedia, the free encyclopedia Dynamic Adaptive Streaming over HTTP (DASH), also known as MPEG-DASH, is an adaptive bitrate streaming technique that enables high quality streaming of media content over the Internet delivered from conventional HTTP web servers. Similar to Apple's HTTP Live Streaming (HLS) solution, MPEG-DASH works by breaking the content into a sequence of small HTTP-based file segments, each segment containing a short interval of playback time of a content that is potentially many hours in duration, such as a movie or the live broadcast of a sports event. The content is made available at a variety of different bit rates, i.e., alternative segments encoded at different bit rates covering aligned short intervals of play back time are made available. As the content is played back by an MPEG-DASH client, the client automatically selects from the alternatives the next segment to download and play back based on current network conditions. The client selects the segment with the highest bit rate possible that can be downloaded in time for play back without causing stalls or rebuffering events in the playback. Thus, an MPEG-DASH client can seamlessly adapt to changing network conditions, and provide high quality play back without stalls or rebuffering events. MPEG-DASH is the first adaptive bit-rate HTTP-based streaming solution that is an international standard.[1] MPEG-DASH should not be confused with a protocol — the protocol that MPEG-DASH uses is HTTP, hence the "H" in the name. MPEG-DASH uses the previously existing HTTP web server infrastructure that is used for delivery of essentially all World Wide Web content. It allows devices such as Internet connected televisions, TV set-top boxes, desktop computers, smartphones, tablets, etc. to consume multimedia content (video, TV, radio...) delivered via the Internet, coping with variable Internet receiving conditions, thanks to its adaptive streaming technology. Standardizing an adaptive streaming solution is meant to provide confidence to the market that the solution can be adopted for universal deployment, compared to similar but more proprietary solutions such as HLS by Apple, Smooth Streaming by Microsoft, or HDS by Adobe. ···························++- Well... so, I have to choose a plain media download instead, the one numbered 18. So... perhaps if that thing is adaptive, speed can not be controlled easily. So I tried the download of the 18 type, without trickle - but no, download speed is not controlled continuously. I still need trickle. Firefox does not support "dash", apparently: http://www.streamingmedia.com/Articles/Editorial/What-Is-.../What-is-MPEG-DA... +++··························· Finally, at this point, it remains unclear whether DASH usage will be royalty-free. This may impact adaption by many potential users, including Mozilla, who has already commented that it’s “unlikely to implement” DASH unless and until it’s completely royalty-free. With Firefox currently sitting at around 22% of market share, this certainly dims DASH’s impact in the HTML5 market. ···························++- Here is more info: http://blog.smplayer.info/how-to-play-the-new-1080p-dash-format-from-youtube... +++··························· In this format the video and audio are separated in different streams. Youtube-dl can download videos in this format (it’s necessary to download both the video and audio streams). The development version of smplayer can play the files downloaded by youtube-dl. You just open the video (with mp4 extension) and smplayer will use automatically the m4a for the audio. ···························++- Audio and video have to be downloaded separately: 137 : mp4 [1080p] (DASH Video) 141 : m4a [256k] (DASH Audio) youtube-dl -f 137 http://www.youtube.com/watch?v=Vpg9yizPP_g youtube-dl -f 141 http://www.youtube.com/watch?v=Vpg9yizPP_g And then both files can be joined: mencoder -oac copy -ovc copy -fafmttag 0x706d -of lavf \ -lavfopts format=mp4 "video_file.mp4" \ -audiofile "audio_file.m4a" -o full_movie.mp4 :-o ! -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Linda Walsh

16:53

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Carlos E. R. wrote:

...

On 2014-04-14 15:03, Linda Walsh wrote:

...
Carlos E. R. wrote:

...
...
That's my problem... I can not do *anything* while Firefox is downloading from youtube!

Have you tried wondershaper?

It does a fair job of prioritizing your network usage so things like DNS have priority over FF.

Maybe I should have a look at it... that would allow the PC doing the download to keep working, but not the rest of the gadgets in the house.

That's one reason why my linux box *is* my router. What does your router do that your linux box can't?

...

No way to differentiate youtube traffic. Except... perhaps let the download start, find the IP used, and then create the rule. Possible... cumbersome...

Usually you'd use a predefined block of IP's to manage. Either that or have squid mark the TOS based on youtube being present.

...

...
You could route FF through squid so squid can set the TOS bits on all web traffic, to further the actions of wondershaper.

There is a trick via setting the SGID of a binary to mark packages. But it would be the upload that I could control that way, not the download. :-?

---- Coming back -- is trickier. Used to be you could only drop to accept because to differentiate, you have to accept first, but I think it is the IFB (there have been a couple of competing TLA's) that can play the part of an intermediate input buffer that queuing policy can be applied to on input.

...

...
...
+++················ wget "http://r4---sn-h5q7enls.googlevideo.com/videoplayback...

Cannot write to ‘videoplayback?sver=...mv=m&ratebypass=yes’ (File name too long). ················++-

Have you tried specifying the file it should save to? i.e. the "-O" switch?

I did not identify "-O" as the appropriate switch... O:-)

--- Does that mean it might work, or that it does? .. I.e. when I had a 'too long' google filename, it worked.

...

This command is easier, it understand "youtube" directly:

youtube-dl --write-sub --sub-lang 'en,es' -r 50K \ -f 135 http://www.youtube.com/watch?v=...

---- youtube does it's own handshakes within it's protocol, it knows if the communication is lagging (blocked), or if the user has pressed pause, or such... send status back to you tube about every 2-3 seconds of video so they can bookmark your place, among other things..(watched the protocol exchange of a friend watching YT, They might know it down to the second so they can estimate buffering needed and congestion... (at least when you are watching it directly, when you pre-download, I don't think it applies the same algorithms). Another thing to try is to 'strangle' FF. nice & ionice it down and limit it to 1 cpu. Then you could indirectly slow it down by running something else w/high cpu prio on the same cpu. Part of the problem in scheduling --- is the network scheduler only can get scheduled (usually) about once/millisecond), and then if you use a 1000Hz clock. I found out w/the policing method, my D/l BW was getting choked with almost any settings -- so I only controlled uploading when I was doing that. But that was before the IFB...(imq?)..... Yeah -- I saw the delay pools in squid -- they might also help, but have never used them.

...

I should try perhaps "trickle" in combination with "youtube-dl".

--- Definitely try it... if it works, problem solved! (until needs grow... ;-))... -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

20:25

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-14 18:53, Linda Walsh wrote:

...

Carlos E. R. wrote:

...

...
Maybe I should have a look at it... that would allow the PC doing the download to keep working, but not the rest of the gadgets in the house.

That's one reason why my linux box *is* my router.

What does your router do that your linux box can't?

Two things: it uses far less electricity, and contains the ADSL /modem/ (or whatever is the correct name of the thing). Ah, also it has a WiFi access point, and four Ethernet sockets. To use the computer as router, I would have to connect the current adsl-modem-router (in pass-trough mode) to one eth port of a full PC, connect a switch to the other eth port of a computer, and add an extra Wi-Fi access point. That is: 1 adsl modem-router 2 computer 3 switch 4 WiFi access point That's four machines running full time, and one of them, the PC, consumes a lot of power, comparatively - instead of a single dedicated machine, the elcheapo router. That's why :-)

...

...
No way to differentiate youtube traffic. Except... perhaps let the download start, find the IP used, and then create the rule. Possible... cumbersome...

Usually you'd use a predefined block of IP's to manage.

Surely youtube uses a large range of IPs, and they probably change and rotate. So, I would have to maintain that list, manually.

...

...
...
...
+++················ wget "http://r4---sn-h5q7enls.googlevideo.com/videoplayback...

Cannot write to ‘videoplayback?sver=...mv=m&ratebypass=yes’ (File name too long). ················++-

Have you tried specifying the file it should save to? i.e. the "-O" switch?

I did not identify "-O" as the appropriate switch... O:-)

Does that mean it might work, or that it does? .. I.e. when I had a 'too long' google filename, it worked.

I don't know, I have not tried. When I wanted to try it I did not locate the syntax, and when I found it, I no longer needed it :-)) Ok, I'll try now - wait [...] nope: HTTP request sent, awaiting response... 403 Forbidden 2014-04-14 21:53:16 ERROR 403: Forbidden.

...

...
This command is easier, it understand "youtube" directly:

youtube-dl --write-sub --sub-lang 'en,es' -r 50K \ -f 135 http://www.youtube.com/watch?v=...

youtube does it's own handshakes within it's protocol, it knows if the communication is lagging (blocked), or if the user has pressed pause, or such... send status back to you tube about every 2-3 seconds of video so they can bookmark your place, among other things..(watched the protocol exchange of a friend watching YT, They might know it down to the second so they can estimate buffering needed and congestion... (at least when you are watching it directly, when you pre-download, I don't think it applies the same algorithms).

Specially when they use "DASH" - see my other post. FF doesn't appear to have it, perhaps Chrome does. In fact, when I watch a youtube video in FF, it often stutters or worse. But when I watch it in the dedicated android app of my mobile phone it works nicely, albeit on a very small display. So surely this device negotiates successfully, whereas FF doesn't.

...

Another thing to try is to 'strangle' FF. nice & ionice it down and limit it to 1 cpu. Then you could indirectly slow it down by running something else w/high cpu prio on the same cpu.

I'm not sure that ionice would do it, it is about disk i/o, I understand. AND, it requires running as root. In any case, that will not do, as it would slow down my entire Firefox, and I have maybe a fifty tabs open. The combination of "trickle" and "youtube-dl" works very nicely. I can do other things while the download slowly progress, and in any machine. It is what I wanted: to do the download slowly. Not at a constant low speed, but it is acceptable. It can even resume an interrupted download! Pity that the flash download add-ons to Firefox that I know about are unable to do such an, at least apparently, simple thing as throttling down the download.

...

...
I should try perhaps "trickle" in combination with "youtube-dl".

--- Definitely try it... if it works, problem solved! (until needs grow... ;-))...

It does indeed :-) -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Carlos E. R.

20:30

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-14 22:25, Carlos E. R. wrote:

...

On 2014-04-14 18:53, Linda Walsh wrote:

...
Carlos E. R. wrote:

wget.

...

...
Does that mean it might work, or that it does? .. I.e. when I had a 'too long' google filename, it worked.

I don't know, I have not tried. When I wanted to try it I did not locate the syntax, and when I found it, I no longer needed it :-))

Ok, I'll try now - wait [...] nope:

HTTP request sent, awaiting response... 403 Forbidden 2014-04-14 21:53:16 ERROR 403: Forbidden.

Correction. The link times out, so you have to try it fresh. It does work. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

jdd

15 Apr 15 Apr

06:56

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Le 14/04/2014 22:25, Carlos E. R. a écrit :

...

That's four machines running full time, and one of them, the PC, consumes a lot of power, comparatively - instead of a single dedicated machine, the elcheapo router.

you could also change the router for a better one, possibly with more proxy services :-)

...

Pity that the flash download add-ons to Firefox that I know about are unable to do such an, at least apparently, simple thing as throttling down the download.

may be ask the programmer? jdd -- http://www.dodin.org -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Per Jessen

08:12

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

jdd wrote:

...

Le 14/04/2014 22:25, Carlos E. R. a écrit :

...
That's four machines running full time, and one of them, the PC, consumes a lot of power, comparatively - instead of a single dedicated machine, the elcheapo router.

you could also change the router for a better one, possibly with more proxy services :-)

ISTR a D-Link router that ran on openWRT, I think I might even have one in the basement somewhere. With openWRT you could add virtually anything you need. -- Per Jessen, Zürich (6.8°C) http://www.hostsuisse.com/ - dedicated server rental in Switzerland. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

10:14

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-15 08:56, jdd wrote:

...

Le 14/04/2014 22:25, Carlos E. R. a écrit :

...
That's four machines running full time, and one of them, the PC, consumes a lot of power, comparatively - instead of a single dedicated machine, the elcheapo router.

you could also change the router for a better one, possibly with more proxy services :-)

I did change it. This is the new and improved one already :-) One has to buy what is available, and the descriptions you find are not that extensive. It does have a lot of good features. In fact, it was not the simplest model available, it was considered a good one.

...

...
Pity that the flash download add-ons to Firefox that I know about are unable to do such an, at least apparently, simple thing as throttling down the download.

may be ask the programmer?

Dunno :-?? I just found some answers that basically say "no". I still need to read them fully. https://support.mozilla.org/en-US/questions/945247 https://support.mozilla.org/en-US/questions/815153 https://support.mozilla.org/en-US/questions/755876 -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

jdd

10:19

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Le 15/04/2014 12:14, Carlos E. R. a écrit :

...

On 2014-04-15 08:56, jdd wrote:

...

...
may be ask the programmer?

Dunno :-??

I was thinking of the plugin programmers: http://www.downloadhelper.net/contact-us.php

...

jdd -- http://www.dodin.org -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

10:48

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-15 12:19, jdd wrote:

...

Le 15/04/2014 12:14, Carlos E. R. a écrit :

...
On 2014-04-15 08:56, jdd wrote:

...
...
may be ask the programmer?

Dunno :-??

I was thinking of the plugin programmers:

http://www.downloadhelper.net/contact-us.php

Which basically says that unless you registered or bought the program, you can not contact them. AFAIK, that's not the plugin I'm using, but this one: http://www.flashvideodownloader.org/helpfirefox.php and it does have a suggestion link :-) Done. But I think the answer will be "no", because what the plugin does is find the actual download link to use to get the flash you selected. Once the link is found, it is passed to the Firefox internal download manager. What I would need, then, is replace the default internal download manager with another one that allows such customization. I had a look at "download manager" add ons, and it finds 164 of them. Most are visual tweaks and tabs, or video downloaders things. Nope. I don't see anything. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Carlos E. R.

17:21

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-15 12:48, Carlos E. R. wrote:

...

On 2014-04-15 12:19, jdd wrote:

...
Le 15/04/2014 12:14, Carlos E. R. a écrit :

...
On 2014-04-15 08:56, jdd wrote:

...
...
may be ask the programmer?

...

and it does have a suggestion link :-)

Done.

But I think the answer will be "no", because what the plugin does is find the actual download link to use to get the flash you selected. Once the link is found, it is passed to the Firefox internal download manager.

And it was "no", and fast: +++··························· Hello Addon doesn't download, only finds links of video. Thanks ···························++- So "trickle -d 50 youtube-dl ..." it is. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Linda Walsh

16 Apr 16 Apr

02:22

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

Carlos E. R. wrote:

...

On 2014-04-14 18:53, Linda Walsh wrote:

...
Carlos E. R. wrote:

...
No way to differentiate youtube traffic. Except... perhaps let the download start, find the IP used, and then create the rule. Possible... cumbersome...

Usually you'd use a predefined block of IP's to manage.

Surely youtube uses a large range of IPs, and they probably change and rotate. So, I would have to maintain that list, manually.

Rotate? I wouldn't think so. websites don't usually rotate IP's in their purpose -- they might have a group and shift/rotate within the group, but the group would usually be a fixed size at a given point (might expand, or less frequently, contract, based on load). Once you have the list, it would just 'stay'. You might have to add to it once in a while, but I doubt you'd have to worry about subtracting anything in the near future..

...

...
...
I did not identify "-O" as the appropriate switch... O:-)

Does that mean it might work, or that it does? .. I.e. when I had a 'too long' google filename, it worked.

Ok, I'll try now - wait [...] nope:

HTTP request sent, awaiting response... 403 Forbidden 2014-04-14 21:53:16 ERROR 403: Forbidden.

That is different -- that indicates you don't have access to that URL. It might only be good while you are watching it, OR it might require cookie support. (note, as you already have it solved, don't bother w/more testing... just file it away for future ref)

...

...
...
This command is easier, it understand "youtube" directly:

youtube-dl --write-sub --sub-lang 'en,es' -r 50K \ -f 135 http://www.youtube.com/watch?v=...

youtube does it's own handshakes within it's protocol, ...

Specially when they use "DASH" - see my other post. FF doesn't appear to have it, perhaps Chrome does.

Depends on V of FF, newer versions have it, but don't know when it went in... within the last year, I think.

...

In fact, when I watch a youtube video in FF, it often stutters or worse. But when I watch it in the dedicated android app of my mobile phone it works nicely, albeit on a very small display. So surely this device negotiates successfully, whereas FF doesn't.

---- "Negotiate" a 320x200 display on your PC and I'll bet it won't stutter.

...

...
Another thing to try is to 'strangle' FF. nice & ionice it down and limit it to 1 cpu. Then you could indirectly slow it down by running something else w/high cpu prio on the same cpu.

I'm not sure that ionice would do it, it is about disk i/o, I understand. AND, it requires running as root.

Ahhh.. no ionice alone wouldn't do it -- that was an "and" statement. To control wayward MS-OS processes all 3 are necessary -- now they post OS I/O through the 'System' process so it is "anonymous", and System will instantly "blue-screen' your system if you change it's priority or it's I/O privilege level. (Even tells you that "something" changed it's "holy-priority", and that's why it is dying (can't touch this!).

...

The combination of "trickle" and "youtube-dl" works very nicely. I can do other things while the download slowly progress, and in any machine. It is what I wanted: to do the download slowly. Not at a constant low speed, but it is acceptable. It can even resume an interrupted download!

Pity that the flash download add-ons to Firefox that I know about are unable to do such an, at least apparently, simple thing as throttling down the download.

Well, it's about "DEMAND", -- i.e. there are more people trying to figure out how to *speed up* a D/L than slow it down. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

08:51

New subject: [opensuse] Re: Is it possible to limit the download speed fo Firefox?

On 2014-04-16 04:22, Linda Walsh wrote:

...

Carlos E. R. wrote:

...
On 2014-04-14 18:53, Linda Walsh wrote:

...

...
Ok, I'll try now - wait [...] nope:

HTTP request sent, awaiting response... 403 Forbidden 2014-04-14 21:53:16 ERROR 403: Forbidden.

That is different -- that indicates you don't have access to that URL. It might only be good while you are watching it, OR it might require cookie support. (note, as you already have it solved, don't bother w/more testing... just file it away for future ref)

It had timed out, that test was done several hours after I got the link. I tested again with a fresh link and it worked fine. Yes, wget is indeed a possibility, but it is inconvenient because you have to find first the precise link and change the output file name. And the "link" can be two hundred chars long... On the other hand, it probably handles speed throttling fine.

...

...
Specially when they use "DASH" - see my other post. FF doesn't appear to have it, perhaps Chrome does.

Depends on V of FF, newer versions have it, but don't know when it went in... within the last year, I think.

Ah. Dunno.

...

...
In fact, when I watch a youtube video in FF, it often stutters or worse. But when I watch it in the dedicated android app of my mobile phone it works nicely, albeit on a very small display. So surely this device negotiates successfully, whereas FF doesn't.

"Negotiate" a 320x200 display on your PC and I'll bet it won't stutter.

Guess not X'-)

...

...
The combination of "trickle" and "youtube-dl" works very nicely. I can do other things while the download slowly progress, and in any machine. It is what I wanted: to do the download slowly. Not at a constant low speed, but it is acceptable. It can even resume an interrupted download!

Pity that the flash download add-ons to Firefox that I know about are unable to do such an, at least apparently, simple thing as throttling down the download.

Well, it's about "DEMAND", -- i.e. there are more people trying to figure out how to *speed up* a D/L than slow it down.

Sigh! Yes. My house is within 20 meters from the fiber box of one of the big ISP here (ONO). It is an old neighbourhood, so although current regulations say that utilities must be supplied underground, there are no provisions for that here. As it is old houses, not high rise flats, meaning low "human" density, they see little profit in it. So the cable has to be passed old style, at first floor level (not ground level), and ask permissions to all the neighbours. Fine, they got it. But... as the first house in the row happens to be a kindergarten, they say that they have to comply with some extra regulations or insurance or who knows what to do work at that height with children nearby... and they refuse. A friend of mine says that is simply an excuse, that the real reason will be different. Dunno. So no fiber. Plain Old Copper instead. So it is copper, from Telefonica. Next hurdle... apparently, the hardware at the exchange for my block is only capable of 1 Mbit/s (it is not the copper line itself that is the problem, I understand). Other houses get 10 Mbit/s. Ah, well... :-( I know people limited to even less speed, 255K or less. I count my blessings. Mine is stable, no disconnects. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

jdd

14 Apr 14 Apr

07:06

Le 14/04/2014 03:24, Carlos E. R. a écrit :

...

So... Can I limit the download speed used by Firefox, when downloading files?

searching google for "netxork nice linux", I got this http://monkey.org/~marius/pages/?page=trickle don't know what it's worth jdd -- http://www.dodin.org -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

11:37

On 2014-04-14 09:06, jdd wrote:

...

Le 14/04/2014 03:24, Carlos E. R. a écrit :

...
So... Can I limit the download speed used by Firefox, when downloading files?

searching google for "netxork nice linux", I got this

http://monkey.org/~marius/pages/?page=trickle

don't know what it's worth

Curious... -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Florian Gleixner

16:43

Home routers should have some traffic control build in. Modern routers prioritize at least ACK packets. Your router seems not to be able to do this, but you can do it yourself with "tc" - traffic control. Example is here: http://www.funtoo.org/Traffic_Control#ACKs Susefirewall has it built in too. Search for FW_HTB_TUNE_DEV in /etc/sysconfig/SuSEfirewall2. Read the comment above, set it and restart the firewall. On 04/14/2014 03:24 AM, Carlos E. R. wrote:

...

Hi,

My internet bandwidth is only 1 Mbit/s. On the occasions when I have to use Firefox to download something large, that can take an hour, I can not do anything with Internet on any other thing on the machine during that time. Even DNS fails to respond.

I prefer to use something like wget and limit its bandwidth, but some downloads have to be done directly by Firefox (like a youtube video).

So... Can I limit the download speed used by Firefox, when downloading files?

-- Cheers Carlos E. R.

(from 12.3 x86_64 "Dartmouth" at Telcontar)

Carlos E. R.

19:40

On 2014-04-14 18:43, Florian Gleixner wrote:

...

Home routers should have some traffic control build in. Modern routers prioritize at least ACK packets. Your router seems not to be able to do this, but you can do it yourself with "tc" - traffic control.

Example is here: http://www.funtoo.org/Traffic_Control#ACKs

Susefirewall has it built in too. Search for FW_HTB_TUNE_DEV in /etc/sysconfig/SuSEfirewall2. Read the comment above, set it and restart the firewall.

But this would solve the problem only for one machine, the one doing the download. The rest would keep having problems, because they have to go through the router only. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

Ken Schneider - openSUSE

15 Apr 15 Apr

15:43

On 04/13/2014 09:24 PM, Carlos E. R. pecked at the keyboard and wrote:

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

Hi,

My internet bandwidth is only 1 Mbit/s. On the occasions when I have to use Firefox to download something large, that can take an hour, I can not do anything with Internet on any other thing on the machine during that time. Even DNS fails to respond.

I prefer to use something like wget and limit its bandwidth, but some downloads have to be done directly by Firefox (like a youtube video).

So... Can I limit the download speed used by Firefox, when downloading files?

Carlos, Have you considered using smplayer to download YouTube videos? Doesn't support rate limiting but I found it easier to download with. Have you checked your router to see if it supports QOS for different formats. -- Ken Schneider SuSe since Version 5.2, June 1998 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org

Carlos E. R.

17:17

On 2014-04-15 17:43, Ken Schneider - openSUSE wrote:

...

On 04/13/2014 09:24 PM, Carlos E. R. pecked at the keyboard and wrote:

...

Have you considered using smplayer to download YouTube videos? Doesn't support rate limiting but I found it easier to download with.

It is a possibility, but any viewer to be usable has to download a continuous stream, or it will stutter. To avoid stutter means choosing low quality video, in order to reduce bandwidth - and logically, I want better quality, which means download in advance. And downloading in advance at full pipe speed clogs internet on my system for long intervals, so much so that even DNS fails. So rate limiting is a must have.

...

Have you checked your router to see if it supports QOS for different formats.

It is IP/port based. If you read the thread, the best solution so far is using trickle -d 50 youtube-dl -f NUMBER URL It works fantastically well. -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" at Telcontar)

3661

Age (days ago)

3671

Last active (days ago)

List overview

Download

45 comments

14 participants

participants (14)

Basil Chupin
Carl Hartung
Carlos E. R.
Carlos E. R.
David Haller
David T-G
ellanios82
Felix Miata
Florian Gleixner
jdd
Ken Schneider - openSUSE
Linda Walsh
Per Jessen
Rolf Muth