December 2014 - tor-commits - lists.torproject.org

[translation/torbirdy] Update translations for torbirdy
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit df6538ba5044cefd49e452b5ed1db953a8e392b3 Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 09:15:25 2014 +0000 Update translations for torbirdy --- az/torbirdy.properties | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/az/torbirdy.properties b/az/torbirdy.properties index b999de2..13747a7 100644 --- a/az/torbirdy.properties +++ b/az/torbirdy.properties @@ -1,19 +1,19 @@ -# torbirdy.name=TorBirdy +torbirdy.name=TorBirdy -# torbirdy.enabled.tor=TorBirdy Enabled: Tor -# torbirdy.enabled.jondo=TorBirdy Enabled: JonDo -# torbirdy.enabled.custom=TorBirdy Enabled: Custom Proxy -# torbirdy.enabled.torification=TorBirdy Enabled: Transparent Torification -# torbirdy.enabled.whonix=TorBirdy Enabled: Whonix -# torbirdy.disabled=TorBirdy: Disabled! +torbirdy.enabled.tor=TorBirdy Aktivləşdirdi: Tor +torbirdy.enabled.jondo=TorBirdy Aktivləşdirdi: JonDo +torbirdy.enabled.custom=TorBirdy Aktivləşdirdi: Mövcud Proksi +torbirdy.enabled.torification=TorBirdy Aktivləşdirdi: Şəffaf Torifikasiya +torbirdy.enabled.whonix=TorBirdy Aktivləşdirdi: Whonix +torbirdy.disabled=TorBirdy: Söndürüldü! -# torbirdy.email.prompt=TorBirdy has disabled Thunderbird's auto-configuration wizard to protect your anonymity.\n\nThe recommended security settings for %S have been set.\n\nYou can now configure the other account settings manually. +torbirdy.email.prompt=TorBirdy sənin anonimliyini qorumaq üçün Thunderbird-in avto-konfiqurasiya vizardını dayandırdı.\n\n%S üçün tpvsiyyə edilən təhlükəsizlik parametrləri quraşdırılmışdır.\n\nİndi digər hesab parametrlərini manual olaraq konfiqurasiya edə bilərsən. -# torbirdy.email.advanced=Please note that changing the advanced settings of TorBirdy is NOT recommended.\n\nYou should only continue if you are sure of what you are doing. -# torbirdy.email.advanced.nextwarning=Show this warning next time -# torbirdy.email.advanced.title=TorBirdy Advanced Settings +torbirdy.email.advanced=Lütfən, nəzərdə saxla ki, TorBirdy-nin ətraflı parametrlərini dəyişmək tövsiyyə EDİLMİR.\n\nYalnız nə etdiyinə əmin olduğun halda dəyişiklik etməlisən. +torbirdy.email.advanced.nextwarning=Bu xəbərdarlığı gələn dəfə göstər +torbirdy.email.advanced.title=TorBirdy Ətraflı Parametrlər -# torbirdy.restart=You must restart Thunderbird for the time zone preference to take effect. +torbirdy.restart=Effekt almaq üçün Thunderbird-ü zaman göstəricilərinə görə yenidən başlatmalısan. -# torbirdy.firstrun=You are now running TorBirdy.\n\nTo help protect your anonymity, TorBirdy will enforce the Thunderbird settings it has set, preventing them from being changed by you or by any add-on. There are some settings that can be changed and those are accessed through TorBirdy's preferences dialog. When TorBirdy is uninstalled or disabled, all settings that it changes are reset to their default values (the values prior to TorBirdy's install).\n\nIf you are a new user, it is recommended that you read through the TorBirdy website to understand what we are trying to accomplish with TorBirdy for our users. -# torbirdy.website=https://trac.torproject.org/projects/tor/wiki/torbirdy +torbirdy.firstrun=Hazırda TorBirdy-ni işlədirsən.\n\nSənin təhlükəsizliyini qorumaq üçün TorBirdy Thunderbird-ün parametrlərinin sən və ya digər proqramlar tərəfindən dəyişdirilməsini qadağa edəcəkdir. Bəzi dəyişdirilə bilən parametrlər TorBirdy-nin göstəricilər dialoqunda təqdim edilmişdir. TorBirdy ləğv edildiyi zaman bütün parametrlər ilkin vəziyyətə qaytarilacaqdır (TorBordy-dən əvvəlki vəziyyətə).\n\nYeni istifadəçisənsə, TorBirdy-nin veb səhifəsinə keçib bizim istifadəçilər üçün nə etmək istədiyimizlə yaxından yanış ol. +torbirdy.website=https://trac.torproject.org/projects/tor/wiki/torbirdy

1 0

[translation/torcheck] Update translations for torcheck
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit 968abea2eedb9c4df06c8f904f7365897826600b Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 09:15:07 2014 +0000 Update translations for torcheck --- az/torcheck.po | 19 ++++++++++--------- 1 file changed, 10 insertions(+), 9 deletions(-) diff --git a/az/torcheck.po b/az/torcheck.po index 6ff36fd..ce37fc1 100644 --- a/az/torcheck.po +++ b/az/torcheck.po @@ -2,12 +2,13 @@ # Copyright (C) 2008-2013 The Tor Project, Inc # # Translators: +# E <ehuseynzade(a)gmail.com>, 2014 msgid "" msgstr "" "Project-Id-Version: The Tor Project\n" "POT-Creation-Date: 2012-02-16 20:28+PDT\n" -"PO-Revision-Date: 2014-12-27 15:40+0000\n" -"Last-Translator: runasand <runa.sandvik(a)gmail.com>\n" +"PO-Revision-Date: 2014-12-28 09:13+0000\n" +"Last-Translator: E <ehuseynzade(a)gmail.com>\n" "Language-Team: Azerbaijani (http://www.transifex.com/projects/p/torproject/language/az/)\n" "MIME-Version: 1.0\n" "Content-Type: text/plain; charset=UTF-8\n" @@ -17,34 +18,34 @@ msgstr "" "Plural-Forms: nplurals=2; plural=(n != 1);\n" msgid "Congratulations. This browser is configured to use Tor." -msgstr "" +msgstr "Təbriklər. Bu brauzer Tor istifadəsi üçün konfiqurasiya edilmişdir." msgid "" "Please refer to the <a href=\"https://www.torproject.org/\">Tor website</a> " "for further information about using Tor safely. You are now free to browse " "the Internet anonymously." -msgstr "" +msgstr "Tor-u təhlükəsiz istifadə etmə qaydaları haqqında daha ətraflı məlumat üçün <a href=\"https://www.torproject.org/\">Tor-un veb səhifəsinə</a> keç. Artıq internetdən anonim istifadə edə bilərsən." msgid "There is a security update available for the Tor Browser Bundle." -msgstr "" +msgstr "Tor Brauzer Bağlaması üçün təhlükəsizlik yenilənmələri mövcuddur." msgid "" "<a href=\"https://www.torproject.org/download/download-easy.html\">Click " "here to go to the download page</a>" -msgstr "" +msgstr "<a href=\"https://www.torproject.org/download/download-easy.html\">Yükləmə səhifəsinə bu sözləri klikləməklə keç</a>" msgid "Sorry. You are not using Tor." -msgstr "" +msgstr "Üzr istəyirik. Sən Tor istifadə etmirsən." msgid "" "If you are attempting to use a Tor client, please refer to the <a " "href=\"https://www.torproject.org/\">Tor website</a> and specifically the <a" " href=\"https://www.torproject.org/docs/faq#DoesntWork\">instructions for " "configuring your Tor client</a>." -msgstr "" +msgstr "Tor müştərisini istifadə etmək istədiyin halda lütfən, <a href=\"https://www.torproject.org/\">Tor-un veb səhifəsinə</a> keç və daha sonra <a href=\"https://www.torproject.org/docs/faq#DoesntWork\">Tor müştərinin quraşdırılma qaydaları</a> bölməsinə daxil ol." msgid "Sorry, your query failed or an unexpected response was received." -msgstr "" +msgstr "Üzr istəyirik, sənin sorğun alınmadı, ya da gözlənilməz cavab alındı." msgid "" "A temporary service outage prevents us from determining if your source IP "

1 0

[translation/tails-iuk] Update translations for tails-iuk
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit a994d3fa1116eda3f74f17cedd9836d463b52ef5 Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 08:45:48 2014 +0000 Update translations for tails-iuk --- az.po | 30 +++++++++++++++--------------- 1 file changed, 15 insertions(+), 15 deletions(-) diff --git a/az.po b/az.po index 0c9688f..5f37edb 100644 --- a/az.po +++ b/az.po @@ -9,7 +9,7 @@ msgstr "" "Project-Id-Version: The Tor Project\n" "Report-Msgid-Bugs-To: Tails developers <tails(a)boum.org>\n" "POT-Creation-Date: 2014-12-02 09:42+0100\n" -"PO-Revision-Date: 2014-12-28 08:10+0000\n" +"PO-Revision-Date: 2014-12-28 08:45+0000\n" "Last-Translator: E <ehuseynzade(a)gmail.com>\n" "Language-Team: Azerbaijani (http://www.transifex.com/projects/p/torproject/language/az/)\n" "MIME-Version: 1.0\n" @@ -74,24 +74,24 @@ msgstr "Tail-in bu versiyasının vaxtı ötüb və təhlükəsizlik problemlər msgid "" "The available incremental upgrade requires %{space_needed}s of free space on" " Tails system partition, but only %{free_space}s is available." -msgstr "" +msgstr "Artan təkmilləşmə Tail sistem bölməsində %{space_needed}s boş sahə tələb etdiyi halda, cəmi %{free_space}s boş yaddaş sahəsinə sahibsən." #: ../lib/Tails/IUK/Frontend.pm:334 #, perl-brace-format msgid "" "The available incremental upgrade requires %{memory_needed}s of free memory," " but only %{free_memory}s is available." -msgstr "" +msgstr "Artan təkmilləşmə %{memory_needed}s boş sahə tələb etdiyi halda, cəmi %{free_memory}s boş yaddaş sahəsinə sahibsən." #: ../lib/Tails/IUK/Frontend.pm:356 msgid "" "An incremental upgrade is available, but no full upgrade is.\n" "This should not happen. Please report a bug." -msgstr "" +msgstr "Artan təkmilləşmə mümkün olsa da tam deyil.\nBu baş verməməlidir. Lütfən, problem haqqında xəbər ver." #: ../lib/Tails/IUK/Frontend.pm:360 msgid "Error while detecting available upgrades" -msgstr "" +msgstr "Mümkün təkmilləşmələrin müəyyən edilməsi zamanı xəta" #: ../lib/Tails/IUK/Frontend.pm:370 #, perl-brace-format @@ -107,19 +107,19 @@ msgid "" "Download size: %{size}s\n" "\n" "Do you want to upgrade now?" -msgstr "" +msgstr "Sən %{name}s %{version}s təkmilləşdirməlisən.\n\nBu yeni versiya haqqında daha ətraflı məlumat üçün %{details_url}s linkinə keç.\n\nTəkmilləşmə prosesi zamanı bütün açıq aplikasiyaların bağlanması məsləhətdir.\nTəkmilləşmənin yüklənməsi bir neçə dəqiqədən bir neçə saata qədər davam edə bilər.\nŞəbəkələşmə təkmilləşmə yükləndikdən sonra deaktivə ediləcək.\n\nYükləmə ölçüsü: %{size}s\n\nİndi təkmilləşdirmək istəyirsən?" #: ../lib/Tails/IUK/Frontend.pm:385 msgid "Upgrade available" -msgstr "" +msgstr "Təkmilləşmə mümkündür" #: ../lib/Tails/IUK/Frontend.pm:386 msgid "Upgrade now" -msgstr "" +msgstr "İndi təkmilləşdir" #: ../lib/Tails/IUK/Frontend.pm:387 msgid "Upgrade later" -msgstr "" +msgstr "Daha sonra təkmilləşdir" #: ../lib/Tails/IUK/Frontend.pm:395 #, perl-brace-format @@ -131,20 +131,20 @@ msgid "" "It is not possible to automatically upgrade your device to this new version: %{explanation}s.\n" "\n" "To learn how to do a manual upgrade, go to https://tails.boum.org/doc/first_steps/upgrade/#manual" -msgstr "" +msgstr "%{name}s %{version}s üçün manual təkmilləşmə etməlisən.\n\nBu yeni versiya haqqında daha ətraflı məlumat üçün %{details_url}s linkinə keç.\n\nBu yeni versiyaya ötürücünün avtomatik təkmilləşdirilməsi qeyri-mümkündür: %{explanation}s\n\nManual təkmilləşmənin necə ediləcəyini burada öyrənə bilərsən:https://tails.boum.org/doc/first_steps/upgrade/#manual" #: ../lib/Tails/IUK/Frontend.pm:411 msgid "New version available" -msgstr "" +msgstr "Yeni versiya mümkündür" #: ../lib/Tails/IUK/Frontend.pm:468 msgid "Downloading upgrade" -msgstr "" +msgstr "Təkmilləşmənin yüklənməsi" #: ../lib/Tails/IUK/Frontend.pm:471 #, perl-brace-format msgid "Downloading the upgrade to %{name}s %{version}s..." -msgstr "" +msgstr "Təkmilləşmənin %{name}s %{version}s-a yüklənməsi..." #: ../lib/Tails/IUK/Frontend.pm:512 msgid "" @@ -152,11 +152,11 @@ msgid "" "connection, and restart Tails to try upgrading again.\\n\\nIf the problem " "persists, go to " "file:///usr/share/doc/tails/website/doc/upgrade/error/download.en.html" -msgstr "" +msgstr "Təkmilləşmə yüklənə bilmədi..\\n\\nŞəbəkə əlaqəni yoxla və yenidən təkmilləşməyə cəhd etmək üçün Tails-i yenidən başlat.\\n\\nƏgər problem olduğu kimi qalsa, bu fayla keç:///usr/share/doc/tails/website/doc/upgrade/error/download.en.html" #: ../lib/Tails/IUK/Frontend.pm:528 ../lib/Tails/IUK/Frontend.pm:547 msgid "Error while downloading the upgrade" -msgstr "" +msgstr "Təkmilləşmənin yüklənməsi zamanı xəta" #: ../lib/Tails/IUK/Frontend.pm:540 #, perl-brace-format

1 0

[research-web/master] Add Virgil's tech report.
by karsten＠torproject.org 28 Dec '14

28 Dec '14

commit b70ffef99a62b9edc608fb0eb03d7b967f89dd08 Author: Karsten Loesing <karsten.loesing(a)gmx.net> Date: Sun Dec 28 09:35:54 2014 +0100 Add Virgil's tech report. --- techreports.bib | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/techreports.bib b/techreports.bib index 56c0d0b..f2a1c97 100644 --- a/techreports.bib +++ b/techreports.bib @@ -1,3 +1,13 @@ +@techreport{tor-2014-10-001, + author = {Virgil Griffith}, + title = {{Tor} growth rates and improving {Torperf} throughput}, + institution = {The Tor Project}, + number = {2014-10-001}, + year = {2014}, + month = {October}, + url = {https://research.torproject.org/techreports/tor-growth-2014-10-04.pdf}, +} + @techreport{tor-2013-11-001, author = {Nicholas Hopper}, title = {Protecting {Tor} from botnet abuse in the long term},

1 0

[translation/tails-iuk] Update translations for tails-iuk
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit 9a9324171a4117cfc24c350364270f55eb89c68e Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 08:15:45 2014 +0000 Update translations for tails-iuk --- az.po | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/az.po b/az.po index f4f4860..0c9688f 100644 --- a/az.po +++ b/az.po @@ -9,7 +9,7 @@ msgstr "" "Project-Id-Version: The Tor Project\n" "Report-Msgid-Bugs-To: Tails developers <tails(a)boum.org>\n" "POT-Creation-Date: 2014-12-02 09:42+0100\n" -"PO-Revision-Date: 2014-12-28 07:40+0000\n" +"PO-Revision-Date: 2014-12-28 08:10+0000\n" "Last-Translator: E <ehuseynzade(a)gmail.com>\n" "Language-Team: Azerbaijani (http://www.transifex.com/projects/p/torproject/language/az/)\n" "MIME-Version: 1.0\n" @@ -59,15 +59,15 @@ msgstr "bu sistemdə kifayət qədər yaddaş yeri yoxdur" #: ../lib/Tails/IUK/Frontend.pm:261 #, perl-brace-format msgid "No explanation available for reason '%{reason}s'." -msgstr "" +msgstr "'%{reason}s' səbəbi üçün heç bir izah yoxdur." #: ../lib/Tails/IUK/Frontend.pm:281 msgid "The system is up-to-date" -msgstr "" +msgstr "Sistem ən son versiyadadır" #: ../lib/Tails/IUK/Frontend.pm:286 msgid "This version of Tails is outdated, and may have security issues." -msgstr "" +msgstr "Tail-in bu versiyasının vaxtı ötüb və təhlükəsizlik problemləri ola bilər." #: ../lib/Tails/IUK/Frontend.pm:318 #, perl-brace-format

1 0

[tech-reports/master] Remove a zero.
by karsten＠torproject.org 28 Dec '14

28 Dec '14

commit 38562bee457243730c547d77d684c41c5601ce84 Author: Karsten Loesing <karsten.loesing(a)gmx.net> Date: Sun Dec 28 09:09:37 2014 +0100 Remove a zero. --- 2014/tor-growth/tor-growth.tex | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/2014/tor-growth/tor-growth.tex b/2014/tor-growth/tor-growth.tex index d2798ae..368db71 100644 --- a/2014/tor-growth/tor-growth.tex +++ b/2014/tor-growth/tor-growth.tex @@ -31,7 +31,7 @@ \author{Virgil Griffith} \contact{\href{mailto:i@virgil.gr}{i@virgil.gr}} \reportid{2014-10-001} -\date{October 04, 2014} +\date{October 4, 2014} \newcommand{\Figref}[1]{Figure~\ref{#1}} \newcommand{\figref}[1]{Figure~\ref{#1}}

1 0

[tech-reports/master] Add Virgil's Tor growth report.
by karsten＠torproject.org 28 Dec '14

28 Dec '14

commit 9495a0361e2dbd603038fe0ac2bfc29db7e9b2e5 Author: Karsten Loesing <karsten.loesing(a)gmx.net> Date: Mon Dec 22 11:04:12 2014 +0100 Add Virgil's Tor growth report. --- 2014/tor-growth/.gitignore | 3 + .../figs/5a--normalized-torperf-small.png | Bin 0 -> 130729 bytes .../figs/NUR-predicts-norm-torperf-large.png | Bin 0 -> 182833 bytes .../figs/NUR-predicts-norm-torperf-small.png | Bin 0 -> 183043 bytes 2014/tor-growth/figs/appendix--NUR-over-time.png | Bin 0 -> 109859 bytes 2014/tor-growth/figs/fig1-relays.png | Bin 0 -> 91418 bytes 2014/tor-growth/figs/fig2-bw.png | Bin 0 -> 91863 bytes 2014/tor-growth/figs/fig3-mean-bw.png | Bin 0 -> 109277 bytes 2014/tor-growth/figs/fig4--torperf.png | Bin 0 -> 213045 bytes ...fig6--NUR-predicts-normalized-torperf_large.png | Bin 0 -> 147906 bytes .../figs/fig6--NUR-predicts-normtorperf_small.png | Bin 0 -> 149461 bytes 2014/tor-growth/figs/non-tor-bw.png | Bin 0 -> 108303 bytes 2014/tor-growth/scripts/NUR-predicts-normtorperf.R | 211 +++++++++++++++++ 2014/tor-growth/scripts/NUR.R | 102 ++++++++ 2014/tor-growth/scripts/bandwidth-per-relay.R | 95 ++++++++ 2014/tor-growth/scripts/bandwidth.R | 90 +++++++ 2014/tor-growth/scripts/doubling-table.R | 148 ++++++++++++ 2014/tor-growth/scripts/non-tor-bandwidth.R | 70 ++++++ 2014/tor-growth/scripts/relays.R | 97 ++++++++ 2014/tor-growth/scripts/torperf.R | 136 +++++++++++ 2014/tor-growth/tor-growth.tex | 245 ++++++++++++++++++++ 2014/tor-growth/tortechrep.cls | 1 + 22 files changed, 1198 insertions(+) diff --git a/2014/tor-growth/.gitignore b/2014/tor-growth/.gitignore new file mode 100644 index 0000000..e4ba2a9 --- /dev/null +++ b/2014/tor-growth/.gitignore @@ -0,0 +1,3 @@ +tor-growth.pdf +tor-growth-2014-10-04.pdf + diff --git a/2014/tor-growth/figs/5a--normalized-torperf-small.png b/2014/tor-growth/figs/5a--normalized-torperf-small.png new file mode 100644 index 0000000..b13592b Binary files /dev/null and b/2014/tor-growth/figs/5a--normalized-torperf-small.png differ diff --git a/2014/tor-growth/figs/NUR-predicts-norm-torperf-large.png b/2014/tor-growth/figs/NUR-predicts-norm-torperf-large.png new file mode 100644 index 0000000..4798a36 Binary files /dev/null and b/2014/tor-growth/figs/NUR-predicts-norm-torperf-large.png differ diff --git a/2014/tor-growth/figs/NUR-predicts-norm-torperf-small.png b/2014/tor-growth/figs/NUR-predicts-norm-torperf-small.png new file mode 100644 index 0000000..2b08b3b Binary files /dev/null and b/2014/tor-growth/figs/NUR-predicts-norm-torperf-small.png differ diff --git a/2014/tor-growth/figs/appendix--NUR-over-time.png b/2014/tor-growth/figs/appendix--NUR-over-time.png new file mode 100644 index 0000000..6badfc6 Binary files /dev/null and b/2014/tor-growth/figs/appendix--NUR-over-time.png differ diff --git a/2014/tor-growth/figs/fig1-relays.png b/2014/tor-growth/figs/fig1-relays.png new file mode 100644 index 0000000..16d4a29 Binary files /dev/null and b/2014/tor-growth/figs/fig1-relays.png differ diff --git a/2014/tor-growth/figs/fig2-bw.png b/2014/tor-growth/figs/fig2-bw.png new file mode 100644 index 0000000..65f2456 Binary files /dev/null and b/2014/tor-growth/figs/fig2-bw.png differ diff --git a/2014/tor-growth/figs/fig3-mean-bw.png b/2014/tor-growth/figs/fig3-mean-bw.png new file mode 100644 index 0000000..5da852b Binary files /dev/null and b/2014/tor-growth/figs/fig3-mean-bw.png differ diff --git a/2014/tor-growth/figs/fig4--torperf.png b/2014/tor-growth/figs/fig4--torperf.png new file mode 100644 index 0000000..ba32cd4 Binary files /dev/null and b/2014/tor-growth/figs/fig4--torperf.png differ diff --git a/2014/tor-growth/figs/fig6--NUR-predicts-normalized-torperf_large.png b/2014/tor-growth/figs/fig6--NUR-predicts-normalized-torperf_large.png new file mode 100644 index 0000000..5983fe2 Binary files /dev/null and b/2014/tor-growth/figs/fig6--NUR-predicts-normalized-torperf_large.png differ diff --git a/2014/tor-growth/figs/fig6--NUR-predicts-normtorperf_small.png b/2014/tor-growth/figs/fig6--NUR-predicts-normtorperf_small.png new file mode 100644 index 0000000..4036d05 Binary files /dev/null and b/2014/tor-growth/figs/fig6--NUR-predicts-normtorperf_small.png differ diff --git a/2014/tor-growth/figs/non-tor-bw.png b/2014/tor-growth/figs/non-tor-bw.png new file mode 100644 index 0000000..acdb646 Binary files /dev/null and b/2014/tor-growth/figs/non-tor-bw.png differ diff --git a/2014/tor-growth/scripts/NUR-predicts-normtorperf.R b/2014/tor-growth/scripts/NUR-predicts-normtorperf.R new file mode 100644 index 0000000..ca01f45 --- /dev/null +++ b/2014/tor-growth/scripts/NUR-predicts-normtorperf.R @@ -0,0 +1,211 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') +library(car) # for pretty plots +#library(matlab) # for matlab function names +#library(data.table) # for data.table like data.frame +#library(xtable) # for exporting to LaTeX +#library(gdata) +#library(lmtest) # for testing linear models + + +library(plyr) # for renaming columns +source("colortitles.R") +####################################################### + +process_torperf_rawdata <- function( filename, filesize_to_consider=5242880 ) +{ + + # Import data from TorPerf + Dtp <- read.csv( filename )[c('date','size','source','q1','md','q3')] + Dtp <- rename(Dtp, c("size"="filesize") ) + + print(unique(Dtp$filesize)) + # only use the aggregated Tor data for downloading a 5 MiB file + Dtp <- subset( Dtp, source=='' & filesize==filesize_to_consider ) + + #print( tail(Dtp) ) + + # drop the source and filesize column + #Dtp <- Dtp[ , -which(names(Dtp) %in% c('source','filesize'))] + Dtp <- Dtp[ , -which(names(Dtp) %in% c('source'))] + + # rename the q1, md, and q3 for TIME + Dtp <- rename(Dtp, c("q1"="time_q1","md"="time_md","q3"="time_q3") ) + + # convert time from MILLISECONDS -> SECONDS + Dtp$time_q1 <- Dtp$time_q1/1000 + Dtp$time_md <- Dtp$time_md/1000 + Dtp$time_q3 <- Dtp$time_q3/1000 + + + # now create the bw_q1, bw_md, bw_q3 in: KiB/s + Dtp[c("bw_q1","bw_md","bw_q3")] <- c(NA,NA,NA) + + #convert my_filesize to + + # Rewrite q1, md, and q3 to be in bandwidth (KB/s) + Dtp$bw_q1 <- (filesize_to_consider / 1024) / Dtp$time_q1; + Dtp$bw_md <- (filesize_to_consider / 1024) / Dtp$time_md; + Dtp$bw_q3 <- (filesize_to_consider / 1024) / Dtp$time_q3; + + return(Dtp) +} + + +composite_nontor_bandwidth <- function( filename ) +{ + D_netindex <- read.csv( filename )[c('date','country_code','download_kbps')] + + D_netindex$download_kbps <- D_netindex$download_kbps * (1000 / 1024) + + + # make a single download_rate averaging across the countries: US, DE, RU. + D_US = subset( D_netindex, country_code=='US' ) + D_DE = subset( D_netindex, country_code=='DE' ) + D_RU = subset( D_netindex, country_code=='RU' ) + + # merge the US, DE, and RU bandwidths + D_temp <- merge( D_US, D_DE, by='date' ) + D_ni <- merge( D_temp, D_RU, by='date' ) + + # drop the country codes + D_ni <- D_ni[ , -which(names(D_ni) %in% c('country_code.x','country_code.y','country_code'))] + + # average the download KiB/s entries into one + D_ni$avr_download_KBps <- NA + D_ni$avr_download_KBps <- (D_ni$download_kbps.x + D_ni$download_kbps.y + D_ni$download_kbps) / 3.0 + + # drop the country-specific download rates + D_ni <- D_ni[ , -which(names(D_ni) %in% c('download_kbps.x','download_kbps.y','download_kbps'))] + + D_ni <- rename(D_ni, c("avr_download_KBps"="download_kbps") ) + + return( D_ni ) + +} + +# readin the Tor bandwidth data +################################################################# +Dbw <- read.csv('bandwidth-clean.csv')[c('day','advbw','date','bwread')] + +# convert units from from B/s to KiB/s +Dbw$bwread <- Dbw$bwread / 1024 +Dbw$advbw <- Dbw$advbw / 1024 + + +## plot the clients and advertised bandwidth with time +#plot(day, log2(clients), pch=20, ylab='Clients', xlab='Year', xaxt='n') + +Dbw[c("congestion")] <- c(NA) +Dbw$congestion <- Dbw$bwread / Dbw$advbw + +# remove all instances of Dbw with congestion==NA +Dbw <- subset(Dbw, ! is.na(congestion) ) +Dbw <- subset(Dbw, day > 917 ) + +# remove some outliers +Dbw <- Dbw[-c(318,367,2),] + + +# readin the non-Tor bandwidth data +################################################################# +D_netindex <- composite_nontor_bandwidth('country_daily_speeds.csv') + +# Pull in the torperf data for downloading a 5 MiB file +################################################################# +#Dtp <- process_torperf_rawdata('torperf-clean.csv',51200) +Dtp <- process_torperf_rawdata('torperf-clean.csv',5242880) + +# now merge Dtp and D by date +Dnorm <- merge(D_netindex,Dtp,by='date') + +# drop some columns we don't need +Dnorm <- Dnorm[ , -which(names(Dnorm) %in% c('time_q1','time_md','time_q3','country_code','filesize','bw_q1','bw_q3','day'))] + +Dnorm$normalized_torperf <- NA +Dnorm$normalized_torperf <- (Dnorm$bw_md / Dnorm$download_kbps) * 100 + +# now merge Dnorm and Dbw into D +D <- merge(Dnorm, Dbw, by='date' ) + +D <- D[ , -which(names(D) %in% c('download_kbps','bw_md','advbw','bwread'))] + +#plot( D$day, D$normalized_torperf ) +#plot( D$congestion, D$normalized_torperf ) + +m0 <- lm( D$normalized_torperf ~ D$day ) +m1 <- lm( D$normalized_torperf ~ D$congestion ) +m2 <- lm( D$normalized_torperf ~ D$day+D$congestion ) + + +#m3 <- lm( log2(D$normalized_torperf) ~ D$congestion+D$day ) + +# break D into years and more/less effected by the botnet +D2010 <- D[grepl("2010", D$date), ] +D2011 <- D[grepl("2011", D$date), ] +D2012 <- D[grepl("2012", D$date), ] +D2013 <- D[grepl("2013", D$date), ] +D2014 <- D[grepl("2014", D$date), ] + + +#dim(D2012) +par(las=1) + +#plot( D$day, D$normalized_torperf, ylab='Norm Torperf', xlab='day', cex=0.1 ) +#plot( D$congestion, D$normalized_torperf, ylab='Norm Torperf', xlab="Network's Read / Advertised Bandwidth", cex=0.2, xaxt='n', yaxt='n' ) +plot( D$congestion, D$normalized_torperf, ylab='Normalized Torperf', xlab="NUR", cex=0.2, xaxt='n', yaxt='n' ) +#abline( m1 ) + +# plot as a function of advbw_per_client +par(new = T) +points(D2010$congestion, D2010$normalized_torperf, pch=20, cex=0.7, col='red' ) +points(D2011$congestion, D2011$normalized_torperf, pch=20, cex=0.7, col='orange' ) +points(D2012$congestion, D2012$normalized_torperf, pch=20, cex=0.7, col='green' ) +points(D2013$congestion, D2013$normalized_torperf, pch=20, cex=0.7, col='blue' ) +points(D2014$congestion, D2014$normalized_torperf, pch=20, cex=0.7, col='purple' ) + + +#title("Lower network utilization has little impact on Torperf (50 KiB)") +#title("Lower network utilization implies faster Torperf (5 MiB)") + +## Set the Legend and Title +################################################################## +legend_texts = c("2010","2011","2012", "2013", "2014") +legend( "topright", legend=legend_texts, inset=0.01, pch=c(20,20), col=c('red','orange','green','blue','purple') ) + + +CongestLabels=c('','50%','','60%','','70%','') +CongestLocations=c(.45,.50,.55,.60,.65,.70,.75) +axis(1,at=CongestLocations,labels=CongestLabels ) + + +# normalized Torperf labels +# For 50 KiB +#TorperfLabels=c('.05%','.1%','.15%','.2%','.25%') +#TorperfLocations=c(.05,.1,.15,.2,.25) +#axis(2,at=TorperfLocations,labels=TorperfLabels ) + +# For 5 MiB +TorperfLabels=c('.5%','1%','1.5%','2%','2.5%') +TorperfLocations=c(.5,1,1.5,2,2.5) +axis(2,at=TorperfLocations,labels=TorperfLabels ) + + + + +################################################################# + +nfit <- lm( normalized_torperf ~ congestion, data=D ) +summary( nfit ) +first_x <- .45 +last_x <- .75 + +# add the line segment for the predicted pine +segments( first_x, predict(nfit, data.frame(congestion=first_x)), + last_x, predict(nfit, data.frame(congestion=last_x)), + col="black", lty=2, lwd=3 ) + +# Add a point highlighting the beginning of the line +points( first_x, predict(nfit, data.frame(congestion=first_x)), col="black", pch=15, cex=1.3) + + diff --git a/2014/tor-growth/scripts/NUR.R b/2014/tor-growth/scripts/NUR.R new file mode 100644 index 0000000..68cd1a4 --- /dev/null +++ b/2014/tor-growth/scripts/NUR.R @@ -0,0 +1,102 @@ + rm( list = ls() ) + setwd('/Users/know/Desktop/tor analytics/') + library(car) # for pretty plots + + library(plyr) # for renaming columns + source("colortitles.R") + ####################################################### + + D <- read.csv('bandwidth-clean.csv')[c('day','advbw','bwread','date')] + #D <- rename(D, c("date"="day") ) + + # convert from B/s to MiB/s + D$advbw <- D$advbw / 1048576.0 + D$bwread <- D$bwread / 1048576.0 + + ## Plot the "Congestion" --- read / advertised + ################################################################## + D[c("congestion")] <- NA + D$congestion <- D$bwread / D$advbw + + ####### Remove some outliers #################################################### + Dother <- subset(D, congestion <= 0.01 ) + D <- subset(D, congestion > 0.01 ) + # drop all points between days [1200,1310] with congestion BELOW 0.55 + outliers <- subset(D, ( 1200 <= day & day <= 1310 & congestion <=0.55) | (2258 <= day & day <= 2320 & congestion <= 0.47) ) + + D <- subset(D, !( 1200 <= day & day <= 1310 & congestion <=0.55) ) + D <- subset(D, !(2258 <= day & day <= 2320 & congestion <= 0.47) ) + ################################################################################# + + ####### Put into groups #################################################### + cut_off1 <- 2173 # delta=2173 is date 2013-10-08 + cut_off2 <- 2413 # delta=2413 is date 2014-06-05 + g1 <- subset(D, day <= cut_off1 & congestion >= 0.5 ) + g2 <- subset(D, cut_off1 < day & day <= cut_off2 ) + g3 <- subset(D, cut_off2 < day ) + ################################################################################# + + par(las=1) + plot(D$day, D$congestion, + col='black', pch='.', cex=0.6, ylim=c(0.35,0.8), + #xlab="Year", ylab="used bandwidth / capacity bandwidth", xaxt='n', yaxs="i") + xlab="Year", ylab="NUR", xaxt='n', yaxs="i") + + # plot the three groups + points( g1$day, g1$congestion, col='red', pch=20, cex=0.6 ) + points( g2$day, g2$congestion, col='blue', pch=20, cex=0.6 ) + points( g3$day, g3$congestion, col='green', pch=20, cex=0.6 ) + + # plot the outliers + #points( outliers$day, outliers$congestion, col='black', pch=1, cex=0.6 ) + + + ####### Set the pretty X-axis ############################ + par(las=1) + YearLabels=seq(from=2008,to=2014,by=1) + YearLocations=c(66,432,797,1162,1527,1893,2258) + axis(1,at=YearLocations,labels=YearLabels ) + ########################################################## + + + ## Plot the three best-fit lines + ################################################################# + g1 <- subset(g1, day >= 1200) + fit_D <- lm( congestion ~ day, data=D ) + fit_g1 <- lm( congestion ~ day, data=g1 ) + fit_g2 <- lm( congestion ~ day, data=g2 ) + fit_g3 <- lm( congestion ~ day, data=g3 ) + + + # add the line segment for the predicted pine + segments( min(g1$day), predict(fit_g1, data.frame(day=min(g1$day))), + max(g1$day), predict(fit_g1, data.frame(day=max(g1$day))), + col="black", lty=1, lwd=3 ) + + segments( min(g2$day), predict(fit_g2, data.frame(day=min(g2$day))), + max(g2$day), predict(fit_g2, data.frame(day=max(g2$day))), + col="black", lty=1, lwd=3 ) + + segments( min(g3$day), predict(fit_g3, data.frame(day=min(g3$day))), + max(g3$day), predict(fit_g3, data.frame(day=max(g3$day))), + col="black", lty=1, lwd=3 ) + + + # Add a point highlighting the beginning of the line + points( min(g1$day), predict(fit_g1, data.frame(day=min(g1$day))), col="black", pch=15, cex=1.3) + points( min(g2$day), predict(fit_g2, data.frame(day=min(g2$day))), col="black", pch=15, cex=1.3) + points( min(g3$day), predict(fit_g3, data.frame(day=min(g3$day))), col="black", pch=15, cex=1.3) + + + + + ## Set the Title and Legend + ################################################################# + #title("Better: channel utilization in three distinct, flat stages") + legend_text = c('2010-04-30 to 2013-10-08', '2013-10-09 to 2014-06-05', '2014-06-06 to present') + legend( "bottomleft", legend=legend_text, inset=0.05, pch=c(20,20,20), col=c('red','blue','green') ) + + + + + diff --git a/2014/tor-growth/scripts/bandwidth-per-relay.R b/2014/tor-growth/scripts/bandwidth-per-relay.R new file mode 100644 index 0000000..426e7b3 --- /dev/null +++ b/2014/tor-growth/scripts/bandwidth-per-relay.R @@ -0,0 +1,95 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') +library(car) # for pretty plots +library(matlab) # for matlab function names +library(data.table) # for data.table like data.frame +#library(xtable) # for exporting to LaTeX +#library(gdata) +library(lmtest) # for testing linear models +library(calibrate) + +library(plyr) # for renaming columns +source("colortitles.R") +####################################################### + +## Readin the data into data.frame D with columns: days, relays.stable, relays.fast, relays.all +####################################################### +#Dstable <- read.csv('relays-stable.csv')[c('date','relays')] +#Dfast <- read.csv('relays-fast.csv')[c('date','relays')] +#Dtemp <- merge(Dstable, Dfast, by="date", suffixes=c('.stable','.fast') ) + +Dbandwidth <- read.csv('bandwidth-clean.csv')[c('date','advbw','bwread')] +Drelays <- read.csv('relays-total.csv')[c('date','relays')] +D <- merge( Dbandwidth, Drelays, by='date' ) +D <- rename(D, c("date"="day","relays"="relays.all")) +names(D) + +# convert units from from B/s to MiB/s +D$advbw <- D$advbw / 1048576.0 +D$bwread <- D$bwread / 1048576.0 + + +D[c("advbw_per_relay","bwread_per_relay")] <- c(NA,NA) +D$advbw_per_relay <- D$advbw / D$relays.all +D$bwread_per_relay <- D$bwread / D$relays.all + +plot(D$day, log2(D$advbw_per_relay), ylab='Bandwidth (MiB/s) per relay', xlab='Year', yaxt='n', pch=20, cex=0.6, xaxt='n', col='blue' ) +points( D$day, log2(D$bwread_per_relay), pch=20, cex=0.6, col='red' ) + + +####### Set the pretty X-axis ################################### +YearLabels=seq(from=2008,to=2014,by=1) +YearLocations=c(66,432,797,1162,1527,1893,2258) +axis(1,at=YearLocations,labels=YearLabels ) +################################################################# + +####### Set the pretty Y-axis ################################### +par(las=1) +lab <- seq(from=-3,to=1,by=1) +axis(2,at=lab, labels=c("⅛","¼","½","1","2") ) +################################################################# + +## Set the Legend and Title +################################################################## +legend_texts = c( + expression(paste("Capacity (advertised) ", r^2, "=0.91")), + expression(paste("Used (read) ", r^2, "=0.68")) +) + + +legend( "topleft", legend=legend_texts, inset=0.05, pch=c(20,20), col=c('blue','red') ) + + +multiTitle(color="black","Average bandwidth per relay doubles every ", + color="blue","1.8", + color="black",'-', + color="red","2.1", + color="black"," years") + +####### Plot the best-fit lines ############################ + +# remove data before the 'read' metric started +temp <- subset( D, !is.na(bwread) ) +first_day <- min(temp$day) +FD <- D[ which(D$day >= first_day), ] + +# fit the Filtered Data to a linear model... +fit_advbw <- lm( log2(advbw_per_relay) ~ day, data=FD ) +fit_bwread <- lm( log2(bwread_per_relay) ~ day, data=FD ) + + +# Add the best-fit lines +segments( first_day, predict(fit_advbw, data.frame(day=first_day)), + max(FD$day), predict(fit_advbw, data.frame(day=max(FD$day))), + col="black", lty=2, lwd=3 ) +segments( first_day, predict(fit_bwread, data.frame(day=first_day)), + max(FD$day), predict(fit_bwread, data.frame(day=max(FD$day))), + col="black", lty=2, lwd=3 ) + +# Add the black squares +points( first_day, predict(fit_advbw, data.frame(day=min(FD$day))), col="black", pch=15, cex=1.3) +points( first_day, predict(fit_bwread, data.frame(day=min(FD$day))), col="black", pch=15, cex=1.3) + +#summary( fit_all ) +#summary( fit_stable ) + diff --git a/2014/tor-growth/scripts/bandwidth.R b/2014/tor-growth/scripts/bandwidth.R new file mode 100644 index 0000000..cc2ac0a --- /dev/null +++ b/2014/tor-growth/scripts/bandwidth.R @@ -0,0 +1,90 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') +library(car) # for pretty plots +#library(matlab) # for matlab function names +#library(data.table) # for data.table like data.frame +#library(xtable) # for exporting to LaTeX +#library(gdata) +#library(lmtest) # for testing linear models +#library(calibrate) + +library(plyr) # for renaming columns +#source("colortitles.R") +####################################################### + +D <- read.csv('bandwidth-clean.csv')[c('date','advbw','bwread','bwwrite')] +D <- rename(D, c("date"="day") ) + +# convert from B/s to MiB/s +D$advbw <- D$advbw / 1048576.0 +D$bwread <- D$bwread / 1048576.0 +D$bwwrite <- D$bwwrite / 1048576.0 + +Xs = D$day; +Ys_advbw = D$advbw; +Ys_bwread = D$bwread; +Ys_bwwrite = D$bwwrite; + +# data +plot(Xs, log2(Ys_advbw), xlab="Year", ylab="Bandwidth (MiB/s)", yaxt='n', xaxt='n', col='blue', pch=20, cex=0.6 ) +points(Xs, log2(Ys_bwread), pch=20, col='red', cex=0.6 ) + + +####### Set the pretty X-axis ############################ +YearLabels=seq(from=2008,to=2014,by=1) +YearLocations=c(66,432,797,1162,1527,1893,2258) +axis(1,at=YearLocations,labels=YearLabels ) +########################################################## + +####### Set the pretty Y-axis ############################ +par(las=1) +lab <- seq(from=1,to=45,by=1) +axis(2,at=lab,labels=parse(text=paste("2^", lab, sep="")) ) +########################################################## + + +####### Plot the best-fit lines ############################ +temp <- subset( D, !is.na(bwread), c('day','bwread') ) +first_bwread_day <- min(temp$day) + +# remove data before year 2010 +#FD <- D[ which(D$day >= 797), ] +D <- D[ which(D$day >= first_bwread_day), ] + +fit_advbw <- lm( log2(advbw) ~ day, data=D ) +fit_bwread <- lm( log2(bwread) ~ day, data=D ) +summary( fit_advbw ) +summary( fit_bwread ) + +### we need this for the lines + + +# Add the best-fit line (with black square) for the advertised bandwidth +segments( min(D$day), predict(fit_advbw, data.frame(day=min(D$day))), + max(D$day), predict(fit_advbw, data.frame(day=max(D$day))), + col="black", lty=2, lwd=3 ) +points( min(D$day), predict(fit_advbw, data.frame(day=min(D$day))), col="black", pch=15, cex=1.3) + +# Add the best-fit line (with black square) for the read bandwidth +segments( min(D$day), predict(fit_bwread, data.frame(day=min(D$day))), + max(D$day), predict(fit_bwread, data.frame(day=max(D$day))), + col="black", lty=2, lwd=3 ) +points( min(D$day), predict(fit_bwread, data.frame(day=min(D$day))), col="black", pch=15, cex=1.3) + + +## Set the Legend and Title +################################################################## +legend_texts = c( + expression(paste("Capacity (advertised) ", r^2, "=0.97")), + expression(paste("Used (read) ", r^2, "=0.88")) +) + +legend( "topleft", legend=legend_texts, inset=0.05, pch=c(20,20), col=c('blue','red') ) + +multiTitle(color="black","Tor relay bandwidth doubles every ", + color="blue","13", + color="black",'-', + color="red","14", + color="black"," months") + + diff --git a/2014/tor-growth/scripts/doubling-table.R b/2014/tor-growth/scripts/doubling-table.R new file mode 100644 index 0000000..db64b53 --- /dev/null +++ b/2014/tor-growth/scripts/doubling-table.R @@ -0,0 +1,148 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') + + +process_torperf_rawdata <- function( filename, filesize_to_consider=5242880 ) +{ + + # Import data from TorPerf + Dtp <- read.csv( filename )[c('day','date','size','source','q1','md','q3')] + Dtp <- rename(Dtp, c("size"="filesize") ) + + print(unique(Dtp$filesize)) + # only use the aggregated Tor data for downloading a 5 MiB file + Dtp <- subset( Dtp, source=='' & filesize==filesize_to_consider ) + + #print( tail(Dtp) ) + + # drop the source and filesize column + #Dtp <- Dtp[ , -which(names(Dtp) %in% c('source','filesize'))] + Dtp <- Dtp[ , -which(names(Dtp) %in% c('source'))] + + # rename the q1, md, and q3 for TIME + Dtp <- rename(Dtp, c("q1"="time_q1","md"="time_md","q3"="time_q3") ) + + # convert time from MILLISECONDS -> SECONDS + Dtp$time_q1 <- Dtp$time_q1/1000 + Dtp$time_md <- Dtp$time_md/1000 + Dtp$time_q3 <- Dtp$time_q3/1000 + + + # now create the bw_q1, bw_md, bw_q3 in: KiB/s + Dtp[c("bw_q1","bw_md","bw_q3")] <- c(NA,NA,NA) + + #convert my_filesize to + + # Rewrite q1, md, and q3 to be in bandwidth (KiB/s) + Dtp$bw_q1 <- (filesize_to_consider / 1024) / Dtp$time_q1; + Dtp$bw_md <- (filesize_to_consider / 1024) / Dtp$time_md; + Dtp$bw_q3 <- (filesize_to_consider / 1024) / Dtp$time_q3; + + return(Dtp) +} + +##################################################################################### +# Number of relays +##################################################################################### + +# remove all entries with values below 937 +Dall <- read.csv('relays-total.csv')[c('date','relays')] +Dall$day <- NA +Dall$day <- 1:nrow(Dall) + +plot( Dall$day, log2(Dall$relays), pch=20, cex=0.6, col='blue' ) + +Dall <- subset(Dall, relays >= 938 ) +points(Dall$day, log2(Dall$relays), pch=20, cex=0.6, col='red' ) + +mm <- lm( log2(Dall$relays) ~ Dall$day ) + +rows_to_remove <- abs(resid(mm)) > 0.38 +Dall <- Dall[ !rows_to_remove, ] + +points(Dall$day, log2(Dall$relays), pch=20, cex=0.6, col='purple' ) + +mm <- lm( log2(Dall$relays) ~ Dall$day ) + +# from here the doubling rate is gotten by +(1.0 / mm$coefficients) / 365 + +# which comes out to 2.99 years + +##################################################################################### +# total network bandwidth +##################################################################################### +rm( list = ls() ) +D <- read.csv('bandwidth-clean.csv')[c('date','advbw','bwread')] +D$advbw <- D$advbw / 1048576.0 +#D <- rename(D, c("date"="day") ) +D$day <- NA +D$day <- 1:nrow(D) + +# convert from B/s to MiB/s + +m <- lm( log2(D$advbw) ~ D$day ) + +# now for the monthly doubling rate +(1.0 / m$coefficients) / 30 + + +##################################################################################### +# Absolute Torperf +##################################################################################### +#rm( list = ls() ) +D_SMALL <- process_torperf_rawdata('torperf-clean.csv', 51200)[c('date','day','bw_md')] +D_BIG <- process_torperf_rawdata('torperf-clean.csv', 5242880)[c('date','day','bw_md')] + + +D_SMALL <- subset( D_SMALL, day>=547 ) +D_BIG <- subset( D_BIG, day>=547 ) + + +mSMALL <- lm( log2(bw_md) ~ day, data=D_SMALL ) +mBIG <- lm( log2(bw_md) ~ day, data=D_BIG ) + +(1.0 / mSMALL$coefficients) / 30 +(1.0 / mBIG$coefficients) / 30 + + + +##################################################################################### +# Normalized Torperf +##################################################################################### + +# Readin the netindex and average it +####################################################### +D_netindex <- read.csv('country_daily_speeds.csv')[c('date','country_code','download_kbps')] + +D_netindex$download_kbps <- D_netindex$download_kbps * (1000 / 1024) + + +# make a single download_rate averaging across the countries: US, DE, RU. +D_US = subset( D_netindex, country_code=='US' ) +D_DE = subset( D_netindex, country_code=='DE' ) +D_RU = subset( D_netindex, country_code=='RU' ) + +# merge the US, DE, and RU bandwidths +D_temp <- merge( D_US, D_DE, by='date' ) +D_ni <- merge( D_temp, D_RU, by='date' ) + +# drop the country codes +D_ni <- D_ni[ , -which(names(D_ni) %in% c('country_code.x','country_code.y','country_code'))] + +# average the download KiB/s entries into one +D_ni$avr_download_KBps <- NA +D_ni$avr_download_KBps <- (D_ni$download_kbps.x + D_ni$download_kbps.y + D_ni$download_kbps) / 3.0 + +# drop the country-specific download rates +D_ni <- D_ni[ , -which(names(D_ni) %in% c('download_kbps.x','download_kbps.y','download_kbps'))] + + +# now merge D_ni and {D_SMALL,D_BIG} based on date +Dnorm_SMALL <- merge( D_ni, D_SMALL, by='date' ) +Dnorm_BIG <- merge( D_ni, D_BIG, by='date' ) + +Dnorm_SMALL$normalized_bw <- NA; Dnorm_SMALL$normalized_bw <- Dnorm_SMALL$bw_md / Dnorm_SMALL$avr_download_KBps +Dnorm_BIG$normalized_bw <- NA; Dnorm_BIG$normalized_bw <- Dnorm_BIG$bw_md / Dnorm_BIG$avr_download_KBps + + diff --git a/2014/tor-growth/scripts/non-tor-bandwidth.R b/2014/tor-growth/scripts/non-tor-bandwidth.R new file mode 100644 index 0000000..c062f55 --- /dev/null +++ b/2014/tor-growth/scripts/non-tor-bandwidth.R @@ -0,0 +1,70 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/non-tor-bw/') + + +library(plyr) # for renaming columns + +####################################################### +D_netindex <- read.csv('country_daily_speeds.csv')[c('date','country_code','download_kbps')] + +D_netindex$download_kbps <- D_netindex$download_kbps * (1000 / 1024) +D_netindex$upload_kbps <- D_netindex$upload_kbps * (1000 / 1024) + + + +D_US = subset( D_netindex, country_code=='US' ) +D_DE = subset( D_netindex, country_code=='DE' ) +D_RU = subset( D_netindex, country_code=='RU' ) + +# merge the US, DE, and RU bandwidths +D_temp <- merge( D_US, D_DE, by='date' ) +D_COMPOSITE <- merge( D_temp, D_RU, by='date' ) + +# drop the country codes +D_COMPOSITE <- D_COMPOSITE[ , -which(names(D_COMPOSITE) %in% c('country_code.x','country_code.y','country_code'))] + +# average the download KiB/s entries into one +D_COMPOSITE$avr_download_KBps <- NA +D_COMPOSITE$avr_download_KBps <- (D_COMPOSITE$download_kbps.x + D_COMPOSITE$download_kbps.y + D_COMPOSITE$download_kbps) / 3.0 + +# drop the country-specific download rates +D_COMPOSITE <- D_COMPOSITE[ , -which(names(D_COMPOSITE) %in% c('download_kbps.x','download_kbps.y','download_kbps'))] + + + +plot( 1:nrow(D_US), log2(D_US$download_kbps), yaxt='n', xaxt='n', col='red', cex=0.7, xlab="Year", ylab="Mean download bandwidth (KiB/s)", pch=20 ) +points( 1:nrow(D_RU), log2(D_RU$download_kbps), yaxt='n', xaxt='n', col='blue', cex=0.7, pch=20 ) +points( 1:nrow(D_DE), log2(D_DE$download_kbps), yaxt='n', xaxt='n', col='orange', cex=0.7, pch=20 ) + +points( 1:nrow(D_COMPOSITE), log2(D_COMPOSITE$avr_download_KBps), col='black', cex=0.5, pch=20 ) + +####### Set the pretty Y-axis ############################ +par(las=1) +#lab <- seq(from=1,to=45,by=1) +lab <- c(12,12.5,13,13.5,14,14.5) +axis(2,at=lab,labels=parse(text=paste("2^", lab, sep="")) ) +########################################################## + + +####### Set the pretty X-axis ################################### +YearLabels=c('2009','2010','2011','2012','2013','2014') +YearLocations=c(367, 732, 1097, 1462, 1828, 2193) +axis(1,at=YearLocations,labels=YearLabels ) +################################################################# + + +legend_texts = c("United Staes", "Germany", "Russia", "Composite") +legend( "topleft", legend=legend_texts, inset=0.01, pch=c(20,20), col=c('red','orange','blue','black') ) + + + +day <- 1:nrow(D_US) + +mm <- lm( log2(download_kbps) ~ day, data=D_US ) +1.0 / (mm$coefficients["day"] * 30) + +mm <- lm( log2(download_kbps) ~ day, data=D_DE ) +1.0 / (mm$coefficients["day"] * 30) + +mm <- lm( log2(download_kbps) ~ day, data=D_RU ) +1.0 / (mm$coefficients["day"] * 30) diff --git a/2014/tor-growth/scripts/relays.R b/2014/tor-growth/scripts/relays.R new file mode 100644 index 0000000..f95ba77 --- /dev/null +++ b/2014/tor-growth/scripts/relays.R @@ -0,0 +1,97 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') +library(car) # for pretty plots +#library(matlab) # for matlab function names +#library(data.table) # for data.table like data.frame +#library(xtable) # for exporting to LaTeX +#library(gdata) +#library(lmtest) # for testing linear models +#library(calibrate) + +library(plyr) # for renaming columns + +####################################################### + +## Readin the data into data.frame D with columns: days, relays.stable, relays.fast, relays.all +####################################################### +Dstable <- read.csv('relays-stable.csv')[c('date','relays')] +#Dfast <- read.csv('relays-fast.csv')[c('date','relays')] +#Dtemp <- merge(Dstable, Dfast, by="date", suffixes=c('.stable','.fast') ) +Dall <- read.csv('relays-total.csv')[c('date','relays')] +D <- merge( Dstable, Dall, by='date' ) +D <- rename(D, c("date"="day","relays"="relays.all")) +names(D) + +plot(D$day, log2(D$relays.all), ylab='Number of Relays', xlab='Year', yaxt='n', pch=20, cex=0.6, xaxt='n', col='blue', ylim=c(8,13) ) + +points( D$day, log2(D$relays.stable), pch=20, cex=0.6, col='purple' ) + + +plot(1:nrow(Dall), log2(Dall$relays), ylab='Number of Relays', xlab='Year', yaxt='n', pch=20, cex=0.6, xaxt='n', col='blue', ylim=c(8,13) ) + + +####### Set the pretty X-axis ################################### +YearLabels=seq(from=2008,to=2014,by=1) +YearLocations=c(66,432,797,1162,1527,1893,2258) +axis(1,at=YearLocations,labels=YearLabels ) +################################################################# + +####### Set the pretty Y-axis ################################### +par(las=1) +lab <- seq(from=1,to=45,by=1) +axis(2,at=lab,labels=parse(text=paste("2^", lab, sep="")) ) +################################################################# + + + + + + +## Set the Legend and Title +################################################################## +legend_texts = c( + expression(paste("All relays ", r^2, "=0.96")), + expression(paste("Stable relays ", r^2, "=0.93")) +) + +legend( "topleft", legend=legend_texts, inset=0.05, pch=c(20,20), col=c('blue','purple') ) + +multiTitle(color="black","Number of Tor relays doubles every ", + color="purple","2.1", + color="black",'-', + color="blue","2.6", + color="black"," years" ) + + + +####### Plot the best-fit lines ############################ + +# remove data before year 2010 +FD <- D[ which(D$day >= 750), ] + +# remove points with super-high-residuals from the fitted line +fit_all <- lm( log2(relays.all) ~ day, data=FD ) +rows_to_remove <- abs(resid(fit_all)) > 0.38 +FD <- FD[ !rows_to_remove, ] + + +# fit to a linear model +fit_all <- lm( log2(relays.all) ~ day, data=FD ) +fit_stable <- lm( log2(relays.stable) ~ day, data=FD ) + + +# Add the best-fit lines +first_day <- min(FD$day) +segments( first_day, predict(fit_all, data.frame(day=first_day)), + max(FD$day), predict(fit_all, data.frame(day=max(FD$day))), + col="black", lty=2, lwd=3 ) +segments( first_day, predict(fit_stable, data.frame(day=first_day)), + max(FD$day), predict(fit_stable, data.frame(day=max(FD$day))), + col="black", lty=2, lwd=3 ) + +# Add the black squares +points( first_day, predict(fit_all, data.frame(day=min(FD$day))), col="black", pch=15, cex=1.3) +points( first_day, predict(fit_stable, data.frame(day=min(FD$day))), col="black", pch=15, cex=1.3) + +#summary( fit_all ) +#summary( fit_stable ) \ No newline at end of file diff --git a/2014/tor-growth/scripts/torperf.R b/2014/tor-growth/scripts/torperf.R new file mode 100644 index 0000000..eda9162 --- /dev/null +++ b/2014/tor-growth/scripts/torperf.R @@ -0,0 +1,136 @@ +rm( list = ls() ) +setwd('/Users/know/Desktop/tor analytics/') +library(car) # for pretty plots +library(matlab) # for matlab function names +library(data.table) # for data.table like data.frame +#library(xtable) # for exporting to LaTeX +#library(gdata) +library(lmtest) # for testing linear models +library(calibrate) + +library(plyr) # for renaming columns +source("colortitles.R") +####################################################### + +process_torperf_rawdata <- function( filename, filesize_to_consider=5242880 ) +{ + + # Import data from TorPerf + Dtp <- read.csv( filename )[c('day','date','size','source','q1','md','q3')] + Dtp <- rename(Dtp, c("size"="filesize") ) + + print(unique(Dtp$filesize)) + # only use the aggregated Tor data for downloading a 5 MiB file + Dtp <- subset( Dtp, source=='' & filesize==filesize_to_consider ) + + #print( tail(Dtp) ) + + # drop the source and filesize column + #Dtp <- Dtp[ , -which(names(Dtp) %in% c('source','filesize'))] + Dtp <- Dtp[ , -which(names(Dtp) %in% c('source'))] + + # rename the q1, md, and q3 for TIME + Dtp <- rename(Dtp, c("q1"="time_q1","md"="time_md","q3"="time_q3") ) + + # convert time from MILLISECONDS -> SECONDS + Dtp$time_q1 <- Dtp$time_q1/1000 + Dtp$time_md <- Dtp$time_md/1000 + Dtp$time_q3 <- Dtp$time_q3/1000 + + + # now create the bw_q1, bw_md, bw_q3 in: KiB/s + Dtp[c("bw_q1","bw_md","bw_q3")] <- c(NA,NA,NA) + + #convert my_filesize to + + # Rewrite q1, md, and q3 to be in bandwidth (KiB/s) + Dtp$bw_q1 <- (filesize_to_consider / 1024) / Dtp$time_q1; + Dtp$bw_md <- (filesize_to_consider / 1024) / Dtp$time_md; + Dtp$bw_q3 <- (filesize_to_consider / 1024) / Dtp$time_q3; + + return(Dtp) +} + +# get the two groups +D_BIG <- process_torperf_rawdata('torperf-clean.csv', 5242880) +D_MED <- process_torperf_rawdata('torperf-clean.csv', 1048576) +D_SMALL <- process_torperf_rawdata('torperf-clean.csv', 51200) + + +# DO ANALYSIS FROM HERE +####################################################### + +plot(D_BIG$day, log2(D_BIG$bw_md), xlab='Year', ylab="Torperf bandwidth (KiB/s)", pch='', xaxt='n', yaxt='n', ylim=c(2.5,9) ) +#points(D_BIG$day, log2(D_BIG$bw_md), pch=20, col='blue', cex=0.4 ) +#points(D_MED$day, log2(D_MED$bw_md), pch=20, col='purple', cex=0.4 ) +#points(D_SMALL$day, log2(D_SMALL$bw_md), pch=20, col='red', cex=0.4 ) + + +points( smooth.spline(D_BIG$day, log2(D_BIG$bw_md)), pch=20, col='blue', cex=0.5 ) +points( smooth.spline(D_MED$day, log2(D_MED$bw_md)), pch=20, col='purple', cex=0.5 ) +points( smooth.spline(D_SMALL$day, log2(D_SMALL$bw_md)), pch=20, col='red', cex=0.5 ) + + +####### Set the pretty X-axis and Y-axis ############################ +YearLabels=seq(from=2010,to=2014,by=1) +YearLocations=c(182,547,912,1278,1643) +axis(1,at=YearLocations,labels=YearLabels ) + +par(las=1) +lab <- seq(from=-5,to=10,by=1) +labels <- parse(text=paste("2^", lab, sep="") ) +axis(2,at=lab,labels=labels ) + + + + +####### Plot the best-fit lines ############################ +Dfit <- subset( D_BIG, day>=547 ) +first_fit_day <- min(Dfit$day) +fit_BIG <- lm( log2(bw_md) ~ day, data=Dfit ) + + +# Add the best-fit line (with black square) for the advertised bandwidth +segments( min(Dfit$day), predict(fit_BIG, data.frame(day=min(Dfit$day))), + max(Dfit$day), predict(fit_BIG, data.frame(day=max(Dfit$day))), + col="black", lty=2, lwd=3 ) +points( min(Dfit$day), predict(fit_BIG, data.frame(day=min(Dfit$day))), col="black", pch=15, cex=1.3) + + +#################################################################### + +Dfit <- subset( D_MED, day>=547 ) +first_fit_day <- min(Dfit$day) +fit_MED <- lm( log2(bw_md) ~ day, data=Dfit ) + + +# Add the best-fit line (with black square) for the advertised bandwidth +segments( min(Dfit$day), predict(fit_MED, data.frame(day=min(Dfit$day))), + max(Dfit$day), predict(fit_MED, data.frame(day=max(Dfit$day))), + col="black", lty=2, lwd=3 ) +points( min(Dfit$day), predict(fit_MED, data.frame(day=min(Dfit$day))), col="black", pch=15, cex=1.3) + + +#################################################################### + +Dfit <- subset( D_SMALL, day>=547 ) +fit_SMALL <- lm( log2(bw_md) ~ day, data=Dfit ) + +# Add the best-fit line (with black square) for the advertised bandwidth +segments( min(Dfit$day), predict(fit_SMALL, data.frame(day=min(Dfit$day))), + max(Dfit$day), predict(fit_SMALL, data.frame(day=max(Dfit$day))), + col="black", lty=2, lwd=3 ) +points( min(Dfit$day), predict(fit_SMALL, data.frame(day=min(Dfit$day))), col="black", pch=15, cex=1.3) + + + +legend_texts = c( + expression(paste("5 MiB ", r^2, "=0.46")), + expression(paste("1 MiB ", r^2, "=0.48")), + expression(paste("50 KiB ", r^2, "=0.55")) +) + + +legend( "topleft", legend=legend_texts, inset=0.03, pch=c(20,20), col=c('blue','purple','red') ) + + diff --git a/2014/tor-growth/tor-growth.tex b/2014/tor-growth/tor-growth.tex new file mode 100644 index 0000000..593d103 --- /dev/null +++ b/2014/tor-growth/tor-growth.tex @@ -0,0 +1,245 @@ +\documentclass{tortechrep} +\usepackage{afterpage} +%\usepackage{subfloat} +\usepackage{subfig} +\usepackage{url} +\usepackage{fullpage} +\usepackage{amsmath} +\usepackage{booktabs} +%\usepackage{afterpage} +%\usepackage{subcanonption} +\usepackage{graphicx} + + + +%%%%%%%%% BLUE UNDERLINES +\usepackage{color} % << color package is required for blue underline +\usepackage{ulem} % << ulem package is required for blue underline + +%Define a blue underline +\newcommand{\blueuline}{\bgroup\markoverwith{\hbox{\kern-.03em\vtop% +{\begingroup\kern.1ex\color{blue}\hrule width .2em\kern1.1pt \endgroup\kern-.03em}}}\ULon} +%\newcommand\reduline{\bgroup\markoverwith +% {\textcolor{red}{\rule[-0.5ex]{2pt}{0.4pt}}}\ULon} + +\newcommand{\uhref}[2]{\href{#1}{\blueuline{#2}}} +%%%%%%%%%%%%% END BLUE UNDERLINES + + + +\title{Tor growth rates and improving Torperf throughput} +\author{Virgil Griffith} +\reportid{2014-10-001} +\date{October 04, 2014} + +\newcommand{\Figref}[1]{Figure~\ref{#1}} +\newcommand{\figref}[1]{Figure~\ref{#1}} + +\begin{document} +\maketitle + +\section{Preliminaries} +Despite data being available from \uhref{http://metrics.torproject.org}{metrics.torproject.org} for sometime, there’s been little statistical analysis of that data. Let’s fix that. From the Metrics data, the most obvious thing to plot is the number of relays over time, see \figref{fig:fig1}. Plotting in logscale (so a straight line means exponential growth) reveals that the number of relays increases exponentially. Good to know. The ``stable relays'' are plotted in purple because they are fabulous. + + +Next in \figref{fig:fig2} we chart the total network bandwidth over time. Tor's total network bandwidth doubles at a darn impressive 13--14 months! Moore's Law, doubling every 18 months, is downright torpid by comparison. + + +Since 2010 the doubling rates for both relays and bandwidth have been remarkably consistent. Although recognizing that there are unaccounted for sinusoidal trends, the fact remains that a simple fit of $y = m~\log(x) + b$ accounts for \textasciitilde 90\% of the variance! Additionally, the 99\% confidence intervals on the predicted data are barely visible without a magnifying glass. Extrapolation from statistics is a dangerous game, but realistically we can't expect these growth rates to be more predictable. With this statistical bedrock under our feet, let's go deeper. In \figref{fig:fig3} we see how the mean relay bandwidth grows over time. We see that the mean relay bandwidth doubles about every two years. This is akin to \uhref{http://www.nngroup.com/articles/law-of-bandwidth/}{Nielsen's Law} which states that for high-end home users, bandwidth doubles every two years. Good job operators---those Tor-shirts are well earned! + + + + + + +We see that the mean relay bandwidth increases by Nielsen's Law, but how does this impact client experience? Fortunately, we have \uhref{https://metrics.torproject.org/performance.html}{Torperf data} to answer this. Simple things first, and in \figref{fig:fig4} we plot Torperf bandwidth over time. Torperf's fitted line isn't nearly as good a fit as the number of relays or total bandwidth (Figures \ref{fig:fig1} and \ref{fig:fig2}), but it conveys enough of the trend to be useful. We see that, depending on file size, Torperf throughput doubles every 25--35 months.\footnote{It's not obvious that Torperf bandwidth increases exponentially, but given that bandwidth and CPU are the primary factors in Torperf and that each of these follow their respective exponential curves, it's reasonable to err on the side of an exponential fit over a linear one. Statistical modeling often leverages domain knowledge.} Given such a wide spread in Figure \figref{fig:fig4}, we will separately conside r the Torperf bandwidth for downloading a 50 KiB and 5 MiB file. Lets go deeper. + + + + +Absolute Torperf improvements are great to see, but the key measure is how Torperf throughput compares with clients’ non-Tor throughput. From \uhref{http://www.netindex.com/}{OOKLA bandwidth data} we calculate the composite mean download rate for the three countries with the greatest number of Tor clients: United States, Germany, and Russia (\figref{fig:nonTor}). With the composite non-Tor bandwidth in hand, we plot Torperf bandwidth normalized (divided) by the composite non-Tor bandwidth arriving at \figref{fig:fig5}. + + + +For smaller files (50 KiB), we see that although absolute Torperf has been doubling every 35 months, normalized Torperf has been essentially flat. For larger files (5 MiB), we see a gradual uptick in normalized Torperf. + +From the doubling rates of Torperf and composite non-Tor bandwidth we can derive the normalized Torperf growth rates analytically. Taking the ratio of two exponentials of the form $y = 2^{(1/n) x}$ where $n$ is the doubling rate, we get $y = 2^{(1/n - 1/m) x}$ where $n$ and $m$ are the doubling rates of Torperf bandwidth and composite non-Tor bandwidth respectively. This results in normalized Torperf doubling every $20$ years for small files and doubling every $5$ years for large files. To put a five year doubling rate in perspective, this means Torperf will reach $5\%$ of non-Tor bandwidth around year 2022. Internal optimizations like the \uhref{http://www.robgjansen.com/publications/kist-sec2014.pdf}{KIST scheduler} are great steps to improve this. + +\section{Will adding advertised bandwidth improve Torperf?} + +There have been \uhref{https://blog.torproject.org/blog/tor-incentives-research-roundup-goldstar-par-braids-lira-tears-and-torcoin}{various proposals} for improving client speeds by adding operator incentives beyond the established \uhref{https://www.torproject.org/getinvolved/tshirt.html}{T-shirts} and \uhref{https://blog.torservers.net/20131213/torservers-awarded-250000-by-digital-defenders.html}{financial grants}. Our final analysis is an attempt to predict whether adding more advertised relay bandwidth would reliably improve Torperf throughput. + + +We've established that absolute Torperf improves on its own due to the increasing bandwidth of relays. Our first step to blunt the influence of increasing relay bandwidth is to always look at the \emph{normalized} Torperf performance. We explored several different predictors of normalized Torperf, and the most promising was proportion of total read bandwidth to total advertised bandwidth, or the Network Utilization Ratio (NUR). We plot normalized Torperf as a function of NUR in \figref{fig:fig6}. + + + + +We see that NUR doesn't predict much of the normalized bandwidth for small (50 KiB) files. However, for large files (5 MiB), there's a fuzzy yet definite trend of ``lower NUR means higher normalized Torperf''. But there's a risk, we see that the lowest NUR data points (purple) are all from 2014. Therefore NUR could be acting as a mere proxy for the gradual (yet slow per \figref{fig:fig5}) improvement of normalized Torperf over time. + +We control for this using a two-factor ANOVA using \texttt{DATE} and \texttt{NUR} as the two factors and normalized Torperf as the dependent variable. For the stats-literate, the full ANOVA tables are given in Table \ref{tbl:anovatables}, but the take-home message is that \texttt{NUR} provides substantial predictive power for normalized Torperf even after accounting for \texttt{DATE}. Concretely, while the single-factor model using \texttt{DATE} has an $r^2$ of $0.02$ (50 KiB) and $0.14$ (5 MiB), the two-factor model using \texttt{DATE} and \texttt{NUR} yields an $r^2$ of $0.17$ and $0.44$---a $750\%$ and $208\%$ improvement respectively. This allows us to tentatively conclude that a sudden uptick in advertised bandwidth would improve normalized Torperf beyond the glacial ascent seen in \figref{fig:fig5}.\footnote{Unsurprisingly, there's some caveats to this conclusion. Our argument presumes that the distribution of advertised bandwidth across relays is constant---for example, T orperf would not improve if $10^{12}$ new relays joined the consensus but each provided only $1$ B/s. We're aware of no evidence indicating this assumption is unrealistic.} + + +\begin{table}[hbt] +\centering +\subfloat[50 KiB. For aggregate model $r^2=0.17$.] { +\begin{tabular}{ l l l l l l } \toprule + & df & Sum Sq & Mean Sq & F-value & p-value \\ +\midrule +\texttt{DATE} & 1 & 0.04039 & 0.040390 & \ \ 38.418 & 7.309\textsc{e}$^{-10}$ \\ +\texttt{NUR} & 1 & 0.29005 & 0.290045 & 275.887 & 2\textsc{e}$^{-16}$ \\ +Residuals & 1546 & 1.62534 & 0.001051 & & \\ +\bottomrule +\end{tabular} } + +%\vskip +\bigskip + +\subfloat[5 MiB. For aggregate model $r^2=0.44$.]{ +\begin{tabular}{ l l l l l l } \toprule + & df & Sum Sq & Mean Sq & F-value & p-value \\ +\midrule +\texttt{DATE} & 1 & 27.395 & 27.395 & 401.09 & 2\textsc{e}$^{-16}$ \\ +\texttt{NUR} & 1 & 56.750 & 56.750 & 830.87 & 2\textsc{e}$^{-16}$ \\ +Residuals & 1546 & 105.595 & 0.068 & & \\ +\bottomrule +\end{tabular} } + +\caption{ANOVA tables predicting normalized Torperf for downloading a 50 KiB and 5 MiB file.} +\label{tbl:anovatables} +\end{table} + + + +\section{Summary} +We've learned a few things. + +\begin{enumerate} + \item Many aspects of Tor follow exponential growth. Table \ref{tbl:summary} summarizes these results. Additionally, Tor bandwidth currently sits at $<2\%$ of mean non-Tor bandwidth. + + \item Tor clients' absolute throughput is steadily improving. However, after normalizing by mean non-Tor bandwidth, this improvement is greatly diminished. For small files, normalized Torperf has been essentially flat since records have been kept. + + \item An intervention to increase advertised bandwidth would noticeably improve normalized Torperf for large \emph{as well as small} files. +\end{enumerate} + + +\begin{table} +\centering +\begin{tabular}{ l l l l } \toprule + & Doubling rate & $\ \ r^2$ \\ +% & (years) & \\ +\midrule +Total advertised bandwidth & \ \;1.2 \ years & 0.96 \\ +Mean relay bandwidth & \ \;2\ \ \; \ years & 0.91 \\ +Number of relays (all) & \ \;3\ \ \; \ years & 0.94 \medskip \\ + +Absolute Torperf (5 MiB) & \ \;2\ \ \; \ years & 0.46 \\ +Absolute Torperf (50 KiB) & \ \;3\ \ \; \ years & 0.55 \medskip \\ + +Mean RU download bandwidth & \ \;3.1 \ years & 0.95 \\ +Mean US download bandwidth & \ \;3.4 \ years & 0.97 \\ +Mean DE download bandwidth & \ \;3.9 \ years & 0.88 \\ +Composite download bandwidth & \ \;3.5 \ years & 0.97 \medskip \\ + +Normalized Torperf (5 MiB) & \ \;5 \ \ \;\ years & \ \ - \\ +Normalized Torperf (50 KiB) & 19.9 \ years & \ \ - \\ +\bottomrule +\end{tabular} + +\caption{Summary of growth rates} +\label{tbl:summary} +\end{table} + + + +\section{Future Work} +\label{sect:fw} +Some natural extensions to this work are: +\begin{itemize} + \item Instead of looking at the \emph{mean} relay bandwidth, instead separately calculate the \emph{expected} bandwidth for the guard, middle, and exit node positions. + \item It'd be nice to characterize the \emph{distribution} of advertised bandwidth. Does it follow a Gaussian? Pareto? It'd be nice to know. + \item When computing the composite non-Tor bandwidth, instead of doing an unweighted average of the United Staes, Germany, and Russia, it'd be better to do a \emph{weighted average} among all countries in which each country is weighted by its number of originating Tor clients. We doubt this would change the conclusions. + \item Tor's Network Utilization Ratio (NUR), shown in \figref{fig:fig8}, has clear drops of unclear cause. Given how predictive NUR is of normalized Torperf, we'd like to know the causes of the two drops in NUR on 2013-10-09 and 2014-06-06. +\end{itemize} + +\flushleft \textbf{Acknowledgements.} We thank Roger Dingledine and Karsten Loesing for their help and review. All analyses were done in R. + +\clearpage + +%%%%%%%%%%%%%%%%% +%% FIGURES +%%%%%%%%%%%%%%%%% + +\begin{figure}[h!bt] + \centering + \includegraphics[height=3.55in]{figs/fig1-relays.png} + \caption{The number of Tor relays increases exponentially, doubling every 2 years (stable) to 2.5 years (all).} + \label{fig:fig1} +\end{figure} +\begin{figure}[h!bt] + \centering + \includegraphics[height=3.55in]{figs/fig2-bw.png} + \caption{Total network bandwidth also increases exponentially.} + \label{fig:fig2} +\end{figure} + +\begin{figure}[h!bt] + \centering + \includegraphics[height=5in]{figs/fig3-mean-bw.png} + \caption{Mean relay bandwidth increases exponentially and doubles approximately every 24 months.} + \label{fig:fig3} +\end{figure} + +\begin{figure}[h!bt] + \centering + \includegraphics[height=5in]{figs/fig4--torperf.png} + \caption{Absolute Torperf throughput increases exponentially, doubling every 25 months for 5 MiB files and every 35 months for 50 KiB files. Unfortunately, the throughput when downloading a 50 KiB file is \textasciitilde 8x slower than downloading a 5 MiB file. These trends imply that these two rates will continue to diverge.} + \label{fig:fig4} +\end{figure} + + +\begin{figure}[h!bt] + \centering + \includegraphics[height=5in]{figs/5a--normalized-torperf-small.png} + \caption{The normalized Torperf for 50 KiB and 5 MiB files.} + \label{fig:fig5} +\end{figure} + + +\begin{figure} + \centering + \subfloat[50 KiB; $r^2=0.15$.]{ \includegraphics[height=4in]{figs/fig6--NUR-predicts-normtorperf_small.png} \label{fig:6a} } + + \subfloat[5 MiB; $r^2=0.44$.]{ \includegraphics[height=4in]{figs/fig6--NUR-predicts-normalized-torperf_large.png} \label{fig:6b} } + \caption{Low NUR imples higher normalized Torperf---especially so for larger files.} + \label{fig:fig6} +\end{figure} + + + +\begin{figure}[h!bt] + \centering + \includegraphics[height=5in]{figs/non-tor-bw.png} + \caption{Mean download bandwidth for United States, Germany, and Russia according to netindex.com. Composite is the mean of all three.} + \label{fig:nonTor} +\end{figure} + + +\begin{figure}[h!bt] + \centering + \includegraphics[height=5in]{figs/appendix--NUR-over-time.png} + \caption{Network Utilization Ratio (NUR) falls into three distinct stages. Within each stage the fitted line is essentially flat. What happened on 2013-10-08 and 2014-06-06!? The only thing we see is that on 2014-06-05 (one day prior) the EFF began their Tor Challenge.} + \label{fig:fig8} +\end{figure} + + + + + + + + + + + +\end{document} diff --git a/2014/tor-growth/tortechrep.cls b/2014/tor-growth/tortechrep.cls new file mode 120000 index 0000000..4c24db2 --- /dev/null +++ b/2014/tor-growth/tortechrep.cls @@ -0,0 +1 @@ +../../tortechrep.cls \ No newline at end of file

1 0

[tech-reports/master] Add Virgil's email address.
by karsten＠torproject.org 28 Dec '14

28 Dec '14

commit 444bf166d4066d1566aa5ee6a287e28642c7b71c Author: Karsten Loesing <karsten.loesing(a)gmx.net> Date: Mon Dec 22 11:07:04 2014 +0100 Add Virgil's email address. --- 2014/tor-growth/tor-growth.tex | 1 + 1 file changed, 1 insertion(+) diff --git a/2014/tor-growth/tor-growth.tex b/2014/tor-growth/tor-growth.tex index 593d103..d2798ae 100644 --- a/2014/tor-growth/tor-growth.tex +++ b/2014/tor-growth/tor-growth.tex @@ -29,6 +29,7 @@ \title{Tor growth rates and improving Torperf throughput} \author{Virgil Griffith} +\contact{\href{mailto:i@virgil.gr}{i@virgil.gr}} \reportid{2014-10-001} \date{October 04, 2014}

1 0

[translation/tails-iuk] Update translations for tails-iuk
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit 4dbfec5023f88b7d21527ce51773fbecd3a5620e Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 07:45:45 2014 +0000 Update translations for tails-iuk --- az.po | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/az.po b/az.po index 45af8c2..f4f4860 100644 --- a/az.po +++ b/az.po @@ -9,7 +9,7 @@ msgstr "" "Project-Id-Version: The Tor Project\n" "Report-Msgid-Bugs-To: Tails developers <tails(a)boum.org>\n" "POT-Creation-Date: 2014-12-02 09:42+0100\n" -"PO-Revision-Date: 2014-12-28 07:10+0000\n" +"PO-Revision-Date: 2014-12-28 07:40+0000\n" "Last-Translator: E <ehuseynzade(a)gmail.com>\n" "Language-Team: Azerbaijani (http://www.transifex.com/projects/p/torproject/language/az/)\n" "MIME-Version: 1.0\n" @@ -34,27 +34,27 @@ msgid "" "Check your network connection, and restart Tails to try upgrading again.\n" "\n" "If the problem persists, go to file:///usr/share/doc/tails/website/doc/upgrade/error/check.en.html" -msgstr "" +msgstr "Bizim vebsaytımızdan təkmilləşmələrin mümkün olub olmaması müəyyənləşdirilə bilmədi.\n\nŞəbəkə əlaqəni yoxla, yenidən təkmilləşdirməyə cəhd etmək üçün Tailləri yenidən aç.\n\nProblem qalmaqda davam etsə, file:///usr/share/doc/tails/website/doc/upgrade/error/check.en.html səhifəsinə keç." #: ../lib/Tails/IUK/Frontend.pm:234 msgid "no automatic upgrade is available from our website for this version" -msgstr "" +msgstr "bu versiya üçün bizim saytımızdan avtomatik təkmilləşmə yoxdur" #: ../lib/Tails/IUK/Frontend.pm:240 msgid "your device was not created using Tails Installer" -msgstr "" +msgstr "sənin ötürücün Tails Quraşdırıcının vasitəsilə yaradılmamışdır" #: ../lib/Tails/IUK/Frontend.pm:245 msgid "Tails was started from a DVD or a read-only device" -msgstr "" +msgstr "Tails DVD və ya yalnız-ozuna bilən ötürücü tərəfindən başlanmışdır" #: ../lib/Tails/IUK/Frontend.pm:250 msgid "there is not enough free space on the Tails system partition" -msgstr "" +msgstr "Tails sistem bölməsində kifayət qədər boş yer yoxdur" #: ../lib/Tails/IUK/Frontend.pm:255 msgid "not enough memory is available on this system" -msgstr "" +msgstr "bu sistemdə kifayət qədər yaddaş yeri yoxdur" #: ../lib/Tails/IUK/Frontend.pm:261 #, perl-brace-format

1 0

[translation/tor-and-https_completed] Update translations for tor-and-https_completed
by translation＠torproject.org 28 Dec '14

28 Dec '14

commit 31477dcc6b8dfc60907acc370b45c93fb87de0c4 Author: Translation commit bot <translation(a)torproject.org> Date: Sun Dec 28 07:15:59 2014 +0000 Update translations for tor-and-https_completed --- az.po | 136 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 136 insertions(+) diff --git a/az.po b/az.po new file mode 100644 index 0000000..892ca53 --- /dev/null +++ b/az.po @@ -0,0 +1,136 @@ +# +# Translators: +# E <ehuseynzade(a)gmail.com>, 2014 +msgid "" +msgstr "" +"Project-Id-Version: The Tor Project\n" +"POT-Creation-Date: 2014-07-17 14:23+0000\n" +"PO-Revision-Date: 2014-12-28 07:10+0000\n" +"Last-Translator: E <ehuseynzade(a)gmail.com>\n" +"Language-Team: Azerbaijani (http://www.transifex.com/projects/p/torproject/language/az/)\n" +"MIME-Version: 1.0\n" +"Content-Type: text/plain; charset=UTF-8\n" +"Content-Transfer-Encoding: 8bit\n" +"Language: az\n" +"Plural-Forms: nplurals=2; plural=(n != 1);\n" + +#. (itstool) path: C/tor-and-https.svg/svg@direction +#. (itstool) comment: C/tor-and-https.svg/svg@direction +#. Specify "ltr" for left-to-right languages or "rtl" for right-to-left +#. languages (e.g. Arabic or Hebrew). +#: C/tor-and-https.svg:3 +msgid "ltr" +msgstr "Itr" + +#. (itstool) path: svg/title +#: C/tor-and-https.svg:14 +#, no-wrap +msgid "Tor and HTTPS" +msgstr "Tor və HTTPS" + +#. (itstool) path: defs/text +#. Keep it short: 7em max. Seven times the capital letter "M". +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Site.com" +msgstr "Site.com" + +#. (itstool) path: defs/text +#. Keep it short: 7em max. Seven times the capital letter "M". +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "user / pw" +msgstr "istifadəçi / şifrə" + +#. (itstool) path: defs/text +#. Keep it short: 7em max. Seven times the capital letter "M". +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "data" +msgstr "məlumat" + +#. (itstool) path: defs/text +#. Keep it short: 7em max. Seven times the capital letter "M". +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "location" +msgstr "məkan" + +#. (itstool) path: defs/text +#. Keep it short: 3em max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "WiFi" +msgstr "WiFi" + +#. (itstool) path: defs/text +#. Keep it short: 4em max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "ISP" +msgstr "ISP" + +#. (itstool) path: defs/text +#. Keep it short: 8em is ok, 9em is max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Hacker" +msgstr "Haker" + +#. (itstool) path: defs/text +#. Keep it short: 8em is ok, 9em is max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Lawyer" +msgstr "Hüquqşünas" + +#. (itstool) path: defs/text +#. Keep it short: 8em is ok, 9em is max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Sysadmin" +msgstr "Sistemadmini" + +#. (itstool) path: defs/text +#. Keep it short: 8em is ok, 9em is max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Police" +msgstr "Polis" + +#. (itstool) path: defs/text +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "NSA" +msgstr "NSA" + +#. (itstool) path: defs/text +#. Keep it short: 8em is ok, 9em is max. +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Tor relay" +msgstr "Tor keçidi" + +#. (itstool) path: defs/text +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Key" +msgstr "Açar" + +#. (itstool) path: defs/text +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Internet connection" +msgstr "İnternet əlaqəsi" + +#. (itstool) path: defs/text +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Eavesdropping" +msgstr "Dinlənmə" + +#. (itstool) path: defs/text +#: C/tor-and-https.svg:363 +#, no-wrap +msgid "Data sharing" +msgstr "Məlumat bölüşməsi"

1 0