richard pushed to branch tor-browser-115.9.0esr-13.0-1 at The Tor Project / Applications / Tor Browser

Commits: d2b1c1d1 by Eitan Isaacson at 2024-03-11T16:32:34+01:00 Bug 1819160 - Map Android ids to doc/accessible id pairs. r=Jamie

Differential Revision: https://phabricator.services.mozilla.com/D179737 - - - - - 23fcc363 by Pier Angelo Vendrame at 2024-03-11T16:32:35+01:00 Bug 1832523 - Allow using NSS to sign and verify MAR signatures. r=application-update-reviewers,glandium,bytesized

Allow using NSS for checking MAR signatures also in platforms where OS-native APIs are used by default, i.e., macOS and Windows.

Differential Revision: https://phabricator.services.mozilla.com/D177743 - - - - - b20022a4 by Pier Angelo Vendrame at 2024-03-11T16:32:35+01:00 Bug 1849129: Prevent exceptions caused by extensions from interrupting the SearchService initialization. r=search-reviewers,Standard8

Differential Revision: https://phabricator.services.mozilla.com/D186456 - - - - - 4839f003 by Emilio Cobos Álvarez at 2024-03-11T16:32:35+01:00 Bug 1853731 - Use html:img for message-bar-icon. r=Gijs,dao,settings-reviewers,desktop-theme-reviewers,sfoster

Differential Revision: https://phabricator.services.mozilla.com/D188521 - - - - - c9e1e91f by Pier Angelo Vendrame at 2024-03-11T16:32:35+01:00 Bug 1854117 - Sort the DLL blocklist flags. r=mossop,win-reviewers,gstoll

Differential Revision: https://phabricator.services.mozilla.com/D188716 - - - - - 6122f0fe by Eden Chuang at 2024-03-11T16:32:35+01:00 Bug 1738426 - Ignoring status 206 and vary header checking for opaque response in Cache API. r=asuth

Differential Revision: https://phabricator.services.mozilla.com/D186431 - - - - - 6aab5479 by edgul at 2024-03-11T16:32:36+01:00 Bug 1802057 - Block the following characters from use in the cookie name in the cookie string: 0x3B (semi-colon), 0x3D (equals), and 0x7F (del) r=dveditz,cookie-reviewers

Differential Revision: https://phabricator.services.mozilla.com/D182373

- - - - - 4711e146 by Kelsey Gilbert at 2024-03-11T16:32:36+01:00 Bug 1819497 - Don't race on static bool for initialization. r=gfx-reviewers,aosmond

We could do non-racy static init here (e.g. with a static initializer self-calling-closure), but there doesn't seem to be a strong reason for this. Let's just use a switch and get robustness from -Werror=switch.

Differential Revision: https://phabricator.services.mozilla.com/D188054 - - - - - 7760af1d by Mark Banner at 2024-03-11T16:32:36+01:00 Bug 1845752. r=ckerschb

Differential Revision: https://phabricator.services.mozilla.com/D186676 - - - - - 0d354ba5 by Bob Owen at 2024-03-11T16:32:36+01:00 Bug 1850072: Initialize RecordedDrawTargetCreation::mHasExistingData. r=jrmuizel

This also specializes ElementStreamFormat for bool.

Differential Revision: https://phabricator.services.mozilla.com/D187794 - - - - - 84f61d81 by Malte Juergens at 2024-03-11T16:32:36+01:00 Bug 1850200 - Add delay to HTTPS-Only "Continue to HTTPS Site" button r=freddyb

Differential Revision: https://phabricator.services.mozilla.com/D187887 - - - - - fe596fa1 by Andreas Pehrson at 2024-03-11T16:32:37+01:00 Bug 1851803 - Introduce SourceMediaTrack::mDirectDisabledMode. r=karlt

Similar to MediaTrack::mDisabledMode, but this is for uses on the SourceMediaTrack producer thread. It is still signaled via a control message from the control thread to maintain order of operations, and is protected by the SourceMediaTrack mutex.

Differential Revision: https://phabricator.services.mozilla.com/D187554 - - - - - 8906e65f by Pier Angelo Vendrame at 2024-03-11T16:32:37+01:00 Bug 1860020 - Remove the assertion on the value of toolkit.telemetry.enabled. r=KrisWright,chutten

Bug 1444275 introduced an assertion on the parent process to check that the value of toolkit.telemetry.enabled is the expected one. However, this expected value could be different from the one set and locked e.g. in some forks. Therefore, the assertion prevented debug builds from working in these cases.

Differential Revision: https://phabricator.services.mozilla.com/D195080 - - - - - 4f55001d by Kagami Sascha Rosylight at 2024-03-11T16:32:37+01:00 Bug 1865238 - Use One UI Sans KR VF for Korean sans-serif font on Android r=jfkthame

Per /etc/fonts.xml, there are now only two `<family lang="ko">` nodes there:

* OneUISansKRVF series * SECCJK series (but no KR postfix anymore?)

This patch uses One UI Sans KR VF as the replacement as this is newer and is a variable font (tested with https://codepen.io/SaschaNaz/pen/ExrdYXJ)

Differential Revision: https://phabricator.services.mozilla.com/D195078 - - - - - 1648f425 by Pier Angelo Vendrame at 2024-03-11T16:32:49+01:00 Bug 1875306 - Localize numbers in the underflow and overflow error messages. r=emilio

Differential Revision: https://phabricator.services.mozilla.com/D198965 - - - - - 142c7b81 by Pier Angelo Vendrame at 2024-03-11T16:32:49+01:00 Bug 1875313 - Use en-US as a fallback when spoof English is enabled in ICUUtils. r=timhuang,tjr

Differential Revision: https://phabricator.services.mozilla.com/D198967

- - - - - 53ce727f by Pier Angelo Vendrame at 2024-03-12T11:26:14+01:00 Bug 1880988 - Apply spoof English to the default detail summary. r=emilio

Differential Revision: https://phabricator.services.mozilla.com/D202203 - - - - - 47109659 by Henry Wilkes at 2024-03-12T11:26:14+01:00 Bug 41454: Move focus after calling openPreferences for a sub-category.

Temporary fix until mozilla bug 1799153 gets a patch upstream.

- - - - - 4edc0d8e by hackademix at 2024-03-12T11:26:15+01:00 Bug 42194: Fix blank net error page on failed DNS resolution with active proxy.

- - - - - ef724c19 by Henry Wilkes at 2024-03-12T11:26:15+01:00 Bug 41483: Remove the firefox override for appstrings.properties

Remove this patch after upstream bugzilla bug 1790187

- - - - - c0e7b3f3 by Pier Angelo Vendrame at 2024-03-12T11:26:15+01:00 Bug 41116: Normalize system fonts.

System fonts are an enormous fingerprinting vector. Even with font allow lists and with our custom configuration on Linux, which counter metrics measurements, getComputedStyle leaks several details. This patch counters both these kinds of attacks.

- - - - - f4013f95 by Marco Simonelli at 2024-03-12T11:26:15+01:00 Bug 41459: WebRTC fails to build under mingw (Part 1)

- properly define NOMINMAX for just MSVC builds

- - - - - 25f21096 by Marco Simonelli at 2024-03-12T11:26:16+01:00 Bug 41459: WebRTC fails to build under mingw (Part 2)

- fixes required to build third_party/libwebrtc

- - - - - f969a9b9 by Marco Simonelli at 2024-03-12T11:26:16+01:00 Bug 41459: WebRTC fails to build under mingw (Part 3)

- fixes required to build third_party/sipcc

- - - - - 73337325 by Marco Simonelli at 2024-03-12T11:26:16+01:00 Bug 41459: WebRTC fails to build under mingw (Part 4)

- fixes requried to build netwerk/sctp

- - - - - 409c716a by Marco Simonelli at 2024-03-12T11:26:16+01:00 Bug 41459: WebRTC fails to build under mingw (Part 5)

- fixes required to build dom/media/webrtc

- - - - - 5676971c by Marco Simonelli at 2024-03-12T11:26:16+01:00 Bug 41459: WebRTC fails to build under mingw (Part 6)

- fixes required to build dom/media/systemservices

- - - - - ac7a471f by hackademix at 2024-03-12T11:26:17+01:00 Bug 41854: Allow overriding download spam protection.

- - - - - 6fda2f19 by Gaba at 2024-03-12T11:26:17+01:00 Adding issue and merge request templates

- - - - - af7d8731 by Pier Angelo Vendrame at 2024-03-12T11:26:17+01:00 Base Browser's .mozconfigs.

Bug 17858: Cannot create incremental MARs for hardened builds. Define HOST_CFLAGS, etc. to avoid compiling programs such as mbsdiff (which is part of mar-tools and is not distributed to end-users) with ASan.

Bug 21849: Don't allow SSL key logging.

Bug 25741 - TBA: Disable features at compile-time

Define MOZ_ANDROID_NETWORK_STATE and MOZ_ANDROID_LOCATION

Bug 27623 - Export MOZILLA_OFFICIAL during desktop builds

This fixes a problem where some preferences had the wrong default value. Also see bug 27472 where we made a similar fix for Android.

Bug 29859: Disable HLS support for now

Bug 30463: Explicitly disable MOZ_TELEMETRY_REPORTING

Bug 32493: Disable MOZ_SERVICES_HEALTHREPORT

Bug 33734: Set MOZ_NORMANDY to False

Bug 33851: Omit Parental Controls.

Bug 40252: Add --enable-rust-simd to our tor-browser mozconfig files

Bug 41584: Move some configuration options to base-browser level

- - - - - 95102012 by Pier Angelo Vendrame at 2024-03-12T11:26:17+01:00 Tweaks to the build system

Bug 40857: Modified the fat .aar creation file

This is a workaround to build fat .aars with the compiling enviornment disabled. Mozilla does not use a similar configuration, but either runs a Firefox build and discards its output, or uses artifacts build.

We might switch to artifact builds too, and drop this patch, or write a better one to upstream. But until then we need this patch.

See also https://bugzilla.mozilla.org/show_bug.cgi?id=1763770.

Bug 41458: Prevent `mach package-multi-locale` from actually creating a package

macOS builds need some files to be moved around with ./mach package-multi-locale to create multi-locale packages. The required command isn't exposed through any other mach command. So, we patch package-multi-locale both to prevent it from failing when doing official builds and to detect any future changes on it.

- - - - - 440ff555 by Pier Angelo Vendrame at 2024-03-12T11:26:18+01:00 Bug 41108: Remove privileged macOS installation from 102

- - - - - d6b07750 by Dan Ballard at 2024-03-12T11:26:18+01:00 Bug 41149: Re-enable DLL injection protection in all builds not just nightlies

- - - - - 8bf1c9b8 by Matthew Finkel at 2024-03-12T11:26:18+01:00 Bug 24796: Comment out excess permissions from GeckoView

The GeckoView AndroidManifest.xml is not preprocessed unlike Fennec's manifest, so we can't use the ifdef preprocessor guards around the permissions we do not want. Commenting the permissions is the next-best-thing.

- - - - - 8ee6abbb by Matthew Finkel at 2024-03-12T11:26:18+01:00 Bug 28125: Prevent non-Necko network connections

- - - - - 3bb4dfec by Mike Perry at 2024-03-12T11:26:19+01:00 Bug 12974: Disable NTLM and Negotiate HTTP Auth

The Mozilla bugs: https://bugzilla.mozilla.org/show_bug.cgi?id=1046421, https://bugzilla.mozilla.org/show_bug.cgi?id=1261591, tor-browser#27602

- - - - - ff44a22f by Alex Catarineu at 2024-03-12T11:26:19+01:00 Bug 40166: Disable security.certerrors.mitm.auto_enable_enterprise_roots

Bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1768899

- - - - - 8e253876 by Georg Koppen at 2024-03-12T11:26:19+01:00 Bug 16285: Exclude ClearKey system for now

In the past the ClearKey system had not been compiled when specifying --disable-eme. But that changed and it is even bundled nowadays (see: Mozilla's bug 1300654). We don't want to ship it right now as the use case for it is not really visible while the code had security vulnerabilities in the past.

- - - - - 02e18ebb by Kathy Brade at 2024-03-12T11:26:19+01:00 Bug 21431: Clean-up system extensions shipped in Firefox

Only ship the pdfjs extension.

- - - - - ee5000fb by Kathy Brade at 2024-03-12T11:26:19+01:00 Bug 33852: Clean up about:logins (LockWise) to avoid mentioning sync, etc.

Hide elements on about:logins that mention sync, "Firefox LockWise", and Mozilla's LockWise mobile apps.

Disable the "Create New Login" button when security.nocertdb is true.

- - - - - 19283061 by Alex Catarineu at 2024-03-12T11:26:20+01:00 Bug 41457: Remove Mozilla permissions

Bug 40025: Remove Mozilla add-on install permissions

- - - - - e0dd1dbf by Kathy Brade at 2024-03-12T11:26:20+01:00 Bug 40002: Remove about:ion

Firefox Ion (previously Firefox Pioneer) is an opt-in program in which people volunteer to participate in studies that collect detailed, sensitive data about how they use their browser.

Bug 41662: Disable about:sync-logs

Even though we disable sync by default with `identity.fxaccounts.enabled`, this about: page is still avilable. We could throw an exception on the constructor of the related component, but it would result only in an error in the console, without a visible "this address does not look right" error page. If we fix the issues with MOZ_SERVICES_SYNC, we can restore the component.

- - - - - 520c4066 by Arthur Edelstein at 2024-03-12T11:26:20+01:00 Bug 26353: Prevent speculative connect that violated FPI.

Connections were observed in the catch-all circuit when the user entered an https or http URL in the URL bar, or typed a search term.

- - - - - 783cff8a by Alex Catarineu at 2024-03-12T11:26:20+01:00 Bug 31740: Remove some unnecessary RemoteSettings instances

More concretely, SearchService.jsm 'hijack-blocklists' and url-classifier-skip-urls.

Avoid creating instance for 'anti-tracking-url-decoration'.

If prefs are disabling their usage, avoid creating instances for 'cert-revocations' and 'intermediates'.

Do not ship JSON dumps for collections we do not expect to need. For the ones in the 'main' bucket, this prevents them from being synced unnecessarily (the code in remote-settings does so for collections in the main bucket for which a dump or local data exists). For the collections in the other buckets, we just save some size by not shipping their dumps.

We also clear the collections database on the v2 -> v3 migration.

- - - - - 2094f659 by cypherpunks1 at 2024-03-12T11:26:21+01:00 Bug 41092: Add a RemoteSettings JSON dump for query-stripping

- - - - - 13c641a3 by Pier Angelo Vendrame at 2024-03-12T11:26:21+01:00 Bug 41635: Disable the Normandy component

Do not include Normandy at all whenever MOZ_NORMANDY is False.

- - - - - e0cd9a84 by Georg Koppen at 2024-03-12T11:26:21+01:00 Bug 30541: Disable WebGL readPixel() for web content

Related Bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1428034

- - - - - 352e5e70 by Alex Catarineu at 2024-03-12T11:26:21+01:00 Bug 28369: Stop shipping pingsender executable

- - - - - 033e11cf by cypherpunks1 at 2024-03-12T11:26:22+01:00 Bug 41568: Disable LaterRun

- - - - - 85bf008f by cypherpunks1 at 2024-03-12T11:26:22+01:00 Bug 40717: Hide Windows SSO in settings

- - - - - 9fcfcc09 by Pier Angelo Vendrame at 2024-03-12T11:26:22+01:00 Bug 41599: Always return an empty string as network ID

Firefox computes an internal network ID used to detect network changes and act consequently (e.g., to improve WebSocket UX). However, there are a few ways to get this internal network ID, so we patch them out, to be sure any new code will not be able to use them and possibly link users.

We also sent a patch to Mozilla to seed the internal network ID, to prevent any accidental leak in the future. Upstream: https://bugzilla.mozilla.org/show_bug.cgi?id=1817756

- - - - - 6e572d36 by cypherpunks1 at 2024-03-12T11:26:22+01:00 Bug 40175: Add origin attributes to about:reader top-level requests

- - - - - 73e2f014 by Richard Pospesel at 2024-03-12T11:26:22+01:00 Bug 41327: Disable UrlbarProviderInterventions

- - - - - 9aae5f9d by Richard Pospesel at 2024-03-12T11:26:23+01:00 Bug 42037: Disable about:firefoxview page

- - - - - f09939b8 by Mike Perry at 2024-03-12T11:26:23+01:00 Firefox preference overrides.

This hack directly includes our preference changes in omni.ja.

Bug 18292: Staged updates fail on Windows

Temporarily disable staged updates on Windows.

Bug 18297: Use separate Noto JP,KR,SC,TC fonts

Bug 23404: Add Noto Sans Buginese to the macOS whitelist

Bug 23745: Set dom.indexedDB.enabled = true

Bug 13575: Disable randomised Firefox HTTP cache decay user tests. (Fernando Fernandez Mancera <ffmancera@riseup.net>)

Bug 17252: Enable session identifiers with FPI

Session tickets and session identifiers were isolated by OriginAttributes, so we can re-enable them by allowing the default value (true) of "security.ssl.disable_session_identifiers".

The pref "security.enable_tls_session_tickets" is obsolete (removed in https://bugzilla.mozilla.org/917049)

Bug 14952: Enable http/2 and AltSvc

In Firefox, SPDY/HTTP2 now uses Origin Attributes for isolation of connections, push streams, origin frames, etc. That means we get first-party isolation provided "privacy.firstparty.isolate" is true. So in this patch, we stop overriding "network.http.spdy.enabled" and "network.http.spdy.enabled.http2".

Alternate Services also use Origin Attributes for isolation. So we stop overriding "network.http.altsvc.enabled" and "network.http.altsvc.oe" as well.

(All 4 of the abovementioned "network.http.*" prefs adopt Firefox 60ESR's default value of true.)

However, we want to disable HTTP/2 push for now, so we set "network.http.spdy.allow-push" to false.

"network.http.spdy.enabled.http2draft" was removed in Bug 1132357. "network.http.sped.enabled.v2" was removed in Bug 912550. "network.http.sped.enabled.v3" was removed in Bug 1097944. "network.http.sped.enabled.v3-1" was removed in Bug 1248197.

Bug 26114: addons.mozilla.org is not special * Don't expose navigator.mozAddonManager on any site * Don't block NoScript from modifying addons.mozilla.org or other sites

Enable ReaderView mode again (#27281).

Bug 29916: Make sure enterprise policies are disabled

Bug 2874: Block Components.interfaces from content

Bug 26146: Spoof HTTP User-Agent header for desktop platforms

In Tor Browser 8.0, the OS was revealed in both the HTTP User-Agent header and to JavaScript code via navigator.userAgent. To avoid leaking the OS inside each HTTP request (which many web servers log), always use the Windows 7 OS value in the desktop User-Agent header. We continue to allow access to the actual OS via JavaScript, since doing so improves compatibility with web applications such as GitHub and Google Docs.

Bug 12885: Windows Jump Lists fail for Tor Browser

Jumplist entries are stored in a binary file in: %APPDATA%\Microsoft\Windows\Recent\CustomDestinations\ and has a name in the form [a-f0-9]+.customDestinations-ms

The hex at the front is unique per app, and is ultimately derived from something called the 'App User Model ID' (AUMID) via some unknown hashing method. The AUMID is provided as a key when programmatically creating, updating, and deleting a jumplist. The default behaviour in firefox is for the installer to define an AUMID for an app, and save it in the registry so that the jumplist data can be removed by the uninstaller.

However, the Tor Browser does not set this (or any other) regkey during installation, so this codepath fails and the app's AUMID is left undefined. As a result the app's AUMID ends up being defined by windows, but unknowable by Tor Browser. This unknown AUMID is used to create and modify the jumplist, but the delete API requires that we provide the app's AUMID explicitly. Since we don't know what the AUMID is (since the expected regkey where it is normally stored does not exist) jumplist deletion will fail and we will leave behind a mostly empty customDestinations-ms file. The name of the file is derived from the binary path, so an enterprising person could reverse engineer how that hex name is calculated, and generate the name for Tor Browser's default Desktop installation path to determine whether a person had used Tor Browser in the past.

The 'taskbar.grouping.useprofile' option that is enabled by this patch works around this AUMID problem by having firefox.exe create it's own AUMID based on the profile path (rather than looking for a regkey). This way, if a user goes in and enables and disables jumplist entries, the backing store is properly deleted.

Unfortunately, all windows users currently have this file lurking in the above mentioned directory and this patch will not remove it since it was created with an unknown AUMID. However, another patch could be written which goes to that directory and deletes any item containing the 'Tor Browser' string. See bug 28996.

Bug 30845: Make sure default themes and other internal extensions are enabled

Bug 28896: Enable extensions in private browsing by default

Bug 31065: Explicitly allow proxying localhost

Bug 31598: Enable letterboxing

Disable Presentation API everywhere

Bug 21549 - Use Firefox's WASM default pref. It is disabled at safer security levels.

Bug 32321: Disable Mozilla's MitM pings

Bug 19890: Disable installation of system addons

By setting the URL to "" we make sure that already installed system addons get deleted as well.

Bug 22548: Firefox downgrades VP9 videos to VP8.

On systems where H.264 is not available or no HWA, VP9 is preferred. But in Tor Browser 7.0 all youtube videos are degraded to VP8.

This behaviour can be turned off by setting media.benchmark.vp9.threshold to 0. All clients will get better experience and lower traffic, beause TBB doesn't use "Use hardware acceleration when available".

Bug 25741 - TBA: Add mobile-override of 000-tor-browser prefs

Bug 16441: Suppress "Reset Tor Browser" prompt.

Bug 29120: Use the in-memory media cache and increase its maximum size.

Bug 33697: use old search config based on list.json

Bug 33855: Ensure that site-specific browser mode is disabled.

Bug 30682: Disable Intermediate CA Preloading.

Bug 40061: Omit the Windows default browser agent from the build

Bug 40322: Consider disabling network.connectivity-service.enabled

Bug 40408: Disallow SVG Context Paint in all web content

Bug 40308: Disable network partitioning until we evaluate dFPI

Bug 40322: Consider disabling network.connectivity-service.enabled

Bug 40383: Disable dom.enable_event_timing

Bug 40423: Disable http/3

Bug 40177: Update prefs for Fx91esr

Bug 40700: Disable addons and features recommendations

Bug 40682: Disable network.proxy.allow_bypass

Bug 40736: Disable third-party cookies in PBM

Bug 19850: Enabled HTTPS-Only by default

Bug 40912: Hide the screenshot menu

Bug 41292: Disable moreFromMozilla in preferences page

Bug 40057: Ensure the CSS4 system colors are not a fingerprinting vector

Bug 24686: Set network.http.tailing.enabled to true

Bug 40183: Disable TLS ciphersuites using SHA-1

Bug 40783: Review 000-tor-browser.js and 001-base-profile.js for 102

We reviewed all the preferences we set for 102, and remove a few old ones. See the description of that issue to see all the preferences we believed were still valid for 102, and some brief description for the reasons to keep them.

- - - - - 24ea6b5f by Pier Angelo Vendrame at 2024-03-12T11:26:23+01:00 fixup! Firefox preference overrides.

Bug 42377: Hidden fonts should obey the allow list.

Remove .Helvetica Neue DeskInterface from the allow list. This font might not be actually available, and in any case fonts starting with period will not be displayed by the browser.

- - - - - f553ca79 by Richard Pospesel at 2024-03-12T11:26:23+01:00 Bug 41659: Add canonical color definitions to base-browser

- - - - - 8137c0ce by Pier Angelo Vendrame at 2024-03-12T11:26:24+01:00 Bug 41043: Hardcode the UI font on Linux

The mechanism to choose the UI font does not play well with our fontconfig configuration. As a result, the final criterion to choose the font for the UI was its version.

Since we hardcode Arimo as a default sans-serif on preferences, we use it also for the UI. FontConfig will fall back to some other font for scripts Arimo does not cover as expected (we tested with Japanese).

- - - - - 639c01bb by Pier Angelo Vendrame at 2024-03-12T11:26:24+01:00 Bug 42377: Hidden fonts should obey the allow list.

Hidden font families were automatically added to the `font.system.whitelist`, which is a behavior that conflicts with our font picking.

- - - - - 2a5f31b2 by Alex Catarineu at 2024-03-12T11:26:24+01:00 Bug 30605: Honor privacy.spoof_english in Android

This checks `privacy.spoof_english` whenever `setLocales` is called from Fenix side and sets `intl.accept_languages` accordingly.

Bug 40198: Expose privacy.spoof_english pref in GeckoView

- - - - - fc3e6ce6 by Alex Catarineu at 2024-03-12T11:26:24+01:00 Bug 40199: Avoid using system locale for intl.accept_languages in GeckoView

- - - - - 71d3ac30 by Alex Catarineu at 2024-03-12T11:26:24+01:00 Bug 40171: Make WebRequest and GeckoWebExecutor First-Party aware

- - - - - a897940a by Alex Catarineu at 2024-03-12T11:26:25+01:00 Bug 26345: Hide tracking protection UI

- - - - - 55e89034 by Pier Angelo Vendrame at 2024-03-12T11:26:25+01:00 Bug 9173: Change the default Firefox profile directory to be relative.

This commit makes Firefox look for the default profile directory in a directory relative to the binary path. The directory can be specified through the --with-relative-data-dir. This is relative to the same directory as the firefox main binary for Linux and Windows.

On macOS, we remove Contents/MacOS from it. Or, in other words, the directory is relative to the application bundle.

This behavior can be overriden at runtime, by placing a file called system-install adjacent to the firefox main binary (also on macOS).

- - - - - 18188a85 by Alex Catarineu at 2024-03-12T11:26:25+01:00 Bug 27604: Fix addon issues when moving the profile directory

Bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1429838

- - - - - 8f9d8c11 by Mike Perry at 2024-03-12T11:26:25+01:00 Bug 13028: Prevent potential proxy bypass cases.

It looks like these cases should only be invoked in the NSS command line tools, and not the browser, but I decided to patch them anyway because there literally is a maze of network function pointers being passed around, and it's very hard to tell if some random code might not pass in the proper proxied versions of the networking code here by accident.

Bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1433509

- - - - - f2aaad4d by Igor Oliveira at 2024-03-12T11:26:26+01:00 Bug 23104: Add a default line height compensation

Many fonts have issues with their vertical metrics. they are used to influence the height of ascenders and depth of descenders. Gecko uses it to calculate the line height (font height + ascender + descender), however because of that idiosyncratic behavior across multiple operating systems, it can be used to identify the user's OS.

The solution proposed in the patch uses a default factor to be multiplied with the font size, simulating the concept of ascender and descender. This way all operating systems will have the same line height.

- - - - - 0e2928ff by Pier Angelo Vendrame at 2024-03-12T11:26:26+01:00 Bug 40309: Avoid using regional OS locales

Avoid regional OS locales if the pref `intl.regional_prefs.use_os_locales` is false but RFP is enabled.

- - - - - ff37e601 by Matthew Finkel at 2024-03-12T11:26:26+01:00 Bug 40432: Prevent probing installed applications

Bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1711084

- - - - - fc282704 by cypherpunks1 at 2024-03-12T11:26:26+01:00 Bug 33955: When copying an image only copy the image contents to the clipboard

- - - - - f418dd54 by cypherpunks1 at 2024-03-12T11:26:27+01:00 Bug 41791: Omit the source URL when copying page contents to the clipboard

- - - - - 5f3ce2b2 by hackademix at 2024-03-12T11:26:27+01:00 Bug 42288: Allow language spoofing in status messages.

- - - - - 6d8372c4 by Pier Angelo Vendrame at 2024-03-12T11:26:27+01:00 Base Browser strings

This commit adds all the strings needed by following Base Browser patches.

- - - - - be0bf9fb by hackademix at 2024-03-12T11:26:27+01:00 Bug 41434: Letterboxing, preemptively apply margins in a global CSS rule to mitigate race conditions on newly created windows and tabs.

- - - - - 8dfafdd5 by hackademix at 2024-03-12T11:26:28+01:00 Bug 41434: Letterboxing, improve logging.

- - - - - 1550a4d1 by hackademix at 2024-03-12T11:26:28+01:00 Bug 31064: Letterboxing, exempt browser extensions.

- - - - - ddffa421 by hackademix at 2024-03-12T11:26:28+01:00 Bug 32411: Letterboxing, exempt view-source: URIs.

- - - - - 7267fc06 by hackademix at 2024-03-12T11:26:28+01:00 Bug 32308: use direct browser sizing for letterboxing. Bug 30556: align letterboxing with 200x100 new win width stepping

- - - - - f041fca0 by hackademix at 2024-03-12T11:26:29+01:00 Bug 41631: Prevent weird initial window dimensions caused by subpixel computations

- - - - - 74ea9ebd by Pier Angelo Vendrame at 2024-03-12T11:26:29+01:00 Bug 41369: Improve Firefox language settings for multi-lingual packages

Change the language selector to be sorted by language code, rather than name, and to display the language code to the user.

Bug 41372: Handle Japanese as a special case in preferences on macOS

Japanese is treated in a special way on macOS. However, seeing the Japanese language tag could be confusing for users, and moreover the language name is not localized correctly like other langs.

Bug 41378: Tell users that they can change their language at the first start

With multi-lingual builds, Tor Browser matches the user's system language, but some users might want to change it. So, we tell them that it is possible, but only once.

- - - - - 2fb4f4d6 by p13dz at 2024-03-12T11:26:29+01:00 Bug 40283: Workaround for the file upload bug

- - - - - 2b5c1c03 by Arthur Edelstein at 2024-03-12T11:26:29+01:00 Bug 18905: Hide unwanted items from help menu

Bug 25660: Remove the "New Private Window" option

- - - - - a1b2316b by cypherpunks1 at 2024-03-12T11:26:30+01:00 Bug 41740: Change the RFP value of devicePixelRatio to 2

- - - - - a456bca9 by Pier Angelo Vendrame at 2024-03-12T11:26:30+01:00 Bug 41739: Remove "Website appearance" from about:preferences.

It is ignored because of RFP and it is confusing for users.

- - - - - fbfd0877 by cypherpunks1 at 2024-03-12T11:26:30+01:00 Bug 41881: Don't persist custom network requests on private windows

- - - - - 6174d8b0 by hackademix at 2024-03-12T11:26:30+01:00 Bug 42019: Empty browser's clipboard on browser shutdown

- - - - - a884c557 by hackademix at 2024-03-12T11:26:30+01:00 Bug 42084: Ensure English spoofing works even if preferences are set out of order.

- - - - - ba8d2573 by Pier Angelo Vendrame at 2024-03-12T11:26:31+01:00 Bug 41603: Customize the creation of MOZ_SOURCE_URL

MOZ_SOURCE_URL is created by combining MOZ_SOURCE_REPO and MOZ_SOURCE_CHANGESET. But the code takes for granted that it refers to a Hg instance, so it combines them as `$MOZ_SOURCE_REPO/rev/$MOZ_SOURCE_CHANGESET`. With this commit, we change this logic to combine them to create a URL that is valid for GitLab. $MOZ_SOURCE_CHANGESET needs to be a commit hash, not a branch or a tag. If that is needed, we could use /-/tree/, instead of /-/commit/.

- - - - - c20cb23f by Henry Wilkes at 2024-03-12T11:26:31+01:00 Bug 31575: Disable Firefox Home (Activity Stream)

Treat about:blank as the default home page and new tab page.

Avoid loading AboutNewTab in BrowserGlue.sys.mjs in order to avoid several network requests that we do not need.

Bug 41624: Disable about:pocket-* pages.

Bug 40144: Redirect about:privatebrowsing to the user's home

- - - - - e941b629 by Kathy Brade at 2024-03-12T11:26:31+01:00 Bug 4234: Use the Firefox Update Process for Base Browser.

Windows: disable "runas" code path in updater (15201). Windows: avoid writing to the registry (16236). Also includes fixes for tickets 13047, 13301, 13356, 13594, 15406, 16014, 16909, 24476, and 25909.

Also fix bug 27221: purge the startup cache if the Base Browser version changed (even if the Firefox version and build ID did not change), e.g., after a minor Base Browser update.

Also fix 32616: Disable GetSecureOutputDirectoryPath() functionality.

Bug 26048: potentially confusing "restart to update" message

Within the update doorhanger, remove the misleading message that mentions that windows will be restored after an update is applied, and replace the "Restart and Restore" button label with an existing "Restart to update Tor Browser" string.

Bug 28885: notify users that update is downloading

Add a "Downloading Base Browser update" item which appears in the hamburger (app) menu while the update service is downloading a MAR file. Before this change, the browser did not indicate to the user that an update was in progress, which is especially confusing in Tor Browser because downloads often take some time. If the user clicks on the new menu item, the about dialog is opened to allow the user to see download progress.

As part of this fix, the update service was changed to always show update-related messages in the hamburger menu, even if the update was started in the foreground via the about dialog or via the "Check for Tor Browser Update" toolbar menu item. This change is consistent with the Tor Browser goal of making sure users are informed about the update process.

Removed #28885 parts of this patch which have been uplifted to Firefox.

- - - - - 7349e42b by Pier Angelo Vendrame at 2024-03-12T11:26:31+01:00 Bug 42061: Create an alpha update channel.

- - - - - 883f8f03 by Nicolas Vigier at 2024-03-12T11:26:32+01:00 Bug 41682: Add base-browser nightly mar signing key

- - - - - d7a5bb37 by hackademix at 2024-03-12T11:26:32+01:00 Bug 41695: Warn on window maximization without letterboxing in RFPHelper module

- - - - - 9fe09168 by Pier Angelo Vendrame at 2024-03-12T11:26:32+01:00 Bug 41698: Reword the recommendation badges in about:addons

Firefox strings use { -brand-product-name }. As a result, it seems that the fork is recommending extensions, whereas AMO curators are doing that. So, we replace the strings with custom ones that clarify that Mozilla is recommending them.

We assign the strings with JS because our translation backend does not support Fluent attributes, yet, but once it does, we should switch to them, instead.

Upstream bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1825033

- - - - - 29cc4be2 by Alex Catarineu at 2024-03-12T11:26:32+01:00 Bug 40069: Add helpers for message passing with extensions

- - - - - b0c53488 by Matthew Finkel at 2024-03-12T11:26:33+01:00 Bug 41598: Prevent NoScript from being removed/disabled.

Bug 40253: Explicitly allow NoScript in Private Browsing mode.

- - - - - 302a30ab by Henry Wilkes at 2024-03-12T11:26:33+01:00 Bug 41736: Hide NoScript extension's toolbar button by default.

This hides it from both the toolbar and the unified extensions panel.

We also hide the unified-extension-button if the panel would be empty: not including the NoScript button when it is hidden. As a result, this will be hidden by default until a user installs another extension (or shows the NoScript button and unpins it).

- - - - - 5fa4d5bf by hackademix at 2024-03-12T11:26:33+01:00 Bug 41834: Hide "Can't Be Removed - learn more" menu line for uninstallable add-ons

- - - - - e3fd50da by Pier Angelo Vendrame at 2024-03-12T11:26:33+01:00 Bug 40925: Implemented the Security Level component

This component adds a new Security Level toolbar button which visually indicates the current global security level via icon (as defined by the extensions.torbutton.security_slider pref), a drop-down hanger with a short description of the current security level, and a new section in the about:preferences#privacy page where users can change their current security level. In addition, the hanger and the preferences page will show a visual warning when the user has modified prefs associated with the security level and provide a one-click 'Restore Defaults' button to get the user back on recommended settings.

Bug 40125: Expose Security Level pref in GeckoView

- - - - - 4c1b31f7 by Pier Angelo Vendrame at 2024-03-12T11:26:34+01:00 Bug 40926: Implemented the New Identity feature

- - - - - 79fc8661 by Henry Wilkes at 2024-03-12T11:26:34+01:00 Bug 41736: Customize toolbar for base-browser.

- - - - - 594d534b by Pier Angelo Vendrame at 2024-03-12T11:26:34+01:00 Bug 42027: Base Browser migration procedures.

This commit implmenents the the Base Browser's version of _migrateUI.

- - - - - 9ee00d08 by Richard Pospesel at 2024-03-12T11:26:34+01:00 Bug 41649: Create rebase and security backport gitlab issue templates

- - - - - 38464c44 by Richard Pospesel at 2024-03-12T11:26:34+01:00 Bug 41089: Add tor-browser build scripts + Makefile to tor-browser

- - - - - 76813d64 by Henry Wilkes at 2024-03-12T11:26:35+01:00 Bug 41803: Add some developer tools for working on tor-browser.

- - - - - 4f7c73b9 by Kathy Brade at 2024-03-12T11:26:35+01:00 Bug 11641: Disable remoting by default.

Unless the -osint command line flag is used, the browser now defaults to the equivalent of -no-remote. There is a new -allow-remote flag that may be used to restore the original (Firefox-like) default behavior.

- - - - - 3ad01bdd by Alex Catarineu at 2024-03-12T11:26:35+01:00 Add TorStrings module for localization

- - - - - cc20fd30 by Henry Wilkes at 2024-03-12T11:26:35+01:00 fixup! Add TorStrings module for localization

Bug 42305: Tidy up stable strings, ready for new translation CI.

Cherry-picked from Bug 42221: Remove unused strings now that 13.0 is stable.

Plus removed aboutTor.dtd after Bug 41333.

- - - - - 02f283e3 by Henry Wilkes at 2024-03-12T11:26:36+01:00 Tor Browser strings

This commit adds all the strings needed for Tor Browser patches.

- - - - - 26e5dba3 by Henry Wilkes at 2024-03-12T11:26:36+01:00 Tor Browser localization migration scripts.

- - - - - 2372f05d by Mike Perry at 2024-03-12T11:26:36+01:00 Bug 2176: Rebrand Firefox to TorBrowser

See also Bugs #5194, #7187, #8115, #8219.

This patch does some basic renaming of Firefox to TorBrowser. The rest of the branding is done by images and icons.

Also fix bug 27905.

Bug 25702: Update Tor Browser icon to follow design guidelines

- Updated all of the branding in /browser/branding/official with new 'stable' icon series. - Updated /extensions/onboarding/content/img/tor-watermark.png with new icon and add the source svg in the same directory - Copied /browser/branding/official over /browser/branding/nightly and the new /browser/branding/alpha directories. Replaced content with 'nightly' and 'alpha' icon series. Updated VisualElements_70.png and VisualElements_150.png with updated icons in each branding directory (fixes #22654) - Updated firefox.VisualElementsManfiest.xml with updated colors in each branding directory - Added firefox.svg to each branding directory from which all the other icons are derived (apart from document.icns and document.ico) - Added default256.png and default512.png icons - Updated aboutTBUpdate.css to point to branding-aware icon128.png and removed original icon - Use the Tor Browser icon within devtools/client/themes/images/.

Bug 30631: Blurry Tor Browser icon on macOS app switcher

It would seem the png2icns tool does not generate correct icns files and so on macOS the larger icons were missing resulting in blurry icons in the OS chrome. Regenerated the padded icons in a macOS VM using iconutil.

Bug 28196: preparations for using torbutton tor-browser-brand.ftl

A small change to Fluent FileSource class is required so that we can register a new source without its supported locales being counted as available locales for the browser.

Bug 31803: Replaced about:debugging logo with flat version

Bug 21724: Make Firefox and Tor Browser distinct macOS apps

When macOS opens a document or selects a default browser, it sometimes uses the CFBundleSignature. Changing from the Firefox MOZB signature to a different signature TORB allows macOS to distinguish between Firefox and Tor Browser.

Bug 32092: Fix Tor Browser Support link in preferences

For bug 40562, we moved onionPattern* from bug 27476 to here, as about:tor needs these files but it is included earlier.

Bug 41278: Create Tor Browser styled pdf logo similar to the vanilla Firefox one

Bug 42088: New application icons (used in-app and on linux).

Bug 42087: New application icons (windows).

- - - - - d81ad590 by sanketh at 2024-03-12T11:26:36+01:00 Bug 40209: Implement Basic Crypto Safety

Adds a CryptoSafety actor which detects when you've copied a crypto address from a HTTP webpage and shows a warning.

Closes #40209.

Bug 40428: Fix string attribute names

- - - - - 9664d644 by Mike Perry at 2024-03-12T11:26:37+01:00 TB3: Tor Browser's official .mozconfigs.

Also: Add an --enable-tor-browser-data-outside-app-dir configure option

Add --with-tor-browser-version configure option

Bug 31457: disable per-installation profiles

The dedicated profiles (per-installation) feature does not interact well with our bundled profiles on Linux and Windows, and it also causes multiple profiles to be created on macOS under TorBrowser-Data.

Bug 31935: Disable profile downgrade protection.

Since Tor Browser does not support more than one profile, disable the prompt and associated code that offers to create one when a version downgrade situation is detected.

Add --enable-tor-browser-update build option

Bug 40793: moved Tor configuration options from old-configure.in to moz.configure

Bug 41584: Move some configuration options to base-browser level

- - - - - 2fb33151 by Henry Wilkes at 2024-03-12T11:26:37+01:00 Bug 41340: Enable TOR_BROWSER_NIGHTLY_BUILD features for dev and nightly builds

tor-browser#41285: Enable fluent warnings.

- - - - - a1541e65 by Pier Angelo Vendrame at 2024-03-12T11:26:37+01:00 Bug 40562: Added Tor Browser preferences to 000-tor-browser.js

Before reordering patches, we used to keep the Tor-related patches (torbutton and tor-launcher) at the beginning. After that issue, we decided to move them towards the end.

In addition to that, we have decided to move Tor Browser-only preferences there, too, to make Base Browser-only fixups easier to apply.

- - - - - 760e8f5f by Cecylia Bocovich at 2024-03-12T11:26:37+01:00 fixup! Bug 40562: Added Tor Browser preferences to 000-tor-browser.js

Bug 42435: Update moat domain fronting configuration

- - - - - 1709c788 by Pier Angelo Vendrame at 2024-03-12T11:26:37+01:00 Bug 13252: Customize profile management on macOS

On macOS we allow both portable mode and system installation. However, in the latter case, we customize Firefox's directories to match the hierarchy we use for the portable mode.

Also, display an informative error message if the TorBrowser-Data directory cannot be created due to an "access denied" or a "read only volume" error.

- - - - - f7626825 by Pier Angelo Vendrame at 2024-03-12T11:26:38+01:00 Bug 40933: Add tor-launcher functionality

Bug 41926: Reimplement the control port

- - - - - d768bc46 by Richard Pospesel at 2024-03-12T11:26:38+01:00 Bug 40597: Implement TorSettings module

- migrated in-page settings read/write implementation from about:preferences#tor to the TorSettings module - TorSettings initially loads settings from the tor daemon, and saves them to firefox prefs - TorSettings notifies observers when a setting has changed; currently only QuickStart notification is implemented for parity with previous preference notify logic in about:torconnect and about:preferences#tor - about:preferences#tor, and about:torconnect now read and write settings thorugh the TorSettings module - all tor settings live in the torbrowser.settings.* preference branch - removed unused pref modify permission for about:torconnect content page from AsyncPrefs.jsm

Bug 40645: Migrate Moat APIs to Moat.jsm module

- - - - - b19fb0de by Arthur Edelstein at 2024-03-12T11:26:38+01:00 Bug 3455: Add DomainIsolator, for isolating circuit by domain.

Add an XPCOM component that registers a ProtocolProxyChannelFilter which sets the username/password for each web request according to url bar domain.

Bug 9442: Add New Circuit button

Bug 13766: Set a 10 minute circuit dirty timeout for the catch-all circ.

Bug 19206: Include a 128 bit random tag as part of the domain isolator nonce.

Bug 19206: Clear out the domain isolator state on `New Identity`.

Bug 21201.2: Isolate by firstPartyDomain from OriginAttributes

Bug 21745: Fix handling of catch-all circuit

Bug 41741: Refactor the domain isolator and new circuit

- - - - - aff8a97d by Henry Wilkes at 2024-03-12T11:26:38+01:00 Bug 41600: Add a tor circuit display panel.

- - - - - 25d641cb by hackademix at 2024-03-12T11:26:39+01:00 Bug 8324: Prevent DNS proxy bypasses caused by Drag&Drop

Bug 41613: Skip Drang & Drop filtering for DNS-safe URLs

- - - - - 6853e2f6 by Amogh Pradeep at 2024-03-12T11:26:39+01:00 Orfox: Centralized proxy applied to AbstractCommunicator and BaseResources.

See Bug 1357997 for partial uplift.

Also: Bug 28051 - Use our Orbot for proxying our connections

Bug 31144 - ESR68 Network Code Review

- - - - - 0cb91681 by Matthew Finkel at 2024-03-12T11:26:39+01:00 Bug 25741: TBA: Disable GeckoNetworkManager

The browser should not need information related to the network interface or network state, tor should take care of that.

- - - - - d997b4c4 by Kathy Brade at 2024-03-12T11:26:39+01:00 Bug 14631: Improve profile access error messages.

Instead of always reporting that the profile is locked, display specific messages for "access denied" and "read-only file system".

To allow for localization, get profile-related error strings from Torbutton. Use app display name ("Tor Browser") in profile-related error alerts.

- - - - - 6aa3984d by Pier Angelo Vendrame at 2024-03-12T11:26:39+01:00 Bug 40807: Added QRCode.js to toolkit/modules

- - - - - e199b1ea by Richard Pospesel at 2024-03-12T11:26:40+01:00 Bug 31286: Implementation of bridge, proxy, and firewall settings in about:preferences#connection

This patch adds a new about:preferences#connection page which allows modifying bridge, proxy, and firewall settings from within Tor Browser. All of the functionality present in tor-launcher's Network Configuration panel is present:

- Setting built-in bridges - Requesting bridges from BridgeDB via moat - Using user-provided bridges - Configuring SOCKS4, SOCKS5, and HTTP/HTTPS proxies - Setting firewall ports - Viewing and Copying Tor's logs - The Networking Settings in General preferences has been removed

Bug 40774: Update about:preferences page to match new UI designs

- - - - - 96c8d080 by Richard Pospesel at 2024-03-12T11:26:40+01:00 Bug 27476: Implement about:torconnect captive portal within Tor Browser

- implements new about:torconnect page as tor-launcher replacement - adds new torconnect component to browser - tor process management functionality remains implemented in tor-launcher through the TorProtocolService module - adds warning/error box to about:preferences#tor when not connected to tor

Bug 40773: Update the about:torconnect frontend page to match additional UI flows.

Bug 41608: Add a toolbar status button and a urlbar "Connect" button.

- - - - - 6a68b8de by Henry Wilkes at 2024-03-12T11:26:40+01:00 Bug 7494: Create local home page for TBB.

Bug 41333: Update about:tor to new design. Including: + make the favicon match the branding icon. + make the location bar show a search icon.

- - - - - 55d2e859 by Arthur Edelstein at 2024-03-12T11:26:40+01:00 Bug 12620: TorBrowser regression tests

Regression tests for Bug #2950: Make Permissions Manager memory-only

Regression tests for TB4: Tor Browser's Firefox preference overrides.

Note: many more functional tests could be made here

Regression tests for #2874: Block Components.interfaces from content

Bug 18923: Add a script to run all Tor Browser specific tests

Regression tests for Bug #16441: Suppress "Reset Tor Browser" prompt.

- - - - - 5c776e37 by Pier Angelo Vendrame at 2024-03-12T11:26:41+01:00 Bug 41668: Tweaks to the Base Browser updater for Tor Browser

This commit was once part of "Bug 4234: Use the Firefox Update Process for Tor Browser.". However, some parts of it were not needed for Base Browser and some derivative browsers. Therefore, we extracted from that commit the parts for Tor Browser legacy, and we add them back to the patch set with this commit.

- - - - - 23cf59bb by Kathy Brade at 2024-03-12T11:26:41+01:00 Bug 12647: Support symlinks in the updater.

- - - - - f0e3ebb7 by Kathy Brade at 2024-03-12T11:26:41+01:00 Bug 19121: reinstate the update.xml hash check

This is a partial revert of commit f1241db6986e4b54473a1ed870f7584c75d51122.

Revert most changes from Mozilla Bug 862173 "don't verify mar file hash when using mar signing to verify the mar file (lessens main thread I/O)."

We kept the addition to the AppConstants API in case other JS code references it in the future.

- - - - - 9323d7cd by Kathy Brade at 2024-03-12T11:26:41+01:00 Bug 16940: After update, load local change notes.

Add an about:tbupdate page that displays the first section from TorBrowser/Docs/ChangeLog.txt and includes a link to the remote post-update page (typically our blog entry for the release).

Always load about:tbupdate in a content process, but implement the code that reads the file system (changelog) in the chrome process for compatibility with future sandboxing efforts.

Also fix bug 29440. Now about:tbupdate is styled as a fairly simple changelog page that is designed to be displayed via a link that is on about:tor.

- - - - - d9c77ce5 by Georg Koppen at 2024-03-12T11:26:42+01:00 Bug 32658: Create a new MAR signing key

It's time for our rotation again: Move the backup key in the front position and add a new backup key.

Bug 33803: Move our primary nightly MAR signing key to tor-browser

Bug 33803: Add a secondary nightly MAR signing key

- - - - - 1cf1cb93 by Mike Perry at 2024-03-12T11:26:42+01:00 Omnibox: Add DDG, Startpage, Disconnect, Youtube, Twitter; remove Amazon, eBay, bing

eBay and Amazon don't treat Tor users very well. Accounts often get locked and payments reversed.

Also: Bug 16322: Update DuckDuckGo search engine

We are replacing the clearnet URL with an onion service one (thanks to a patch by a cypherpunk) and are removing the duplicated DDG search engine. Duplicating DDG happend due to bug 1061736 where Mozilla included DDG itself into Firefox. Interestingly, this caused breaking the DDG search if JavaScript is disabled as the Mozilla engine, which gets loaded earlier, does not use the html version of the search page. Moreover, the Mozilla engine tracked where the users were searching from by adding a respective parameter to the search query. We got rid of that feature as well.

Also: This fixes bug 20809: the DuckDuckGo team has changed its server-side code in a way that lets users with JavaScript enabled use the default landing page while those without JavaScript available get redirected directly to the non-JS page. We adapt the search engine URLs accordingly.

Also fixes bug 29798 by making sure we only specify the Google search engine we actually ship an .xml file for.

Also regression tests.

squash! Omnibox: Add DDG, Startpage, Disconnect, Youtube, Twitter; remove Amazon, eBay, bing

Bug 40494: Update Startpage search provider

squash! Omnibox: Add DDG, Startpage, Disconnect, Youtube, Twitter; remove Amazon, eBay, bing

Bug 40438: Add Blockchair as a search engine

Bug 33342: Avoid disconnect search addon error after removal.

We removed the addon in #32767, but it was still being loaded from addonStartup.json.lz4 and throwing an error on startup because its resource: location is not available anymore.

- - - - - 87eb3247 by Alex Catarineu at 2024-03-12T11:26:42+01:00 Bug 40073: Disable remote Public Suffix List fetching

In https://bugzilla.mozilla.org/show_bug.cgi?id=1563246 Firefox implemented fetching the Public Suffix List via RemoteSettings and replacing the default one at runtime, which we do not want.

- - - - - 6608c8af by Henry Wilkes at 2024-03-12T11:26:42+01:00 Bug 41906: Hide DNS over HTTPS preferences.

- - - - - dd945392 by Richard Pospesel at 2024-03-12T11:26:43+01:00 Bug 23247: Communicating security expectations for .onion

Encrypting pages hosted on Onion Services with SSL/TLS is redundant (in terms of hiding content) as all traffic within the Tor network is already fully encrypted. Therefore, serving HTTP pages from an Onion Service is more or less fine.

Prior to this patch, Tor Browser would mostly treat pages delivered via Onion Services as well as pages delivered in the ordinary fashion over the internet in the same way. This created some inconsistencies in behaviour and misinformation presented to the user relating to the security of pages delivered via Onion Services:

- HTTP Onion Service pages did not have any 'lock' icon indicating the site was secure - HTTP Onion Service pages would be marked as unencrypted in the Page Info screen - Mixed-mode content restrictions did not apply to HTTP Onion Service pages embedding Non-Onion HTTP content

This patch fixes the above issues, and also adds several new 'Onion' icons to the mix to indicate all of the various permutations of Onion Services hosted HTTP or HTTPS pages with HTTP or HTTPS content.

Strings for Onion Service Page Info page are pulled from Torbutton's localization strings.

- - - - - 1a8b2bcf by Kathy Brade at 2024-03-12T11:26:43+01:00 Bug 30237: Add v3 onion services client authentication prompt

When Tor informs the browser that client authentication is needed, temporarily load about:blank instead of about:neterror and prompt for the user's key.

If a correctly formatted key is entered, use Tor's ONION_CLIENT_AUTH_ADD control port command to add the key (via Torbutton's control port module) and reload the page.

If the user cancels the prompt, display the standard about:neterror "Unable to connect" page. This requires a small change to browser/actors/NetErrorChild.jsm to account for the fact that the docShell no longer has the failedChannel information. The failedChannel is used to extract TLS-related error info, which is not applicable in the case of a canceled .onion authentication prompt.

Add a leaveOpen option to PopupNotifications.show so we can display error messages within the popup notification doorhanger without closing the prompt.

Add support for onion services strings to the TorStrings module.

Add support for Tor extended SOCKS errors (Tor proposal 304) to the socket transport and SOCKS layers. Improved display of all of these errors will be implemented as part of bug 30025.

Also fixes bug 19757: Add a "Remember this key" checkbox to the client auth prompt.

Add an "Onion Services Authentication" section within the about:preferences "Privacy & Security section" to allow viewing and removal of v3 onion client auth keys that have been stored on disk.

Also fixes bug 19251: use enhanced error pages for onion service errors.

- - - - - 4a0e239f by Alex Catarineu at 2024-03-12T11:26:43+01:00 Bug 21952: Implement Onion-Location

Whenever a valid Onion-Location HTTP header (or corresponding HTML <meta> http-equiv attribute) is found in a document load, we either redirect to it (if the user opted-in via preference) or notify the presence of an onionsite alternative with a badge in the urlbar.

- - - - - 8010cff9 by Pier Angelo Vendrame at 2024-03-12T11:26:43+01:00 Bug 40458: Implement .tor.onion aliases

We have enabled HTTPS-Only mode, therefore we do not need HTTPS-Everywhere anymore. However, we want to keep supporting .tor.onion aliases (especially for securedrop). Therefore, in this patch we implemented the parsing of HTTPS-Everywhere rulesets, and the redirect of .tor.onion domains. Actually, Tor Browser believes they are actual domains. We change them on the fly on the SOCKS proxy requests to resolve the domain, and on the code that verifies HTTPS certificates.

- - - - - 7781e5a8 by Pier Angelo Vendrame at 2024-03-12T11:26:44+01:00 Bug 11698: Incorporate Tor Browser Manual pages into Tor Browser

This patch associates the about:manual page to a translated page that must be injected to browser/omni.ja after the build. The content must be placed in chrome/browser/content/browser/manual/, so that is then available at chrome://browser/content/manual/. We preferred giving absolute freedom to the web team, rather than having to change the patch in case of changes on the documentation.

- - - - - bc49bbb6 by Pier Angelo Vendrame at 2024-03-12T11:26:44+01:00 Bug 41435: Add a Tor Browser migration function

For now this function only deletes old language packs for which we are already packaging the strings with the application.

- - - - - cf6e0f82 by Henry Wilkes at 2024-03-12T11:26:44+01:00 Bug 42110: Add TorUIUtils module for common tor component methods.

- - - - - 3b5c8885 by Dan Ballard at 2024-03-12T11:26:44+01:00 Bug 40701: Add security warning when downloading a file

Shown in the downloads panel, about:downloads and places.xhtml.

- - - - - e14da8fa by Henry Wilkes at 2024-03-12T11:26:44+01:00 Bug 41736: Customize toolbar for tor-browser.

- - - - - dd69d7fa by hackademix at 2024-03-12T11:26:45+01:00 Bug 41728: Pin bridges.torproject.org domains to Let's Encrypt's root cert public key

- - - - - 27a7af4f by Henry Wilkes at 2024-03-12T11:26:45+01:00 Customize moz-toggle for tor-browser.

- - - - - b159ab04 by Richard Pospesel at 2024-03-12T11:26:45+01:00 Bug 41822: Unconditionally disable default browser UX in about:preferences

- - - - -

30 changed files:

- .eslintignore - .gitignore - + .gitlab/issue_templates/Backport Android Security Fixes.md - + .gitlab/issue_templates/Rebase Browser - Alpha.md - + .gitlab/issue_templates/Rebase Browser - Stable.md - + .gitlab/issue_templates/bug.md - + .gitlab/merge_request_templates/default.md - accessible/android/SessionAccessibility.cpp - accessible/android/SessionAccessibility.h - accessible/ipc/DocAccessibleParent.cpp - accessible/ipc/DocAccessibleParent.h - accessible/ipc/moz.build - + browser/actors/AboutTBUpdateChild.jsm - + browser/actors/AboutTBUpdateParent.jsm - + browser/actors/CryptoSafetyChild.jsm - + browser/actors/CryptoSafetyParent.jsm - − browser/actors/RFPHelperChild.sys.mjs - − browser/actors/RFPHelperParent.sys.mjs - browser/actors/moz.build - browser/app/Makefile.in - browser/app/macbuild/Contents/Info.plist.in - browser/app/macbuild/Contents/MacOS-files.in - browser/app/moz.build - browser/app/permissions - + browser/app/profile/000-tor-browser.js - + browser/app/profile/001-base-profile.js - browser/app/profile/firefox.js - browser/base/content/aboutDialog-appUpdater.js - browser/base/content/aboutDialog.js - browser/base/content/aboutDialog.xhtml

The diff was not included because it is too large.

View it on GitLab: https://gitlab.torproject.org/tpo/applications/tor-browser/-/compare/cf4437d...