[tor-bugs] #25667 [Core Tor/Tor]: LZMA/ZSTD descriptor compression support

[Tor Bug Tracker & Wiki]

#25667: LZMA/ZSTD descriptor compression support
-------------------------------------------------+-------------------------
 Reporter:  atagar                               |          Owner:  (none)
     Type:  defect                               |         Status:  new
 Priority:  Medium                               |      Milestone:  Tor:
                                                 |  0.3.3.x-final
Component:  Core Tor/Tor                         |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  regression? 033-must needs-analysis  |  Actual Points:
Parent ID:                                       |         Points:
 Reviewer:                                       |        Sponsor:
-------------------------------------------------+-------------------------

Comment (by teor):

 Oh, it helps if the script checks the consensus file after downloading
 consensuses. Now lzma works:

 {{{
 $
 for encoding in x-tor-lzma x-zstd deflate gzip identity; do
     for doc in server/authority status-vote/current/consensus; do
         echo
         echo "Accept-Encoding: $encoding"
         echo "Requested: $doc"
         curl -s -O --header "Accept-Encoding: $encoding" \
             91.121.230.208:9030/tor/$doc && \
             file `basename $doc`
     done
 done

 Accept-Encoding: x-tor-lzma
 Requested: server/authority
 basename $doc
 authority: ASCII text

 Accept-Encoding: x-tor-lzma
 Requested: status-vote/current/consensus
 basename $doc
 consensus: LZMA compressed data, streamed

 Accept-Encoding: x-zstd
 Requested: server/authority
 basename $doc
 authority: Zstandard compressed data (v0.8+), Dictionary ID: None

 Accept-Encoding: x-zstd
 Requested: status-vote/current/consensus
 basename $doc
 consensus: Zstandard compressed data (v0.8+), Dictionary ID: None

 Accept-Encoding: deflate
 Requested: server/authority
 basename $doc
 authority: zlib compressed data

 Accept-Encoding: deflate
 Requested: status-vote/current/consensus
 basename $doc
 consensus: zlib compressed data

 Accept-Encoding: gzip
 Requested: server/authority
 basename $doc
 authority: gzip compressed data, max compression, from Unix

 Accept-Encoding: gzip
 Requested: status-vote/current/consensus
 basename $doc
 consensus: zlib compressed data

 Accept-Encoding: identity
 Requested: server/authority
 basename $doc
 authority: ASCII text

 Accept-Encoding: identity
 Requested: status-vote/current/consensus
 basename $doc
 consensus: ASCII text, with very long lines
 }}}

 I opened #25676 for zlib consensuses in response to gzip requests:
 {{{
 Accept-Encoding: gzip
 Requested: status-vote/current/consensus
 basename $doc
 consensus: zlib compressed data
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25667#comment:11>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online