[tor-bugs] #27373 [Core Tor/Tor]: add UTF-8 validation code

[Tor Bug Tracker & Wiki]

#27373: add UTF-8 validation code
---------------------------------+------------------------------------
 Reporter:  cyberpunks           |          Owner:  (none)
     Type:  task                 |         Status:  needs_revision
 Priority:  Medium               |      Milestone:  Tor: 0.3.6.x-final
Component:  Core Tor/Tor         |        Version:
 Severity:  Normal               |     Resolution:
 Keywords:  rust-wants, prop285  |  Actual Points:
Parent ID:  #24033               |         Points:
 Reviewer:                       |        Sponsor:
---------------------------------+------------------------------------

Comment (by teor):

 Replying to [comment:7 cyberpunks]:
 > Replying to [comment:5 teor]:
 > > Can you also check that Surrogate code points fail to validate?
 > > I couldn't see any in there.
 >
 > They're in there. That's what `"\xed\xa0\x80"` and `"\xed\xbf\xbf"` are.
 They could be Unicode literals to make it clearer, but now I wonder if
 clang will warn about those too...

 Oh, right, in their encoded forms.

 Please add comments to each test (or each block of tests), so that future
 developers know why the tests are failing.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/27373#comment:8>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online