[tor-bugs] #28877 [Core Tor/Tor]: Paginate large controller commands like 'GETINFO desc/all-recent' (was: Command desc/all-recent slows down or craches Nyx)

[Tor Bug Tracker & Wiki]

#28877: Paginate large controller commands like 'GETINFO desc/all-recent'
--------------------------+--------------------------
 Reporter:  wagon         |          Owner:  atagar
     Type:  defect        |         Status:  assigned
 Priority:  Medium        |      Milestone:
Component:  Core Tor/Tor  |        Version:
 Severity:  Normal        |     Resolution:
 Keywords:                |  Actual Points:
Parent ID:                |         Points:
 Reviewer:                |        Sponsor:
--------------------------+--------------------------
Changes (by atagar):

 * component:  Core Tor/Nyx => Core Tor/Tor


Comment:

 Hi wagon, I'm gonna toss this over to tor and repurpose it to be for
 paginated GETINFO commands. You're right that commands like 'GETINFO desc
 /all-recent' provide megabytes of data.

 These GETINFO commands were created in tor's early days when the consensus
 was pretty small, but nowadays the response of this method is massive. The
 usual way of dealing with this is to have a paginated API where the caller
 can provide a starting index and number of responses. This would let Nyx
 fetch smaller batches without hosing the control connection.

 Unfortunately without that there's not much I can do on my end.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/28877#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online