[tor-bugs] #13803 [Ooni]: Better and more efficient database schema

[Tor Bug Tracker & Wiki]

#13803: Better and more efficient database schema
------------------------+---------------------
     Reporter:  otr     |      Owner:  hellais
         Type:  defect  |     Status:  new
     Priority:  normal  |  Milestone:
    Component:  Ooni    |    Version:
   Resolution:          |   Keywords:
Actual Points:          |  Parent ID:
       Points:          |
------------------------+---------------------

Comment (by otr):

 kudrom already suggested the use of subdocuments. Basicually this would
 merge the reports and measurements collections. The measurements become
 just an array in each report's entry.

 An implementation of this for the publish module of ooni pipeline is here:

 https://github.com/olliwolli/ooni-
 pipeline/blob/feature/nested_mongodb/ooni/pipeline/task/publish.py#L35

 The export step would also need to be adapted. Ideally by using find()
 only to get subdocuments (not the whole report which would contain ALL
 measurements of the report).

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/13803#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online