Hello all,
This is the biweekly status update for ahmia development, that arrives a bit late, since I should have sent it on Friday.
The last two weeks I have been working on:
=== Ahmia-Site ===
* Changed the search criteria of elasticsearch searches, by 1) using
weighted fields
and 2) adding 'anchor' and 'content' fields as well. That has improved the first (upper) results in some cases, and also increases the overall results fetched. [2]
* Performed an overall html refactoring, to improve the code structure, fix some unmatched tags, etc [3]
* A minor improvement on add onion page, makes clearer the response message, and doesn't redirect to new page. [4]
* [Ongoing] I have been Integrating PageRank algorithm in order to improve results sorting based on website popularity. For each page we take into account the backlinks from the rest of the onion addresses to calculate its page rank coefficient. An appropriate formula needs to be done to combine this metric with the already elasticsearch relevance score [5] To be committed soon
=== Ahmia-Index ===
* Changed the bulk update request on ES aliases, to an iterative one, to prevent any error on the first requests from disrupting the rest of the requests [6]
* Separated add and remove alias, functionality to make the first crawls of each month available from the beginning of the month. [7]