[ooni-dev] Exposing too many or too few options from ooni tests

[Vasilis]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Hello list,

On 15/03/16 14:18, Arturo Filastò wrote:

[...]
> Basically these tests will try to run the lantern and psiphon
> tool, then attempt to connect to a certain website with it and
> verify if the response it gets from the website is the expected
> one.
> 
> In the past it was possible to configure the URL to be fetched and 
> the response body that is expected with a sane default.
> 
> I have changed this to no longer be the case and instead use a 
> hardcoded value of a website that we expect to not change in the 
> future and an expected result for it. In the specific case it’s 
> http://www.google.com/humans.txt

I believe we can have both!
By using default parameters -sane default we are allowing the tests to
run without requiring extra arguments. This satisfies:

- - Users that just want to run the test without any parameters set.
Either because they are not aware of the "correct" parameters or they
don't want to do any further tests rather than just check if lantern
or psiphon bootstraps and works.

- - Users that (probably) know what they do and would like to change the
default (sane default) parameters.
They would like to test if other URLs are reachable via lantern or
psiphon or trigger different responses or do something else without
doing changes into the code.

Does this makes more sense?

Just for reference the current sane default is to check the URL:
http://www.google.com/humans.txt

~Vasilis
-----BEGIN PGP SIGNATURE-----

iQIcBAEBCgAGBQJW6HZBAAoJEF+/cLHRJgFiOqcQAK/snzWTv9RooeYxqgx5YnNN
XMFj5zLs6en4ZcxQmmfNDG3dibiKR9ee2x82fYu8UC/UGDoWWMqy5TX5YiuqDLfD
Ty/EE7ZeWNDubkXr+IhwcwImYAI6T7ANXNdGMDMon2TLCr5M6rcOlAQ4JDzm9X/Q
P0jMbvWSAw0W+8o6oDS11arE1jyp68Xk/5m+MlpfdpjTfMYbuhPQcoXAfecYCJ93
I4ellb5efOKU0F3HHupag9RgNWMu9oJBn1GHz/tdNGiD/B3ECXkLQ531REs4xrhv
/E1GLF8DG6p8NSWvj4zvv+Cf5xnjwTm5o+FUo0MNzo1XRQnTFw3QLT9rc1jIjwr0
+s7WP+yXlCo+uAqME4zCOkj8qNRkC15ByhKa+h0KcuUQpxmwSfT1spZqr15WFH7k
18x3YESLOOFCcvngx2Z6ZlGJmD+RcuD/0alTTXucBdz1vVxorh4tFViXoLfYwqj/
0xX2tK33YrltB80MoqVt4fKApKRqIGSrMxkRfc+Z5fSFsAtyn5l0n1zdHriigU0Y
kcfxr/bh/+KMlDZ7yRiVl91N+DR2j3v3bDQfAsTg/RZcd4aIvb1U3Kpjq6wOqB15
BUmfdKyR09QOnBO4ybqrEn3MQuPiwi3iD4GJ+XmNBqXOgyWowLd19psh/DVt9dcf
ptV7ucaFznRH+nKdiaA2
=mf2H
-----END PGP SIGNATURE-----