A result bundle from running a particular LAVA test job becomes aggregated into a bundle stream which forms the basis of data analysis and reporting in LAVA, using filter and Image Reports.
In each case, the structure of the data complies with the current Dashboard Bundle Format and the details of this format are visible in the Bundle Viewer tab when viewing the bundle in LAVA.
lava_tool can download any result bundle and instructions are given on each bundle page giving the command to use for that bundle. Bundles are downloaded as JSON and can be analyzed using any tool which can parse JSON, including python and perl.
See the lava-tool overview
Once the bundle has been downloaded, data from the bundle can be used with other export calls to obtain more detail.
LAVA uses XML-RPC to communicate between dispatchers and the server and methods are available to query various information in LAVA.
Warning
When using XML-RPC to communicate with a remote server, check whether https:// can be used to protect the token. http:// connections to a remote XML-RPC server will transmit the token in plaintext. Not all servers have https:// configured. If a token becomes compromised, login to that LAVA instance and delete the token before creating a new one.
The general structure of an XML-RPC call can be shown in this python snippet:
import xmlrpclib
import json
config = json.dumps({ ... })
server=xmlrpclib.ServerProxy("http://username:API-Key@localhost:8001/RPC2/")
jobid=server.scheduler.submit_job(config)
XML-RPC can also be used to query data anonymously:
import xmlrpclib
server = xmlrpclib.ServerProxy("http://sylvester.codehelp/RPC2")
print server.system.listMethods()
Individual XML-RPC commands are documented on the API Help page.
This query returns a list of all bundle streams on the validation.linaro.org:
import xmlrpclib
import simplejson
server = xmlrpclib.ServerProxy("http://validation.linaro.org/RPC2")
print server.dashboard.streams()
Assuming that you are interested in a bundle stream which is public and anonymous and has a pathname of /anonymous/codehelp/, the bundles within that stream can also be queried:
import xmlrpclib
import simplejson
server = xmlrpclib.ServerProxy("http://validation.linaro.org/RPC2")
stream_path="/anonymous/codehelp/"
bundles = server.dashboard.bundles(stream_path)
A specific bundle is addressed using the content_sha1 value which returns a JSON string:
latest = len(bundles) - 1
sha1 = bundles[latest]['content_sha1']
bundle = simplejson.loads(server.dashboard.get(sha1)['content'])
At this point, you have the same information as would be obtained using lava-tool already in memory, indeed you could use lava-tool to download any bundle when you know the bundle stream path and the bundle content_sha1.
To output just the data about test runs which are included in the bundle, use this python snippet:
for test in bundle['test_runs']:
print test['test_results']
LAVA also supports Comma Separated Value exports directly from the LAVA page for the bundle or bundle stream.
CSV data can also be downloaded by using a simple export URL:
https://validation.linaro.org/dashboard/streams/anonymous/codehelp/bundles/export
Specific bundles can be exported using the content_sha1:
Within a bundle, test runs can be exported using the Test Run UUID (which is the same as the analyzer_assigned_uuid in the previous export)