Need an easier way to spot failing jobs
Create a new fixture for loading test data
Box annotations provide a nice way to visualize failing jobs, the start and end times to draw the box annotations are obtained from the job status.
Minimal working example:
from bokeh.io import curdoc
from datetime import datetime
from bokeh.models import BoxAnnotation
from bokeh.plotting import figure
plot = figure(width=700, height=250,x_axis_type='datetime')
start = time.mktime(datetime(2016,9,1,0,0,0,0).timetuple())*1000
end = time.mktime(datetime(2016,9,10,21,0,0,0).timetuple())*1000
box = BoxAnnotation(left=start, right=end, fill_alpha=0.1, fill_color='red')
The result can be verified in my test environment:
it draws a red rectancle each time a job is missing, you can follow that by looking the CI Ids of each measurement. You can think about the visual result in production with lots of data.
Added title and a second line description for the selected metric as part of this ticket: