Ticket #24 (closed task: fixed)

Opened 9 months ago

Last modified 4 months ago

Add benchmarking to the test suite

Reported by: mgranger Assigned to: mahlon
Priority: blocker Milestone: ThingFish 0.3 - The "N-Robot" Release
Component: ThingFish Keywords: thingfish profile benchmark performance http
Cc: Depends on:

Description

We're making several major changes to the daemon's functionality in the 0.3 release, so we'll need to establish a performance baseline to make sure we're aware of any slowdowns that are introduced by new features. Also, as we deploy this at LAIKA, we'll almost certainly start to exercise it in ways we haven't anticipated, so we'll want to be able to gauge the effectiveness of our optimizations.

We've investigated several different HTTP benchmarking tools, and the ones that look like they'll be most useful to us are:

Some of the features that we'll want:

  • Historical plots of performance vs. svn rev
  • A way to cross-reference performance and profiling output
  • In-browser benchmarking

Change History

04/29/08 22:12:43 changed by mahlon

  • owner changed from mgranger to mahlon.
  • depends_on changed.
  • status changed from new to assigned.

Added some more notes about all of this here.

05/01/08 07:10:41 changed by mgranger

  • status changed from assigned to closed.
  • resolution set to fixed.

(In [527]) Re-integrated Gruff graphing into the build in an optional task 'benchmarks:graphs'. Closes #24.