Changes

Revision history for {{$dist->name}}

{{$NEXT}}
        - Complete benchmarking sub system, consisting of
          * key/value schema to describe data points, usually for benchmark results
          * corresponding backend store, scaling to millions of entries
          * dedicated query api to fetch data points by key/values
          * native charting in Web UI (to replace 100% of codespeed and typical gnuplot uses)
          * REST-like data export of those data
        - Scale-up
          * to millions of testruns, reports, and data points
          * thousands of testruns running at the same time
          * dedicated MySQL optimizations
        - Pool hosts
          * hide multiple "anonymous" machines behind a single machine name
          * define quota how many of such hosts of a pool can run at same time
          * think of a cloud of instances
        - Command-line interface harmonized
          * less scattered tools
          * just one single frontend command "tapper"
        - Testplan improvements
          * merged feature set with "interdependent scenarios"
          * better preview/debugging support
          * REST api to submit tests and testplans
        - Web UI improvements
          * modernized (yes, more Javascript)
          * optimizations for speed and traffic
          * more powerful navigation and filters
          * UI to maintain continuous testrun rotation (pause, continue, edit, delete, clone)
        - Tapper-autoreport/bash-test-utils
          * better separation from Tapper via plugins/hooks
          * support Tapper benchmarking
        - General refactoring
          * Hacking - raw SQL support for optional performance tweaks
          * more plugin'ification, to separate internal systems
          * merged the two databases, which makes the automation layer better integrated
          * database connection re-use (allowing thousands of testruns at the same time)

4.1.1     2012-11-19
        - rerelease for CPAN ID TAPPER
        - new command 'tapper init':
          creates ~/.tapper/ with defaults and examples
          for an easier start as normal user

4.1       2012-10-23
        * Databases
        - refactoring to also work with PostgreSQL

        * Automation
        - scheduler 10x speedup
        - first Cobbler support
        - host blacklisting per queue

        * Tools
        - CLI consolidation/harmonization

        * Documentation
        - migrated to POD for maintainability
        - complex precondition and testplan examples

        * Misc
        - overall cleanup in sync with upstream upgrades
          * autotest 0.14.x
          * Perl 5.16
          * Catalyst 5.9

4.0     2012-05-16
        * Automation
        - better linux32 chroot/exec support
        - persistent automation layer, based on event-queues
          (Tapper::MCP, Tapper::MCP::MessageReceiver)
        - introduce SSH-connect to test without complete machine setup
        - support suspend/resume testing;
          via abstract central 'actions' to be called from remote clients
          (Tapper::Action)
        - conditionally trigger notifications on incoming results
          (Tapper::Notification)
        - keep-alive mechanics for broken hosts
        - much better scriptability everywhere to support strangest
          requirements
        - reworked TaskJuggler/Testplan bridge
          (Tapper::Testplan)

        * Testsuites
        - Tapper-autotest wrapper:
           - now send+upload virtually all result details+files
           - allow use snapshots to not suffer from upstream changes
        - Tapper-autoreport: better virtualization support (probably the
          world's current best Xen/KVM host/guest detection heuristics,
          really)
        - better Perl::Formance benchmarking integration

        * Reports database
        - store attachments bzip2 compressed (optionally compress already
          existing attachments)

        * Reports API
        - allow passthrough of incoming results to 3rd party applications
          (e.g. extract benchmark results and pass them along them to external
          graph rendering - aka. "level 2 receivers")
        - more robust TAP::Archive support

        * Query API
        - easier attachment downloading
        - QueryAPI now available in testplan template to allows generate
          testruns based on older results (think of "use last successful
          aka. known-good Xen changeset for another complicated test")

        * Web GUI
        - user authentication (via PAM)
        - reworked filter framework
        - better show current scheduling state
        - configurable site customizations for non-OSRC instances

        * CLI
        - new frontend tool 'tapper'
        - more subcommands for user/notification/testplan handling
        - testplan development support

        * misc
        - better configurable control over grub entry writing
        - utils to fake/test the automation layer (Tapper::Fake)

        * hack on Tapper
        - use Dist::Zilla to author Perl libs

        * Tapper
        - zero-content lib as primary entry point for Tapper info

3.0     2011-04-08
        - for the initial Tapper feature overview (version 3) see
          http://www.amd64.org/support/automated-test-infrastructure.html