Skip to content

Run

6 emulators 601 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.

Suite grew from 572 to 601 tests this run.

That's 29 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 601 tests, up 29, and every new test landed in Tier 3: a broader strict surface spanning validation ordering, exact error messages, service limits, and the legacy request shapes. Floci and Ministack were added to the run as targets the same day.

  1. DynamoDB
    live (AWS) · full coverage
    100% ground truth
    Tier 1 100%
    Tier 2 100%
    Tier 3 100%
  2. Dynoxide
    - · full coverage
    100.0% +1.0pp rose 1.0 percentage points
    Tier 1 100.0%
    Tier 2 100.0%
    Tier 3 100.0%
  3. LocalStack
    - · full coverage
    89.0% -3.3pp fell 3.3 percentage points
    Tier 1 99.0%
    Tier 2 96.1%
    Tier 3 69.7%
  4. DynamoDB Local
    - · full coverage
    88.2% -3.2pp fell 3.2 percentage points
    Tier 1 99.0%
    Tier 2 91.3%
    Tier 3 69.7%
  5. Dynalite
    - · 43 unsupported
    84.1% -2.3pp fell 2.3 percentage points
    Tier 1 98.3%
    Tier 2 16.7%
    Tier 3 82.6%
  6. Ministack
    - · 18 unsupported
    62.4% new
    Tier 1 85.1%
    Tier 2 70.6%
    Tier 3 23.6%
  7. Floci
    - · 25 unsupported
    61.3% new
    Tier 1 78.2%
    Tier 2 84.6%
    Tier 3 25.6%