Welcome to International Dataset of Flaky Tests (IDoFT)

Flaky tests are tests that can non-deterministically pass and fail when run on the same version of code.
This website captures the information of flaky tests that have been detected or fixed.


Summary of Flaky Tests

A summary of all flaky tests detected,
their projects, and categories.

Read More

Unfixed Tests

A list of unfixed tests, their projects,
and categories.

Read More

Fixed Tests

A list of fixed tests, their projects,
categories, and PR links.

Read More

TSO & ISO Rates

Failure rates for running flaky tests in the
test suite (TSO) vs. in isolation (ISO).

Read More

Flakiness Introduction

Summary of how flakiness introducing commits relate to test introducing commits.

Read More

About

Describes the purpose of the dataset,
related papers, and contributors.

Read More