Testing

Relevant source files

• benches/utils/markdown.rs
• src/supertable/reader_cache/disk.rs
• src/test_helpers/brute_force_bm25.rs
• src/test_helpers/mod.rs
• tests/superfile/fts/brute_force_oracle.rs
• tests/supertable/main.rs
• tests/supertable/query/brute_force_oracle.rs

Infino employs a multi-layered testing strategy designed to validate correctness across different abstraction levels, from low-level byte parsing to high-level distributed table semantics. The strategy combines traditional unit tests with brute-force oracles, property-based crash tests, and memory safety validation using specialized tooling.

Test Infrastructure & Tooling

The testing lifecycle is managed primarily through the Makefile, which provides standardized entry points for CI and local development.

Target	Tool	Purpose
make test	cargo test	Runs the core Rust test suite with test-helpers enabled Makefile35-36
make coverage	cargo-llvm-cov	Validates that line/function/region coverage exceeds 90% Makefile38-40
make miri	Miri	Catches language-level UB (aliasing, provenance, uninitialized reads) in FTS Makefile73-77
make asan	LLVM ASan	Catches hardware-level memory errors (UAF, overflows) in unsafe blocks Makefile96-99
make public-api	cargo-public-api	Guards against accidental breaking changes to the curated API surface Makefile27-30

Memory Safety Oracles

Because the FTS and format layers use unsafe for performance (e.g., bumpalo lifetime extensions and byte parsing), Infino uses Miri and ASan as complementary oracles Makefile59-62 Miri validates the Rust abstract machine rules, while ASan monitors real-hardware execution Makefile93-95

Sources: Makefile1-100

Testing Domains

Supertable Integration Tests

These tests validate the Supertable abstraction, focusing on the durability and consistency of the multi-file table format.

• Commit Correctness: Validates pointer-file atomicity, ID uniqueness across shards, and manifest persistence tests/supertable/main.rs8-11
• Mutation Tests: Exercises the WAL (Write-Ahead Log) state machine and tombstone bitmaps through crash-property tests tests/supertable/main.rs32-33
• Concurrency: Tests multiple writers and readers interacting with the same object-store prefix tests/supertable/main.rs20-24
• Cache Validation: Tests the DiskCacheStore for LRU eviction accuracy, hybrid cold-fetch coordination, and madvise behavior src/supertable/reader_cache/disk.rs137-152 tests/supertable/main.rs16-17

For details, see Supertable Integration Tests.

Superfile & Search Tests

This domain focuses on the internal layout of the .sf.parquet file and the accuracy of the search pipelines.

• Brute-Force Oracles: Infino uses a textbook BM25 reference implementation (BruteForceBm25) to verify that optimized algorithms like Block-Max WAND produce identical top-k results tests/superfile/fts/brute_force_oracle.rs4-9
• Vector Recall: Measures the recall ceiling of the RaBitQ/IVF implementation against ground-truth datasets.
• Pipeline Continuity: Validates the full SuperfileBuilder to SuperfileReader lifecycle, including multi-batch ingestion and schema enforcement tests/superfile/fts/brute_force_oracle.rs113-135

For details, see Superfile & Search Tests.

Search Correctness Architecture

The following diagram illustrates how the testing suite bridges high-level search requirements to specific code entities used for validation.

Search Oracle Mapping

Sources: src/test_helpers/brute_force_bm25.rs49-56 tests/supertable/query/brute_force_oracle.rs4-12 tests/superfile/fts/brute_force_oracle.rs113-135

Benchmarking as Validation

While primarily for performance, the in-tree benchmark harness (infino-bench-utils) serves as a secondary correctness layer. It executes a "correctness phase" on every artifact it builds before measuring latency, ensuring that performance optimizations do not regress result accuracy. The harness includes a markdown emitter for summarizing these results in CI benches/utils/markdown.rs4-11

Bench-to-Code Mapping

Sources: benches/utils/markdown.rs18-21 src/test_helpers/mod.rs11-22 src/supertable/reader_cache/disk.rs38-42

Child Pages

• Supertable Integration Tests — Detailed coverage of commit atomicity, WAL recovery, and concurrent storage operations.
• Superfile & Search Tests — Deep dive into BM25 oracles, vector recall validation, and Parquet compatibility suites.