Add new Moss local benchmarks

BU
4d ago
+7287-80

Pull Request Checklist

Please ensure that your PR meets the following requirements:

  • I have read the CONTRIBUTING guide.
  • I have updated the documentation (if applicable).
  • My code follows the style guidelines of this project.
  • I have performed a self-review of my own code.
  • I have added tests that prove my fix is effective or that my feature works.
  • New and existing unit tests pass locally with my changes.

Description

Adds new benchmarks for Moss vs others for local only performance.

N/A

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update
  • Updated/added new benchmarks

Summary by CodeRabbit

  • New Features

    • Added reproducible local and cloud semantic-search benchmark suites.
    • Added dataset download, preparation, validation, ground-truth generation, and embedding workflows.
    • Added comparisons across multiple vector-search engines, datasets, metrics, filtering scenarios, scaling, and tuning configurations.
    • Added automated HTML and Markdown reports with charts, tables, latency, recall, memory, build-time, and disk-usage results.
    • Added watchdog support for monitoring benchmark runtime and resource usage.
  • Documentation

    • Expanded benchmark setup, execution, methodology, interpretation, reproducibility, and engine-selection guidance.
    • Documented cloud comparisons for Moss, Pinecone, Qdrant, and ChromaDB.