Add new Moss local benchmarks
BU
4d ago+7287+7287+0123456789012345678901234567890123456789-80-80-01234567890123456789
Pull Request Checklist
Please ensure that your PR meets the following requirements:
- I have read the CONTRIBUTING guide.
- I have updated the documentation (if applicable).
- My code follows the style guidelines of this project.
- I have performed a self-review of my own code.
- I have added tests that prove my fix is effective or that my feature works.
- New and existing unit tests pass locally with my changes.
Description
Adds new benchmarks for Moss vs others for local only performance.
N/A
Type of Change
- Bug fix (non-breaking change which fixes an issue)
- New feature (non-breaking change which adds functionality)
- Breaking change (fix or feature that would cause existing functionality to not work as expected)
- This change requires a documentation update
- Updated/added new benchmarks
Summary by CodeRabbit
-
New Features
- Added reproducible local and cloud semantic-search benchmark suites.
- Added dataset download, preparation, validation, ground-truth generation, and embedding workflows.
- Added comparisons across multiple vector-search engines, datasets, metrics, filtering scenarios, scaling, and tuning configurations.
- Added automated HTML and Markdown reports with charts, tables, latency, recall, memory, build-time, and disk-usage results.
- Added watchdog support for monitoring benchmark runtime and resource usage.
-
Documentation
- Expanded benchmark setup, execution, methodology, interpretation, reproducibility, and engine-selection guidance.
- Documented cloud comparisons for Moss, Pinecone, Qdrant, and ChromaDB.