Commit Graph

3 Commits

Author SHA1 Message Date
LearningCircuit
7f8cab3144 Enhance benchmarking system with dataset refactoring and additional utilities
- Refactor benchmarks to use modular dataset and metrics classes
- Add Gemini optimization and multi-benchmark utilities
- Update benchmark runners with LLM configuration options
- Improve CLI commands to support database configuration
2025-05-14 09:25:17 -04:00
LearningCircuit
afe4e96ffa Add database-based LLM configuration and parallel benchmarking tools
- Create update_llm_config.py utility for managing LLM settings in database
- Add run_gemini_benchmark.py for running benchmarks with Gemini via OpenRouter
- Implement run_parallel_benchmark.py for concurrent benchmark execution
- Update core library to properly use database configuration
- Update documentation with new utilities and usage examples
2025-05-14 09:25:17 -04:00
LearningCircuit
aa5531a29a Add benchmark module components and examples
- Add benchmark CLI module with parameter optimization, comparison and profiling functionality
- Add efficiency module for speed and resource monitoring
- Add comparison module for evaluating different configurations
- Add example scripts for benchmarks and optimization
- Updated import references from 'benchmarking' to 'benchmarks' module
2025-05-14 09:24:52 -04:00