Skip to content

Cleanup/fix benchmark and ci issues #87

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
May 25, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
9f55a10
chore: finalize 4.1.0 release
sidmohan0 May 19, 2025
fa4f2a0
clear mock's call history
sidmohan0 May 19, 2025
25589ac
fixed typer issues
sidmohan0 May 19, 2025
d42b9d2
pre-commit
sidmohan0 May 19, 2025
dd059f4
pre-commit
sidmohan0 May 19, 2025
ace3b54
pre-commit
sidmohan0 May 19, 2025
675d29b
feat(benchmarks): add fair benchmark analysis validating 190x speedup…
sidmohan0 May 25, 2025
5eb38a6
refactor(ci): streamline GitHub Actions workflows and fix pre-commit …
sidmohan0 May 25, 2025
9fa5f33
feat(deps): add lean setup.py for dependency splitting
sidmohan0 May 25, 2025
f8c3ef5
feat(v4.1.0): implement dependency splitting for lightweight core pac…
sidmohan0 May 25, 2025
632179e
style(ci): fix flake8 formatting issues in fair_benchmark.py
sidmohan0 May 25, 2025
8e8eac7
docs: update Claude.md and roadmap to reflect v4.1.0 achievements
sidmohan0 May 25, 2025
1fae933
fix(text): implement proper structured output for multi-chunk processing
sidmohan0 May 25, 2025
c043375
fix(ci): resolve CI failures while preserving 4.1.0 lean architecture
sidmohan0 May 25, 2025
69cc56f
fix(tests): resolve remaining CI failures and enhance README
sidmohan0 May 25, 2025
9882cfa
refactor: replace speed claims with intelligent engine selection mess…
sidmohan0 May 25, 2025
83f6dee
fix: resolve benchmark test failures and CI hanging issues
sidmohan0 May 25, 2025
2707dec
chore: remove notes folder from git tracking
sidmohan0 May 25, 2025
ec75c6c
fix: rename CI jobs to match expected GitHub checks
sidmohan0 May 25, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ jobs:
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install -e .
pip install -e ".[nlp]"
pip install -r requirements-dev.txt

- name: Restore benchmark data
Expand Down
81 changes: 0 additions & 81 deletions .github/workflows/beta-cicd.yml

This file was deleted.

75 changes: 75 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
name: CI

on:
push:
branches: [main, dev, "feature/*", "fix/*", "chore/*", "cleanup/*"]
pull_request:
branches: [main, dev]

jobs:
lint:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v5
with:
python-version: "3.10"
cache: "pip"
- name: Install pre-commit
run: pip install pre-commit
- name: Run pre-commit
run: pre-commit run --all-files --show-diff-on-failure

build:
runs-on: ubuntu-latest
strategy:
matrix:
python-version: ["3.10", "3.11", "3.12"]
steps:
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: "pip"

- name: Install Tesseract OCR
run: |
sudo apt-get update
sudo apt-get install -y tesseract-ocr libtesseract-dev

- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install -e ".[nlp,ocr]"
pip install -r requirements-dev.txt

- name: Run tests
run: |
python -m pytest tests/ --cov=datafog --cov-report=xml --cov-report=term

- name: Upload coverage
uses: codecov/codecov-action@v4
with:
file: ./coverage.xml
token: ${{ secrets.CODECOV_TOKEN }}

wheel-size:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v5
with:
python-version: "3.10"
cache: "pip"

- name: Install build dependencies
run: |
python -m pip install --upgrade pip
pip install build wheel

- name: Build wheel
run: python -m build --wheel

- name: Check wheel size
run: python scripts/check_wheel_size.py
84 changes: 0 additions & 84 deletions .github/workflows/dev-cicd.yml

This file was deleted.

81 changes: 0 additions & 81 deletions .github/workflows/feature-cicd.yml

This file was deleted.

42 changes: 0 additions & 42 deletions .github/workflows/lint.yml

This file was deleted.

Loading
Loading