Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: use transformer.js for embeddings #74

Merged
merged 7 commits into from Mar 12, 2024
Merged

feat: use transformer.js for embeddings #74

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
22384a6
feat: use transformer.js for embeddings
TimPietrusky Mar 12, 2024
46d72b3
Merge branch 'alpha' into feat/embedding-transformersjs
TimPietrusky Mar 12, 2024
a631881
chore: remove unused console.log
TimPietrusky Mar 12, 2024
e816c65
docs: describe how it works
TimPietrusky Mar 12, 2024
0ff5fe2
ci: run e2e on windows
TimPietrusky Mar 12, 2024
6364d4b
ci: eslint
TimPietrusky Mar 12, 2024
9654f82
ci: don't use xvfb-run as this only works on Ubuntu
TimPietrusky Mar 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
11 changes: 8 additions & 3 deletions .github/workflows/test-e2e.yml
View file
Open in desktop
Expand Up @@ -2,14 +2,14 @@ name: e2e Tests

on:
push:
branches: [ alpha, beta, rc, main ]
branches: [alpha, beta, rc, main]
pull_request:
types: [opened, synchronize]
branches: [ alpha, beta, rc, main ]
branches: [alpha, beta, rc, main]

jobs:
test-e2e:
runs-on: ubuntu-latest
runs-on: windows-latest
strategy:
matrix:
node-version: [18.x]
Expand All @@ -20,7 +20,12 @@ jobs:
uses: actions/setup-node@v4
with:
node-version: ${{ matrix.node-version }}

- name: Install dependencies
run: npm install

- name: Fix auto-fixable eslint issues
run: npm run eslint -- --fix

- name: Run e2e tests
run: npm run test:e2e
10 changes: 9 additions & 1 deletion jest.config.electron.e2e.ts
View file
Open in desktop
Expand Up @@ -5,7 +5,15 @@ const jestConfig = {
roots: ["<rootDir>/src/electron"],
testMatch: ["**/*.test.e2e.ts"],
transform: {
"^.+\\.(ts|js)$": ["@swc/jest"],
"^.+\\.(ts)$": ["@swc/jest"],
"^.+\\.(js)$": [
"@swc/jest",
{
jsc: {
target: "es5",
},
},
],
},
moduleNameMapper: {
"@/(.*)": "<rootDir>/src/electron/future/$1",
Expand Down
175 changes: 175 additions & 0 deletions package-lock.json
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 4 additions & 2 deletions package.json
View file
Open in desktop
Expand Up @@ -21,7 +21,7 @@
"spj": "npx sort-package-json@latest",
"test:client": "jest --runInBand --config jest.config.client.ts --verbose",
"pretest:e2e": "nextron build --no-pack",
"test:e2e": "xvfb-run --auto-servernum --server-args=\"-screen 0 1280x960x24\" -- cross-env TEST_ENV=test npx playwright test",
"test:e2e": "cross-env TEST_ENV=test npx playwright test",
"test:e2e:local": "cross-env TEST_ENV=local npx playwright test",
"test:electron": "jest --runInBand --config jest.config.electron.ts --verbose",
"test:electron:e2e": "cross-env TEST_ENV=local jest --runInBand --config jest.config.electron.e2e.ts --verbose",
Expand All @@ -34,6 +34,7 @@
"electron-dl": "3.5.2",
"electron-serve": "1.3.0",
"electron-store": "^8.2.0",
"onnxruntime-node": "^1.17.0",
"sharp": "0.33.2"
},
"devDependencies": {
Expand Down Expand Up @@ -81,6 +82,7 @@
"@types/uuid": "^9.0.8",
"@typescript-eslint/eslint-plugin": "^7.1.1",
"@typescript-eslint/parser": "^7.1.1",
"@xenova/transformers": "github:xenova/transformers.js#v3",
"axios": "^1.6.7",
"codemirror": "^5.65.16",
"conventional-changelog-cli": "^4.1.0",
Expand Down Expand Up @@ -151,8 +153,8 @@
"tslib": "2.6.2",
"type-fest": "4.12.0",
"typescript": "^5.4.2",
"uuid": "^9.0.1",
"use-debounce": "^10.0.0",
"uuid": "^9.0.1",
"webpack": "^5.90.3"
},
"optionalDependencies": {
Expand Down