Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Log all config hyper parameters to mlflow tags #480

Open
3 tasks
guybartal opened this issue Apr 15, 2024 · 0 comments · Fixed by #529
Open
3 tasks

Log all config hyper parameters to mlflow tags #480

guybartal opened this issue Apr 15, 2024 · 0 comments · Fixed by #529
Assignees
@guybartal
Labels
bug Something isn't working Sprint 1 April 11 to May 1 2024

Comments

@guybartal
Copy link
Collaborator

guybartal commented Apr 15, 2024 •
edited

As a researcher I would like all my config.json hyper parameters logged as mlflow tags as soon as possible
So, I would be able to compare between my job runs even if pipeline didn't finish to run (failed / long time running).

note:
today only few properties are being tagged in mlflow and many parameters are missing.

Tasks
Beta Give feedback
@guybartal guybartal self-assigned this Apr 15, 2024
@guybartal guybartal added the bug Something isn't working label Apr 15, 2024
@guybartal guybartal mentioned this issue Apr 15, 2024
Merged
@Lep06fg Lep06fg added the Sprint 1 April 11 to May 1 2024 label May 2, 2024
@guybartal guybartal mentioned this issue May 6, 2024
Merged
guybartal added a commit that referenced this issue May 18, 2024
@guybartal
Log all hyper-parameters to mlflow (#529)
618007a 
closes #480 

### This PR includes

- Log all hyper parameters to mlflow
- Config refactoring - lowercase for all attributes as those are not constants (match coding conventions)
- Print azure ml monitoring URL right after its creation to allow easy access to monitoring (ctrl + left click)
- Fix issues with experiment and job names, allowing azure ml commands open experiment and mlflow runs automatically, while locally we create those manually.
- Remove unused experiment settings from `.env` sample file
- Hide warning azureml warnings by using `CliV2AnonymousEnvironment` as Azure ML environment name
- Temporary solution for wrong json format in Q&A Gen step with current CI generation model version by removing all "..."` strings from the model response

### WIP
#540
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@guybartal guybartal

Labels
bug Something isn't working Sprint 1 April 11 to May 1 2024
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Log all hyper-parameters to mlflow microsoft/rag-experiment-accelerator
2 participants
@guybartal @Lep06fg