Update MLOps Stacks to Use Databricks Asset Bundles #77
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Mingyu Li <[email protected]>
…score and update the project folder name to project_name_alphanumeric_underscore Signed-off-by: Mingyu Li <[email protected]>
…version to resolve a recipe issue Signed-off-by: Mingyu Li <[email protected]>
…e experiment folder will be removed until bundles supports managing it. Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
…format. Signed-off-by: Mingyu Li <[email protected]>
…ck to github. Add model name parameter to BatchInference notebook to avoid reading it from terraform output file Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
…, update bundle to use the new table and fix fs batch inference Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
…xplicit token. Signed-off-by: Mingyu Li <[email protected]>
…ording latest bundle update Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
…bundle Signed-off-by: Mingyu Li <[email protected]>
Signed-off-by: Mingyu Li <[email protected]>
* Remove experiment parent dir Signed-off-by: Mingyu Li <[email protected]> * Update experiment to be in the current user's directory Signed-off-by: Mingyu Li <[email protected]> * Fix test Signed-off-by: Mingyu Li <[email protected]> --------- Signed-off-by: Mingyu Li <[email protected]>
…rraform (#5) * update docs Signed-off-by: Mingyu Li <[email protected]> * Add bundle and remove terraform from gitignore Signed-off-by: Mingyu Li <[email protected]> * Remove terraform from MLOps-stacks except ADO CICD. Fix tests and update more docs Signed-off-by: Mingyu Li <[email protected]> * Add file names to gitignore Signed-off-by: Mingyu Li <[email protected]> * More doc changes. Move the CICD set up section from ML resource README to mlops-setup doc Signed-off-by: Mingyu Li <[email protected]> * Address comments Signed-off-by: Mingyu Li <[email protected]> * Do not use hard coded aws doc for bricks CLI bundles since azure doc is also available Signed-off-by: Mingyu Li <[email protected]> --------- Signed-off-by: Mingyu Li <[email protected]>
Address bug bash issues and polish stacks for private preview
Rename bricks CLI to databricks
Signed-off-by: Mingyu Li <[email protected]>
* vscode gitignore
* vscode gitignore
* typo in test configs
* update reqs path
* update tests-ci to use bundles
* add script to install bricks cli
* update main -> {{cookiecutter.default_branch}}
* add bundle cicd
* update docs
* typo
* update docs to have ado
* update pipelines to use cookiecutter URLs
* doc updates
* remove print statement
* update setup script bricks -> databricks rename
* update to use databricks cli and lowercase staging
* lowercase standardize, databricks CLI
* update conditions
* update name
* parameterize databricks cli version
* bricks -> databricks
* lowercase displayName
* update pipelines
* minor doc updates
* revert condition
* Update {{cookiecutter.root_dir__update_if_you_intend_to_use_monorepo}}/.azure/devops-pipelines/{{cookiecutter.project_name}}-tests-ci.yml
Co-authored-by: Vladimir Kolovski <[email protected]>
* Update {{cookiecutter.root_dir__update_if_you_intend_to_use_monorepo}}/{{cookiecutter.project_name_alphanumeric_underscore}}/databricks-resource/README.md
Co-authored-by: Vladimir Kolovski <[email protected]>
* Update tests/example-project-configs/aws/aws-github.yaml
Co-authored-by: Pieter Noordhuis <[email protected]>
* Update {{cookiecutter.root_dir__update_if_you_intend_to_use_monorepo}}/.azure/devops-pipelines/{{cookiecutter.project_name}}-bundle-cicd.yml
Co-authored-by: Vladimir Kolovski <[email protected]>
* Update {{cookiecutter.root_dir__update_if_you_intend_to_use_monorepo}}/.azure/devops-pipelines/{{cookiecutter.project_name}}-bundle-cicd.yml
Co-authored-by: Vladimir Kolovski <[email protected]>
* update url
* update docs to use SPs over PATs
* use SP credentials
* use SP credentials
* update path
* standardize on Azure Pipelines
* minor doc updates
* typos
* Fix links (#16)
Signed-off-by: Mingyu Li <[email protected]>
---------
Signed-off-by: Mingyu Li <[email protected]>
Co-authored-by: Vladimir Kolovski <[email protected]>
Co-authored-by: Pieter Noordhuis <[email protected]>
Co-authored-by: Mingyu Li <[email protected]>
…acks-using-bundles into cleanup-recipes-docs
Some more docs cleanups
|
Do we want to tag the pre-bundles version with a release tag or something? In case users want to refer to it and use it for some reason. |
Yeah I was thinking about that but they can also just refer to the commit right before this release. But also release tags are free so I can just do it too 😛 UPDATE: ended up creating tag |
Fix unmerged conflicts in README files
Miscellaneous doc improvements
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.