Skip to content

Commit

Permalink
Release v3.11.0
Browse files Browse the repository at this point in the history
  • Loading branch information
akchinSTC committed Aug 23, 2022
1 parent 9307c75 commit e6eda40
Show file tree
Hide file tree
Showing 35 changed files with 76 additions and 71 deletions.
2 changes: 1 addition & 1 deletion Makefile
Expand Up @@ -38,7 +38,7 @@ PYTHON_VERSION?=3.9
CONDA_ACTIVATE = source $$(conda info --base)/etc/profile.d/conda.sh ; conda activate

ELYRA_VERSION:=$$(grep __version__ elyra/_version.py | cut -d"\"" -f2)
TAG:=dev
TAG:=3.11.0
IMAGE_IS_LATEST=False
ELYRA_IMAGE=elyra/elyra:$(TAG)
ELYRA_IMAGE_LATEST=elyra/elyra:latest
Expand Down
4 changes: 2 additions & 2 deletions README.md
Expand Up @@ -67,14 +67,14 @@ Note: You can also [build a container image from the `main` branch ("dev build")
To run one of the container images, issue the following command, specifying a tag of your choice.

```
docker run -it -p 8888:8888 elyra/elyra:dev jupyter lab --debug
docker run -it -p 8888:8888 elyra/elyra:3.11.0 jupyter lab --debug
```

To make a local directory containing your Notebooks (e.g. ${HOME}/opensource/jupyter-notebooks/) available in your
docker container, you can use a mount command similar to the following:

```
docker run -it -p 8888:8888 -v ${HOME}/opensource/jupyter-notebooks/:/home/jovyan/work -w /home/jovyan/work elyra/elyra:dev jupyter lab --debug
docker run -it -p 8888:8888 -v ${HOME}/opensource/jupyter-notebooks/:/home/jovyan/work -w /home/jovyan/work elyra/elyra:3.11.0 jupyter lab --debug
```

These should produce output similar to that below, where you can then find the URL to be used to access Elyra in your local browser.
Expand Down
14 changes: 7 additions & 7 deletions docs/source/recipes/configure-airflow-as-a-runtime.md
Expand Up @@ -37,7 +37,7 @@ AND
- A Kubernetes Cluster without Apache Airflow installed
- Ensure Kubernetes is at least v1.18. Earlier versions might work but have not been tested.
- Helm v3.0 or later
- Use the [Helm chart](https://github.com/airflow-helm/charts/tree/main/charts/airflow) available in the Airflow source distribution with the [Elyra sample configuration](https://raw.githubusercontent.com/elyra-ai/elyra/main/etc/kubernetes/airflow/helm/values.yaml).
- Use the [Helm chart](https://github.com/airflow-helm/charts/tree/v3.11.0/charts/airflow) available in the Airflow source distribution with the [Elyra sample configuration](https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/etc/kubernetes/airflow/helm/values.yaml).

OR

Expand All @@ -50,7 +50,7 @@ OR

In order to use Apache Airflow with Elyra, it must be configured to use a Git repository to store DAGs.

- Create a private repository on github.com, GitHub Enterprise, gitlab.com, or GitLab Enterprise. (Elyra produces DAGs that contain credentials, which are not encrypted. Therefore you should not use a public repository.) Next, create a branch (e.g `main`) in your repository. This will be referenced later for storing the DAGs.
- Create a private repository on github.com, GitHub Enterprise, gitlab.com, or GitLab Enterprise. (Elyra produces DAGs that contain credentials, which are not encrypted. Therefore you should not use a public repository.) Next, create a branch (e.g `v3.11.0`) in your repository. This will be referenced later for storing the DAGs.
- Generate a personal access token with push access to the repository. This token is used by Elyra to upload DAGs.
- [Instructions for GitHub](https://docs.github.com/en/github/authenticating-to-github/creating-a-personal-access-token)
- [Instructions for GitLab](https://docs.gitlab.com/ee/user/profile/personal_access_tokens.html)
Expand All @@ -61,7 +61,7 @@ In order to use Apache Airflow with Elyra, it must be configured to use a Git re
Take note of the following information:
- Git API endpoint (e.g. `https://api.github.com` for github.com or `https://gitlab.com` for gitlab.com)
- Repository name (e.g. `your-git-org/your-dag-repo`)
- Repository branch name (e.g. `main`)
- Repository branch name (e.g. `v3.11.0`)
- Personal access token (e.g. `4d79206e616d6520697320426f6e642e204a616d657320426f6e64`)

You need to provide this information in addition to your cloud object storage credentials when you [create a runtime configuration](../user_guide/runtime-conf) in Elyra for the Apache Airflow deployment.
Expand All @@ -79,9 +79,9 @@ To deploy Apache Airflow on a new Kubernetes cluster:
kubectl create secret generic airflow-secret --from-file=id_rsa=.ssh/id_rsa --from-file=known_hosts=.ssh/known_hosts --from-file=id_rsa.pub=.ssh/id_rsa.pub -n airflow
```

2. Download, review, and customize the [sample `helm` configuration](https://raw.githubusercontent.com/elyra-ai/elyra/main/etc/kubernetes/airflow/helm/values.yaml) (or customize an existing configuration). This sample configuration will use the `KubernetesExecutor` by default.
2. Download, review, and customize the [sample `helm` configuration](https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/etc/kubernetes/airflow/helm/values.yaml) (or customize an existing configuration). This sample configuration will use the `KubernetesExecutor` by default.
- Set `git.url` to the URL of the private repository you created earlier, e.g. `ssh://git@github.com/your-git-org/your-dag-repo`. **Note: Make sure your ssh URL contains only forward slashes.**
- Set `git.ref` to the DAG branch, e.g. `main` you created earlier.
- Set `git.ref` to the DAG branch, e.g. `v3.11.0` you created earlier.
- Set `git.secret` to the name of the secret you created, e.g. `airflow-secret`.
- Adjust the `git.gitSync.refreshTime` as desired.

Expand All @@ -103,7 +103,7 @@ To deploy Apache Airflow on a new Kubernetes cluster:

## the branch/tag/sha1 which we clone
##
ref: "main"
ref: "v3.11.0"

## the name of a pre-created secret containing files for ~/.ssh/
##
Expand All @@ -127,7 +127,7 @@ To deploy Apache Airflow on a new Kubernetes cluster:
repository: elyra/airflow
```

The container image is created using [this `Dockerfile`](https://github.com/elyra-ai/elyra/tree/main/etc/docker/airflow) and published on [Docker Hub](https://hub.docker.com/r/elyra/airflow) and [quay.io](https://quay.io/repository/elyra/airflow).
The container image is created using [this `Dockerfile`](https://github.com/elyra-ai/elyra/tree/v3.11.0/etc/docker/airflow) and published on [Docker Hub](https://hub.docker.com/r/elyra/airflow) and [quay.io](https://quay.io/repository/elyra/airflow).

3. Install Apache Airflow using the customized configuration.

Expand Down
Expand Up @@ -42,7 +42,7 @@ singleuser:
image:
name: elyra/elyra
# change to a specific release version as appropriate
tag: dev
tag: 3.11.0
# disable this in a production environment
pullPolicy: "Always"
storage:
Expand Down Expand Up @@ -94,7 +94,7 @@ singleuser:
image:
name: elyra/elyra
# change to a specific release version as appropriated
tag: dev
tag: 3.11.0
# disable this in a production environment
pullPolicy: "Always"
storage:
Expand All @@ -112,7 +112,7 @@ required to run elyra, and that could be used to customize your environment with
packages required by your workloads, or any other customizations needed.

```dockerfile
FROM elyra/elyra:dev
FROM elyra/elyra:3.11.0

...

Expand Down
10 changes: 5 additions & 5 deletions docs/source/recipes/running-elyra-in-air-gapped-environment.md
Expand Up @@ -50,11 +50,11 @@ During pipeline execution in the Kubeflow Pipelines or Apache Airflow environmen
- **Container registry**: All pipeline nodes are executed in containers. The runtime environment must be configured to have read access to the registries (e.g. Docker Hub) where the container images are stored that the generic and custom components are referencing.
- **Elyra runtime artifacts**: When processing pipeline nodes that are implemented using [generic components](../user_guide/pipeline-components.html#generic-components), Elyra downloads a few dependencies to the container. By default these dependencies are located in a _release-specific branch_ in the [Elyra GitHub repository](https://github.com/elyra-ai/elyra):
```
https://raw.githubusercontent.com/elyra-ai/elyra/main/etc/kfp/pip.conf
https://raw.githubusercontent.com/elyra-ai/elyra/main/elyra/kfp/bootstrapper.py
https://raw.githubusercontent.com/elyra-ai/elyra/main/elyra/airflow/bootstrapper.py
https://raw.githubusercontent.com/elyra-ai/elyra/main/etc/generic/requirements-elyra-py37.txt
https://raw.githubusercontent.com/elyra-ai/elyra/main/etc/generic/requirements-elyra.txt
https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/etc/kfp/pip.conf
https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/elyra/kfp/bootstrapper.py
https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/elyra/airflow/bootstrapper.py
https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/etc/generic/requirements-elyra-py37.txt
https://raw.githubusercontent.com/elyra-ai/elyra/v3.11.0/etc/generic/requirements-elyra.txt
```
In air-gapped environments you must store a copy of these files in a location that is accessible via an anonymous HTTP `GET` request and configure the following environment variables _in the environment where JupyterLab is running_:
- For Kubeflow Pipelines:
Expand Down
Expand Up @@ -29,7 +29,7 @@ In this example we will show how to launch Elyra using [Kubeflow's Notebook Serv

OR

Create a custom Elyra container image following the [instructions in this directory](https://github.com/elyra-ai/elyra/tree/main/etc/docker/kubeflow).
Create a custom Elyra container image following the [instructions in this directory](https://github.com/elyra-ai/elyra/tree/3.11.0/etc/docker/kubeflow).

## Launching Elyra in the Kubeflow Notebook Server
1. In the default Kubeflow welcome page, in the left side menu, click on `Notebook Servers`
Expand Down
2 changes: 1 addition & 1 deletion docs/source/user_guide/jupyterlab-interface.md
Expand Up @@ -24,7 +24,7 @@ Many of these tasks can also be accomplished using the [Elyra command line inter

### Launcher

Elyra adds a new category to the JupyterLab launcher, providing access to the Visual Pipeline Editor, the [Python editor](enhanced-script-support.html#python-script-execution-support), the [R editor](enhanced-script-support.html#r-script-execution-support), and the [Elyra documentation](https://elyra.readthedocs.io/en/latest/).
Elyra adds a new category to the JupyterLab launcher, providing access to the Visual Pipeline Editor, the [Python editor](enhanced-script-support.html#python-script-execution-support), the [R editor](enhanced-script-support.html#r-script-execution-support), and the [Elyra documentation](https://elyra.readthedocs.io/en/v3.11.0/).

![Elyra category in JupyterLab launcher](../images/user_guide/jupyterlab-interface/launcher.png)

Expand Down
2 changes: 1 addition & 1 deletion elyra/_version.py
Expand Up @@ -13,4 +13,4 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
__version__ = "3.12.0.dev0"
__version__ = "3.11.0"
2 changes: 1 addition & 1 deletion elyra/cli/pipeline_app.py
Expand Up @@ -286,7 +286,7 @@ def pipeline():
Run Elyra pipelines in your local environment or submit them to an external service,
such as Kubeflow Pipelines or Apache Airflow.
Find more information at: https://elyra.readthedocs.io/en/latest/
Find more information at: https://elyra.readthedocs.io/en/v3.11.0/
"""
pass

Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/metadata_app_utils.py
Expand Up @@ -640,7 +640,7 @@ def print_subcommands(self):
print("-----------")
print("Subcommands are launched as `elyra-metadata cmd [args]`. For information on")
print("using subcommand 'cmd', run: `elyra-metadata cmd -h` or `elyra-metadata cmd --help`.")
print("\nFind more information at https://elyra.readthedocs.io/en/latest/")
print("\nFind more information at https://elyra.readthedocs.io/en/v3.11.0/")
print()
for subcommand, desc in self.subcommands.items():
print(f"{subcommand:<10}{desc[1]:>10}")
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/airflow.json
Expand Up @@ -10,7 +10,7 @@
"uihints": {
"title": "Apache Airflow runtimes",
"icon": "elyra:runtimes",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/runtime-conf.html"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/runtime-conf.html"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/code-snippet.json
Expand Up @@ -8,7 +8,7 @@
"uihints": {
"title": "Code Snippets",
"icon": "elyra:code-snippet",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/code-snippets.html"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/code-snippets.html"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/kfp.json
Expand Up @@ -10,7 +10,7 @@
"uihints": {
"title": "Kubeflow Pipelines runtimes",
"icon": "elyra:runtimes",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/runtime-conf.html"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/runtime-conf.html"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/local-directory-catalog.json
Expand Up @@ -9,7 +9,7 @@
"metadata_class_name": "elyra.pipeline.component_metadata.DirectoryCatalogMetadata",
"uihints": {
"icon": "",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/pipeline-components.html#directory-component-catalog"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/pipeline-components.html#directory-component-catalog"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/local-file-catalog.json
Expand Up @@ -9,7 +9,7 @@
"metadata_class_name": "elyra.pipeline.component_metadata.FilenameCatalogMetadata",
"uihints": {
"icon": "",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/pipeline-components.html#filesystem-component-catalog"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/pipeline-components.html#filesystem-component-catalog"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/runtime-image.json
Expand Up @@ -8,7 +8,7 @@
"uihints": {
"icon": "elyra:container",
"title": "Runtime Images",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/runtime-image-conf.html"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/runtime-image-conf.html"
},
"properties": {
"schema_name": {
Expand Down
2 changes: 1 addition & 1 deletion elyra/metadata/schemas/url-catalog.json
Expand Up @@ -9,7 +9,7 @@
"metadata_class_name": "elyra.pipeline.component_metadata.UrlCatalogMetadata",
"uihints": {
"icon": "",
"reference_url": "https://elyra.readthedocs.io/en/latest/user_guide/pipeline-components.html#url-component-catalog"
"reference_url": "https://elyra.readthedocs.io/en/v3.11.0/user_guide/pipeline-components.html#url-component-catalog"
},
"properties": {
"schema_name": {
Expand Down
11 changes: 8 additions & 3 deletions lerna.json
@@ -1,12 +1,17 @@
{
"version": "3.12.0-dev",
"version": "3.11.0",
"npmClient": "yarn",
"useWorkspaces": true,
"command": {
"publish": {
"ignoreChanges": ["ignored-file", "*.md"],
"ignoreChanges": [
"ignored-file",
"*.md"
],
"message": "chore(release): publish"
}
},
"packages": ["packages/*"]
"packages": [
"packages/*"
]
}
2 changes: 1 addition & 1 deletion package.json
@@ -1,6 +1,6 @@
{
"name": "elyra",
"version": "3.12.0-dev",
"version": "3.11.0",
"private": true,
"workspaces": {
"packages": [
Expand Down
8 changes: 4 additions & 4 deletions packages/code-snippet/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/code-snippet-extension",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab extension - Reusable code snippets for your Notebook and Python Scripts",
"keywords": [
"jupyter",
Expand Down Expand Up @@ -43,9 +43,9 @@
"unlink:dev": "yarn unlink @jupyterlab/builder"
},
"dependencies": {
"@elyra/metadata-common": "3.12.0-dev",
"@elyra/services": "3.12.0-dev",
"@elyra/ui-components": "3.12.0-dev",
"@elyra/metadata-common": "3.11.0",
"@elyra/services": "3.11.0",
"@elyra/ui-components": "3.11.0",
"@jupyterlab/application": "^3.4.0",
"@jupyterlab/apputils": "^3.4.0",
"@jupyterlab/builder": "^3.4.0",
Expand Down
2 changes: 1 addition & 1 deletion packages/code-viewer/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/code-viewer-extension",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab extension - Display code without a file",
"keywords": [
"jupyter",
Expand Down
6 changes: 3 additions & 3 deletions packages/metadata-common/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/metadata-common",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab - Widgets for interacting with metadata",
"keywords": [
"jupyter",
Expand Down Expand Up @@ -33,8 +33,8 @@
"lab:uninstall": "jupyter labextension unlink --no-build"
},
"dependencies": {
"@elyra/services": "3.12.0-dev",
"@elyra/ui-components": "3.12.0-dev",
"@elyra/services": "3.11.0",
"@elyra/ui-components": "3.11.0",
"@jupyterlab/application": "^3.4.0",
"@jupyterlab/apputils": "^3.4.0",
"@jupyterlab/codeeditor": "^3.4.0",
Expand Down
6 changes: 3 additions & 3 deletions packages/metadata/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/metadata-extension",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab extension - View and edit metadata",
"keywords": [
"jupyter",
Expand Down Expand Up @@ -43,8 +43,8 @@
"unlink:dev": "yarn unlink @jupyterlab/builder"
},
"dependencies": {
"@elyra/metadata-common": "3.12.0-dev",
"@elyra/services": "3.12.0-dev",
"@elyra/metadata-common": "3.11.0",
"@elyra/services": "3.11.0",
"@jupyterlab/application": "^3.4.0",
"@jupyterlab/apputils": "^3.4.0",
"@jupyterlab/builder": "^3.4.0",
Expand Down
8 changes: 4 additions & 4 deletions packages/pipeline-editor/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/pipeline-editor-extension",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab extension - Visual editor to build Notebook pipelines",
"keywords": [
"jupyter",
Expand Down Expand Up @@ -45,11 +45,11 @@
"unlink:dev": "yarn unlink @jupyterlab/builder"
},
"dependencies": {
"@elyra/metadata-common": "3.12.0-dev",
"@elyra/metadata-common": "3.11.0",
"@elyra/pipeline-editor": "~1.9.0",
"@elyra/pipeline-services": "~1.9.0",
"@elyra/services": "3.12.0-dev",
"@elyra/ui-components": "3.12.0-dev",
"@elyra/services": "3.11.0",
"@elyra/ui-components": "3.11.0",
"@jupyterlab/application": "^3.4.0",
"@jupyterlab/apputils": "^3.4.0",
"@jupyterlab/builder": "^3.4.0",
Expand Down
2 changes: 1 addition & 1 deletion packages/pipeline-editor/src/EmptyPipelineContent.tsx
Expand Up @@ -70,7 +70,7 @@ export const EmptyPlatformSpecificPipeline: React.FC<IEmptyPlatformSpecificPipel
// Note: the URL is rewritten by the release script by replacing `latest` with a
// specific version number, e.g. https://.../en/v3.6.0/user_guide/pi...
const customComponentsHelpTopicURL =
'https://elyra.readthedocs.io/en/latest/user_guide/pipeline-components.html';
'https://elyra.readthedocs.io/en/v3.11.0/user_guide/pipeline-components.html';

return (
<div>
Expand Down
4 changes: 2 additions & 2 deletions packages/pipeline-editor/src/PipelineEditorWidget.tsx
Expand Up @@ -380,7 +380,7 @@ const PipelineWrapper: React.FC<IProps> = ({
enabled in your environment. Complete the setup
instructions in{' '}
<a
href="https://elyra.readthedocs.io/en/latest/user_guide/pipeline-components.html#example-custom-components"
href="https://elyra.readthedocs.io/en/v3.11.0/user_guide/pipeline-components.html#example-custom-components"
target="_blank"
rel="noreferrer"
>
Expand Down Expand Up @@ -532,7 +532,7 @@ const PipelineWrapper: React.FC<IProps> = ({
<br />
<br />
<a
href="https://elyra.readthedocs.io/en/latest/user_guide/best-practices-custom-pipeline-components.html#troubleshooting-missing-pipeline-components"
href="https://elyra.readthedocs.io/en/v3.11.0/user_guide/best-practices-custom-pipeline-components.html#troubleshooting-missing-pipeline-components"
target="_blank"
rel="noreferrer"
>
Expand Down
6 changes: 3 additions & 3 deletions packages/python-editor/package.json
@@ -1,6 +1,6 @@
{
"name": "@elyra/python-editor-extension",
"version": "3.12.0-dev",
"version": "3.11.0",
"description": "JupyterLab extension - Run python scripts using a kernel runtime",
"keywords": [
"jupyter",
Expand Down Expand Up @@ -43,8 +43,8 @@
"unlink:dev": "yarn unlink @jupyterlab/builder"
},
"dependencies": {
"@elyra/script-editor": "3.12.0-dev",
"@elyra/ui-components": "3.12.0-dev",
"@elyra/script-editor": "3.11.0",
"@elyra/ui-components": "3.11.0",
"@jupyterlab/application": "^3.4.0",
"@jupyterlab/apputils": "^3.4.0",
"@jupyterlab/codeeditor": "^3.4.0",
Expand Down

0 comments on commit e6eda40

Please sign in to comment.