-
-
Notifications
You must be signed in to change notification settings - Fork 267
Update preview build instructions #7588
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
a1327e2
dc85193
9d711b6
a04b461
bc09a6a
5463653
b094486
4196732
fa249f4
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,41 @@ | ||
| # Using local builds | ||
|
|
||
| If you are unable to use [preview builds](./preview-builds.md) for testing, you can always build a package locally and link it to a project. | ||
|
|
||
| 1. First, build the monorepo by running `yarn build`. | ||
|
|
||
| 2. In the project, open `package.json` and locate the entry in `dependencies` for the package you want to test. | ||
|
|
||
| 3. Replace the version range in the right-hand side of the entry to point to the local build: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>@<VERSION_RANGE>": "file:<PATH_TO_CORE>/packages/<PACKAGE_NAME>" | ||
| ``` | ||
|
|
||
| where: | ||
|
|
||
| - `PACKAGE_NAME` is the name of your package | ||
| - `VERSION_RANGE` is the version range of your package being used in production, usually starting with `^` | ||
| - `PATH_TO_MONOREPO` is the local path to the clone of this monorepo | ||
|
|
||
| 4. Run `yarn install`. (Note that due to the use of Yarn's `file:` protocol, you'll need to repeat this step each time you update the package in the monorepo.) | ||
|
|
||
| > **Example:** | ||
| > | ||
| > Given: | ||
| > | ||
| > - You have changes to `@metamask/controller-utils` you want to test | ||
| > - `@metamask/controller-utils` is listed at `^1.1.4` | ||
| > - You've cloned this repo next to the project | ||
| > | ||
| > In this case, you would go to `dependencies` and replace the line: | ||
| > | ||
| > ```json | ||
| > "@metamask/controller-utils": "^1.1.4" | ||
| > ``` | ||
| > | ||
| > with: | ||
| > | ||
| > ```json | ||
| > "@metamask/controller-utils@^1.1.4": "file:../core/packages/controller-utils" | ||
| > ``` | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,268 @@ | ||
| # Publishing and using preview builds | ||
|
|
||
| Preview builds are pre-production versions of packages. Unlike [local builds](./local-builds.md), they are published to NPM (albeit under a separate NPM namespace) and can therefore be treated the same way as production releases in CI. Because of this, we recommend using preview builds for testing. | ||
|
|
||
| Generally, when working with preview builds, you will follow this process: | ||
|
|
||
| 1. Create a branch in your clone of this repo | ||
| 2. Work on changes to your package(s) | ||
| 3. [Publish preview builds](#publishing-preview-builds) | ||
| 4. Switch to the project and [configure it to use the new preview builds](#using-preview-builds) | ||
| 5. Repeat steps 2-4 as necessary | ||
|
|
||
| ## Publishing preview builds | ||
|
|
||
| To publish preview builds: | ||
|
|
||
| 1. Create a pull request with the changes to your package(s). | ||
| 2. Post a comment on the pull request with the text `@metamaskbot publish-previews`. The `publish-preview` GitHub action will kick off to generate and publish preview builds for all packages in the monorepo. | ||
| 3. After a few minutes, you will see a new comment that lists the newly published packages along with their versions. | ||
|
|
||
| <details><summary><b>Publishing preview builds as an independent contributor</b></summary> | ||
| <br/> | ||
| Note that the steps above will only work if you are a member of the MetaMask engineering team on GitHub. If you are not, you'll need to follow some different steps: | ||
|
|
||
| 1. First, you'll need access to an NPM organization under which the preview builds will be published. If you have not already done so, you can either [create a new organization](https://www.npmjs.com/org/create) or [convert your existing username into an organization](https://www.npmjs.com/org/upgrade). | ||
| 2. Open the `package.json` for each package that you want to publish, and change the NPM scope in the package's name from `@metamask` to reflect your NPM organization. | ||
| 3. Run the following command to create and publish preview builds for all packages in the monorepo (replacing `NPM_ORG` as appropriate): | ||
|
|
||
| ```bash | ||
| yarn prepare-preview-builds "@<NPM_ORG>" "$(git rev-parse --short HEAD)" | ||
| yarn build | ||
| yarn publish-previews | ||
| ``` | ||
|
|
||
| You will see a list of the newly published packages along with their versions. | ||
| </details> | ||
|
|
||
| ## Using preview builds | ||
|
|
||
| To simulate production as best as possible, there are two different paths to take depending on whether you anticipate making breaking or non-breaking changes to the package you want to test. | ||
|
|
||
| ### Testing non-breaking changes to a package | ||
|
|
||
| If you're in a MetaMask client repo (e.g. `metamask-extension` or `metamask-mobile`): | ||
|
|
||
| 1. Open `package.json` and locate the `previewBuilds` section. If it doesn't exist, then add it (it should be an object). | ||
| 2. Within `previewBuilds`, add an entry that looks like this: | ||
|
|
||
| ``` | ||
| "<name-of-package>": { | ||
| "type": "non-breaking", | ||
| "previewVersion": "<preview-version>" | ||
| } | ||
| ``` | ||
|
|
||
| For example: | ||
|
|
||
| ``` | ||
| "@metamask/permission-controller": { | ||
| "type": "non-breaking", | ||
| "previewVersion": "13.0.2-preview-940c934" | ||
| } | ||
| ``` | ||
|
|
||
| 3. Run `yarn install`. You're now using the preview build. | ||
|
|
||
| <details> | ||
| <summary><strong>Manual steps</strong></summary> | ||
|
|
||
| 1. In the project, open `package.json` and locate the entry in `dependencies` for the package. Take note of the major part of the version. | ||
|
|
||
| - Note that the dependency may be patched. Patched dependencies look like this: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>": "patch:@metamask/<PACKAGE_NAME>@npm:<ESCAPED_VERSION_RANGE>#~/.yarn/patches/<PATCH_NAME>.patch" | ||
| ``` | ||
|
|
||
| where: | ||
|
|
||
| - `PACKAGE_NAME` is the name of the package. | ||
| - `ESCAPED_VERSION_RANGE` is the version range, but where characters like `^` are escaped (for instance, `^` will appear as `%3A`). | ||
| - `PATCH_NAME` is the filename for a patch. It is usually dash-separated, starts with the package name, and ends with the commit ID from which the patch was created. | ||
|
|
||
| In this case the major version you are targeting will come from `ESCAPED_VERSION_RANGE`. | ||
|
|
||
| 2. Run `yarn why @metamask/<PACKAGE_NAME>`, replacing `PACKAGE_NAME` as appropriate. You will see output like this: | ||
|
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This is a new process that I'm introducing in this PR. The previous process recommended that the engineer look at the existing dependency entry and target whatever version range was used there. Now I'm recommended that all version ranges in the dependency tree that are compatible with the one used in the dependency tree are targeted. As I mention at the top of this section, this is to mimic production as close as possible. So on one hand, it's more accurate. On the other hand, it's more steps that before. Do we have any thoughts on this? It would nice if we could automate this somehow, but I'm not sure how to do that yet. |
||
|
|
||
| ``` | ||
| ├─ @metamask/parent-controller-1@npm:93.1.0 | ||
| │ └─ @metamask/my-controller@npm:12.1.1 (via npm:^12.1.1) | ||
| │ | ||
| ├─ @metamask/parent-controller-2@npm:94.1.0 | ||
| │ └─ @metamask/my-controller@npm:12.1.1 (via npm:^12.1.1) | ||
| │ | ||
| ├─ @metamask/parent-controller-3@npm:94.1.0 [abc9d] | ||
| │ └─ @metamask/my-controller@npm:12.1.1 [57677] (via npm:^12.1.1 [15228]) | ||
| ... | ||
| │ | ||
| └─ metamask@workspace:. | ||
| └─ @metamask/my-controller@npm:12.1.1 [57677] (via npm:^12.1.0 [abc9d]) | ||
| ``` | ||
|
|
||
| Take note of all the version ranges that match the major version you saw earlier (here, we are looking for all version ranges that start with `^12`). | ||
|
|
||
| 3. Back in `package.json`, locate the `resolutions` section. If it doesn't exist, then add it (it should be an object). | ||
|
|
||
| 4. For each version range, add a new entry that looks like this: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>@<VERSION_RANGE>": "npm:@<NPM_ORG>/<PACKAGE_NAME>@<PREVIEW_VERSION>" | ||
| ``` | ||
|
|
||
| where: | ||
|
|
||
| - `PACKAGE_NAME` is the name of your package | ||
| - `VERSION_RANGE` is one of the version ranges you noted in step 2 | ||
| - `NPM_ORG` is the NPM scope that the preview build is published under (note: this is _not_ `@metamask`) | ||
| - `PREVIEW_VERSION` is the version string of the preview build (note: this should _not_ start with `^`) | ||
|
|
||
| Note that if the dependency was patched as in step 1, you may have a resolution already. You'll want to replace the existing resolution while keeping the existing patch. Your entry will look more like: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>@<VERSION_RANGE>": "patch:@<NPM_ORG>/<PACKAGE_NAME>@npm:<ESCAPED_PREVIEW_VERSION>#~/.yarn/patches/<PATCH_NAME>.patch" | ||
| ``` | ||
|
|
||
| 5. Run `yarn install` to apply the changes. | ||
|
|
||
| 6. Run `yarn why @metamask/<PACKAGE_NAME>` again to confirm that all of the instances of the package you saw when you ran this command earlier are now using your preview build. | ||
|
|
||
| > **Example 1 (non-patched dependency):** | ||
| > | ||
| > - You have non-breaking changes to `@metamask/controller-utils` you want to test | ||
| > - `@metamask/controller-utils` is listed at `^1.1.4`, and `yarn why` reveals that `^1.0.1` and `^1.1.3` are also being used as version ranges in the dependency tree | ||
| > - You want to use the preview version `1.1.4-preview-e2df9b4` | ||
| > | ||
| > In this case, you would go to `resolutions` and add these lines: | ||
| > | ||
| > ```json | ||
| > "@metamask/controller-utils@^1.0.1": "npm:@metamask-previews/controller-utils@1.1.4-preview-e2df9b4", | ||
| > "@metamask/controller-utils@^1.1.3": "npm:@metamask-previews/controller-utils@1.1.4-preview-e2df9b4", | ||
| > "@metamask/controller-utils@^1.1.4": "npm:@metamask-previews/controller-utils@1.1.4-preview-e2df9b4", | ||
| > ``` | ||
|
|
||
| > **Example 2 (patched dependency):** | ||
| > | ||
| > - You have non-breaking changes to `@metamask/controller-utils` you want to test | ||
| > - `@metamask/controller-utils` is listed at `^1.1.4`, and `yarn why` reveals that `^1.0.1` and `^1.1.3` are also being used as version ranges in the dependency tree | ||
| > - The dependency entry looks like this: | ||
| > ```json | ||
| > "@metamask/controller-utils": "patch:@metamask/controller-utils@npm%3A1.1.4#~/.yarn/patches/@metamask-controller-utils-npm-1.1.4-cccac388c7.patch" | ||
| > ``` | ||
| > - A resolution entry also exists which looks like this: | ||
| > ```json | ||
| > "@metamask/controller-utils@npm:^1.1.4": "patch:@metamask/controller-utils@npm%3A1.1.4#~/.yarn/patches/@metamask-controller-utils-npm-1.1.4-cccac388c7.patch" | ||
| > ``` | ||
| > - You want to use the preview version `1.1.4-preview-e2df9b4` | ||
| > | ||
| > In this case, you would go to `resolutions`, _remove_ the existing entry, and add these new entries: | ||
| > | ||
| > ```json | ||
| > "@metamask/controller-utils@^1.0.1": "patch:@metamask-previews/controller-utils@npm%3A1.1.4-preview-e2df9b4#~/.yarn/patches/@metamask-controller-utils-npm-1.1.4-cccac388c7.patch" | ||
| > "@metamask/controller-utils@^1.1.3": "patch:@metamask-previews/controller-utils@npm%3A1.1.4-preview-e2df9b4#~/.yarn/patches/@metamask-controller-utils-npm-1.1.4-cccac388c7.patch" | ||
| > "@metamask/controller-utils@^1.1.4": "patch:@metamask-previews/controller-utils@npm%3A1.1.4-preview-e2df9b4#~/.yarn/patches/@metamask-controller-utils-npm-1.1.4-cccac388c7.patch" | ||
| > ``` | ||
|
|
||
| </details> | ||
|
|
||
| ### Testing breaking changes to a package | ||
|
|
||
| If you're in a MetaMask client repo (e.g. `metamask-extension` or `metamask-mobile`), run: | ||
|
|
||
| 1. Open `package.json` and locate the `previewBuilds` section. If it doesn't exist, then add it (it should be an object). | ||
| 2. Within `previewBuilds`, add an entry that looks like this: | ||
|
|
||
| ``` | ||
| "<name-of-package>": { | ||
| "type": "breaking", | ||
| "previewVersion": "<preview-version>" | ||
| } | ||
| ``` | ||
|
|
||
| For example: | ||
|
|
||
| ``` | ||
| "@metamask/permission-controller": { | ||
| "type": "breaking", | ||
| "previewVersion": "13.0.2-preview-940c934" | ||
| } | ||
| ``` | ||
|
|
||
| 3. Run `yarn install`. You're now using the preview build. | ||
|
|
||
| <details> | ||
| <summary><strong>Manual steps</strong></summary> | ||
|
|
||
| 1. In the project, open `package.json`, and: | ||
|
|
||
| - Note the name of the package. | ||
| - Locate the `resolutions` section. If it doesn't exist, then add it (it should be an object). | ||
| - Check to see if the dependency you're testing is patched. Patched dependencies look like this: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>": "patch:@metamask/<PACKAGE_NAME>@npm:<ESCAPED_VERSION_RANGE>#~/.yarn/patches/<PATCH_NAME>.patch" | ||
| ``` | ||
|
|
||
| where: | ||
|
|
||
| - `PACKAGE_NAME` is the name of the package. | ||
| - `ESCAPED_VERSION_RANGE` is the version range, but where characters like `^` are escaped (for instance, `^` will appear as `%3A`). | ||
| - `PATCH_NAME` is the filename for a patch. It is usually dash-separated, starts with the package name, and ends with the commit ID from which the patch was created. | ||
|
|
||
| 2. Add a new entry to `resolutions` that looks like this: | ||
|
|
||
| ```json | ||
| "<ROOT_PACKAGE_NAME>@workspace:./@metamask/<PACKAGE_NAME>": "npm:@<NPM_ORG>/<PACKAGE_NAME>@<PREVIEW_VERSION>" | ||
| ``` | ||
|
|
||
| where: | ||
|
|
||
| - `ROOT_PACKAGE_NAME` is the value of the `name` field at the top of `package.json` | ||
| - `NPM_ORG` is the NPM scope that the preview build is published under (note: this is _not_ `@metamask`) | ||
| - `PACKAGE_NAME` is the name of your package | ||
| - `PREVIEW_VERSION` is the version string of the preview build (note: this should _not_ start with `^`) | ||
|
|
||
| Note that if the dependency was patched as in step 1, you may have a resolution already. You'll want to replace the existing resolution while keeping the existing patch. Your entry will look more like: | ||
|
|
||
| ```json | ||
| "@metamask/<PACKAGE_NAME>@<VERSION_RANGE>": "patch:@<NPM_ORG>/<PACKAGE_NAME>@npm:<ESCAPED_PREVIEW_VERSION>#~/.yarn/patches/<PATCH_NAME>.patch" | ||
| ``` | ||
|
|
||
| 3. Run `yarn install` to apply the changes. | ||
|
|
||
| > **Example 1 (non-patched dependency):** | ||
| > | ||
| > - You have breaking changes to `@metamask/network-controller` you want to test | ||
| > - The `name` in `package.json` is "my-cool-project" | ||
| > - `@metamask/network-controller` is listed at `^12.4.9` | ||
| > - You want to use the preview version `12.4.9-preview-e2df9b4` | ||
| > | ||
| > In this case, you would go to `resolutions` and add this line: | ||
| > | ||
| > ```json | ||
| > "my-cool-project@workspace:./@metamask/network-controller@^12.4.9": "npm:@metamask-previews/network-controller@12.4.9-preview-e2df9b4", | ||
| > ``` | ||
|
|
||
| > **Example 2 (patched dependency):** | ||
| > | ||
| > - You have breaking changes to `@metamask/network-controller` you want to test | ||
| > - You're in a MetaMask client repo | ||
| > - The `name` in `package.json` is "metamask" | ||
| > - `@metamask/network-controller` is listed at `^12.4.9` | ||
| > - The dependency entry looks like this: | ||
| > ```json | ||
| > "@metamask/network-controller": "patch:@metamask/network-controller@npm%3A12.4.9#~/.yarn/patches/@metamask-network-controller-npm-12.4.9-cccac388c7.patch" | ||
| > ``` | ||
| > - A resolution entry also exists which looks like this: | ||
| > ```json | ||
| > "@metamask/network-controller@npm:^12.4.9": "patch:@metamask/network-controller@npm%3A12.4.9#~/.yarn/patches/@metamask-network-controller-npm-12.4.9-cccac388c7.patch" | ||
| > ``` | ||
| > - You want to use the preview version `12.4.9-preview-e2df9b4` | ||
| > | ||
| > In this case, you would go to `resolutions` and leave the existing one there, but _add_ a new one: | ||
| > | ||
| > ```json | ||
| > "metamask@workspace:./@metamask/network-controller@^12.4.9": "patch:@metamask-previews/network-controller@npm%3A12.4.9-preview-e2df9b4#~/.yarn/patches/@metamask-network-controller-npm-12.4.9-cccac388c7.patch" | ||
| > ``` | ||
|
|
||
| </details> | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think
yarn link -Adoes this as well, did you try that?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yarn link(or, using theportal:protocol) doesn't always work in my experience. Sometimes Yarn will claim that transitive dependencies are incompatible between the package being tested and the project. I've found thatfile:always works, even if it's less convenient.For instance if you run
yarn link -A ../create-release-branchincoreyou get: