Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: pin Firefox version temporarily to 134 until artifacts `tar.bz2… #30126

Merged
merged 1 commit into from
Feb 5, 2025

Conversation

seaona
Copy link
Contributor

@seaona seaona commented Feb 5, 2025

…` are available again (or a fix is provided) (#30112)

Description

Firefox specs started failing with the error:

<failure message="Unable to obtain browser driver.
        For more information on how to install drivers see
        https://www.selenium.dev/documentation/webdriver/troubleshooting/errors/driver_location/. Error: Error executing command for /home/circleci/project/node_modules/selenium-webdriver/bin/linux/selenium-manager with --browser,firefox,--output,json,--browser-path,/opt/firefox/firefox: Unsuccessful response (404 Not Found) for URL https://ftp.mozilla.org/pub/firefox/releases/135.0/linux-x86_64/en-US/firefox-135.0.tar.bz2
  (Ran on CircleCI Node 0 of 24, Job test-e2e-firefox)" type="Error"><![CDATA[Error: Unable to obtain browser driver.

The problem is that the artifact ending with tar.bz2 is not in present in the version 135.0, whereas it was always in previous versions, which we relied on.

https://ftp.mozilla.org/pub/firefox/releases/135.0/linux-x86_64/en-US/

image

From @itsyoboieltr :
It seems like firefox changed the way their releases work, so selenium cannot get the tar.

Context:
https://consensys.slack.com/archives/CTQAGKY5V/p1738664570174839

Open in GitHub Codespaces

Related issues

Fixes:

Manual testing steps

I re-enabled FF specs and tested this in another
branch
:

  1. Check ci, how FF tests started running normally here

I canceled the job once I saw that the browser was successfully downloaded and specs started running

Screenshots/Recordings

Screenshot from 2025-02-05 08-23-28

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

Description

Open in GitHub Codespaces

Related issues

Fixes:

Manual testing steps

  1. Go to this page...

Screenshots/Recordings

Before

After

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

…` are available again (or a fix is provided) (#30112)

<!--
Please submit this PR as a draft initially.
Do not mark it as "Ready for review" until the template has been
completely filled out, and PR status checks have passed at least once.
-->

## **Description**

<!--
Write a short description of the changes included in this pull request,
also include relevant motivation and context. Have in mind the following
questions:
1. What is the reason for the change?
2. What is the improvement/solution?
-->
Firefox specs started failing with the error:

```
<failure message="Unable to obtain browser driver.
        For more information on how to install drivers see
        https://www.selenium.dev/documentation/webdriver/troubleshooting/errors/driver_location/. Error: Error executing command for /home/circleci/project/node_modules/selenium-webdriver/bin/linux/selenium-manager with --browser,firefox,--output,json,--browser-path,/opt/firefox/firefox: Unsuccessful response (404 Not Found) for URL https://ftp.mozilla.org/pub/firefox/releases/135.0/linux-x86_64/en-US/firefox-135.0.tar.bz2
  (Ran on CircleCI Node 0 of 24, Job test-e2e-firefox)" type="Error"><![CDATA[Error: Unable to obtain browser driver.
```
The problem is that the artifact ending with `tar.bz2` is not in present
in the version 135.0, whereas it was always in previous versions, which
we relied on.

https://ftp.mozilla.org/pub/firefox/releases/135.0/linux-x86_64/en-US/


![image](https://github.com/user-attachments/assets/e4f4166d-b703-4bf6-a979-d1d3aca2347c)



From @itsyoboieltr :
`It seems like firefox changed the way their releases work, so selenium
cannot get the tar.`

Context:
https://consensys.slack.com/archives/CTQAGKY5V/p1738664570174839

[![Open in GitHub
Codespaces](https://github.com/codespaces/badge.svg)](https://codespaces.new/MetaMask/metamask-extension/pull/30112?quickstart=1)

## **Related issues**

Fixes:

## **Manual testing steps**
I re-enabled FF specs and tested this in [another
branch](#30122):

1. Check ci, how FF tests started running normally
[here](https://app.circleci.com/pipelines/github/MetaMask/metamask-extension/122355/workflows/f1806a6c-b9ef-4a27-8291-fc6c71f0c519/jobs/4518553)

I canceled the job once I saw that the browser was successfully
downloaded and specs started running


## **Screenshots/Recordings**

![Screenshot from 2025-02-05
08-23-28](https://github.com/user-attachments/assets/f1d65d15-218e-4db2-a34c-327ce6f5dfdb)

## **Pre-merge author checklist**

- [x] I've followed [MetaMask Contributor
Docs](https://github.com/MetaMask/contributor-docs) and [MetaMask
Extension Coding
Standards](https://github.com/MetaMask/metamask-extension/blob/main/.github/guidelines/CODING_GUIDELINES.md).
- [x] I've completed the PR template to the best of my ability
- [x] I’ve included tests if applicable
- [x] I’ve documented my code using [JSDoc](https://jsdoc.app/) format
if applicable
- [x] I’ve applied the right labels on the PR (see [labeling
guidelines](https://github.com/MetaMask/metamask-extension/blob/main/.github/guidelines/LABELING_GUIDELINES.md)).
Not required for external contributors.

## **Pre-merge reviewer checklist**

- [ ] I've manually tested the PR (e.g. pull and build branch, run the
app, test code being changed).
- [ ] I confirm that this PR addresses all acceptance criteria described
in the ticket it closes and includes the necessary testing evidence such
as recordings and or screenshots.
Copy link
Contributor

github-actions bot commented Feb 5, 2025

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@metamaskbot metamaskbot added the team-qa QA team label Feb 5, 2025
@seaona seaona marked this pull request as ready for review February 5, 2025 10:14
@danjm danjm merged commit df5ac4e into Version-v12.10.4 Feb 5, 2025
62 of 64 checks passed
@danjm danjm deleted the cherry-pick-ff-v12.10.4 branch February 5, 2025 10:31
@github-actions github-actions bot locked and limited conversation to collaborators Feb 5, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
team-qa QA team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants