Skip to content

Wikibase CI failures due to retired test Wikibase instance #7589

New issue
New issue
Open
Bug
Open
Wikibase CI failures due to retired test Wikibase instance#7589
Bug
Assignees
tfmorris
Labels
CI/CDContinuous Integration/Continuous DeploymentmaintainabilityMaking it easier to maintain OpenRefinewikibaseRelated to wikidata/wikibase integration

Description

@tfmorris
tfmorris
opened on Dec 18, 2025

Two recent unrelated PRs which were submitted at the same time failed at the same place in the Wikibase tests with the same errors, which makes me suspect that the tests depend on the live site being available (and that it wasn't available for some reason).

If this is a rare occurrence, it's probably easier to just live with it, but logging the error just in case it reoccurs.

Current Results

The following errors were logged for both failed runs:

  cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance, general navigation: 
  ✓ cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance, general navigation: 1282ms
    cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (URL): 
  1) cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (URL)
    cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (JSON Manifest copy-pasted in the textarea): 
  ✓ cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (JSON Manifest copy-pasted in the textarea): 1341ms
    cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (Invalid manifest provided): 
  ✓ cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Add a wikibase instance (Invalid manifest provided): 1683ms
    cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Delete wikibase: 
  2) cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js Delete wikibase

  3 passing (17s)
  2 failing

  1) cypress/e2e/extensions/wikibase/select_wikibase_instance.cy.js
       Add a wikibase instance (URL):
     Error: The following error originated from your application code, not from Cypress.

  > Script error.

Cypress detected that an uncaught error was thrown from a cross origin script.

We cannot provide you the stack trace, line number, or file where this error occurred.

Check your Developer Tools Console for the actual error - it should be printed there.

The two numbered tests are the failing ones (they are in red in the original log).

Expected Behavior

CI tests run whether or not network/live site is available.

Screenshots

Additional context

The URL being accessed by both tests is:
https://raw.githubusercontent.com/OpenRefine/wikibase-manifests/master/openrefine-wikibase-test-manifest.json

Activity

  1. tfmorris
    added
    Type: BugIssues related to software defects or unexpected behavior, which require resolution.
    Status: Pending ReviewIndicates that the issue or pull request is awaiting review by project maintainers or collaborators
    wikibaseRelated to wikidata/wikibase integration
    CI/CDContinuous Integration/Continuous Deployment
    on Dec 18, 2025

  2. tfmorris commented on Dec 18, 2025

    @tfmorris
    tfmorris
    on Dec 18, 2025
    MemberAuthor

    Looking at the tests, both of them use the URL
    'https://raw.githubusercontent.com/OpenRefine/wikibase-manifests/master/openrefine-wikibase-test-manifest.json'
    which would seem to indicate some kind of problem with the internal Github raw content serving, so I'm going to ignore this.

  3. tfmorris
    closed this as not plannedon Dec 18, 2025
  4. tfmorris
    removed
    Status: Pending ReviewIndicates that the issue or pull request is awaiting review by project maintainers or collaborators
    on Dec 18, 2025

  5. tfmorris commented on Dec 19, 2025

    @tfmorris
    tfmorris
    on Dec 19, 2025
    MemberAuthor

    It failed twice again today, so I guess it wasn't a unique failure.
    https://github.com/OpenRefine/OpenRefine/actions/runs/20383781519/attempts/2

  6. tfmorris
    reopened this on Dec 19, 2025
  7. tfmorris
    changed the title [-]Wikibase CI depends on live site?[/-] [+]Wikibase CI failures using Github user content URL[/+] on Dec 19, 2025
  8. SoryRawyer
    self-assigned this
    on Jan 5, 2026
  9. SoryRawyer
    added
    maintainabilityMaking it easier to maintain OpenRefine
    on Jan 5, 2026
  10. SoryRawyer
    removed their assignment
    on Jan 5, 2026

  11. SoryRawyer commented on Jan 5, 2026

    @SoryRawyer
    SoryRawyer
    on Jan 5, 2026
    Member

    After looking into this a little bit, I think the issues are coming from the reconciliation endpoint in that manifest: https://or-wikibase-test.reconci.link/en/api (I think the default language in the automated tests is English). Following that site led me to this repo, which was archived a few months ago: https://github.com/wetneb/openrefine-wikibase

    Before following that trail further to the new repository, I was hoping @wetneb could elaborate on how these tests were set up and what use that reconciliation endpoint was originally supposed to serve.

  12. tfmorris commented on Jan 6, 2026

    @tfmorris
    tfmorris
    on Jan 6, 2026
    MemberAuthor

    I think the source code repos are distinct from the deployed services. The code that was used to deploy the production Wikidata reconciliation service was from the original repo.

    I haven't dug in to the tests, but if they require access to a live reconciliation service (perhaps as a side effect of parsing the manifest?), that's probably a dependency that we should look at removing, although the urgency isn't high as long as the failures remain rare (I haven't seen a failure in the last few weeks, but CI activity has also been low).

  13. SoryRawyer commented on Jan 20, 2026

    @SoryRawyer
    SoryRawyer
    on Jan 20, 2026
    Member

    I think this is becoming a consistent issue. I'll take a look at resolving the issue while still testing this code path.

  14. SoryRawyer
    self-assigned this
    on Jan 20, 2026

  15. tfmorris commented on Jan 21, 2026

    @tfmorris
    tfmorris
    on Jan 21, 2026
    MemberAuthor

    It looks like the test reconciliation service was deployed back in 2020 on WBStack.com, which has since been sunsetted. It's possible that the intermittent failures, which have now become hard failure, were part of their turndown process.

    The link is currently returning "No available server." https://or-wikibase-test.reconci.link/

    There are also some references to https://or-wikibase-test.wiki.opencura.com, but I'm not sure if that's an alias for the host above or a separate instance.

    The replacement for WBStack.com is apparently wikibase.cloud, but we may want to look at something mocked or Docker hosted for better isolation.

  16. tfmorris
    changed the title [-]Wikibase CI failures using Github user content URL[/-] [+]Wikibase CI failures due to retired test reconciliation service[/+] on Jan 22, 2026

  17. tfmorris commented on Jan 22, 2026

    @tfmorris
    tfmorris
    on Jan 22, 2026
    MemberAuthor

    opencura.com was the domain used to host free subdomains for WBstack. It's registration has expired and it's now owned by squatters.

    or-wikibase-test.reconci.link/ is hosted on the same infrastructure as the primary Wikidata reconciliation service and may still be live (but pointing at a Wikibase instance which no longer exists).

    This document describes the original manual testing, from which some of the Wikibase test instance setup can be inferred.

    The domain or-wikibase-test.wikibase.cloud is reserved, but has no wiki hosted there, so it may have been (partially?) migrated. I've got queries out to the WBstack developer and WMDE (for wikibase.cloud) to try and figure out the status.

    For now, I'm going to disable the tests so that we can get CI working again.

  18. tfmorris
    self-assigned this
    on Jan 22, 2026
  19. tfmorris
    added a commit that references this issue on Jan 22, 2026

    Disable Wikibase reconciliation tests. Refs OpenRefine#7589

    78dc7e5
  20. SoryRawyer
    removed their assignment
    on Jan 22, 2026

  21. SoryRawyer commented on Jan 22, 2026

    @SoryRawyer
    SoryRawyer
    on Jan 22, 2026
    Member

    Thanks for the context! I'll unassign myself for now.

  22. tfmorris commented on Jan 22, 2026

    @tfmorris
    tfmorris
    on Jan 22, 2026
    MemberAuthor

    @SoryRawyer would you be able to review #7617 as a last contribution to this? It's just a stopgap while we work on a more permanent solution.

  23. tfmorris
    added a commit that references this issue on Jan 23, 2026

    Disable Wikibase reconciliation tests. Refs #7589

    e465dd9
  24. tfmorris
    changed the title [-]Wikibase CI failures due to retired test reconciliation service[/-] [+]Wikibase CI failures due to retired test Wikibase instance[/+] on Jan 27, 2026
  25. SoryRawyer
    added a commit that references this issue on Feb 10, 2026

    Disable Wikibase reconciliation tests. Refs #7589

    4ac3eba
  26. tfmorris
    added the
    Bug
    issue type on Oct 13, 2026
  27. tfmorris
    removed
    Type: BugIssues related to software defects or unexpected behavior, which require resolution.
    on Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

CI/CDContinuous Integration/Continuous DeploymentmaintainabilityMaking it easier to maintain OpenRefinewikibaseRelated to wikidata/wikibase integration

Type

Bug

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions