Skip to content

Add ADDITIONAL_HF_REPOS config option for Hugging Face repos outside the org#75

Draft
Copilot wants to merge 5 commits intomainfrom
copilot/add-option-for-additional-hf-repos
Draft

Add ADDITIONAL_HF_REPOS config option for Hugging Face repos outside the org#75
Copilot wants to merge 5 commits intomainfrom
copilot/add-option-for-additional-hf-repos

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 16, 2026

Mirrors the existing ADDITIONAL_REPOS (GitHub) pattern for Hugging Face. Each entry specifies the repo ID and its type since HF API endpoints differ by repo type.

Config format

ADDITIONAL_HF_REPOS:
  - repo: "user/dataset-name"
    type: "datasets"
  - repo: "user/model-name"
    type: "models"
  - repo: "user/space-name"
    type: "spaces"

The parameter is optional — defaults to [] when absent from config.yaml.

Changes

  • main.js: In fetchHubItems(), after fetching org items for a given HF type, filters ADDITIONAL_HF_REPOS entries matching that type, deduplicates by item.id, and fetches each additional repo via ${API_BASE_URL}${repoType}/${entry.repo}. Added config validation and module-scope variable.
  • scripts/export-tags.js: Same fetch-and-merge logic so the tag export script picks up tags from additional HF repos.
  • public/config.yaml: New parameter with commented usage examples.
  • README.md: Documented ADDITIONAL_HF_REPOS alongside ADDITIONAL_REPOS.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • https://api.github.com/orgs/imageomics/repos
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/Imageomics/Fish-Vista/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/Imageomics/docker-workshop/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/Imageomics/phylonn/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/Imageomics/telemetry-dashboard/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/ixlab/vidformer/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)
  • https://api.github.com/repos/jennamk14/autonomous_drone_simulator/releases/latest
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node node scripts/fetch-releases.js (http block)

If you need me to access, download, or install something from one of these locations, you can either:

…tside the org

Adds support for including Hugging Face repositories from outside the
designated organization. Each entry specifies the repo ID (owner/name)
and its type (datasets, models, or spaces).

The parameter is optional and defaults to an empty array when not
provided in config.yaml.

Closes #64

Agent-Logs-Url: https://github.com/Imageomics/catalog/sessions/84f115ce-95f1-4640-be1f-191404fa3aa9

Co-authored-by: egrace479 <38985481+egrace479@users.noreply.github.com>
Copilot AI changed the title [WIP] Add option for additional Hugging Face repositories Add ADDITIONAL_HF_REPOS config option for Hugging Face repos outside the org Apr 16, 2026
Copilot AI requested a review from egrace479 April 16, 2026 18:12
@egrace479 egrace479 requested a review from Copilot April 16, 2026 19:52
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new ADDITIONAL_HF_REPOS config option to include Hugging Face datasets/models/spaces that are not owned by the configured org, and merges those items into the existing HF fetch flows (UI + tag export).

Changes:

  • Adds ADDITIONAL_HF_REPOS parsing/defaulting in the app config and uses it to fetch extra HF items per repo type.
  • Mirrors the same “fetch + merge” behavior in scripts/export-tags.js so exported tags include the additional HF repos.
  • Documents the new config key in public/config.yaml and README.md.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 4 comments.

File Description
main.js Adds optional ADDITIONAL_HF_REPOS config handling and fetch/merge logic for extra HF repos.
scripts/export-tags.js Adds optional ADDITIONAL_HF_REPOS support when collecting HF tags.
public/config.yaml Documents and adds a default ADDITIONAL_HF_REPOS: [].
README.md Documents the new config option alongside existing config keys.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread main.js
Comment thread scripts/export-tags.js Outdated
Comment thread scripts/export-tags.js
Comment thread main.js Outdated
@egrace479 egrace479 requested a review from EmersonFras April 17, 2026 14:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add option for HF repos from outside the org

4 participants