VS Code Marketplace Store verified

GitHub Copilot Evals (Preview)

by GitHub · 73 users
e23300c7-1ace-59c8-8aa2-4b5cc8c767fc | Store v0.24.56
64/ 100
MEDIUM risk
No change since v0.24.0
Risk verdict
Review before use

Score-based assessment (medium risk, 64/100). An AI review of version 0.24.0 is in the AI review tab.

Analysis record

Analysed
4 days ago 17 November 2026
Version
v0.24.56
Artifact
SHA256 312c413f…5e6a5d
Detail
Full list

Evidence ledger

Ranked by severity · findings with a source location link to the code viewer

223 findings

YARA Rule Matches

15 rules
SeverityRuleHitsFilesMetadata
LOWcredential env files 8
dist/plugin/skills/improve/SKILL.mddist/web/extension.cjsdist/plugin/dist/mcp/server.mjs +5 more
-
LOWpostinstall persistence mechanism 10
dist/plugin/skills/create/references/hosts/vscode.mddist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/node/extension.cjs +7 more
-
LOWpostinstall obfuscation 54
dist/icons/eval-dark.svgdist/plugin/TELEMETRY.mddist/plugin/automations/eval-health-review.automation.md +51 more
-
LOWpostinstall crypto operations 19
telemetry.jsondist/plugin/skills/create/SKILL.mddist/plugin/dist/mcp/server.mjs +16 more
-
LOWpostinstall file manipulation 22
dist/plugin/skills/improve/SKILL.mddist/plugin/skills/setup/SKILL.mdLICENSE.txt +19 more
-
LOWpostinstall environment access 4
dist/plugin/THIRD-PARTY-NOTICES.txtdist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/plugin/com.github.copilot/extensions/copilot-evals/extension.mjs +1 more
-
LOWpostinstall system command 40
telemetry.jsondist/plugin/skills/improve/SKILL.mddist/plugin/com.github.copilot/extensions/copilot-evals/web/app.mjs +37 more
-
LOWpostinstall registry modification 6
dist/node/discovery-worker.cjsdist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/node/extension.cjs +3 more
-
LOWpostinstall network communication 26
package.jsondist/node/extension.cjsTHIRD-PARTY-NOTICES.txt +23 more
-
LOWOriginsNotVerified 1
dist/plugin/com.github.copilot/extensions/copilot-evals/web/app.mjs
-
LOWUsingShellInterpreterWhenExecutingOSCommands 3
dist/node/discovery-worker.cjsdist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/node/extension.cjs
-
LOWUsingCommandLineArguments 4
dist/plugin/dist/mcp/server.mjsdist/node/discovery-worker.cjsdist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjs +1 more
-
LOWpostinstall file download 10
dist/plugin/THIRD-PARTY-NOTICES.txtdist/node/extension.cjsdist/plugin/com.github.copilot/extensions/copilot-evals/web/app.mjs +7 more
-
LOWSQLInjection 2
dist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/plugin/com.github.copilot/extensions/copilot-evals/web/app.mjs
-
LOWNoUseWeakRandom 3
dist/plugin/dist/mcp/server.mjsdist/plugin/com.github.copilot/extensions/copilot-evals/workbench.mjsdist/node/extension.cjs
-

Publisher Evidence

Low

GitHub

Publisher identity, store signals, distribution reach, and warning signals used for context. Treat this as supporting evidence, not a clean bill of health.

69
Publisher domain
No domain
Missing
Store verification signal
Verified publisher
Verified
Extension portfolio
7
Portfolio

13 evidence rows available.

Finding Categories

301
IoC Indicators

YARA Rules Matched

15 rules(212 hits)
credential env files postinstall persistence mechanism postinstall obfuscation postinstall crypto operations postinstall file manipulation postinstall environment access postinstall system command postinstall registry modification postinstall network communication OriginsNotVerified UsingShellInterpreterWhenExecutingOSCommands UsingCommandLineArguments postinstall file download SQLInjection NoUseWeakRandom

AI Security Report

AI Security Review

Evidence context: threat category none; evidence quality weak.

The supplied findings do not establish what behavior triggered the matches. A fresh analysis with the relevant code and surrounding context is needed. These findings neither establish malicious behavior nor demonstrate that the extension is safe.

Key Reasons

  • Insufficient implementation context for the supplied findings

Reviewed 2026-11-14 · version 0.24.0; recommended action: reanalyze; model confidence 96%.

VS Code version history

Risk trend by version

3 analyzed versions. Each point is the latest successful scan for that version; failed zero-score scans are hidden. Dates: First seen by Risky Plugins.

Selected
64
Change since first
No change
Change from previous
No change
Versions:
First analyzed version
0.22.8
First seen Nov 3, 2026
Risk range
64 to 64
Across analyzed versions
Latest analyzed version
0.24.56
First seen Nov 17, 2026
Selected version
medium
Version
v0.24.56
First seen 4 days ago
Risk score
64
Findings
524
Change vs previous
No change

Pick any point on the chart, then open the Source tab to read that version's code.

Source Code Viewer

Source Code Not Available

Source code is not available for this version of the extension.

About This Extension

Inspect GitHub Copilot customizations and run evals from one VS Code pane.

Frequently Asked Questions