AgentSidekick

arize-experiment

Agent skillby githubSRC

Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance. Covers experiment CRUD, exporting runs, comparing results, and evaluation workflows using the ax CLI. Use when the user mentions create experiment, run experiment, compare models, model performance, evaluate AI, experiment results, benchmark, A/B test models, or measure accuracy.

SRC Publisher-stated: these are the publisher's own words, not an assessment.

RepositorySource listing

Key facts

Type
Agent skill · skill-mdSRC
Publisher
github · organizationSRC
Licence
MITSRC
Open source
YesDER
Hosting
Local (runs on your machine)SRC
Latest version
Unknown
Languages
javascriptSRC
First published
Unknown
In this catalogue since
DER
Last verified
Not verified by a researcher. Last seen in a source on 2026-11-21.

Capabilities and categories

Assigned by keyword rules from the description unless marked otherwise. The matched word is shown so you can judge the match.

CapabilityEvidenceKind
Agent Evaluationmatched benchmarkDER
Agent Monitoringmatched arizeDER
Benchmarkingmatched benchmarkDER

Filed underAgent InfrastructureAgent Observability

Integrations DER

No third-party service is named in the description or package metadata.

Platform compatibility

No pairing has been tested by AgentSidekick. Each status says what kind of evidence exists, not whether it works for you.

Protocol-level26

Each platform listed officially documents support for the Agent Skills format. This specific pairing has not been tested.

Platform discontinued1
PlatformBasis
Roo CodeDiscontinuedRoo Code documented support for the Agent Skills format but is discontinued. Project shut down and repository archived.
Unknown20

Could not confirm whether Each platform listed supports the Agent Skills format.

Install

Read from registry metadata. Follow the publisher's instructions; we have not run this.

No machine-readable install metadata is on record. The publisher's instructions are at the install page.

Permissions and signals

Signals, not a safety verdict. They describe what the product's metadata references. Security review: not reviewed.

SignalEvidenceHow observedObserved
Mentions credentialsmentions ".env"static text inspection 2026-11-21
Includes shell commandsmentions "```bash"static text inspection 2026-11-21

Known advisories for the published package SRC

An advisory existing does not mean the listed version is affected: compare the vulnerable range with the version you install. None found is not evidence of safety.

No advisories found

No published advisory matches a package this product declares. Products without a declared package cannot be matched at all. This is not evidence of safety.

Evaluation

Separate dimensions, each with its evidence. There is no overall score: the dimensions do not add up to one number honestly.

Source authority

Publisher-listed

Listed by the publisher in a source it controls (SKILL.md file, plugin marketplace manifest or extension registry). Field values are the publisher's own claims.

Publisher verification

Organisation account

Published under a GitHub organisation or named vendor. Identity not independently confirmed.

Maintenance activity

Active

Last push 2026-11-20 (1 days before this page was built).

Licence clarity

MIT

Licence identifier as reported by GitHub repository metadata.

Installation clarity

Linked

An install or documentation link is available; steps are not machine-readable.

Documentation

Repository / website only

No dedicated documentation URL on record. AgentSidekick has not assessed documentation quality.

Compatibility evidence

Protocol-level only

Compatibility is inferred from the standard it implements. No pairing has been tested.

Security review

Not reviewed

AgentSidekick has not audited this product. 2 automated signal(s) are listed under Permissions & signals — they describe what it references, not whether it is safe.

Pricing

Not published in any source we track. The code is open source, which says nothing about the cost of any hosted service.

Repository activity

github/awesome-copilot (subfolder skills/arize-experiment; figures are for the whole repository). Read from the GitHub API on 2026-11-21.

41kSRCGitHub stars
5.4kSRCForks
59SRCOpen issues
1d agoSRCLast push2026-11-20
UnknownSRCLatest releaseNo GitHub release published

Version history SRC

No version list is published in any source we track.

Change history

What changed between two ingests of the same source, and when the product was first seen. Registry releases are under Version history.

  1. First seen

Competitors and alternativesDER

Paired by shared capabilities and integrations. Similar on paper; not tested side by side.

Direct

Same type, overlapping capabilities.

SharesAgent EvaluationBenchmarking

SharesAgent EvaluationBenchmarking

Adjacent

A different form or a partial overlap.

SharesAgent EvaluationBenchmarking

SharesAgent EvaluationBenchmarking

chinese-llm-benchmark

Infrastructureby jeinlee1991HEU

6.5k GitHub starspushed 1d agolicence unknown

SharesAgent EvaluationBenchmarking

lmms-eval

Infrastructureby EvolvingLMMs-LabHEU

4.5k GitHub starspushed 1d agolicence unknown

SharesAgent EvaluationBenchmarking

keystone-bench

Infrastructureby xinxuxinHEU

1.1k GitHub starspushed 1mo agolicence unknown

SharesAgent EvaluationBenchmarking

rsi_eval

Infrastructureby Danielxu0208HEU

471 GitHub starspushed 22d agoApache-2.0

SharesAgent EvaluationBenchmarking

Provenance

Which source set each field, what kind of claim it is, and when.

FieldSourceKindSet on
Canonical URLSKILL.md files in public GitHub reposSRC2026-11-21
PublisherSKILL.md files in public GitHub reposSRC2026-11-21
DescriptionSKILL.md files in public GitHub reposSRC2026-11-21
HostingSKILL.md files in public GitHub reposSRC2026-11-21
Install linkSKILL.md files in public GitHub reposSRC2026-11-21
Integration typeSKILL.md files in public GitHub reposSRC2026-11-21
LanguagesGitHub repository metadataSRC2026-11-21
LicenceGitHub repository metadataSRC2026-11-21
NameSKILL.md files in public GitHub reposSRC2026-11-21
Open sourceGitHub repository metadataDER2026-11-21
TypeSKILL.md files in public GitHub reposSRC2026-11-21
RepositorySKILL.md files in public GitHub reposSRC2026-11-21
Source URLSKILL.md files in public GitHub reposSRC2026-11-21

Sources

Not verified by a researcher. Last seen in a source on . Report incorrect information

Page data last updated .