Skip to content

feat: add AsiaInfoSec-AI-XPort-Router submission (AsiaInfoSec AI-XPort Team) - #271

Open
yeanson028 wants to merge 12 commits into
RouteWorks:mainfrom
yeanson028:submit-asiainfosec-router
Open

yeanson028 wants to merge 12 commits into
RouteWorks:mainfrom
yeanson028:submit-asiainfosec-router

Conversation

@yeanson028

Copy link
Copy Markdown

Summary

Adds the submission for RouterArena:

  • router configuration
  • full 8,400-query prediction file with generated results
  • 420-query robustness prediction file

Author: AsiaInfoSec Token-ERP Team
Codebase: https://github.com/yeanson028/token-erp

This submission upgrades the previous 18th place router (AsiaInfo-Router) with multi-dimensional item response theory (MIRT) and token-level speculative entropy probe, significantly breaking the Query-level Pareto frontier on RouterArena.

Validation

All prediction files match the dataset schemas and validate against .

@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Router Evaluation Results

Router: AsiaInfoSec-Token-ERP-Router
Dataset Split: full
Evaluator: main @ 44cc1ff

RouterArena Metrics

Metric Value
RouterArena Score 0.6998
Accuracy 75.80%
Total Cost $24.062438
Avg Cost per Query $0.002865
Avg Cost per 1K Queries $2.8646
Number of Queries 8400
Abnormal Entries 0
Robustness Score 0.6595

Evaluation completed by RouterArena automated workflow

@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Router Evaluation Results

Router: AsiaInfoSec-Token-ERP-Router
Dataset Split: full
Evaluator: main @ 44cc1ff

RouterArena Metrics

Metric Value
RouterArena Score 0.7687
Accuracy 80.46%
Total Cost $5.640619
Avg Cost per Query $0.000672
Avg Cost per 1K Queries $0.6715
Number of Queries 8400
Abnormal Entries 0
Robustness Score 0.1833

Evaluation completed by RouterArena automated workflow

@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@yeanson028 yeanson028 changed the title Add AsiaInfoSec Token-ERP Router submission feat: add AsiaInfoSec-AI-XPort-Router submission (AsiaInfoSec AI-XPort Team) Nov 3, 2026
@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Router Evaluation Results

Router: AsiaInfoSec-Token-ERP-Router
Dataset Split: full
Evaluator: main @ 44cc1ff

RouterArena Metrics

Metric Value
RouterArena Score 0.8601
Accuracy 88.23%
Total Cost $1.058152
Avg Cost per Query $0.000126
Avg Cost per 1K Queries $0.1260
Number of Queries 8400
Abnormal Entries 0
Robustness Score 0.0595

Evaluation completed by RouterArena automated workflow

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Router Evaluation Results

Router: AsiaInfoSec-AI-XPort-Router
Dataset Split: full
Evaluator: main @ 44cc1ff

RouterArena Metrics

Metric Value
RouterArena Score 0.8601
Accuracy 88.23%
Total Cost $1.058152
Avg Cost per Query $0.000126
Avg Cost per 1K Queries $0.1260
Number of Queries 8400
Abnormal Entries 0
Robustness Score 0.0595

Evaluation completed by RouterArena automated workflow

…ith pure-query audit-trace and 5D disclosure
@yeanson028

Copy link
Copy Markdown
Author

/evaluate

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Router Evaluation Results

Router: AsiaInfoSec-AI-XPort-Router
Dataset Split: full
Evaluator: main @ 44cc1ff

RouterArena Metrics

Metric Value
RouterArena Score 0.8601
Accuracy 88.23%
Total Cost $1.058152
Avg Cost per Query $0.000126
Avg Cost per 1K Queries $0.1260
Number of Queries 8400
Abnormal Entries 0
Robustness Score 0.0595

Evaluation completed by RouterArena automated workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant