Frontier labs

Alexandr Wang

Meta Superintelligence Labs Leader

Why we track: Meta AI organization and talent acquisition

Career moves

No published career moves.

Papers

Paper2026-06-10 · arXiv.org

Development of an Evaluation Method to Pinpoint Errors in AI Agents

Layer-Isolated Evaluation: Gating the Deterministic Scaffold of a Production LLM Agent with a No-LLM, Regression-Locked Test Harness

Alexandr Wang +2 more

What: Researchers have developed an evaluation system that divides the structure of AI agents into multiple layers to independently and rapidly inspect errors in each layer.
Key result: They confirmed that even when the overall success rate barely changes, the score of a specific troubled layer drops significantly, enabling accurate identification of the root cause.
Why it matters: This can contribute to enhancing the stability of AI systems and quickly finding the cause when problems occur.AI summary

Agents & coding Safety & policy

Full summary Read paper ↗ PDF ↗

Paper2026-06-09 · arXiv.org

Analysis of Limitations in Conversational Agent Evaluation by LLM-as-Judge

Catching One in Five: LLM-as-Judge Blind Spots in Production Multi-Turn Transaction Agents

Alexandr Wang +2 more

What: Using production food-ordering conversational agents, we measured how effectively LLM-based judges detect actual defects compared to comprehensive human inspection.
Key result: LLM judges failed to catch even a quarter of the systematic issues identified by humans, and in certain batches recorded zero detections.
Why it matters: This suggests that automated evaluation methods serve merely as a minimum baseline and cannot completely replace human review.AI summary

Agents & coding

Full summary Read paper ↗ PDF ↗

This page compiles published papers, official announcements and press reports for information only. Paper summaries are written by AI from the abstract and reviewed by the editor; they may differ from the original, so check the paper for anything important. Nothing here is a recommendation to buy or sell any security or investment advice. Career moves cite official announcements or major press reports; some career records come from Wikidata (CC0). Summaries on this page were translated by AI from the editor-reviewed Korean version.