Show HN: AI 에이전트의 작동 방식을 확인하기 위해 1,573개의 Claude Code 세션을 분석했습니다.
hackernews
|
|
🔬 연구
#ai 에이전트
#analytics
#claude
#claude code
#review
#개발 도구
#분석
원문 출처: hackernews · Genesis Park에서 요약 및 분석
요약
개발자들은 자신들의 Claude Code 세션 데이터를 분석하기 위해 무료 오픈소스 분석 도구 rudel.ai를 개발했습니다. 이 도구를 통해 수집된 1,573개 세션과 1,500만 개 이상의 토큰을 분석한 결과, 전체의 26%가 1분 이내에 중단되는 등 실패 패턴이 세션 유형별로 크게 다르다는 사실을 발견했습니다. 특히 에러 캐스케이드 패턴이 세션 중단을 예측한다는 점을 확인했으며, 현재 AI 에이전트의 성과를 평가할 수 있는 유의미한 벤치마크를 구축 중입니다.
본문
Try the hosted version for free at rudel.ai Analytics for Claude Code. Rudel gives you a dashboard with insights on your coding sessions — token usage, session duration, activity patterns, model usage, and more. - Bun runtime installed - Create an account at app.rudel.ai - Install the CLI and connect it to your account: npm install -g rudel rudel login # authenticate via your browser rudel enable # auto-upload sessions when Claude Code exits - Invite teammates (optional): go to Settings → Organization in the dashboard, enter their email, and share the generated invite link with them. That's it. Your Claude Code sessions will now be uploaded automatically. Already have past sessions? Upload them in one go: rudel upload # interactive picker for batch upload See the CLI documentation for all available commands. - You install the CLI and run rudel enable - This registers a Claude Code hook that runs when a session ends - The hook uploads the session transcript to Rudel - Transcripts are stored in ClickHouse and processed into analytics Each uploaded session includes: - Session ID & timestamps (start, last interaction) - User ID & organization ID - Project path & package name - Git context (repository, branch, SHA, remote) - Session transcript (full prompt & response content) - Sub-agent usage Rudel is designed to ingest full coding-agent session data for analytics. That means uploaded transcripts and related metadata may contain sensitive material, including source code, prompts, tool output, file contents, command output, URLs, and secrets that appeared during a session. Only enable Rudel on projects and environments where you are comfortable uploading that data. If you use the hosted service at app.rudel.ai , we do not have access to personal data contained in uploaded transcripts and cannot read that data. Review the Rudel Privacy Policy before enabling uploads for yourself or your team. We also use limited product analytics on the hosted service to understand whether core workflows work, diagnose failures, and improve the product. This is explicit event tracking for account and authentication flows, CLI login and enable flows, session upload outcomes, dashboard views and interactions, organization management actions, and a small set of utility interactions such as theme toggle or sidebar collapse. This product analytics layer is intentionally limited. It does not enable blanket click autocapture, session replay, or surveys by default. It is designed to capture product events and operational context like page name, action name, date range, normalized error codes, and organization or user identifiers where needed. It should not include raw transcript content, source code, prompts, tool output, command output, or file contents from your sessions. By using the hosted app, you agree to this limited analytics processing as part of the service. See CONTRIBUTING.md for local setup, development commands, and PR guidelines. For self-hosting your own instance, see docs/self-hosting.md. To report a vulnerability, see SECURITY.md. Do not open public issues for security concerns.
Genesis Park 편집팀이 AI를 활용하여 작성한 분석입니다. 원문은 출처 링크를 통해 확인할 수 있습니다.
공유