JetBrains/intellij-community / .agents/skills/notebook-for-experiment
notebook-for-experiment
FlaggedCreate reproducible Jupyter notebooks for performance experiments.
| File | Kind | Size |
|---|---|---|
| OWNERSHIP | other | 19 B |
| SKILL.md | skill md | 17.2 KB |
| reference/log-files.md | markdown | 2.8 KB |
| reference/machine-info.md | markdown | 2.5 KB |
| scripts/nb.py | script | 18.6 KB |
reference/log-files.md
View on GitHub# Finding log files
`idea.log` rotates: older segments are named `idea.1.log`, `idea.2.log`, etc.
Always glob `idea*.log` and sort by mtime to reconstruct chronological order or pick the most recent file.
## IDE Starter tests
IDE Starter writes each test's log to a dedicated directory:
```
<repo>/out/ide-tests/tests/<productCode>-<buildNumber>/<testName>/log/idea*.log
```
`buildNumber` is `LOCAL` for local runs and a numeric build ID on CI. Glob for both:
```python
from pathlib import Path
def find_log(test_name: str) -> Path:
matches = sorted(
(repo_root / 'out' / 'ide-tests' / 'tests').glob(
f'IU-*/{test_name}/log/idea*.log'
),
key=lambda p: p.stat().st_mtime,
)
if not matches:
raise FileNotFoundError(
f'No idea.log found for test "{test_name}". '
'Run the test first, then re-execute this cell.'
)
path = matches[-1] # most recently modified
print(f'{test_name}: {path}')
return path
```
Each IDE Starter test name maps to its own directory, so log files from different tests are already separated — no marker parsing is needed.
The `find_log` function above raises `FileNotFoundError` when the log is missing — this is intentional.
The test must be run before the notebook can analyse anything; a missing log is a hard prerequisite,
not an optional mode, so an exception is the right signal.
## Regular (non-Starter) tests
Regular tests write to the shared system log directory:
```
system/test/testlog/idea*.log
```
The log is **not** cleared between test methods — all tests in a run share the same rotating file set.
To extract records for a specific test, delimit by `LogTestName` markers:
```
=======================
Started a test: ClassName::testMethodName
=======================
...log lines for this test...
=======================
The test finished successfully: ClassName::testMethodName
=======================
```
`LogTestName` (`com.intellij.testFramework.junit5.LogTestName`) is a JUnit 5 `InvocationInterceptor`.
Add `@ExtendWith(LogTestName::class)` to the test class, or it may already be registered transitively via `@TestApplication`.
If `LogTestName` is not applicable (JUnit 4, no application context, etc.), emit equivalent markers manually with a `LOG.info` call at the start and end of the test body.
Parsing between markers:
```python
import re
def extract_test_section(log_text: str, test_display_name: str) -> str:
"""Return log lines between the Started and finished/failed markers for one test."""
start = re.search(r'Started a test: ' + re.escape(test_display_name), log_text)
if not start:
return ''
tail = log_text[start.end():]
end = re.search(
r'The test (?:finished successfully|failed): ' + re.escape(test_display_name),
tail,
)
return tail[:end.start()] if end else tail
```
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |