Skip to content

Initialize autoresearch/mar11 experiment run#5

Open
ap81623 wants to merge 1 commit intomiolini:masterfrom
ap81623:autoresearch/mar11
Open

Initialize autoresearch/mar11 experiment run#5
ap81623 wants to merge 1 commit intomiolini:masterfrom
ap81623:autoresearch/mar11

Conversation

@ap81623
Copy link
Copy Markdown

@ap81623 ap81623 commented Mar 11, 2026

  • Reduce MAX_SEQ_LEN from 2048 to 512 for MPS efficiency
  • Reduce VOCAB_SIZE from 8192 to 2048 for smaller tokenizer
  • Add baseline val_bpb reference (1.630384) to program.md
  • Initialize results.tsv with header for experiment tracking

- Reduce MAX_SEQ_LEN from 2048 to 512 for MPS efficiency
- Reduce VOCAB_SIZE from 8192 to 2048 for smaller tokenizer
- Add baseline val_bpb reference (1.630384) to program.md
- Initialize results.tsv with header for experiment tracking

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant