Skip to content

Pull requests: datajuicer/data-juicer

New pull request New
26 Open 609 Closed
26 Open 609 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add DocumentLineDeduplicator for cross-document line-level dedup
#961 opened Apr 4, 2026 by amanyara Loading…
3
fix(service): propagate text_keys to ops via get_init_configs in _set…
#960 opened Apr 3, 2026 by cmgzn Loading…
3
[Env] Reduce the size of default deps to speed up the installation. dj:ci/cd issues/PRs about CI/CD of Data-Juicer dj:efficiency regarding to efficiency issues and enhancements environment related to third-party dependency, DJ-pypi, DJ-docker, etc.
#959 opened Apr 1, 2026 by HYLcool Loading…
1 task done
@HYLcool
4
feat(agent): interaction quality ops & recipe, bad-case HTML report, and robust JSONL / HF meta loading agent related to agent dj:op issues/PRs about some specific OPs dj:post-tuning issues/PRs about post-tuning scenarios enhancement New feature or request
#957 opened Mar 25, 2026 by yxdyc Loading…
7
feat(semantic_ops): MVP extract + condition filter; join/agg/top-k planned
#948 opened Mar 19, 2026 by yxdyc Loading…
10
better parallelism in partitioned ray executor
#945 opened Mar 17, 2026 by cyruszhang • Draft
6
In PyArrow 20.0.0+, when using open_json to read data in batches, an …
#942 opened Mar 17, 2026 by HunterLine Loading…
8
fix(tests): Specify top_level_dir to resolve tools module ambiguity in test discovery
#940 opened Mar 16, 2026 by cmgzn Loading…
1
feat: add human-centric video understanding operators for HumanVBench
#938 opened Mar 13, 2026 by SYSUzhouting Loading…
9
[WIP] feat: Integrate ElasticJuicer Core Modules
#934 opened Mar 11, 2026 by fengrui-z Loading…
1 of 4 tasks
10
Feat: update vla ops and add val pipeline demo
#931 opened Mar 6, 2026 by Cathy0908 Loading…
15
[WIP] arXiv/PDF to Markdown mappers + dj-op one-shot runner dj:op issues/PRs about some specific OPs
#917 opened Feb 14, 2026 by yxdyc Loading…
7
[WIP] Multi-branch executor dj:core issues/PRs about the core functions of Data-Juicer enhancement New feature or request
#916 opened Feb 13, 2026 by yxdyc Loading…
1
6
[WIP] feat: Add combined_logical_filter operator with AND/OR support dj:op issues/PRs about some specific OPs
#914 opened Feb 13, 2026 by yxdyc Loading…
6
Feat: Support iceberg、hudi、delta、hdfs data source.
#911 opened Feb 11, 2026 by Dludora Loading…
8
[WIP] Feat: Add video_calibration_mapper and video_split_by_frame_mapper
#902 opened Feb 1, 2026 by 1van2ha0 Loading…
3 tasks
7
[WIP] Feat: Add RayImageBTSMinhashDeduplicator
#897 opened Jan 29, 2026 by Dludora Loading…
8
[WIP] feat: Pr 839 s3 download checkpoint resume and unittest for s3 download
#870 opened Dec 25, 2025 by Dludora Loading…
7
Depth seg new op dj:op issues/PRs about some specific OPs
#862 opened Dec 22, 2025 by archernsy Loading…
18
[NewOp] Add group_diversity_filter op
#745 opened Jul 22, 2025 by lingzhq Loading…
5
Add lidar object segmentation op
#736 opened Jul 14, 2025 by Qirui-jiao Loading…
9
[WIP] add lidar object detection op
#721 opened Jun 26, 2025 by Cathy0908 Loading…
1
[NewOp] Add generate_challenging_qa_mapper based on MindGYM principles
#703 opened Jun 14, 2025 by Bat-Reality Loading…
12
Optimization framework dj:core issues/PRs about the core functions of Data-Juicer dj:efficiency regarding to efficiency issues and enhancements
#702 opened Jun 13, 2025 by cyruszhang • Draft
5
[NewOp] Add domain_diversity_selector based on DaaR principles
#699 opened Jun 12, 2025 by lingzhq Loading…
8
ProTip! Updated in the last three days: updated:>2026-04-01.