Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
0cc4295
Pixel shuffle rggb model code
Fmeson Oct 11, 2025
c632d31
SmallRawDataset for pretraining
Fmeson Oct 12, 2025
67736a4
First version of pretraining loop
Fmeson Oct 14, 2025
631c41d
This branch contains training code for mps. Code to produce the small…
Fmeson Oct 16, 2025
75dfdc1
Pretraining code
Fmeson Oct 16, 2025
09cfeff
Update to readme
Fmeson Oct 17, 2025
5b1793f
Updates to models
Fmeson Oct 17, 2025
2e3c980
Moved combined perceptual losses
Fmeson Oct 17, 2025
0e2f0b7
update to gitignore
Fmeson Oct 17, 2025
9ed9ca1
Update to small dataset to control colorspace
Fmeson Oct 17, 2025
1855fa0
Added yaml config
Fmeson Oct 17, 2025
ce39746
Flag to control number of batches for quick testing
Fmeson Oct 17, 2025
947ccfe
Notebook to make script file
Fmeson Oct 17, 2025
52ae672
Merging phase alignment output to be consistent with original alignme…
Fmeson Oct 21, 2025
e076f88
Output both train loss and l1 tracking loss in validation loop
Fmeson Oct 21, 2025
92cf9ba
Make small raw dataset more robust to input path and added option to …
Fmeson Oct 21, 2025
1a13066
Updated config to reflect new alignment output
Fmeson Oct 21, 2025
43a34c1
Experimental uncompressed dataset
Fmeson Oct 22, 2025
922d07c
Wider before deeper config
Fmeson Oct 23, 2025
b70414b
Adding to fuse
Fmeson Oct 24, 2025
bed32bb
Testing additive fusion
Fmeson Oct 24, 2025
5e2d3cc
Pretrain on raw swatches
Fmeson Oct 24, 2025
95149ce
Code to train on cropped raw
Fmeson Oct 26, 2025
7429e26
Update to trace making script
Fmeson Oct 26, 2025
c2e5f96
Added additional losses to test
Fmeson Oct 26, 2025
0a8a86f
Updating align script to preserve sharpness
Fmeson Oct 26, 2025
b079f70
Added modules being tested
Fmeson Oct 26, 2025
80ce72e
Up to date config
Fmeson Oct 26, 2025
bba2c70
Updated gitignore
Fmeson Oct 26, 2025
178d089
Updating cropped raw to better reflect the real raw data.
Fmeson Oct 28, 2025
567545e
Censored offset func
Fmeson Oct 28, 2025
c2bad0b
Update to save dng
Fmeson Oct 29, 2025
0847205
Cleaned up dng making script
Fmeson Oct 29, 2025
2c508a9
Updated censored fit
Fmeson Oct 30, 2025
ea59c0c
Dataset for raw images
Fmeson Oct 30, 2025
7976b44
DNG training
Fmeson Oct 30, 2025
46dfc9a
Updated gitignore
Fmeson Oct 31, 2025
f1b3981
Aditional testing options in cond naf
Fmeson Oct 31, 2025
e15541f
Added sharpness loss to shadow aware loss
Fmeson Oct 31, 2025
d835300
Tracking lr in training loop
Fmeson Oct 31, 2025
81fbfc5
Updates to raw dataset
Fmeson Oct 31, 2025
4e73940
Updates to config and new config
Fmeson Oct 31, 2025
2ff78ec
Script to train on raw from scratch
Fmeson Oct 31, 2025
b4b0676
Improved validaiton script
Fmeson Oct 31, 2025
53aa027
Short script for data cleaning
Fmeson Oct 31, 2025
ffcce3a
Code to finetune model on raw data
Fmeson Oct 31, 2025
a2161aa
Updating raw dataset to provided aligned raw data for noise character…
Fmeson Oct 31, 2025
ff4506e
Code to train demosaicing models
Fmeson Nov 1, 2025
13147eb
Update to demosaicing dataset
Fmeson Nov 1, 2025
ca48e44
Removed comments
Fmeson Nov 1, 2025
430d9f2
Basic demosaicing code
Fmeson Nov 1, 2025
42aae64
Demosaicing training scripts
Fmeson Nov 1, 2025
1401b8e
demosaicing models
Fmeson Nov 4, 2025
2e73823
Built in demosaicing for residual
Fmeson Nov 4, 2025
8715122
Checkpoint config
Fmeson Nov 5, 2025
3cc2acb
Dataset version that loads raw handlers into memory
Fmeson Nov 5, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 11 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -191,4 +191,14 @@ cython_debug/
# exclude from AI features like autocomplete and code analysis. Recommended for sensitive data
# refer to https://docs.cursor.com/context/ignore-files
.cursorignore
.cursorindexingignore
.cursorindexingignore


# custom ignores
mlruns/
.DS_store
*.png
*.jpeg
*.csv
*.xmp
*.dng
133 changes: 133 additions & 0 deletions 0_align_images.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1,133 @@
{
"cells": [
{
"cell_type": "code",
"execution_count": null,
"id": "ac7bbf09",
"metadata": {},
"outputs": [],
"source": [
"from tqdm import tqdm\n",
"import matplotlib.pyplot as plt\n",
"import pandas as pd\n",
"import numpy as np\n",
"from pathlib import Path"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "da5ede59",
"metadata": {},
"outputs": [],
"source": [
"from src.training.align_images import AlignImages\n",
"\n",
"from src.training.load_config import load_config"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "9d50e4c7",
"metadata": {},
"outputs": [],
"source": [
"run_config = load_config()\n",
"path = Path(run_config['jpeg_output_subdir'])\n",
"outpath = Path(run_config['base_data_dir']) / run_config['jpeg_output_subdir']\n",
"secondary_align_csv = outpath / run_config['secondary_align_csv']"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "19e7da21",
"metadata": {},
"outputs": [],
"source": [
"dataset = AlignImages(outpath, run_config['align_csv'])"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "c549b157",
"metadata": {},
"outputs": [],
"source": [
"metric_list = []\n",
"for i in tqdm(range(len(dataset))):\n",
" gt, noisy, aligned, metrics = dataset[i]\n",
" metric_list.append(metrics)"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "5acbb11e",
"metadata": {},
"outputs": [],
"source": [
"\n",
"df = pd.DataFrame(metric_list)\n",
"df.to_csv(secondary_align_csv)"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "6ec8ee48",
"metadata": {},
"outputs": [],
"source": [
"df = pd.read_csv(secondary_align_csv)"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "192ded31",
"metadata": {},
"outputs": [],
"source": [
"(df.PSNR_after - df.PSNR_before).hist(bins = np.linspace(-1, 4, 100))\n",
"plt.ylabel('Images')\n",
"plt.xlabel('Delta PSNR')"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "c04b9532",
"metadata": {},
"outputs": [],
"source": [
"(df.SSIM_after - df.SSIM_before).hist(bins = np.linspace(-.01, .1, 100))\n",
"plt.ylabel('Images')\n",
"plt.xlabel('Delta SSIM')"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "OnSight",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.11"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
Loading
Loading