diff --git a/logs/dataloader_unit_test.log b/logs/dataloader_unit_test.log index a16be9d991b853dafd079359f936ca4db0ccb9ca..950d264681bca10e805befeff6e2726f308fb547 100644 --- a/logs/dataloader_unit_test.log +++ b/logs/dataloader_unit_test.log @@ -51,3 +51,11 @@ INFO:root:Loading the index from sub_2CMEMS-MEDSEA-2010-2016-training.nc.bin_ind INFO:root: - Loaded a dataset with 50154984 samples INFO:root: - Splitting the data in training and validation sets INFO:root:Generating the subset files from 50154984 samples +INFO:root: - Subset dataset +INFO:root:The loaded dataset contains 25 latitudes, 37 longitudes, 28 depths and 2222 time points +INFO:root:Loading the index from sub_2CMEMS-MEDSEA-2010-2016-training.nc.bin_index.idx +INFO:root:The loaded dataset contains 25 latitudes, 37 longitudes, 28 depths and 2222 time points +INFO:root:Loading the index from sub_2CMEMS-MEDSEA-2010-2016-training.nc.bin_index.idx +INFO:root: - The train fold has 40126890 samples +INFO:root: - The valid fold has 10028094 samples +INFO:root:Got a minibatch of size torch.Size([128, 1, 18]) -> torch.Size([128, 1]) diff --git a/train_indices.subset b/train_indices.subset index 52f50d5e0619ed0d361ba53becfb35495ae718be..1ba509767c154bdbb937414014a0a5960961ddf1 100644 Binary files a/train_indices.subset and b/train_indices.subset differ diff --git a/valid_indices.subset b/valid_indices.subset index 8733e1ea294c6b7e278286602c31a9ec5689b66a..dbc9c1a150334b41d69dd2554765303eb9678860 100644 Binary files a/valid_indices.subset and b/valid_indices.subset differ