debug-internal.log 149.61 KiB
2023-01-23 17:41:51,287 INFO StreamThr :2356308 [internal.py:wandb_internal():87] W&B internal server running at pid: 2356308, started at: 2023-01-23 17:41:51.283722
2023-01-23 17:41:51,288 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status
2023-01-23 17:41:51,290 INFO WriterThread:2356308 [datastore.py:open_for_write():85] open: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/run-dwy5vvxq.wandb
2023-01-23 17:41:51,302 DEBUG SenderThread:2356308 [sender.py:send():334] send: header
2023-01-23 17:41:51,305 DEBUG SenderThread:2356308 [sender.py:send():334] send: run
2023-01-23 17:41:51,808 INFO SenderThread:2356308 [dir_watcher.py:__init__():216] watching files in: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files
2023-01-23 17:41:51,808 INFO SenderThread:2356308 [sender.py:_start_run_threads():1065] run started: dwy5vvxq with start time 1674492111.280886
2023-01-23 17:41:51,813 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: check_version
2023-01-23 17:41:51,916 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:51,924 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:51,924 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: check_version
2023-01-23 17:41:52,014 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: run_start
2023-01-23 17:41:52,024 DEBUG HandlerThread:2356308 [system_info.py:__init__():31] System info init
2023-01-23 17:41:52,025 DEBUG HandlerThread:2356308 [system_info.py:__init__():46] System info init done
2023-01-23 17:41:52,025 INFO HandlerThread:2356308 [system_monitor.py:start():151] Starting system monitor
2023-01-23 17:41:52,028 INFO SystemMonitor:2356308 [system_monitor.py:_start():116] Starting system asset monitoring threads
2023-01-23 17:41:52,028 INFO HandlerThread:2356308 [system_monitor.py:probe():172] Collecting system info
2023-01-23 17:41:52,032 INFO SystemMonitor:2356308 [interfaces.py:start():168] Started cpu
2023-01-23 17:41:52,036 INFO SystemMonitor:2356308 [interfaces.py:start():168] Started disk
2023-01-23 17:41:52,039 INFO SystemMonitor:2356308 [interfaces.py:start():168] Started gpu
2023-01-23 17:41:52,043 INFO SystemMonitor:2356308 [interfaces.py:start():168] Started memory
2023-01-23 17:41:52,046 INFO SystemMonitor:2356308 [interfaces.py:start():168] Started network
2023-01-23 17:41:52,181 DEBUG HandlerThread:2356308 [system_info.py:probe():195] Probing system
2023-01-23 17:41:52,193 DEBUG HandlerThread:2356308 [system_info.py:_probe_git():180] Probing git
2023-01-23 17:41:52,223 DEBUG HandlerThread:2356308 [system_info.py:_probe_git():188] Probing git done
2023-01-23 17:41:52,224 DEBUG HandlerThread:2356308 [system_info.py:probe():241] Probing system done
2023-01-23 17:41:52,224 DEBUG HandlerThread:2356308 [system_monitor.py:probe():181] {'os': 'Linux-5.13.0-35-generic-x86_64-with-glibc2.29', 'python': '3.8.10', 'heartbeatAt': '2023-01-23T16:41:52.181388', 'startedAt': '2023-01-23T16:41:51.185047', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'main.py', 'codePath': 'main.py', 'git': {'remote': 'git@gitlab-research.centralesupelec.fr:rayan.messaoudi/Kaggle_Phytoplankton.git', 'commit': 'cc203b7d42ad6c95dd1cbdffb0670f1e2de6a671'}, 'email': 'yandirzm@gmail.com', 'root': '/usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton', 'host': 'tx01', 'username': 'sdi1_3', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 1243.6019999999999, 'min': 1200.0, 'max': 4500.0}, 'cpu_freq_per_core': [{'current': 1200.229, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.026, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.067, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.025, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.019, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.183, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.067, 'min': 1200.0, 'max': 4500.0}, {'current': 1200.095, 'min': 1200.0, 'max': 4500.0}], 'disk': {'total': 228.0885124206543, 'used': 45.57365798950195}, 'gpu': 'NVIDIA GeForce RTX 2080 Ti', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA GeForce RTX 2080 Ti', 'memory_total': 11811160064}], 'memory': {'total': 31.036502838134766}}
2023-01-23 17:41:52,229 INFO HandlerThread:2356308 [system_monitor.py:probe():182] Finished collecting system info
2023-01-23 17:41:52,229 INFO HandlerThread:2356308 [system_monitor.py:probe():185] Publishing system info
2023-01-23 17:41:52,233 DEBUG HandlerThread:2356308 [system_info.py:_save_pip():51] Saving list of pip packages installed into the current environment
2023-01-23 17:41:52,241 DEBUG HandlerThread:2356308 [system_info.py:_save_pip():67] Saving pip packages done
2023-01-23 17:41:52,250 INFO HandlerThread:2356308 [system_monitor.py:probe():187] Finished publishing system info
2023-01-23 17:41:52,260 DEBUG SenderThread:2356308 [sender.py:send():334] send: files
2023-01-23 17:41:52,261 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-metadata.json with policy now
2023-01-23 17:41:52,274 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: stop_status
2023-01-23 17:41:52,276 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: stop_status
2023-01-23 17:41:52,446 DEBUG SenderThread:2356308 [sender.py:send():334] send: telemetry
2023-01-23 17:41:52,812 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_created():275] file/dir created: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-metadata.json
2023-01-23 17:41:52,813 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_created():275] file/dir created: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/requirements.txt
2023-01-23 17:41:52,815 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_created():275] file/dir created: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:41:52,819 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_created():275] file/dir created: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:41:52,973 INFO Thread-16 :2356308 [upload_job.py:push():143] Uploaded file /tmp/sdi1_3-19662/tmpao2li2p2wandb/l67r4sig-wandb-metadata.json
2023-01-23 17:41:54,811 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:41:55,433 DEBUG SenderThread:2356308 [sender.py:send():334] send: telemetry
2023-01-23 17:41:55,434 DEBUG SenderThread:2356308 [sender.py:send():334] send: run
2023-01-23 17:41:55,627 INFO SenderThread:2356308 [sender.py:send_run():942] updated run: dwy5vvxq
2023-01-23 17:41:55,627 DEBUG SenderThread:2356308 [sender.py:send():334] send: telemetry
2023-01-23 17:41:55,812 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/config.yaml
2023-01-23 17:41:55,886 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:55,887 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:55,890 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:55,901 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:56,097 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:56,098 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:56,103 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:56,119 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:56,358 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:56,358 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:56,361 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:56,362 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:41:56,374 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:56,668 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:56,669 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:56,680 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:56,689 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:56,816 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:41:56,817 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:41:56,906 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:56,907 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:56,909 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record2023-01-23 17:41:56,920 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:57,215 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:57,216 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:57,219 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:57,229 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:57,448 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:57,449 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:57,451 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:57,465 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:57,775 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:57,776 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:57,779 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:57,790 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:57,817 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:41:58,013 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,014 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:58,017 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:58,029 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:58,241 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,242 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:58,244 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:58,255 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:58,512 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,513 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,516 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,520 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,523 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,523 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,524 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,524 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,524 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,527 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,527 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,530 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,531 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,536 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,538 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,580 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,581 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,592 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:58,595 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:58,604 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:58,788 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:58,791 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:58,792 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:58,809 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:58,818 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:41:58,818 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:41:59,091 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:59,094 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:59,095 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:59,108 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:59,338 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:59,341 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:59,343 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:59,362 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:59,640 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:59,643 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:59,647 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:59,662 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:41:59,818 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:41:59,883 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:41:59,885 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:41:59,889 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:41:59,901 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:00,126 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:00,128 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:00,131 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:00,143 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:00,424 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:00,426 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:00,428 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:00,443 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:00,674 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:00,677 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:00,679 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:00,695 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:00,819 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:00,819 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:00,958 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:00,961 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:00,961 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:00,976 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:01,195 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,197 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,199 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,202 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,206 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,209 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,213 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,216 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,219 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,222 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,226 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,230 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,233 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,249 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,253 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,257 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,260 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,271 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:01,272 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:01,284 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:01,373 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:01,503 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,506 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:01,507 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:01,522 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:01,754 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,757 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:01,758 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:01,775 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:01,820 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:01,990 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:01,992 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:01,993 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:02,008 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:02,283 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:02,285 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:02,286 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:02,301 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:02,532 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:02,534 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:02,536 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:02,549 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:02,824 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:02,824 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:02,825 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:02,833 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:02,834 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:02,847 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:03,085 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,087 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:03,089 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:03,104 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:03,377 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,379 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:03,380 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:03,398 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:03,624 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:03,627 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:03,628 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:03,642 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:03,825 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:03,852 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,853 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,855 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,859 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,862 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,865 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,897 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,897 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,900 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,903 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,907 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,910 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,913 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,920 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,924 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,927 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,930 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:03,942 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:03,945 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:03,957 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:04,167 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:04,170 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:04,308 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:04,322 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:04,420 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:04,423 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:04,427 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:04,441 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:04,718 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:04,721 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:04,722 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:04,737 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:04,826 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:04,826 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:04,961 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:04,964 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:04,965 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:04,980 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:05,272 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:05,275 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:05,276 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:05,291 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:05,515 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:05,517 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:05,518 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:05,536 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:05,745 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:05,747 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:05,749 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:05,763 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:05,827 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:06,045 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,047 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:06,048 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:06,066 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:06,287 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,290 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:06,291 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:06,306 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:06,379 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:06,550 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,551 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,553 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,556 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,559 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,563 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:06,566 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,571 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,573 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,578 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,582 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,586 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,595 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,599 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,603 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,606 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,610 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,619 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:06,621 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:06,635 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:06,824 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:06,827 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:06,828 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:06,828 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:06,835 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:06,845 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:07,117 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:07,119 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:07,121 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:07,136 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:07,271 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:07,364 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:07,367 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:07,370 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:07,383 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:07,618 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:07,621 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:07,623 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:07,638 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:07,829 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:07,919 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:07,921 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:07,923 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:07,935 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:08,163 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:08,165 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:08,167 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:08,182 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:08,465 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:08,468 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:08,468 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:08,483 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:08,703 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:08,706 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:08,707 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:08,721 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:08,829 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:08,830 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:09,001 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,003 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:09,006 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:09,017 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:09,216 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,217 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,221 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,224 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,227 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,230 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,234 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,237 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,244 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,264 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,272 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:09,274 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:09,286 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:09,475 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,478 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:09,479 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:09,495 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:09,779 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:09,781 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:09,783 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:09,798 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:09,830 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:10,019 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:10,022 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:10,023 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:10,039 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:10,317 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:10,319 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:10,323 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:10,338 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:10,546 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:10,550 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:10,550 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:10,563 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:10,831 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:10,831 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:10,838 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:10,840 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:10,842 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:10,854 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:11,083 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,085 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:11,086 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:11,099 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:11,325 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,327 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:11,361 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:11,375 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:11,428 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:11,637 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,640 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:11,640 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:11,654 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:11,831 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:11,864 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,865 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,868 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,871 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,874 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,878 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,881 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,885 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,888 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,892 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,895 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,899 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,903 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,906 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,910 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,914 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,917 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:11,929 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:11,932 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:11,942 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:12,194 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:12,196 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:12,197 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record2023-01-23 17:42:12,211 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:12,272 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:12,442 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:12,444 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:12,445 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:12,461 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:12,744 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:12,746 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:12,747 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:12,762 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:12,832 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:12,832 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:12,992 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:12,994 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:12,997 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:13,009 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:13,234 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:13,237 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:13,238 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:13,251 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:13,537 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:13,539 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:13,542 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:13,561 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:13,780 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:13,782 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:13,783 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:13,797 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:13,833 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:14,080 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,082 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:14,085 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:14,100 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:14,321 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,324 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:14,324 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:14,338 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:14,544 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,546 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,548 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,552 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,556 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,556 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,556 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,556 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,557 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,559 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,601 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,602 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,602 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,602 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,602 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,602 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,644 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,653 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:14,656 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:14,669 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:14,833 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:14,834 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:14,872 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:14,875 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:14,877 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:14,892 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:15,093 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:15,095 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:15,097 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:15,112 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:15,390 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:15,393 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:15,396 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record2023-01-23 17:42:15,415 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:15,642 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:15,646 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:15,646 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:15,658 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:15,834 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:15,922 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:15,925 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:15,926 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:15,940 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:16,184 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:16,187 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:16,188 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:16,204 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:16,466 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:16,469 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:16,472 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:16,472 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:16,492 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:16,720 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:16,723 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:16,723 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:16,739 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:16,835 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:16,835 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:16,954 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:16,957 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:16,958 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:16,972 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:17,226 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,227 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,231 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,234 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,238 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,242 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,245 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,249 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,253 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,257 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,260 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,264 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,268 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,271 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,275 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,279 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,282 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:17,286 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,298 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:17,300 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:17,312 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:17,510 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,512 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:17,514 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:17,526 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:17,805 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:17,807 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:17,811 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:17,821 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:17,836 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:18,053 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:18,056 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:18,058 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:18,070 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:18,287 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:18,289 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:18,291 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:18,304 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:18,837 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:18,837 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:20,838 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log2023-01-23 17:42:21,507 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:21,839 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/config.yaml
2023-01-23 17:42:22,274 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:22,839 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:23,734 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:23,740 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:23,756 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:23,769 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:23,841 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:24,130 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:24,133 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:24,134 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:24,149 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:24,364 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:24,366 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:24,368 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:24,381 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:24,604 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:24,607 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:24,607 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:24,619 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:24,841 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:24,842 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:24,922 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:24,925 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:24,927 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:24,943 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:25,152 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,155 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:25,155 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:25,169 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:25,457 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,459 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:25,460 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:25,473 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:25,520 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,521 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,521 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,521 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,522 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,525 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,527 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,533 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,535 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,537 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,540 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,542 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,545 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,547 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,592 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,593 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,707 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:25,716 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:25,719 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:25,731 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:25,842 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:26,014 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:26,017 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:26,017 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:26,029 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:26,252 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:26,254 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:26,255 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:26,270 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:26,510 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:26,512 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:26,513 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:26,528 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:26,707 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:26,800 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:26,803 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:26,807 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:26,818 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:26,842 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:26,843 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:27,056 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:27,059 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:27,060 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:27,075 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:27,275 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:27,361 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:27,364 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:27,365 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:27,377 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:27,620 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:27,623 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:27,624 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:27,638 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:27,843 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:27,919 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:27,922 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:27,927 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:27,939 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:28,166 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,168 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:28,169 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:28,187 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:28,221 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,221 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,221 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,221 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,222 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,261 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,261 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,265 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,265 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,265 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,266 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,413 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,423 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:28,425 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:28,439 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:28,718 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,720 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:28,721 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:28,733 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:28,844 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:28,844 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:28,959 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:28,962 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:28,962 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:28,977 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:29,275 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:29,280 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:29,280 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:29,293 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:29,531 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:29,534 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:29,536 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:29,550 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:29,842 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:29,844 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:29,845 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:29,846 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:29,861 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end2023-01-23 17:42:30,069 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,071 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:30,072 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:30,087 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:30,296 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,298 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:30,298 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:30,316 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:30,621 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,623 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:30,625 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:30,638 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:30,846 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:30,846 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:30,851 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,855 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:30,856 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:30,880 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:30,981 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,981 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,981 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,984 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,988 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,992 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,996 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:30,999 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,003 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,007 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,011 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,015 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,018 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,022 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,026 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,030 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,149 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,159 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:31,161 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:31,172 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:31,417 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,420 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:31,420 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:31,434 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:31,703 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,706 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:31,709 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:31,709 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:31,723 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:31,847 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:31,954 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:31,957 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:31,958 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:31,974 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:32,214 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:32,217 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:32,218 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:32,233 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:32,276 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:32,511 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:32,514 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:32,514 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:32,526 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:32,768 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:32,771 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:32,773 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:32,789 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:32,847 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:32,847 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:33,077 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,080 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:33,081 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record2023-01-23 17:42:33,094 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:33,319 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,321 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:33,323 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:33,337 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:33,633 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,636 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:33,638 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:33,650 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:33,692 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,693 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,693 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,695 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,697 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,700 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,702 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,705 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,707 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,709 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,711 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,714 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,718 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,722 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,722 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,723 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,850 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:33,869 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:33,879 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:33,882 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:33,896 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:34,118 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:34,120 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:34,175 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:34,194 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:34,419 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:34,421 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:34,424 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:34,436 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:34,668 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:34,670 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:34,672 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:34,688 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:34,851 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:34,851 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:34,973 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:34,975 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:34,977 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:34,990 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:35,217 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:35,220 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:35,224 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:35,236 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:35,531 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:35,534 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:35,535 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:35,545 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:35,779 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:35,781 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:35,852 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:35,886 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:35,913 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:36,017 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,019 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:36,020 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:36,031 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:36,324 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,327 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:36,328 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:36,346 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:36,373 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:36,375 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,377 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,381 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,385 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,388 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,391 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,395 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,398 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,399 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,399 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,399 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,432 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,433 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,433 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,433 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,561 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,571 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:36,573 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:36,593 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:36,792 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:36,853 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:36,853 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:36,881 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:36,883 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:36,886 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:36,900 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:37,122 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:37,125 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:37,126 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:37,140 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:37,277 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:37,440 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:37,443 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:37,443 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:37,456 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:37,694 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:37,697 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:37,697 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:37,715 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:37,853 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:37,942 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:37,945 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:37,948 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:37,963 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:38,264 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:38,267 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:38,269 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:38,284 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:38,509 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:38,512 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:38,513 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:38,525 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:38,822 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:38,825 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:38,828 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:38,845 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:38,854 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:38,855 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:39,063 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,066 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:39,068 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:39,083 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:39,172 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,174 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,176 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,179 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,183 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,186 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,190 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,193 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:39,197 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,200 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,204 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,208 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,212 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,216 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,220 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,224 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,365 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,375 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:39,378 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:39,390 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:39,608 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,610 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:39,612 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:39,630 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:39,837 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:39,840 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:39,841 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:39,857 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:39,858 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:40,153 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:40,155 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:40,157 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:40,173 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:40,393 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:40,395 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:40,398 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:40,411 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:40,693 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:40,696 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:40,699 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:40,711 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:40,858 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:40,858 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:40,943 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:40,945 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:40,946 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:40,956 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:41,255 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,257 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:41,259 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:41,272 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:41,508 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,511 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:41,514 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:41,531 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:41,748 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,751 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:41,752 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:41,765 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:41,856 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,857 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,858 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:41,861 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,864 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,868 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,871 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,875 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,878 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,882 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,886 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,889 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,893 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,896 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,921 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,921 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,925 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:41,965 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:42,049 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:42,059 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:42,061 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:42,073 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:42,279 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:42,304 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:42,307 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:42,311 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:42,326 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:42,617 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:42,619 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:42,621 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:42,637 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:42,855 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:42,858 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:42,858 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:42,859 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:42,866 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:42,874 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:43,151 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:43,154 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:43,155 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:43,168 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:43,423 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:43,425 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:43,426 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:43,439 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:43,659 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:43,661 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:43,665 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:43,679 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:43,860 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:43,957 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:43,960 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:43,961 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:43,971 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:44,206 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,209 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:44,210 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:44,222 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:44,515 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,518 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:44,567 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,633 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,634 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,634 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,634 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,634 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,634 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,635 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,636 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,628 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:44,644 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:44,754 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:44,766 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:44,768 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:44,782 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:44,861 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:44,861 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:45,059 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:45,062 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:45,064 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:45,076 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:45,303 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history2023-01-23 17:42:45,305 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:45,308 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:45,321 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:45,547 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:45,550 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:45,553 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:45,565 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:45,862 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:45,865 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:45,866 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:45,869 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:45,882 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:46,119 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:46,122 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:46,127 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:46,140 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:46,379 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:46,381 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:46,382 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:46,391 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:46,663 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:46,666 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:46,666 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:46,683 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:46,862 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:46,862 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:46,882 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:46,884 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:46,885 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:46,900 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:47,054 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:47,279 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:47,863 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:48,864 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:50,865 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:52,049 DEBUG SystemMonitor:2356308 [system_monitor.py:_start():130] Starting system metrics aggregation loop
2023-01-23 17:42:52,051 DEBUG SenderThread:2356308 [sender.py:send():334] send: stats
2023-01-23 17:42:52,054 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:52,281 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: keepalive
2023-01-23 17:42:52,412 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: partial_history
2023-01-23 17:42:52,415 DEBUG SenderThread:2356308 [sender.py:send():334] send: history
2023-01-23 17:42:52,416 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: summary_record
2023-01-23 17:42:52,430 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:52,867 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:52,867 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:54,868 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:56,869 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:57,037 DEBUG SenderThread:2356308 [sender.py:send():334] send: exit
2023-01-23 17:42:57,037 INFO SenderThread:2356308 [sender.py:send_exit():557] handling exit code: 0
2023-01-23 17:42:57,040 INFO SenderThread:2356308 [sender.py:send_exit():559] handling runtime: 65
2023-01-23 17:42:57,050 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:57,050 INFO SenderThread:2356308 [sender.py:send_exit():565] send defer
2023-01-23 17:42:57,054 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,057 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 0
2023-01-23 17:42:57,057 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,061 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 0
2023-01-23 17:42:57,061 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 1
2023-01-23 17:42:57,065 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,069 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 1
2023-01-23 17:42:57,069 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:57,070 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,073 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 1
2023-01-23 17:42:57,076 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 2
2023-01-23 17:42:57,077 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,080 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 2
2023-01-23 17:42:57,080 INFO HandlerThread:2356308 [system_monitor.py:finish():161] Stopping system monitor
2023-01-23 17:42:57,081 DEBUG SystemMonitor:2356308 [system_monitor.py:_start():137] Finished system metrics aggregation loop
2023-01-23 17:42:57,081 INFO HandlerThread:2356308 [interfaces.py:finish():175] Joined cpu
2023-01-23 17:42:57,082 DEBUG SystemMonitor:2356308 [system_monitor.py:_start():141] Publishing last batch of metrics
2023-01-23 17:42:57,082 INFO HandlerThread:2356308 [interfaces.py:finish():175] Joined disk2023-01-23 17:42:57,135 INFO HandlerThread:2356308 [interfaces.py:finish():175] Joined gpu
2023-01-23 17:42:57,135 INFO HandlerThread:2356308 [interfaces.py:finish():175] Joined memory
2023-01-23 17:42:57,137 INFO HandlerThread:2356308 [interfaces.py:finish():175] Joined network
2023-01-23 17:42:57,138 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,141 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 2
2023-01-23 17:42:57,142 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 3
2023-01-23 17:42:57,146 DEBUG SenderThread:2356308 [sender.py:send():334] send: stats
2023-01-23 17:42:57,146 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,153 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 3
2023-01-23 17:42:57,154 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,158 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 3
2023-01-23 17:42:57,158 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 4
2023-01-23 17:42:57,162 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,166 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 4
2023-01-23 17:42:57,166 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,170 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 4
2023-01-23 17:42:57,170 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 5
2023-01-23 17:42:57,174 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,178 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 5
2023-01-23 17:42:57,184 DEBUG SenderThread:2356308 [sender.py:send():334] send: summary
2023-01-23 17:42:57,195 INFO SenderThread:2356308 [sender.py:_save_file():1319] saving file wandb-summary.json with policy end
2023-01-23 17:42:57,195 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,199 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 5
2023-01-23 17:42:57,199 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 6
2023-01-23 17:42:57,203 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,207 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 6
2023-01-23 17:42:57,208 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,210 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 6
2023-01-23 17:42:57,211 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 7
2023-01-23 17:42:57,211 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:42:57,219 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:57,222 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 7
2023-01-23 17:42:57,223 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:57,225 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 7
2023-01-23 17:42:57,871 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:42:58,038 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: poll_exit
2023-01-23 17:42:58,874 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:42:58,877 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 8
2023-01-23 17:42:58,881 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: poll_exit
2023-01-23 17:42:58,881 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:58,888 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 8
2023-01-23 17:42:58,889 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:42:58,893 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 8
2023-01-23 17:42:58,925 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 9
2023-01-23 17:42:58,926 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:42:58,926 DEBUG SenderThread:2356308 [sender.py:send():334] send: artifact
2023-01-23 17:42:58,928 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 9
2023-01-23 17:42:59,040 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: poll_exit
2023-01-23 17:42:59,875 INFO Thread-13 :2356308 [dir_watcher.py:_on_file_modified():292] file/dir modified: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:43:00,318 INFO Thread-19 :2356308 [upload_job.py:push():101] Uploaded file /usr/users/sdi1/sdi1_3/.local/share/wandb/artifacts/staging/tmpu_k_w7p4
2023-01-23 17:43:00,318 INFO Thread-18 :2356308 [upload_job.py:push():101] Uploaded file /usr/users/sdi1/sdi1_3/.local/share/wandb/artifacts/staging/tmpp23cxl_l
2023-01-23 17:43:01,558 INFO SenderThread:2356308 [sender.py:send_artifact():1415] sent artifact job-git_gitlab-research.centralesupelec.fr_rayan.messaoudi_Kaggle_Phytoplankton.git_main.py - {'id': 'QXJ0aWZhY3Q6MzM5MzczNzcy', 'digest': '8d0812ac89f042065293b3dd027aa831', 'state': 'PENDING', 'aliases': [], 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjUwMzc4NDAy', 'latestArtifact': None}, 'version': 'latest'}
2023-01-23 17:43:01,559 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:01,563 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 9
2023-01-23 17:43:01,563 INFO SenderThread:2356308 [dir_watcher.py:finish():362] shutting down directory watcher
2023-01-23 17:43:01,877 INFO SenderThread:2356308 [dir_watcher.py:finish():392] scan: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files
2023-01-23 17:43:01,878 INFO SenderThread:2356308 [dir_watcher.py:finish():406] scan save: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/requirements.txt requirements.txt
2023-01-23 17:43:01,881 INFO SenderThread:2356308 [dir_watcher.py:finish():406] scan save: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/config.yaml config.yaml
2023-01-23 17:43:01,888 INFO SenderThread:2356308 [dir_watcher.py:finish():406] scan save: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-metadata.json wandb-metadata.json
2023-01-23 17:43:01,888 INFO SenderThread:2356308 [dir_watcher.py:finish():406] scan save: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json wandb-summary.json
2023-01-23 17:43:01,894 INFO SenderThread:2356308 [dir_watcher.py:finish():406] scan save: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log output.log
2023-01-23 17:43:01,895 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 10
2023-01-23 17:43:01,900 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: poll_exit
2023-01-23 17:43:01,901 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:43:01,906 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 10
2023-01-23 17:43:01,910 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:01,913 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 10
2023-01-23 17:43:01,913 INFO SenderThread:2356308 [file_pusher.py:finish():160] shutting down file pusher
2023-01-23 17:43:02,422 INFO Thread-23 :2356308 [upload_job.py:push():143] Uploaded file /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/output.log
2023-01-23 17:43:02,429 INFO Thread-21 :2356308 [upload_job.py:push():143] Uploaded file /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/config.yaml2023-01-23 17:43:02,585 INFO Thread-22 :2356308 [upload_job.py:push():143] Uploaded file /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/wandb-summary.json
2023-01-23 17:43:02,824 INFO Thread-20 :2356308 [upload_job.py:push():143] Uploaded file /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/files/requirements.txt
2023-01-23 17:43:02,914 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: status_report
2023-01-23 17:43:03,025 INFO Thread-12 :2356308 [sender.py:transition_state():585] send defer: 11
2023-01-23 17:43:03,026 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:43:03,028 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 11
2023-01-23 17:43:03,029 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:03,032 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 11
2023-01-23 17:43:03,032 INFO SenderThread:2356308 [file_pusher.py:join():165] waiting for file pusher
2023-01-23 17:43:03,036 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 12
2023-01-23 17:43:03,040 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:43:03,044 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 12
2023-01-23 17:43:03,048 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:03,051 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 12
2023-01-23 17:43:03,200 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 13
2023-01-23 17:43:03,201 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:43:03,204 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 13
2023-01-23 17:43:03,205 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:03,208 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 13
2023-01-23 17:43:03,208 INFO SenderThread:2356308 [sender.py:transition_state():585] send defer: 14
2023-01-23 17:43:03,212 DEBUG SenderThread:2356308 [sender.py:send():334] send: final
2023-01-23 17:43:03,212 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: defer
2023-01-23 17:43:03,216 DEBUG SenderThread:2356308 [sender.py:send():334] send: footer
2023-01-23 17:43:03,218 INFO HandlerThread:2356308 [handler.py:handle_request_defer():170] handle defer: 14
2023-01-23 17:43:03,223 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: defer
2023-01-23 17:43:03,226 INFO SenderThread:2356308 [sender.py:send_request_defer():581] handle sender defer: 14
2023-01-23 17:43:03,227 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: poll_exit
2023-01-23 17:43:03,229 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: server_info
2023-01-23 17:43:03,229 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: poll_exit
2023-01-23 17:43:03,234 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: get_summary
2023-01-23 17:43:03,237 DEBUG SenderThread:2356308 [sender.py:send_request():361] send_request: server_info
2023-01-23 17:43:03,242 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: sampled_history
2023-01-23 17:43:03,414 INFO MainThread:2356308 [wandb_run.py:_footer_history_summary_info():3427] rendering history
2023-01-23 17:43:03,416 INFO MainThread:2356308 [wandb_run.py:_footer_history_summary_info():3459] rendering summary
2023-01-23 17:43:03,419 INFO MainThread:2356308 [wandb_run.py:_footer_sync_info():3383] logging synced files
2023-01-23 17:43:03,424 DEBUG HandlerThread:2356308 [handler.py:handle_request():144] handle_request: shutdown
2023-01-23 17:43:03,427 INFO HandlerThread:2356308 [handler.py:finish():841] shutting down handler
2023-01-23 17:43:04,234 INFO WriterThread:2356308 [datastore.py:close():299] close: /usr/users/sdi1/sdi1_3/Projet_DL/Kaggle_Phytoplankton/wandb/run-20230123_174151-dwy5vvxq/run-dwy5vvxq.wandb
2023-01-23 17:43:04,414 INFO SenderThread:2356308 [sender.py:finish():1491] shutting down sender
2023-01-23 17:43:04,415 INFO SenderThread:2356308 [file_pusher.py:finish():160] shutting down file pusher
2023-01-23 17:43:04,418 INFO SenderThread:2356308 [file_pusher.py:join():165] waiting for file pusher