2025-04-29T12:28:50 Running all scenarios... 2025-04-29T12:28:50 Setup file saved as montenegro.cfg in results directory. 2025-04-29T12:28:50 Scenario: 2025-04-29T12:28:50 Camera network proxy for the camera found. Using proxy. 2025-04-29T12:28:50 Analyzing montenegro Camera images: 2025-04-29T12:28:50 Establishing connection(s)... 2025-04-29T12:28:50 Looking for images... 2025-04-29T12:28:50 Crawling through 34 paths... 2025-04-29T12:28:51 Running all scenarios... 2025-04-29T12:28:51 Setup file saved as montenegro.cfg in results directory. 2025-04-29T12:28:51 Scenario: 2025-04-29T12:28:51 Camera network proxy for the camera found. Using proxy. 2025-04-29T12:28:51 Analyzing montenegro Camera images: 2025-04-29T12:28:51 Establishing connection(s)... 2025-04-29T12:28:51 Looking for images... 2025-04-29T12:28:51 Crawling through 34 paths... 2025-04-29T12:28:51 73 possible files found. 2025-04-29T12:28:52 73 possible files found. 2025-04-29T12:28:53 49 possible files found. 2025-04-29T12:28:53 49 possible files found. 2025-04-29T12:28:54 103 possible files found. 2025-04-29T12:28:54 103 possible files found. 2025-04-29T12:28:55 109 possible files found. 2025-04-29T12:28:55 107 possible files found. 2025-04-29T12:28:55 105 possible files found. 2025-04-29T12:28:55 105 possible files found. 2025-04-29T12:28:55 101 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 109 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 107 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 103 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 79 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 47 possible files found. 2025-04-29T12:28:56 105 possible files found. 2025-04-29T12:28:56 47 possible files found. 2025-04-29T12:28:56 101 possible files found. 2025-04-29T12:28:56 47 possible files found. 2025-04-29T12:28:56 103 possible files found. 2025-04-29T12:28:56 47 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 79 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 59 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 103 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 47 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 59 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 103 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:57 97 possible files found. 2025-04-29T12:28:57 101 possible files found. 2025-04-29T12:28:58 105 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 Listing images between dates 2025-03-29 - 2025-04-29 between times of the day 05:15:00 - 18:45:59... 2025-04-29T12:28:58 639 images found. 2025-04-29T12:28:58 Running analysis 1: Plug-in: ml_ann_3_dense_reg_1... 2025-04-29T12:28:58 Reading results of image that are already processed... 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 608 images are already processed. 57 images will be processed. Results of 26 images which do not fit the temporal selection will be deleted. 2025-04-29T12:28:58 Checking existing images... 2025-04-29T12:28:58 57 images to be downloaded. 2025-04-29T12:28:58 Downloading/updating images... 2025-04-29T12:28:58 97 possible files found. 2025-04-29T12:28:58 105 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 101 possible files found. 2025-04-29T12:28:58 Listing images between dates 2025-03-29 - 2025-04-29 between times of the day 05:15:00 - 18:45:59... 2025-04-29T12:28:58 639 images found. 2025-04-29T12:28:58 Running analysis 1: Plug-in: ml_ann_3_dense_reg_1... 2025-04-29T12:28:58 Reading results of image that are already processed... 2025-04-29T12:28:58 608 images are already processed. 57 images will be processed. Results of 26 images which do not fit the temporal selection will be deleted. 2025-04-29T12:28:58 Checking existing images... 2025-04-29T12:28:58 57 images to be downloaded. 2025-04-29T12:28:58 Downloading/updating images... 2025-04-29T12:30:45 57 images were downloaded. 2025-04-29T12:30:45 Producing polygonic image mask... 2025-04-29T12:30:45 No polygonic masking selected. 2025-04-29T12:30:45 Number of unmasked pixels: 1244160 2025-04-29T12:30:45 Number of images:57 2025-04-29T12:30:46 Testing plugin for batch processing. 2025-04-29T12:30:46 Test list file saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_list.csv 2025-04-29T12:30:46 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:30:46 57 images were downloaded. 2025-04-29T12:30:46 Producing polygonic image mask... 2025-04-29T12:30:46 No polygonic masking selected. 2025-04-29T12:30:46 Number of unmasked pixels: 1244160 2025-04-29T12:30:46 Number of images:57 2025-04-29T12:30:46 Testing plugin for batch processing. 2025-04-29T12:30:46 Test list file saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_list.csv 2025-04-29T12:30:46 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:30:51 Plugin output: Loading the model 2025-04-29T12:30:51 Plugin output: Reading batch list file 2025-04-29T12:30:51 Plugin output: 1 images to process 2025-04-29T12:30:51 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:30:51 Plugin output: Processing images and saving results 2025-04-29T12:30:51 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_results.csv 2025-04-29T12:30:51 Plugin output: Loading the model 2025-04-29T12:30:51 Plugin output: Reading batch list file 2025-04-29T12:30:51 Plugin output: 1 images to process 2025-04-29T12:30:51 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:30:51 Plugin output: Processing images and saving results 2025-04-29T12:30:51 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_results.csv 2025-04-29T12:30:51 2025-04-29T12:30:51 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_results.csv 2025-04-29T12:30:51 Test successful. Plugin supports batch processing. 2025-04-29T12:30:51 Creating image and mask list to submit to the plugin. 2025-04-29T12:30:51 List file saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_list.csv 2025-04-29T12:30:51 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:30:52 2025-04-29T12:30:52 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_results.csv 2025-04-29T12:30:52 Test successful. Plugin supports batch processing. 2025-04-29T12:30:52 Creating image and mask list to submit to the plugin. 2025-04-29T12:30:52 List file saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_list.csv 2025-04-29T12:30:52 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:31:11 Plugin output: Loading the model 2025-04-29T12:31:11 Plugin output: Reading batch list file 2025-04-29T12:31:11 Plugin output: 57 images to process 2025-04-29T12:31:11 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:11 Plugin output: Processing images and saving results 2025-04-29T12:31:11 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_results.csv 2025-04-29T12:31:11 Plugin output: Loading the model 2025-04-29T12:31:11 Plugin output: Reading batch list file 2025-04-29T12:31:11 Plugin output: 57 images to process 2025-04-29T12:31:11 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:11 Plugin output: Processing images and saving results 2025-04-29T12:31:11 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_results.csv 2025-04-29T12:31:12 2025-04-29T12:31:12 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/88a06a6e-5e4e-4457-a23b-376fcc268fef/batch_results.csv 2025-04-29T12:31:12 Parsing results... 2025-04-29T12:31:12 Merging results... 2025-04-29T12:31:12 Storing results... 2025-04-29T12:31:12 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.tsv, /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.tsvx. 2025-04-29T12:31:12 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.csv. 2025-04-29T12:31:12 Running analysis 2: Plug-in: ml_cnn_large_kernel_1... 2025-04-29T12:31:12 Reading results of image that are already processed... 2025-04-29T12:31:12 2025-04-29T12:31:12 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/f1970057-60c5-4af5-87e6-136dbb470540/batch_results.csv 2025-04-29T12:31:12 Parsing results... 2025-04-29T12:31:12 Merging results... 2025-04-29T12:31:12 Storing results... 2025-04-29T12:31:12 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.tsv, /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.tsvx. 2025-04-29T12:31:12 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A001R000.csv. 2025-04-29T12:31:12 Running analysis 2: Plug-in: ml_cnn_large_kernel_1... 2025-04-29T12:31:12 Reading results of image that are already processed... 2025-04-29T12:31:12 608 images are already processed. 57 images will be processed. Results of 26 images which do not fit the temporal selection will be deleted. 2025-04-29T12:31:12 Checking existing images... 2025-04-29T12:31:12 0 images to be downloaded. 2025-04-29T12:31:12 Producing polygonic image mask... 2025-04-29T12:31:12 608 images are already processed. 57 images will be processed. Results of 26 images which do not fit the temporal selection will be deleted. 2025-04-29T12:31:12 Checking existing images... 2025-04-29T12:31:12 0 images to be downloaded. 2025-04-29T12:31:12 Producing polygonic image mask... 2025-04-29T12:31:12 No polygonic masking selected. 2025-04-29T12:31:12 Number of unmasked pixels: 1244160 2025-04-29T12:31:12 Number of images:57 2025-04-29T12:31:12 No polygonic masking selected. 2025-04-29T12:31:12 Number of unmasked pixels: 1244160 2025-04-29T12:31:12 Number of images:57 2025-04-29T12:31:12 Testing plugin for batch processing. 2025-04-29T12:31:12 Test list file saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_list.csv 2025-04-29T12:31:12 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:31:12 Testing plugin for batch processing. 2025-04-29T12:31:12 Test list file saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_list.csv 2025-04-29T12:31:12 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:31:16 Plugin output: Loading the model 2025-04-29T12:31:16 Plugin output: Reading batch list file 2025-04-29T12:31:16 Plugin output: 1 images to process 2025-04-29T12:31:16 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:16 Plugin output: Processing images and saving results 2025-04-29T12:31:16 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_results.csv 2025-04-29T12:31:16 Plugin output: Loading the model 2025-04-29T12:31:16 Plugin output: Reading batch list file 2025-04-29T12:31:16 Plugin output: 1 images to process 2025-04-29T12:31:16 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:16 Plugin output: Processing images and saving results 2025-04-29T12:31:16 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_results.csv 2025-04-29T12:31:17 2025-04-29T12:31:17 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_results.csv 2025-04-29T12:31:17 Test successful. Plugin supports batch processing. 2025-04-29T12:31:17 Creating image and mask list to submit to the plugin. 2025-04-29T12:31:17 List file saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_list.csv 2025-04-29T12:31:17 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:31:17 2025-04-29T12:31:17 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_results.csv 2025-04-29T12:31:17 Test successful. Plugin supports batch processing. 2025-04-29T12:31:17 Creating image and mask list to submit to the plugin. 2025-04-29T12:31:17 List file saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_list.csv 2025-04-29T12:31:17 Submitting image and mask list to the plugin. There may be no logging until the plugin ends running. 2025-04-29T12:31:41 Plugin output: Loading the model 2025-04-29T12:31:41 Plugin output: Reading batch list file 2025-04-29T12:31:41 Plugin output: 57 images to process 2025-04-29T12:31:41 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:41 Plugin output: Processing images and saving results 2025-04-29T12:31:41 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_results.csv 2025-04-29T12:31:42 Plugin output: Loading the model 2025-04-29T12:31:42 Plugin output: Reading batch list file 2025-04-29T12:31:42 Plugin output: 57 images to process 2025-04-29T12:31:42 Plugin output: Limiting number of images to 5000 since the plugin crashes. More images will be processed in the next run. 2025-04-29T12:31:42 Plugin output: Processing images and saving results 2025-04-29T12:31:42 Plugin output: Results saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_results.csv 2025-04-29T12:31:43 2025-04-29T12:31:43 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/d76b9370-e224-4873-af59-8caadf08c144/batch_results.csv 2025-04-29T12:31:43 Parsing results... 2025-04-29T12:31:43 Merging results... 2025-04-29T12:31:43 Storing results... 2025-04-29T12:31:43 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.tsv, /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.tsvx. 2025-04-29T12:31:43 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.csv. 2025-04-29T12:31:43 Scenario: 2025-04-29T12:31:43 Removing (57) downloaded images to save space. 2025-04-29T12:31:43 Camera network proxy for the camera found. Using proxy. 2025-04-29T12:31:43 Checking preview image for montenegro... 2025-04-29T12:31:43 Updating preview image for camera: PHENOCAM - montenegro 2025-04-29T12:31:43 Looking for the image for the Time of the image to be used as preview image provided by the setup file.... 2025-04-29T12:31:43 Establishing connection(s)... 2025-04-29T12:31:43 Looking for images... 2025-04-29T12:31:43 76 possible files found. 2025-04-29T12:31:43 Listing maximum 1 images between dates 2020-12-05 - 2020-12-05 between times of the day 12:20:00 - 12:20:59... 2025-04-29T12:31:43 Listing maximum 1 images between dates 2020-12-05 - 2020-12-05 between times of the day 12:20:00 - 12:20:59... 2025-04-29T12:31:43 0 images found. 2025-04-29T12:31:43 Checking existing images... 2025-04-29T12:31:43 0 images to be downloaded. 2025-04-29T12:31:43 Can not find the image for the Time of the image to be used as preview image provided by the setup file. It is removed from the setup. 2025-04-29T12:31:43 Looking for a suitable image... 2025-04-29T12:31:43 28.04.2025 2025-04-29T12:31:43 Establishing connection(s)... 2025-04-29T12:31:43 Looking for images... 2025-04-29T12:31:43 2025-04-29T12:31:43 Results should be saved at /FMIprot/srcrun/master_report/src/tmp/f2809412-56ca-49cb-b7aa-071daa42be06/batch_results.csv 2025-04-29T12:31:43 Parsing results... 2025-04-29T12:31:43 Merging results... 2025-04-29T12:31:43 Storing results... 2025-04-29T12:31:43 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.tsv, /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.tsvx. 2025-04-29T12:31:43 Results are stored in /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/S001A002R000.csv. 2025-04-29T12:31:43 Scenario: 2025-04-29T12:31:43 Removing (57) downloaded images to save space. 2025-04-29T12:31:43 Camera network proxy for the camera found. Using proxy. 2025-04-29T12:31:43 Checking preview image for montenegro... 2025-04-29T12:31:43 Updating preview image for camera: PHENOCAM - montenegro 2025-04-29T12:31:43 Looking for the image for the Time of the image to be used as preview image provided by the setup file.... 2025-04-29T12:31:43 Establishing connection(s)... 2025-04-29T12:31:43 Looking for images... 2025-04-29T12:31:43 76 possible files found. 2025-04-29T12:31:43 Listing maximum 1 images between dates 2020-12-05 - 2020-12-05 between times of the day 12:20:00 - 12:20:59... 2025-04-29T12:31:43 Listing maximum 1 images between dates 2020-12-05 - 2020-12-05 between times of the day 12:20:00 - 12:20:59... 2025-04-29T12:31:43 0 images found. 2025-04-29T12:31:43 Checking existing images... 2025-04-29T12:31:43 0 images to be downloaded. 2025-04-29T12:31:43 Can not find the image for the Time of the image to be used as preview image provided by the setup file. It is removed from the setup. 2025-04-29T12:31:43 Looking for a suitable image... 2025-04-29T12:31:43 28.04.2025 2025-04-29T12:31:43 Establishing connection(s)... 2025-04-29T12:31:43 Looking for images... 2025-04-29T12:31:44 103 possible files found. 2025-04-29T12:31:44 Listing maximum 1 images between dates 2025-04-28 - 2025-04-28 between times of the day 09:00:00 - 18:59:59... 2025-04-29T12:31:44 Listing maximum 1 images between dates 2025-04-28 - 2025-04-28 between times of the day 09:00:00 - 18:59:59... 2025-04-29T12:31:44 1 images found. 2025-04-29T12:31:44 Checking existing images... 2025-04-29T12:31:44 1 images to be downloaded. 2025-04-29T12:31:44 Downloading/updating images... 2025-04-29T12:31:44 Image: 2025-04-29T12:31:44 1 images were downloaded. 2025-04-29T12:31:44 Preview image downloaded/updated for camera: PHENOCAM - montenegro 2025-04-29T12:31:44 103 possible files found. 2025-04-29T12:31:44 Listing maximum 1 images between dates 2025-04-28 - 2025-04-28 between times of the day 09:00:00 - 18:59:59... 2025-04-29T12:31:44 Listing maximum 1 images between dates 2025-04-28 - 2025-04-28 between times of the day 09:00:00 - 18:59:59... 2025-04-29T12:31:44 1 images found. 2025-04-29T12:31:44 Checking existing images... 2025-04-29T12:31:44 0 images to be downloaded. 2025-04-29T12:31:44 Preview image downloaded/updated for camera: PHENOCAM - montenegro 2025-04-29T12:31:47 Preparing report... 2025-04-29T12:31:47 Result plots are saved as /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/results.html 2025-04-29T12:31:47 Report is saved as /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/report.html 2025-04-29T12:31:47 Preparing report... 2025-04-29T12:31:47 Result plots are saved as /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/results.html 2025-04-29T12:31:47 Report is saved as /var/www/html/data/operational/phenocam_ml_p2_nrt/montenegro/report.html