Machine Learning Application Benchmark

Project Description

The MLAB project concentrates on benchmarking of artificial intelligence models in constrained edge computing cases with a focus on onboard processing for Earth observation satellite systems. Within this ESA activity, our project focuses on benchmarking of system parameters (energy consumption, redundancy, space fill rates, communication properties) for selected computer vision challenges (Airbus Ship Detection Challenge, EuroSAT, Wildfire Detection, etc.) in the context of specific Xilinx hardware, including UltraScale+ architecture system-on-chip (SoC) designs. In this context, we further focus on the Xilinx Deep Learning Processing Unit (DPU) as well as the FINN system and questions of how models from the wider field need to be updated, constrained, quantized, pruned, and simplified in order to reach deployability on (preferrably) space-grade FPGAs. Further, we have a look at how small we can drive our models in order to gain a soft version of radiation-hardness from spatial on-chip diversity by deploying the same model (or variations with different weights) and combining results in voting schemes. As a side-effect, this project aims at generating a huge wildfire detection dataset on various ESA Sentinel missions in collaboration with OroraTech, which is supposed to become openly accessible and immense (currently about 500TB of raw data) focusing on well-documented wildfires in the United States of America.

Publications

1. Krstova, A., Hegwein, F., Lera, M. C. D., Ales, F., Petry, M., Ali, R., Mallah, M., Hili, L., Ghiglione, M., & Werner, M. (2023). On-Board Anomaly Detection on a Flight-Ready System. EDHPC 2023 - European Data Handling and Data Processing Conference. [BibTeX]

   @article{2023_edhpc_andreas,
     title = {On-Board Anomaly Detection on a Flight-Ready System},
     author = {Krstova, Alisa and Hegwein, Florian and Lera, Mario Castro De and Ales, Filippo and Petry, Michael and Ali, Rashid and Mallah, Maen and Hili, Laurent and Ghiglione, Max and Werner, Martin},
     journal = {EDHPC 2023 - European Data Handling and Data Processing Conference},
     project = {mlab},
     year = {2023}
   }
   

2. Dax, G., & Werner, M. (2022). The Role of Compression in Spatial Computing. PhD Colloquium of the Deutsche Geodätische Kommission, Section on Geoinformatics. [PDF] [BibTeX]

   @inproceedings{2022_phdColoquiumDGK_Dax,
     author = {Dax, Gabriel and Werner, Martin},
     title = {The Role of Compression in Spatial Computing},
     project = {mlab},
     booktitle = {PhD Colloquium of the Deutsche Geodätische Kommission, Section on Geoinformatics},
     year = {2022}
   }
   

3. Denizoglu, D. G., Dax, G., Nagarajan, S., Zhang, N., & Werner, M. (2022). Global Active Fire Detection – Towards a SAR-enabled Multi-Sensor Global Monitoring System. Living Planet Symposium 2022. [PDF] [BibTeX]

   @inproceedings{2022_wildfireS2_Gaye,
     author = {Denizoglu, Deniz Gaye and Dax, Gabriel and Nagarajan, Srilakshmi and Zhang, Ning and Werner, Martin},
     title = {Global Active Fire Detection – Towards a SAR-enabled Multi-Sensor Global Monitoring System},
     project = {mlab},
     booktitle = {Living Planet Symposium 2022},
     year = {2022}
   }
   

4. Raoofy, A., Dax, G., Serra, V., Ghiglione, M., Werner, M., & Trinitis, C. (2022). Benchmarking and Feasibility Aspects of Machine Learning in Space Systems. Proceedings of the 19th ACM International Conference on Computing Frontiers (CF’22). https://doi.org/10.1145/3528416.3530986 [PDF] [Online] [BibTeX]

   @inproceedings{2022_MLBenchmark_Raoofy,
     author = {Raoofy, Amir and Dax, Gabriel and Serra, Vittorio and Ghiglione, Max and Werner, Martin and Trinitis, Carsten},
     title = {Benchmarking and Feasibility Aspects of Machine Learning in Space Systems},
     year = {2022},
     isbn = {9781450393386},
     publisher = {Association for Computing Machinery (ACM)},
     address = {New York, NY, USA},
     project = {mlab},
     url = {https://doi.org/10.1145/3528416.3530986},
     doi = {10.1145/3528416.3530986},
     booktitle = {Proceedings of the 19th ACM International Conference on Computing Frontiers (CF'22)}
   }
   

5. Ghiglione, M., Serra, V., Raoofy, A., Dax, G., Trinitis, C., Werner, M., Schulz, M., & Furano, G. (2022). Survey of frameworks for inference of neural networks in space data system. Data Systems in Aerospace (DASIA). Eurospace. [PDF] [BibTeX]

   @article{2022_cnnInSpace_Ghiglione,
     author = {Ghiglione, Max and Serra, Vittorio and Raoofy, Amir and Dax, Gabriel and Trinitis, Carsten and Werner, Martin and Schulz, Martin and Furano, Gianluca},
     title = {{Survey of frameworks for inference of neural networks in space data system}},
     journal = {Data Systems in Aerospace (DASIA). Eurospace},
     project = {mlab},
     year = {2022}
   }
   

6. Ghiglione, M., Raoofy, A., Dax, G., Furano, G., Wiest, R., Trinitis, C., Werner, M., Schulz, M., & Langer, M. (2021). Machine Learning Application Benchmark for In-Orbit On-Board Data Processing. European Workshop on On-Board Data Processing. https://zenodo.org/record/5520877/files/05.04_OBDP2021_Ghiglione.pdf [PDF] [Online] [BibTeX]

   @inproceedings{2021_MachineLearningApplicationBenchmark_Ghiglione,
     title = {Machine Learning Application Benchmark for In-Orbit On-Board Data Processing},
     author = {Ghiglione, Max and Raoofy, Amir and Dax, Gabriel and Furano, Gianluca and Wiest, Richard and Trinitis, Carsten and Werner, Martin and Schulz, Martin and Langer, Martin},
     booktitle = {European Workshop on On-Board Data Processing},
     year = {2021},
     project = {mlab},
     url = {https://zenodo.org/record/5520877/files/05.04_OBDP2021_Ghiglione.pdf}
   }
   

7. Raoofy, A., Dax, G., Ghiglione, M., Langer, M., Trinitis, C., Werner, M., & Schulz, M. (2021). Benchmarking Machine Learning Inference in FPGA-based Accelerated Space Applications. Proceedings of the Workshop on Benchmarking Machine Learning Workloads Co-Located with IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS). [PDF] [BibTeX]

   @inproceedings{2021_fpgabenchmarkpositionpaper_Raoofy,
     booktitle = {Proceedings of the Workshop on Benchmarking Machine Learning Workloads co-located with IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)},
     title = {Benchmarking Machine Learning Inference in FPGA-based Accelerated Space Applications},
     author = {Raoofy, Amir and Dax, Gabriel and Ghiglione, Max and Langer, Martin and Trinitis, Carsten and Werner, Martin and Schulz, Martin},
     project = {mlab},
     year = {2021}
   }