Research & Development

Externally funded research projects:

• The Forcalytics project (Real-Time Soccer Analysis, funded by RCN)
  
• The AI-storyteller project (​Intelligent Content Curation for Sports, funded by RCN)
  
• The AI-producer project (AI-based Video Clipping and Summarization of Sport Events, funded by RCN)
• The AutoCap  project (Automatic Anomaly Detection in Video Capsule Endoscopy, funded by RCN)
• The Skylantern project (Live and on-Demand Tiled 360 Panorama Streaming, funded by Huawei Technologies Co., LTD.)
  
• The DigSys pre-project (Non-Invasive, Scalable, Algorithmic Automatic Screening of the Digestive System, funded by RCN)
• The VUE project (Video system for User Engagement based on in-video metadata, funded by RCN)

The AI-storyteller project continue investigating AI-solutions for video event curation and summarization. Simula Research Laboratory is an important research partner in the project.

Selected Scientific publications:

• Hockey2D: A Keypoint-Based Framework for Ice Hockey Rink Localization and Object Mapping, Mehdi Houshmand Sarkhoosh et al., Proc. of Content-Based Multimedia Indexing (CBMI), 2025
  
• SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understanding, Sushant Gautam et al., arXiv preprint arXiv:2505.16630, 2025
  
• SmartCrop-R: Adaptive Real-Time Video Cropping for Sports, Mehdi Houshmand Sarkhoosh et al., Proc. of Mile-High Video (MHV), 2025
  
• HockeyOrient: A Dataset for Ice Hockey Player Orientation Classification, Mehdi Houshmand Sarkhoosh et al., Proc. of ACM Multimedia Systems Conference (MMSys), 2025
  
• HockeyAI: A Multi-Class Ice Hockey Dataset for Object Detection, Mehdi Houshmand Sarkhoosh et al., Proc. of ACM Multimedia Systems Conference (MMSys), 2025
  
• HockeyRink: A Dataset for Precise Ice Hockey Rink Keypoint Mapping and Analytics, Mehdi Houshmand Sarkhoosh et al., Proc. of ACM Multimedia Systems Conference (MMSys), 2025
  
• Playertv: Advanced player tracking and identification for automatic soccer highlight clips, Håkon Maric Solberg et al., Proc. Of International Symposium on Multimedia (ISM), 2024
  
• SoccerNet-Echoes: A Soccer game audio commentary dataset, Sushant Gautam et al., Proc. of International Symposium on Multimedia (ISM), 2024
  
• AI-Based Cropping of Sport Videos using SmartCrop, Sayed Mohammad Majidi Dorcheh et al., International Journal of Semantic Computing, 2024
  
• Demo: Creating Player-Specific Soccer Highlight Clips with PlayerTV, Håkon Maric Solberg et al., Proc. of International Conference on Content-based Multimedia Indexing (CBMI), 2024
  
• SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries, Aleksander Theo Strand et al., Proc. of International Conference on Content-based Multimedia Indexing (CBMI), 2024
  
• Demo: Soccer Information Retrieval via Natural Queries using SoccerRAG, Aleksander Theo Strand et al., Proc. of International Conference on Content-based Multimedia Indexing (CBMI), 2024
  
• A large-scale multivariate soccer athlete health, performance, and position monitoring dataset, Cise Midoglu et al., Scientific Data, 2024
  
• TACDEC: Dataset of Tackle Events in Soccer Game Videos, Evan Jåsund Kassab et al., Proc. of ACM Multimedia Systems Conference (MMSys), 2024  
  
• SmartCrop-H: AI-Based Cropping of Ice Hockey Videos, Sayed Mohammad Majidi Dorcheh et al., Proc. of ACM Multimedia Systems Conference (MMSys), 2024  
  
• Multimodal AI-Based Summarization and Storytelling for Soccer on Social Media, Mehdi Houshmand Sarkhoosh et al.,  Proc. of ACM Multimedia Systems Conference (MMSys), 2024  
  
• The SoccerSum Dataset for Automated Detection, Segmentation, and Tracking of Objects on the Soccer Pitch, Mehdi Houshmand Sarkhoosh et al.,  Proc. of ACM Multimedia Systems Conference (MMSys), 2024  
  
• AI-Based Sports Highlight Generation for Social Media,  Cise Midoglu et al. , Proc. of  ACM Mile-High Video Conference (MHV), 2024
  
• AI-Based Cropping of Soccer Videos for Different Social Media Representations,  Mehdi Houshmand Sarkhoosh et al., Proc. of Inernational Conference on Multimedia Modelling (MMM), 2024
  
• SmartCrop: AI-Based Cropping of Soccer Videos,  Sayed Mohammad Majidi Dorcheh et al., Proc. of Internantinal Symphosium on Multimedia (ISM), 2023
  
• Exploration of Different Time Series Models for Soccer Athlete Performance Prediction,  Siarhei Kulakou et al., Engineering proceedings, Vol. 18, No. 1, 2022 
  
• Automatic Thumbnail Selection for Soccer Videos using Machine Learning, Andreas Husa et al, Proc. of ACM Multimedia Systems Conference (MMSys), 2022  
  
• HOST-ATS: automatic thumbnail selection with dashboard-controlled ML pipeline and dynamic user survey, Andreas Husa et al. , Proc. of the ACM Multimedia Systems Conference (MMSYS), June 2022, pp. 334-340
  
• MMSys'22 Grand Challenge on AI-based Video Production for Soccer, Cise Midoglu et al., ​arXiv:2202.01031, 2022  
  
• Automated Event Detection and Classification in Soccer: The Potential of Using Multiple Modalities,  Olav Rongved et al., Machine Learning and Knowledge Extraction, Volume 4, Issue 3, 2021, pp. 1030-1054 
  
• AI-Based Video Clipping of Soccer Events,  Joakim O. Valand et al., Machine Learning and Knowledge Extraction, Volume 3, Issue 4, December 2021, pp. 990-1008
  
• Automated Clipping of Soccer Events using Machine Learning, Joakim O. Valand et al., Proc. of the IEEE International Symphosium of Multimedia (ISM), Virtual, December 2021 
  
• Using 3D Convolutional Neural Networks for Real-time Detection of Soccer Events,  Olav Rongved et al., International Journal of Semantic Computing, Vol. 15, No. 02, 2021, pp. 161-187
  
• Real-Time Detection of Events in Soccer Videos using 3D Convolutional Neural Networks,  Olav Rongved et al., Proc. of the IEEE International Symphosium of Multimeida (ISM), Virtual, December 2020 
  
• Scalable Infrastructure for Efficient Real-Time Sports Analytics,  Håvard Johansen et al., Proc. of Workshop on Action Modelling for Interaction and Analysis in Smart Sports and Physical Education (MAIStroPE), October 2020  
  
• PMData: a sports logging dataset, Vajira Thambawita et al., Proc. of the ACM Multimedia Systems (MMSYS), Istanbul, Turkey, 2020
  
• Effcient Live and On-Demand​ Tiled HEVC 360 VR Video Streaming, Mattis Jeppsson et al., International Journal of Semantic Computing Vol. 13, No. 3, 2019, pp. 1–25 
  
• Real-time Analysis of Physical Performance Parameters in Elite Soccer, Kim Andreassen et al., Proc. of the ACM International Workshop on Content-Based Multimedia Indexing (CBMI), Dublin, Ireland, September 2019 
  
• Predicting Peek Readiness-to-Train of Soccer Players Using Long Short-Term Memory Recurrent Neural Networks, Theodor Wiik et al., Proceedings of the ACM International Workshop on Content-Based Multimedia Indexing (CBMI), Dublin, Ireland, September 2019 
  
• Efficient Live and on-Demand Tiled HEVC 360 VR Video Streaming (Best paper award), Mattis Jeppsson et al., Proc. of IEEE International Symposium on Multimedia (ISM), Taichung, Taiwan, December 2018 
  
• "Quantified Soccer Using Positional Data: A Case Study", Svein A. Pettersen et al., Frontiers in Physiology, Vol. 9, July 2018
  
• Deep Learning and Hand-crafted Feature Based Approaches for Polyp Detection in Medical Videos (Best paper award), Konstantin Pogorelov et al., Proc. of International Symposium on Computer-Based Medical Systems (CBMS), Karlstad, Sweden, June 2018 
  Dissecting Deep Neural Networks for Better Medical Image Classification and Classification Understanding, Steven Alexander Hicks et al., Proc. of International Symposium on Computer-Based Medical Systems (CBMS), Karlstad, Sweden, June 2018 
  
• Mimir: An Automatic Reporting and Reasoning System for DeepLearning based Analysis in the Medical Domain, Steven Alexander Hicks et al., Proc. of ACM Multimedia Systems (MMSYS), Amsterdam, The Netherlands, June 2018 
  
• Comprehensible Reasoning and Automated Reporting of Medical Examinations Based on Deep Learning Analysis, Steven Alexander Hicks et al., Proc. of ACM Multimedia Systems (MMSYS), Amsterdam, The Netherlands, June 2018 
  
• Camera Synchronization for Panoramic Videos (book chapter), Vamsidhar R. Gaddam et al., In: Mario Montagud, Pablo Cesar, Fernando Boronat, Jack Jansen (eds), MediaSync, Springer, 2018, pp 565-592 
  
• Deep Learning and Handcrafted Feature Based Approaches for Automatic Detection of Angiectasia, Konstantin Pogorelov et al., Proc. of the IEEE International Conference on Biomedical and Health Informatics (BHI), Las Vegas, USA, March 2018 
  
• Automatic Detection of Angiectasia: Evaluation of Deep Learning and Handcrafted Approaches, Konstantin Pogorelov et al., Proc. of the IEEE International Conference on Biomedical and Health Informatics (BHI), Las Vegas, USA, March 2018 
  
• An Experimental Evaluation of Debayering Algorithms on GPUs for Recording Panoramic Video in Real-time, Ragnar Langseth et al., ​International Journal of Multimedia Data Engineering and Management, Vol. 6, No. 3, 2015, pp. 1-16
  
• Using a Commodity Hardware Video Encoder for Interactive Applications, Håkon Kvale Stensland et al., ​International Journal of Multimedia Data Engineering and Management, Vol. 6, No. 3, 2015, pp. 17-31
  
• Tiling of Panorama Video for Interactive Virtual Cameras: Overheads and Potential Bandwidth Requirement Reduction, Vamsidhar Reddy Gaddam et al., Proc. of Packet Video (PV), Cairns, Australia, May/June 2015