2026

A conversational multi-agent AI system for automated plant phenotyping

A conversational multi-agent AI system for automated plant phenotyping

Generating realistic images to accurately predict changes in the structure of brain MRI can be a crucial tool for clinicians. Such applications can help assess patients’ outcomes and analyze how diseases progress at the individual level. However, existing methods developed for this task present some l...
TRUST: Leveraging Text Robustness for Unsupervised Domain Adaptation

TRUST: Leveraging Text Robustness for Unsupervised Domain Adaptation

Generating realistic images to accurately predict changes in the structure of brain MRI can be a crucial tool for clinicians. Such applications can help assess patients’ outcomes and analyze how diseases progress at the individual level. However, existing methods developed for this task present some l...
Count2Density: Crowd density estimation without location-level annotations

Count2Density: Crowd density estimation without location-level annotations

Generating realistic images to accurately predict changes in the structure of brain MRI can be a crucial tool for clinicians. Such applications can help assess patients’ outcomes and analyze how diseases progress at the individual level. However, existing methods developed for this task present some l...
Temporally-aware diffusion model for brain progression modelling with bidirectional temporal regularisation

Temporally-aware diffusion model for brain progression modelling with bidirectional temporal regularisation

Generating realistic images to accurately predict changes in the structure of brain MRI can be a crucial tool for clinicians. Such applications can help assess patients’ outcomes and analyze how diseases progress at the individual level. However, existing methods developed for this task present some l...

2025

GMT: Guided Mask Transformer for Leaf Instance Segmentation

GMT: Guided Mask Transformer for Leaf Instance Segmentation

Deep learning is making strides in plant phenotyping and agriculture. But pretrained models require significant adaptation to work on new target datasets originating from a different experiment even on the same species. The current solution is to retrain the model on the new target data implying the...
A Simple Approach to Pavement Cell Segmentation

A Simple Approach to Pavement Cell Segmentation

Deep learning is making strides in plant phenotyping and agriculture. But pretrained models require significant adaptation to work on new target datasets originating from a different experiment even on the same species. The current solution is to retrain the model on the new target data implying the...
Cloud Detection Challenge-Methods and Results

Cloud Detection Challenge-Methods and Results

Accurate weather monitoring depends significantly on cloud detection, a crucial process achievable through remote sensing tools such as satellite imagery and radar or through the analysis of data obtained from ceilometers. A ceilometer is a lidar-based device allowing to analyse the atmosphere and detect...
Benchmarking computer vision architectures for cloud detection from lidar ceilometer backscatter data

Benchmarking computer vision architectures for cloud detection from lidar ceilometer backscatter data

Accurate weather monitoring depends significantly on cloud detection, a crucial process achievable through remote sensing tools such as satellite imagery and radar or through the analysis of data obtained from ceilometers. A ceilometer is a lidar-based device allowing to analyse the atmosphere and detect...
You Are What You Write: Author re-identification privacy attacks in the era of pre-trained language models

You Are What You Write: Author re-identification privacy attacks in the era of pre-trained language models

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these models presents the possibility of encoding personally identifiable...

2024

TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRI

TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRI

Generating realistic images to accurately predict changes in the structure of brain MRI can be a crucial tool for clinicians. Such applications can help assess patients’ outcomes and analyze how diseases progress at the individual level. However, existing methods developed for this task present some l...
Synchronization is All You Need: Exocentric-to-Egocentric Transfer for Temporal Action Segmentation with Unlabeled Synchronized Video Pairs

Synchronization is All You Need: Exocentric-to-Egocentric Transfer for Temporal Action Segmentation with Unlabeled Synchronized Video Pairs

We consider the problem of transferring a temporal action segmentation system initially designed for exocentric (fixed) cameras to an egocentric scenario, where wearable cameras capture video data. The conventional supervised approach requires the collection and labeling of a new set of egocentric videos...
Unsupervised anomaly detection for pome fruit quality inspection using X-ray radiography

Unsupervised anomaly detection for pome fruit quality inspection using X-ray radiography

A novel fully convolutional autoencoder (convAE) was introduced to analyze X-ray radiography images of ‘Braeburn’ apples and ‘Conference’ pears with and without disorders for online sorting purposes. The model was solely trained on either apple or pear samples without disorders and outperformed a tradi...
On the cloud detection from backscattered images generated from a lidar-based ceilometer: Current state and opportunities

On the cloud detection from backscattered images generated from a lidar-based ceilometer: Current state and opportunities

Accurate weather monitoring depends significantly on cloud detection, a crucial process achievable through remote sensing tools such as satellite imagery and radar or through the analysis of data obtained from ceilometers. A ceilometer is a lidar-based device allowing to analyse the atmosphere and detect...
Federated Learning in a Semi-Supervised Environment for Earth Observation Data

Federated Learning in a Semi-Supervised Environment for Earth Observation Data

We propose FedRec, a federated learning workflow taking advantage of unlabelled data in a semi-supervised environment to assist in the training of a supervised aggregated model. In our proposed method, an encoder architecture extracting features from unlabelled data is aggregated with the feature extractor...
Evaluating Language Model Vulnerability to Poisoning Attacks in Low-Resource Settings

Evaluating Language Model Vulnerability to Poisoning Attacks in Low-Resource Settings

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these models presents the possibility of encoding personally identifiable...

2023

Adapting Vision Foundation Models for Plant Phenotyping

Adapting Vision Foundation Models for Plant Phenotyping

Deep learning is making strides in plant phenotyping and agriculture. But pretrained models require significant adaptation to work on new target datasets originating from a different experiment even on the same species. The current solution is to retrain the model on the new target data implying the...
TouchEnc: a Novel Behavioural Encoding Technique to Enable Computer Vision for Continuous Smartphone User Authentication

TouchEnc: a Novel Behavioural Encoding Technique to Enable Computer Vision for Continuous Smartphone User Authentication

This paper proposes a novel approach for semi-supervised domain adaptation for holistic regression tasks, where a DNN predicts a continuous value y∈R given an input image x. The current literature generally lacks specific domain adaptation approaches for this task, as most of them mostly focus on classification. I...
An omnidirectional approach to touch-based continuous authentication

An omnidirectional approach to touch-based continuous authentication

This paper proposes a novel approach for semi-supervised domain adaptation for holistic regression tasks, where a DNN predicts a continuous value y∈R given an input image x. The current literature generally lacks specific domain adaptation approaches for this task, as most of them mostly focus on classification. I...

2022

Transfer Learning via Test-time Neural Networks Aggregation

Transfer Learning via Test-time Neural Networks Aggregation

It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution due to the domain shift. In order to tackle this known issue,...

2021

Semi-Supervised Domain Adaptation for Holistic Counting under Label Gap

Semi-Supervised Domain Adaptation for Holistic Counting under Label Gap

This paper proposes a novel approach for semi-supervised domain adaptation for holistic regression tasks, where a DNN predicts a continuous value y∈R given an input image x. The current literature generally lacks specific domain adaptation approaches for this task, as most of them mostly focus on classification. I...
Plant phenotyping on-demand: an integrative web-based framework using drones and participatory sensing in greenhouses

Plant phenotyping on-demand: an integrative web-based framework using drones and participatory sensing in greenhouses

In this paper, we present an empirical evaluation of 30 features used in touch-based continuous authentication. It is essential to identify the most significant features for each user, as behaviour is different amongst humans. Thus, a fixed feature set cannot be applied to all models. We highlight this...
CAPE: Context-Aware Private Embeddings for Private Language Learning

CAPE: Context-Aware Private Embeddings for Private Language Learning

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these models presents the possibility of encoding personally identifiable...

2020

Towards Continuous User Authentication Using Personalised Touch-Based Behaviour

Towards Continuous User Authentication Using Personalised Touch-Based Behaviour

In this paper, we present an empirical evaluation of 30 features used in touch-based continuous authentication. It is essential to identify the most significant features for each user, as behaviour is different amongst humans. Thus, a fixed feature set cannot be applied to all models. We highlight this...
Affordable and robust phenotyping framework to analyse root system architecture of soil-grown plants

Affordable and robust phenotyping framework to analyse root system architecture of soil-grown plants

The phenotypic analysis of root system growth is important to inform efforts to enhance plant resource acquisition from soils. However, root phenotyping still remains challenging due to soil opacity, requiring systems that facilitate root system visibility and image acquisition. Previously reported systems...
Doing More With Less: A Multitask Deep Learning Approach in Plant Phenotyping

Doing More With Less: A Multitask Deep Learning Approach in Plant Phenotyping

Image-based plant phenotyping has been steadily growing and this has steeply increased the need for more efficient image analysis techniques capable of evaluating multiple plant traits. Deep learning has shown its potential in a multitude of visual tasks in plant phenotyping, such as segmentation and...
Unsupervised Rotation Factorization in Restricted Boltzmann Machines

Unsupervised Rotation Factorization in Restricted Boltzmann Machines

Finding suitable image representations for the task at hand is critical in computer vision. Different approaches extending the original Restricted Boltzmann Machine (RBM) model have recently been proposed to offer rotation-invariant feature learning. In this paper, we present an extended novel RBM that...

2019

Leaf Counting Without Annotations Using Adversarial Unsupervised Domain Adaptation

Leaf Counting Without Annotations Using Adversarial Unsupervised Domain Adaptation

Deep learning is making strides in plant phenotyping and agriculture. But pretrained models require significant adaptation to work on new target datasets originating from a different experiment even on the same species. The current solution is to retrain the model on the new target data implying the...
Adversarial Large-scale Root Gap Inpainting

Adversarial Large-scale Root Gap Inpainting

Root imaging of a growing plant in a non-invasive, affordable, and effective way remains challenging. One approach is to image roots by growing them in a rhizobox, a soil-filled transparent container, imaging them with digital cameras, and segmenting root from soil background. However, due to soil occlusion...
Understanding deep neural networks for regression in leaf counting

Understanding deep neural networks for regression in leaf counting

Deep learning methods are constantly increasing in popularity and success across a wide range of computer vision applications. However, they are perceived as `black boxes', due to the lack of an intuitive interpretation of their decision processes. We present a study aimed at understanding how Deep Neural...

2018

Learning to Count Leaves of Plants

Learning to Count Leaves of Plants

Plant phenotyping refers to the measurement of plant visual traits. In the past, the collection of such traits has been done manually by plant scientists, which is a tedious, error-prone, and time-consuming task. For this reason, image-based plant phenotyping is used to facilitate the measurement of...
Pheno-Deep Counter: a unified and versatile deep learning architecture for leaf counting

Pheno-Deep Counter: a unified and versatile deep learning architecture for leaf counting

Direct observation of morphological plant traits is tedious and a bottleneck for high-throughput phenotyping. Hence, interest in image-based analysis is increasing, requiring software that can reliably extract plant traits, such as leaf count, preferably across a variety of species and growth conditions....
Root Gap Correction with a Deep Inpainting Model

Root Gap Correction with a Deep Inpainting Model

Imaging roots of growing plants in a non-invasive and affordable fashion has been a long-standing problem in image-assisted plant breeding and phenotyping. One of the most affordable and diffuse approaches is the use of mesocosms, where plants are grown in soil against a glass surface that permits the...
Citizen crowds and experts: observer variability in image-based plant phenotyping

Citizen crowds and experts: observer variability in image-based plant phenotyping

Background Image-based plant phenotyping has become a powerful tool in unravelling genotype–environment interactions. The utilization of image analysis and machine learning have become paramount in extracting data stemming from phenotyping experiments. Yet we rely on observer (a human expert) input t...

2017

ARIGAN: Synthetic Arabidopsis Plants using Generative Adversarial Network

ARIGAN: Synthetic Arabidopsis Plants using Generative Adversarial Network

In recent years, there has been an increasing interest in image-based plant phenotyping, applying state-of-the-art machine learning approaches to tackle challenging problems, such as leaf segmentation (a multi-instance problem) and counting. Most of these algorithms need labelled data to learn a model...
Leveraging multiple datasets for deep leaf counting

Leveraging multiple datasets for deep leaf counting

The number of leaves a plant has is one of the key traits (phenotypes) describing its development and growth. Here, we propose an automated, deep learning based approach for counting leaves in model rosette plants. While state-of-the-art results on leaf counting with deep learning methods have recently...
Phenotiki: An Open Software And Hardware Platform For Affordable And Easy Image-based Phenotyping Of Rosette-shaped Plants

Phenotiki: An Open Software And Hardware Platform For Affordable And Easy Image-based Phenotyping Of Rosette-shaped Plants

Phenotyping is important to understand plant biology but current solutions are either costly, not versatile or difficult to deploy. To solve this problem, we present Phenotiki, an affordable system for plant phenotyping which, relying on off-the-shelf parts, provides an easy to install and maintain platform,...
Multimodal MR Synthesis Via Modality-Invariant Latent Representation

Multimodal MR Synthesis Via Modality-Invariant Latent Representation

We propose a multi-input multi-output fully convolutional neural network model for MRI synthesis. The model is robust to missing data, as it benefits from, but does not require, additional input modalities. The model is trained end-to-end, and learns to embed all input modalities into a shared modalityinvariant...

2016

Theta-RBM: Unfactored Gated Restricted Boltzmann Machine for Rotation-Invariant Representations

Theta-RBM: Unfactored Gated Restricted Boltzmann Machine for Rotation-Invariant Representations

Learning invariant representations is a critical task in computer vision. In this paper, we propose the Theta-Restricted Boltzmann Machine (θ-RBM in short), which builds upon the original RBM formulation and injects the notion of rotation-invariance during the learning procedure. In contrast to previous ...
Rotation-Invariant Restricted Boltzmann Machine using Shared Gradient Filters

Rotation-Invariant Restricted Boltzmann Machine using Shared Gradient Filters

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result, several approaches have been proposed that consider a set of transformations,...
Whole Image Synthesis Using a Deep Encoder-Decoder Network

Whole Image Synthesis Using a Deep Encoder-Decoder Network

The synthesis of medical images is an intensity transformation of a given modality in a way that represents an acquisition with a different modality (in the context of MRI this represents the synthesis of images originating from different MR sequences). Most methods follow a patch-based approach, which...

2015

Learning to Count Leaves in Rosette Plants

Learning to Count Leaves in Rosette Plants

Counting the number of leaves in plants is important for plant phenotyping, since it can be used to assess plant growth stages. We propose a learning-based approach for counting leaves in rosette (model) plants. We relate image-based descriptors learned in an unsupervised fashion to leaf counts using...
An interactive tool for semi-automated leaf annotation

An interactive tool for semi-automated leaf annotation

High throughput plant phenotyping is emerging as a necessary step towards meeting agricultural demands of the future. Central to its success is the development of robust computer vision algorithms that analyze images and extract phenotyping information to be associated with genotypes and environmental...
On Blind Source Camera Identification Algorithms

On Blind Source Camera Identification Algorithms

An interesting and challenging problem in digital image forensics is the identification of the device used to acquire an image. Although the source imaging device can be retrieved exploiting the file header (e.g., EXIF), this information can be easily tampered. This lead to the necessity of blind techniques...
Exploiting time-multiplexing structured light with picoprojectors

Exploiting time-multiplexing structured light with picoprojectors

When a picture is shot all the information about the distance between the object and the camera gets lost. Depth estimation from a single image is a notable issue in computer vision. In this work we present a hardware and software framework to accomplish the task of 3D measurement through structured...