Projects with this topic
-
Federated learning (FL) enables multiple devices to collaboratively train a global model while maintaining data on local servers. Each device trains the model on its local server and shares only the model updates (i.e., gradient weights) during the aggregation step. A significant challenge in FL is managing the feature distribution of novel, unbalanced data across devices. In this paper, we propose an FL approach using few-shot learning and aggregation of the model weights on a global server. We introduce a dynamic early stopping method to balance out-of-distribution classes based on representation learning, specifically utilizing the maximum mean discrepancy of feature embeddings between local and global models. An exemplary application of FL is orchestrating machine learning models along highways for interference classification based on snapshots from global navigation satellite system (GNSS) receivers. Extensive experiments on four GNSS datasets from two real-world highways and controlled environments demonstrate that our FL method surpasses state-of-the-art techniques in adapting to both novel interference classes and multipath scenarios.
Updated -
The primary objective of methods in continual learning is to learn tasks in a sequential manner over time from a stream of data, while mitigating the detrimental phenomenon of catastrophic forgetting. In this paper, we focus on learning an optimal representation between previous class prototypes and newly encountered ones. We propose a prototypical network with a Bayesian learning-driven contrastive loss (BLCL) tailored specifically for class-incremental learning scenarios. Therefore, we introduce a contrastive loss that incorporates new classes into the latent representation by reducing the intra-class distance and increasing the inter-class distance. Our approach dynamically adapts the balance between the cross-entropy and contrastive loss functions with a Bayesian learning technique. Empirical evaluations conducted on both the CIFAR-10 and CIFAR-100 dataset for image classification and images of a GNSS-based dataset for interference classification validate the efficacy of our method, showcasing its superiority over existing state-of-the-art approaches.
Updated -
We developed a hardware setup that captures short, wideband snapshots in both E1 and E6 GNSS bands. This setup is mounted to a bridge over a motorway. The setup records 20 ms raw IQ snapshots triggered from the energy with a sample rate of 62.5 MHz, an analog bandwidth of 50MHz and an 8 bit bit-width. At certain frequencies the GPS/Galileo or GLONASS signals can easily be seen as a slight increase in the spectrum. Note that experts manually analyzed the datastreams by thresholding CN/0 and AGC values. Manual labeling of these snapshots has resulted in 11 classes: classes 0 to 2 represent samples with no interferences, distinguished by variations in background intensity, while classes 3 to 10 contain different interferences. The challenge lies in adapting to positive class labels with only a limited number of samples available. We partition the dataset into a 64% training set, 16% validation set, and a 20% test set split (balanced over the classes).
Updated -
Interference signals degrade and disrupt Global Navigation Satellite System (GNSS) receivers, impacting their localization accuracy. Therefore, they need to be detected, classified, and located to ensure GNSS operation. State-of-the-art techniques employ supervised deep learning to detect and classify potential interference signals. Here, literature proposes ResNet18 and TS-Transformer as they provide the most accurate classification rates on quasi-realistic GNSS signals. However, employing these methods individually, they only focus on either spatial or temporal information and discard information during optimization, thereby degrading classification accuracy. This paper proposes a deep learning framework that considers both the spatial and temporal relationships between samples when fusing ResNet18 and TS-Transformers with a joint loss function to compensate for the weaknesses of both methods considered individually. Our real-world experiments show that our novel fusion pipeline with an adapted late fusion technique and uncertainty measure significantly outperforms the state-of-the-art classifiers by 6.7% on average, even in complicated realistic scenarios with multipath propagation and environmental dynamics. This works even well (F-β=2 score about 80.1%), when we fuse both modalities only from a single bandwidth-limited low-cost sensor, instead of a fine-grained high-resolution sensor and coarse-grained low-resolution low-cost sensor. By using late fusion the classification accuracy of the classes FreqHopper, Modulated, and Noise increases while lowering the uncertainty of Multitone, Noise, and Pulsed. The improved classification capabilities allow for more reliable results even in challenging scenarios.
Updated -
Interference signals cause position errors and outages to global navigation satellite system (GNSS) receivers. However, to solve these problems, the interference needs to be detected, classified, its purpose determined, and localized, such that it can be eliminated. Several interference monitoring solutions exist, but these are expensive, resulting in fewer nodes that may miss spatially sparse interference signals. This paper introduces a low-cost commercial-off-the-shelf (COTS) GNSS interference monitoring, detection, and classification receiver. It employs machine learning (ML) on tailored signal pre-possessing of the raw signal samples and GNSS measurements to facilitate a generalized, high-performance architecture that does not require human in the loop (HIL) calibration. Therefore, the low-cost receivers with high performance can justify significantly more receivers to be deployed, resulting in a significantly higher probability of intercept (POI). The initial results of controlled interference scenarios demonstrate detection and classification capabilities exceeding conventional approaches.
Updated