title: Rethinking Position Bias Modeling with Knowledge Distillation for CTR Prediction

abstract: Click-through rate (CTR) Prediction is of great importance in real-world online ads systems. One challenge for the CTR prediction task is to capture the real interest of users from their clicked items, which is inherently biased by presented positions of items, i.e., more front positions tend to obtain higher CTR values. A popular line of existing works focuses on explicitly estimating position bias by result randomization which is expensive and inefficient, or by inverse propensity weighting (IPW) which relies heavily on the quality of the propensity estimation. Another common solution is modeling position as features during offline training and simply adopting fixed value or dropout tricks when serving. However, training-inference inconsistency can lead to sub-optimal performance. Furthermore, post-click information such as position values is informative while less exploited in CTR prediction. This work proposes a simple yet efficient knowledge distillation framework to alleviate the impact of position bias and leverage position information to improve CTR prediction. We demonstrate the performance of our proposed method on a real-world production dataset and online A/B tests, achieving significant improvements over competing baseline models. The proposed method has been deployed in the real world online ads systems, serving main traffic on one of the world's largest e-commercial platforms.


title: Energetic stability and spatial inhomogeneity in the local electronic structure of relaxed twisted trilayer graphene

abstract: We study the energetic stability and the local electronic structure of the general twisted trilayer graphene (TTG) with the top and bottom layers rotated with respect to the middle layer respectively by $\theta$ and $\theta'$. Approximate supercells of the moir\'{e}-of-moir\'{e} superlattices with $\theta$ and $\theta^{\prime}$ within $1^{\circ}\sim 2^{\circ}$ are established to describe the structural and electronic properties of relaxed TTG with the periodic boundary condition. Full relaxation demonstrates that the commensurate TTG with $\theta=\theta^{\prime}$ has the local minimum total energy ($E_{tol}$) at a fixed $\theta$, while $E_{tol}$ first reaches a local maximum and begins to drop with decreasing $\theta^{\prime}$ for $\theta^{\prime} < \theta$. Some regions exhibit enhanced in-plane relaxation in the top and bottom layers but suppressed relaxation in the middle layer and form a hexagonal network with the moir\'{e}-of-moir\'{e} length scale. The stacking configurations with the atoms in the three layers vertically aligned at the origin of the relaxed TTG supercells at $\theta$ around $1.6^{\circ}$ and $\theta^{\prime}$ around $1.4^{\circ}$ have a high density of states (DOS) near the Fermi level ($E_F$), which can reach that of the mirror symmetric TTG with equal twist angles of about $1.7^{\circ}$. In contrast, some other stackings can have rather low DOS around $E_F$. The significant stacking dependence of DOS for some TTG supercells demonstrates that the local electronic structure of TTG can exhibit strong spatial inhomogeneity when the twist angles are slightly away from those of the small supercells with large variations of DOS among different stackings. Moreover, the structural relaxation of TTG plays a crucial role in the high DOS and its strong stacking dependence.


title: Fusing Interpretable Knowledge of Neural Network Learning Agents For Swarm-Guidance

abstract: Neural-based learning agents make decisions using internal artificial neural networks. In certain situations, it becomes pertinent that this knowledge is re-interpreted in a friendly form to both the human and the machine. These situations include: when agents are required to communicate the knowledge they learn to each other in a transparent way in the presence of an external human observer, in human-machine teaming settings where humans and machines need to collaborate on a task, or where there is a requirement to verify the knowledge exchanged between the agents. We propose an interpretable knowledge fusion framework suited for neural-based learning agents, and propose a Priority on Weak State Areas (PoWSA) retraining technique. We first test the proposed framework on a synthetic binary classification task before evaluating it on a shepherding-based multi-agent swarm guidance task. Results demonstrate that the proposed framework increases the success rate on the swarm-guidance environment by 11% and better stability in return for a modest increase in computational cost of 14.5% to achieve interpretability. Moreover, the framework presents the knowledge learnt by an agent in a human-friendly representation, leading to a better descriptive visual representation of an agent's knowledge.


title: Globally Optimal Spectrum- and Energy-Efficient Beamforming for Rate Splitting Multiple Access

abstract: Rate splitting multiple access (RSMA) is a promising non-orthogonal transmission strategy for next-generation wireless networks. It has been shown to outperform existing multiple access schemes in terms of spectral and energy efficiency when suboptimal beamforming schemes are employed. In this work, we fill the gap between suboptimal and truly optimal beamforming schemes and conclusively establish the superior spectral and energy efficiency of RSMA. To this end, we propose a successive incumbent transcending (SIT) branch and bound (BB) algorithm to find globally optimal beamforming solutions that maximize the weighted sum rate or energy efficiency of RSMA in Gaussian multiple-input single-output (MISO) broadcast channels. Numerical results show that RSMA exhibits an explicit globally optimal spectral and energy efficiency gain over conventional multi-user linear precoding (MU-LP) and power-domain non-orthogonal multiple access (NOMA). Compared to existing globally optimal beamforming algorithms for MU-LP, the proposed SIT BB not only improves the numerical stability but also achieves faster convergence. Moreover, for the first time, we show that the spectral/energy efficiency of RSMA achieved by suboptimal beamforming schemes (including weighted minimum mean squared error (WMMSE) and successive convex approximation) almost coincides with the corresponding globally optimal performance, making it a valid choice for performance comparisons. The globally optimal results provided in this work are imperative to the ongoing research on RSMA as they serve as benchmarks for existing suboptimal beamforming strategies and those to be developed in multi-antenna broadcast channels.


title: Random walks on the circle and Diophantine approximation

abstract: Random walks on the circle group $\mathbb{R}/\mathbb{Z}$ whose elementary steps are lattice variables with span $\alpha \not\in \mathbb{Q}$ or $p/q \in \mathbb{Q}$ taken mod $\mathbb{Z}$ exhibit delicate behavior. In the rational case we have a random walk on the finite cyclic subgroup $\mathbb{Z}_q$, and the central limit theorem and the law of the iterated logarithm follow from classical results on finite state space Markov chains. In this paper we extend these results to random walks with irrational span $\alpha$, and explicitly describe the transition of these Markov chains from finite to general state space as $p/q \to \alpha$ along the sequence of best rational approximations. We also consider the rate of weak convergence to the stationary distribution in the Kolmogorov metric, and in the rational case observe a surprising transition from polynomial to exponential decay after $\approx q^2$ steps; this seems to be a new phenomenon in the theory of random walks on compact groups. In contrast, the rate of weak convergence to the stationary distribution in the total variation metric is purely exponential.


title: Unrestricted Douglas-Rachford algorithms for solving convex feasibility problems in Hilbert space

abstract: In this work we focus on the convex feasibility problem (CFP) in Hilbert space. A specific method in this area that has gained a lot of interest in recent years is the Douglas-Rachford (DR) algorithm. This algorithm was originally introduced in 1956 for solving stationary and non-stationary heat equations. Then in 1979, Lions and Mercier adjusted and extended the algorithm with the aim of solving CFPs and even more general problems, such as finding zeros of the sum of two maximally monotone operators. Many developments which implement various concepts concerning this algorithm have occurred during the last decade. We introduce an unrestricted DR algorithm, which provides a general framework for such concepts. Using unrestricted products of a finite number of strongly nonexpansive operators, we apply this framework to provide new iterative methods, where, \textit{inter alia}, such operators may be interlaced between the operators used in the scheme of our \ unrestricted \color DR algorithm.


title: Ising machines as hardware solvers of combinatorial optimization problems

abstract: Ising machines are hardware solvers which aim to find the absolute or approximate ground states of the Ising model. The Ising model is of fundamental computational interest because it is possible to formulate any problem in the complexity class NP as an Ising problem with only polynomial overhead. A scalable Ising machine that outperforms existing standard digital computers could have a huge impact for practical applications for a wide variety of optimization problems. In this review, we survey the current status of various approaches to constructing Ising machines and explain their underlying operational principles. The types of Ising machines considered here include classical thermal annealers based on technologies such as spintronics, optics, memristors, and digital hardware accelerators; dynamical-systems solvers implemented with optics and electronics; and superconducting-circuit quantum annealers. We compare and contrast their performance using standard metrics such as the ground-state success probability and time-to-solution, give their scaling relations with problem size, and discuss their strengths and weaknesses.


title: On calculation of the exact Lyapunov exponent of affine Boole transformations

abstract: We show an elementary way for calculation of the exact Lyapunov exponent of affine Boole transformations using the interchangeability theorem for differentiation and integration due to Leibniz.


title: On the intrinsic pinning and shape of charge-density waves in 1D Peierls systems

abstract: Within the standard perturbative approach of Peierls, a charge-density wave is usually assumed to have a cosine shape of weak amplitude. In nonlinear physics, we know that waves can be deformed. What are the effects of the nonlinearities of the electron-lattice models in the physical properties of Peierls systems? We study in details a nonlinear discrete model, introduced by Brazovskii, Dzyaloshinskii and Krichever. First, we recall its exact analytical solution at integrable points. It is a cnoidal wave, with a continuous envelope, which may slide over the lattice potential at no energy cost, following Fr\"ohlich's argument. Second, we show numerically that integrability-breaking terms modify some important physical properties. The envelope function may become discontinuous: electrons form stronger chemical bonds which are local dimers or oligomers. We show that an Aubry transition from the sliding phase to an insulating pinned phase occurs when the model is no longer integrable.


title: Studying the Impact of Data Disclosure Mechanism in Recommender Systems via Simulation

abstract: Recently, privacy issues in web services that rely on users' personal data have raised great attention. Unlike existing privacy-preserving technologies such as federated learning and differential privacy, we explore another way to mitigate users' privacy concerns, giving them control over their own data. For this goal, we propose a privacy aware recommendation framework that gives users delicate control over their personal data, including implicit behaviors, e.g., clicks and watches. In this new framework, users can proactively control which data to disclose based on the trade-off between anticipated privacy risks and potential utilities. Then we study users' privacy decision making under different data disclosure mechanisms and recommendation models, and how their data disclosure decisions affect the recommender system's performance. To avoid the high cost of real-world experiments, we apply simulations to study the effects of our proposed framework. Specifically, we propose a reinforcement learning algorithm to simulate users' decisions (with various sensitivities) under three proposed platform mechanisms on two datasets with three representative recommendation models. The simulation results show that the platform mechanisms with finer split granularity and more unrestrained disclosure strategy can bring better results for both end users and platforms than the "all or nothing" binary mechanism adopted by most real-world applications. It also shows that our proposed framework can effectively protect users' privacy since they can obtain comparable or even better results with much less disclosed data.


title: A Versatile Framework for Evaluating Ranked Lists in terms of Group Fairness and Relevance

abstract: We present a simple and versatile framework for evaluating ranked lists in terms of group fairness and relevance, where the groups (i.e., possible attribute values) can be either nominal or ordinal in nature. First, we demonstrate that, if the attribute set is binary, our framework can easily quantify the overall polarity of each ranked list. Second, by utilising an existing diversified search test collection and treating each intent as an attribute value, we demonstrate that our framework can handle soft group membership, and that our group fairness measures are highly correlated with both adhoc IR and diversified IR measures under this setting. Third, we demonstrate how our framework can quantify intersectional group fairness based on multiple attribute sets. We also show that the similarity function for comparing the achieved and target distributions over the attribute values should be chosen carefully.


title: i-Razor: A Differentiable Neural Input Razor for Feature Selection and Dimension Search in DNN-Based Recommender Systems

abstract: Input features play a crucial role in DNN-based recommender systems with thousands of categorical and continuous fields from users, items, contexts, and interactions. Noisy features and inappropriate embedding dimension assignments can deteriorate the performance of recommender systems and introduce unnecessary complexity in model training and online serving. Optimizing the input configuration of DNN models, including feature selection and embedding dimension assignment, has become one of the essential topics in feature engineering. However, in existing industrial practices, feature selection and dimension search are optimized sequentially, i.e., feature selection is performed first, followed by dimension search to determine the optimal dimension size for each selected feature. Such a sequential optimization mechanism increases training costs and risks generating suboptimal input configurations. To address this problem, we propose a differentiable neural input razor (i-Razor) that enables joint optimization of feature selection and dimension search. Concretely, we introduce an end-to-end differentiable model to learn the relative importance of different embedding regions of each feature. Furthermore, a flexible pruning algorithm is proposed to achieve feature filtering and dimension derivation simultaneously. Extensive experiments on two large-scale public datasets in the Click-Through-Rate (CTR) prediction task demonstrate the efficacy and superiority of i-Razor in balancing model complexity and performance.


title: A simple proof of the Baillon-Haddad theorem on open subsets of Hilbert spaces

abstract: We give a simple proof of the Baillon-Haddad theorem for convex functions defined on open and convex subsets of Hilbert spaces. We also state some generalizations and limitations. In particular, we discuss equivalent characterizations of the Lipschitz continuity of the derivative of convex functions on open and convex subsets of Banach spaces.


title: Stability of pizoelectric beam with magnetic effect under (Coleman or Pipkin)-Gurtin thermal law

abstract: In this paper, we investigate the stabilization of a system of piezoelectric beams under (Coleman or Pipkin )-Gurtin thermal law with magnetic effect. First, we study the Piezoelectric-Coleman-Gurtin system and we obtain an exponential stability result. Next, we consider the Piezoelectric-Gurtin-Pipkin system and we establish a polynomial energy decay rate of type $t^{-1}$


title: Understanding temperature modulated calorimetry through studies of a model system

abstract: Temperature Modulated calorimetry is widely used but still raises some fundamental questions. In this paper we study a model system as a test sample to address some of them. The model has a nontrivial spectrum of relaxation times. We investigate temperature modulated calorimetry at constant average temperature to precise the meaning of the frequency-dependent heat capacity, its relation with entropy production, and how such measurements can observe the aging of a glassy sample leading to a time-dependent heat capacity. The study of the Kovacs effect for an out-of-equilibrium system shows how temperature modulated calorimetry could contribute to the understanding of this memory effect. Then we compare measurements of standard scanning calorimetry and temperature-modulated calorimetry and show how the two methods are complementary because they do not observe the same features. While it can probe the time scales of energy transfers in a system, even in the limit of low frequency temperature modulated calorimetry does not probe some relaxation phenomena which can be measured by scanning calorimetry, as suggested by experiments with glasses.


title: KilonovaNet: Surrogate Models of Kilonova Spectra with Conditional Variational Autoencoders

abstract: Detailed radiative transfer simulations of kilonova spectra play an essential role in multimessenger astrophysics. Using the simulation results in parameter inference studies requires building a surrogate model from the simulation outputs to use in algorithms requiring sampling. In this work, we present KilonovaNet, an implementation of conditional variational autoencoders (cVAEs) for the construction of surrogate models of kilonova spectra. This method can be trained on spectra directly, removing overhead time of pre-processing spectra, and greatly speeds up parameter inference time. We build surrogate models of three state-of-the-art kilonova simulation data sets and present in-depth surrogate error evaluation methods, which can in general be applied to any surrogate construction method. By creating synthetic photometric observations from the spectral surrogate, we perform parameter inference for the observed light curve data of GW170817 and compare the results with previous analyses. Given the speed with which KilonovaNet performs during parameter inference, it will serve as a useful tool in future gravitational wave observing runs to quickly analyze potential kilonova candidates


title: Net-proton number cumulant ratios as function of beam energy from an expanding nonequilibrium chiral fluid

abstract: The beam energy scan program at RHIC provides data on net-proton number fluctuations with the goal to detect the QCD critical end point and first-order phase transition. Interpreting these experimental signals requires a vital understanding of the interplay of critical phenomena and the nonequilibrium dynamics of the rapidly expanding fireball. We study these aspects with a fluid dynamic expansion coupled to the explicit propagation of the chiral order parameter sigma via a Langevin equation. Assuming a sigma-proton coupling through an effective proton mass, we relate cumulants of the order parameter and the net-proton number at freeze-out and obtain observable cumulant ratios as a function of beam energy. We emphasize the role of the nonequilibrium first-order phase transition where a mixed phase with gradual freeze-out can significantly alter the cumulants. We find that the presence of a critical end point is clearly visible in the cumulant ratios for a relatively wide range of center-of-mass energies.


title: Existence of Ground States in the Infrared-Critial Spin Boson Model

abstract: We review recent results on the existence of ground states for the infrared-critical spin boson model, which describes the interaction of a massless bosonic field with a two-state quantum system. Explicitly, we derive a critical coupling $\lambda_{\mathsf c}>0$ such that the spin boson model exhibits a ground state for coupling constants $\lambda$ with $|\lambda|<\lambda_{\mathsf c}$. The proof combines a Feynman-Kac-Nelson formula for the spin boson model with external magnetic field, a 1D-Ising model correlation bound and a compactness argument in Fock space. Elaborating on the connection to a long-range 1D-Ising model, we briefly discuss the conjecture that the spin boson model does not have a ground state at large coupling. This note is based on joint work with David Hasler and Oliver Siebert.


title: Symbolic Search for Optimal Planning with Expressive Extensions

abstract: In classical planning, the goal is to derive a course of actions that allows an intelligent agent to move from any situation it finds itself in to one that satisfies its goals. Classical planning is considered domain-independent, i.e., it is not limited to a particular application and can be used to solve different types of reasoning problems. In practice, however, some properties of a planning problem at hand require an expressive extension of the standard classical planning formalism to capture and model them. Although the importance of many of these extensions is well known, most planners, especially optimal planners, do not support these extended planning formalisms. The lack of support not only limits the use of these planners for certain problems, but even if it is possible to model the problems without these extensions, it often leads to increased effort in modeling or makes modeling practically impossible as the required problem encoding size increases exponentially. In this thesis, we propose to use symbolic search for cost-optimal planning for different expressive extensions of classical planning, all capturing different aspects of the problem. In particular, we study planning with axioms, planning with state-dependent action costs, oversubscription planning, and top-k planning. For all formalisms, we present complexity and compilability results, highlighting that it is desirable and even necessary to natively support the corresponding features. We analyze symbolic heuristic search and show that the search performance does not always benefit from the use of a heuristic and that the search performance can exponentially deteriorate even under the best possible circumstances, namely the perfect heuristic. This reinforces that symbolic blind search is the dominant symbolic search strategy nowadays, on par with other state-of-the-art cost-optimal planning strategies...


title: Selecting task with optimal transport self-supervised learning for few-shot classification

abstract: Few-Shot classification aims at solving problems that only a few samples are available in the training process. Due to the lack of samples, researchers generally employ a set of training tasks from other domains to assist the target task, where the distribution between assistant tasks and the target task is usually different. To reduce the distribution gap, several lines of methods have been proposed, such as data augmentation and domain alignment. However, one common drawback of these algorithms is that they ignore the similarity task selection before training. The fundamental problem is to push the auxiliary tasks close to the target task. In this paper, we propose a novel task selecting algorithm, named Optimal Transport Task Selecting (OTTS), to construct a training set by selecting similar tasks for Few-Shot learning. Specifically, the OTTS measures the task similarity by calculating the optimal transport distance and completes the model training via a self-supervised strategy. By utilizing the selected tasks with OTTS, the training process of Few-Shot learning become more stable and effective. Other proposed methods including data augmentation and domain alignment can be used in the meantime with OTTS. We conduct extensive experiments on a variety of datasets, including MiniImageNet, CIFAR, CUB, Cars, and Places, to evaluate the effectiveness of OTTS. Experimental results validate that our OTTS outperforms the typical baselines, i.e., MAML, matchingnet, protonet, by a large margin (averagely 1.72\% accuracy improvement).


title: Predicting Intervention Approval in Clinical Trials through Multi-Document Summarization

abstract: Clinical trials offer a fundamental opportunity to discover new treatments and advance the medical knowledge. However, the uncertainty of the outcome of a trial can lead to unforeseen costs and setbacks. In this study, we propose a new method to predict the effectiveness of an intervention in a clinical trial. Our method relies on generating an informative summary from multiple documents available in the literature about the intervention under study. Specifically, our method first gathers all the abstracts of PubMed articles related to the intervention. Then, an evidence sentence, which conveys information about the effectiveness of the intervention, is extracted automatically from each abstract. Based on the set of evidence sentences extracted from the abstracts, a short summary about the intervention is constructed. Finally, the produced summaries are used to train a BERT-based classifier, in order to infer the effectiveness of an intervention. To evaluate our proposed method, we introduce a new dataset which is a collection of clinical trials together with their associated PubMed articles. Our experiments, demonstrate the effectiveness of producing short informative summaries and using them to predict the effectiveness of an intervention.


title: Text-To-Speech Data Augmentation for Low Resource Speech Recognition

abstract: Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve ASR models for agglutinative and low-resource languages. This novel data augmentation method generates both synthetic text and synthetic audio. Some experiments were conducted using the corpus of the Quechua language, which is an agglutinative and low-resource language. In this study, a sequence-to-sequence (seq2seq) model was applied to generate synthetic text, in addition to generating synthetic speech using a text-to-speech (TTS) model for Quechua. The results show that the new data augmentation method works well to improve the ASR model for Quechua. In this research, an 8.73% improvement in the word-error-rate (WER) of the ASR model is obtained using a combination of synthetic text and synthetic speech.


title: Preventing Distillation-based Attacks on Neural Network IP

abstract: Neural networks (NNs) are already deployed in hardware today, becoming valuable intellectual property (IP) as many hours are invested in their training and optimization. Therefore, attackers may be interested in copying, reverse engineering, or even modifying this IP. The current practices in hardware obfuscation, including the widely studied logic locking technique, are insufficient to protect the actual IP of a well-trained NN: its weights. Simply hiding the weights behind a key-based scheme is inefficient (resource-hungry) and inadequate (attackers can exploit knowledge distillation). This paper proposes an intuitive method to poison the predictions that prevent distillation-based attacks; this is the first work to consider such a poisoning approach in hardware-implemented NNs. The proposed technique obfuscates a NN so an attacker cannot train the NN entirely or accurately. We elaborate a threat model which highlights the difference between random logic obfuscation and the obfuscation of NN IP. Based on this threat model, our security analysis shows that the poisoning successfully and significantly reduces the accuracy of the stolen NN model on various representative datasets. Moreover, the accuracy and prediction distributions are maintained, no functionality is disturbed, nor are high overheads incurred. Finally, we highlight that our proposed approach is flexible and does not require manipulation of the NN toolchain.


title: The role of living laboratories in unlocking the potential of low-carbon energy technologies on the journey to net-zero

abstract: We demonstrate the potential role of one of the largest at scale multi-vector Smart Energy Network Demonstrator (SEND).


title: GrowliFlower: An image time series dataset for GROWth analysis of cauLIFLOWER

abstract: This article presents GrowliFlower, a georeferenced, image-based UAV time series dataset of two monitored cauliflower fields of size 0.39 and 0.60 ha acquired in 2020 and 2021. The dataset contains RGB and multispectral orthophotos from which about 14,000 individual plant coordinates are derived and provided. The coordinates enable the dataset users the extraction of complete and incomplete time series of image patches showing individual plants. The dataset contains collected phenotypic traits of 740 plants, including the developmental stage as well as plant and cauliflower size. As the harvestable product is completely covered by leaves, plant IDs and coordinates are provided to extract image pairs of plants pre and post defoliation, to facilitate estimations of cauliflower head size. Moreover, the dataset contains pixel-accurate leaf and plant instance segmentations, as well as stem annotations to address tasks like classification, detection, segmentation, instance segmentation, and similar computer vision tasks. The dataset aims to foster the development and evaluation of machine learning approaches. It specifically focuses on the analysis of growth and development of cauliflower and the derivation of phenotypic traits to foster the development of automation in agriculture. Two baseline results of instance segmentation at plant and leaf level based on the labeled instance segmentation data are presented. The entire data set is publicly available.


title: Cocartesian fibrations and straightening internal to an $\infty$-topos

abstract: We define and study cartesian and cocartesian fibrations between categories internal to an $\infty$-topos and prove a straightening equivalence in this context.


title: Scalable Semi-Modular Inference with Variational Meta-Posteriors

abstract: The Cut posterior and related Semi-Modular Inference are Generalised Bayes methods for Modular Bayesian evidence combination. Analysis is broken up over modular sub-models of the joint posterior distribution. Model-misspecification in multi-modular models can be hard to fix by model elaboration alone and the Cut posterior and SMI offer a way round this. Information entering the analysis from misspecified modules is controlled by an influence parameter $\eta$ related to the learning rate. This paper contains two substantial new methods. First, we give variational methods for approximating the Cut and SMI posteriors which are adapted to the inferential goals of evidence combination. We parameterise a family of variational posteriors using a Normalising Flow for accurate approximation and end-to-end training. Secondly, we show that analysis of models with multiple cuts is feasible using a new Variational Meta-Posterior. This approximates a family of SMI posteriors indexed by $\eta$ using a single set of variational parameters.


title: Spectral identification of networks with generalized diffusive coupling

abstract: Spectral network identification aims at inferring the eigenvalues of the Laplacian matrix of a network from measurement data. This allows to capture global information on the network structure from local measurements at a few number of nodes. In this paper, we consider the spectral network identification problem in the generalized setting of a vector-valued diffusive coupling. The feasibility of this problem is investigated and theoretical results on the properties of the associated generalized eigenvalue problem are obtained. Finally, we propose a numerical method to solve the generalized network identification problem, which relies on dynamic mode decomposition and leverages the above theoretical results.


title: Unitail: Detecting, Reading, and Matching in Retail Scene

abstract: To make full use of computer vision technology in stores, it is required to consider the actual needs that fit the characteristics of the retail scene. Pursuing this goal, we introduce the United Retail Datasets (Unitail), a large-scale benchmark of basic visual tasks on products that challenges algorithms for detecting, reading, and matching. With 1.8M quadrilateral-shaped instances annotated, the Unitail offers a detection dataset to align product appearance better. Furthermore, it provides a gallery-style OCR dataset containing 1454 product categories, 30k text regions, and 21k transcriptions to enable robust reading on products and motivate enhanced product matching. Besides benchmarking the datasets using various state-of-the-arts, we customize a new detector for product detection and provide a simple OCR-based matching solution that verifies its effectiveness.


title: Determination of the recombination coefficient in electrolytic solutions from impedance spectroscopy measurements

abstract: The dependence of the actual/effective ionic concentration on the nominal salt concentration is experimentally investigated for aqueous solutions of NaCl and KCl. The actual ionic bulk density is determined by means of the impedance spectroscopy technique using two approaches for the data analysis: A first approach scrutinizing the real part's plateau of the cell's electric impedance spectrum versus the bulk density of dopant when the impedance is written in the series representation. A second one via extraction of the ionic density from simultaneously fitting of the real and imaginary parts of the impedance spectrum by using the Poisson-Nernst-Planck model. The validity of this procedure reposes on the hypothesis that both the diffusion coefficient and the dielectric constant are independent from the salt concentration in the explored range of concentrations. Our experimental results indicate that a first-order reaction describes well the dissociation phenomenon. The dissociation-association ratio of the reaction has been calculated. Deviations from linearity appear at rather low concentrations of the order of mM.


title: Interpretable RNA Foundation Model from Unannotated Data for Highly Accurate RNA Structure and Function Predictions

abstract: Non-coding RNA structure and function are essential to understanding various biological processes, such as cell signaling, gene expression, and post-transcriptional regulations. These are all among the core problems in the RNA field. With the rapid growth of sequencing technology, we have accumulated a massive amount of unannotated RNA sequences. On the other hand, expensive experimental observatory results in only limited numbers of annotated data and 3D structures. Hence, it is still challenging to design computational methods for predicting their structures and functions. The lack of annotated data and systematic study causes inferior performance. To resolve the issue, we propose a novel RNA foundation model (RNA-FM) to take advantage of all the 23 million non-coding RNA sequences through self-supervised learning. Within this approach, we discover that the pre-trained RNA-FM could infer sequential and evolutionary information of non-coding RNAs without using any labels. Furthermore, we demonstrate RNA-FM's effectiveness by applying it to the downstream secondary/3D structure prediction, SARS-CoV-2 genome structure and evolution prediction, protein-RNA binding preference modeling, and gene expression regulation modeling. The comprehensive experiments show that the proposed method improves the RNA structural and functional modelling results significantly and consistently. Despite only being trained with unlabelled data, RNA-FM can serve as the foundational model for the field.


title: PERIDOT Codes: Replacing Identifiers, Sequence Numbers and Nonces with Permutations

abstract: Identifiers and sequence numbers make up a large part of the protocol overhead in certain low-power wide-area networks. The requirement for cryptographic nonces in authentication and encryption schemes often demands excessively long sequence numbers, which leads to an increase in energy consumption per transmitted packet. In this paper, the novel PERIDOT coding scheme is proposed. It replaces identifiers and sequence numbers with a code, based on which receivers can identify transmitters with high confidence. PERIDOT is based on specially constructed integer permutations assigned to transmitters. An upper bound on the performance of PERIDOT codes is provided and methods for constructing particularly suitable permutations are presented. In practice, PERIDOT can significantly increase intervals between nonce reuses and, at the same time, reduce power consumption.


title: Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processes

abstract: Actual causality and a closely related concept of responsibility attribution are central to accountable decision making. Actual causality focuses on specific outcomes and aims to identify decisions (actions) that were critical in realizing an outcome of interest. Responsibility attribution is complementary and aims to identify the extent to which decision makers (agents) are responsible for this outcome. In this paper, we study these concepts under a widely used framework for multi-agent sequential decision making under uncertainty: decentralized partially observable Markov decision processes (Dec-POMDPs). Following recent works in RL that show correspondence between POMDPs and Structural Causal Models (SCMs), we first establish a connection between Dec-POMDPs and SCMs. This connection enables us to utilize a language for describing actual causality from prior work and study existing definitions of actual causality in Dec-POMDPs. Given that some of the well-known definitions may lead to counter-intuitive actual causes, we introduce a novel definition that more explicitly accounts for causal dependencies between agents' actions. We then turn to responsibility attribution based on actual causality, where we argue that in ascribing responsibility to an agent it is important to consider both the number of actual causes in which the agent participates, as well as its ability to manipulate its own degree of responsibility. Motivated by these arguments we introduce a family of responsibility attribution methods that extends prior work, while accounting for the aforementioned considerations. Finally, through a simulation-based experiment, we compare different definitions of actual causality and responsibility attribution methods. The empirical results demonstrate the qualitative difference between the considered definitions of actual causality and their impact on attributed responsibility.


title: The affine Springer fiber - sheaf correspondence

abstract: Given a semisimple element in the loop Lie algebra of a reductive group, we construct a quasi-coherent sheaf on a partial resolution of the trigonometric commuting variety of the Langlands dual group. The construction uses affine Springer theory and can be thought of as an incarnation of 3d mirror symmetry. For the group $GL_n$, the corresponding partial resolution is $\mathrm{Hilb}^n(\mathbb{C}^\times\times \mathbb{C})$. We also consider a quantization of this construction for homogeneous elements.


title: Quantum dot on a plasma-facing microparticle surface: Thermal balance

abstract: Semiconductor nanocrystals, quantum dots, are known to exhibit the quantum-confined Stark effect which reveals itself in the shift of their photoluminescence spectra in response to external electric field. It was, therefore, proposed to use quantum dots deposited on the microparticle surface for the optical measurement of the charge acquired by the microparticles in low-temperature plasmas. Thermal balance of a quantum dot residing on the surface of a microparticle immersed in a plasma is considered in this work. It is shown for typical plasma parameters that under periodically pulsed plasma conditions, the spectral shift of the photoluminescence of the quantum dot caused by the oscillations of its temperature becomes undetectable at the effective thermal flux characterizing the thermal contact between the quantum dot and the microparticle $\sim 10^9$~s$^{-1}$. Under these conditions, the entire spectral shift observed during the period of plasma pulsing should be attributed to the quantum-confined Stark effect due to the microparticle charge. Lower-boundary estimate for the effective thermal flux for the direct contact between the quantum dot and the microparticle is $\sim 10^{12}$~s$^{-1}$.


title: Face identification by means of a neural net classifier

abstract: This paper describes a novel face identification method that combines the eigenfaces theory with the Neural Nets. We use the eigenfaces methodology in order to reduce the dimensionality of the input image, and a neural net classifier that performs the identification process. The method presented recognizes faces in the presence of variations in facial expression, facial details and lighting conditions. A recognition rate of more than 87% has been achieved, while the classical method of Turk and Pentland achieves a 75.5%.


title: Building Decision Forest via Deep Reinforcement Learning

abstract: Ensemble learning methods whose base classifier is a decision tree usually belong to the bagging or boosting. However, no previous work has ever built the ensemble classifier by maximizing long-term returns to the best of our knowledge. This paper proposes a decision forest building method called MA-H-SAC-DF for binary classification via deep reinforcement learning. First, the building process is modeled as a decentralized partial observable Markov decision process, and a set of cooperative agents jointly constructs all base classifiers. Second, the global state and local observations are defined based on informations of the parent node and the current location. Last, the state-of-the-art deep reinforcement method Hybrid SAC is extended to a multi-agent system under the CTDE architecture to find an optimal decision forest building policy. The experiments indicate that MA-H-SAC-DF has the same performance as random forest, Adaboost, and GBDT on balanced datasets and outperforms them on imbalanced datasets.


title: Classical dynamics for Loop Gravity: The 2-vertex model

abstract: The study of toy models in loop quantum gravity (LQG), defined as truncations of the full theory, is relevant to both the development of the LQG phenomenology, in cosmology and astrophysics, and the progress towards the resolution of the open issues of the theory, in particular the implementation of the dynamics. Here, we study the dynamics of spin network states of quantum geometry defined on the family of graphs consisting in 2 vertices linked by an arbitrary number of edges, or 2-vertex model in short. A symmetry reduced sector of this model -- to isotropic and homogeneous geometries -- was successfully studied in the past, where interesting cosmological insights were found. We now study the evolution of the classical trajectories for this system in the general case, for arbitrary number of edges with random initial configurations. We use the spinorial formalism and its clear interpretation of spin networks in terms of discrete twisted geometries, with the quantum 3d space made of superpositions of polyhedra glued together by faces of equal area. Remarkably, oscillatory and divergent regimes are found with a universal dependence on the coupling constants of the Hamiltonian and independent of the initial spinors or the number of edges. Furthermore, we explore the evolution of the associated polyhedra as well as their volumes and areas.


title: Model-agnostic Counterfactual Synthesis Policy for Interactive Recommendation

abstract: Interactive recommendation is able to learn from the interactive processes between users and systems to confront the dynamic interests of users. Recent advances have convinced that the ability of reinforcement learning to handle the dynamic process can be effectively applied in the interactive recommendation. However, the sparsity of interactive data may hamper the performance of the system. We propose to train a Model-agnostic Counterfactual Synthesis Policy to generate counterfactual data and address the data sparsity problem by modelling from observation and counterfactual distribution. The proposed policy can identify and replace the trivial components for any state in the training process with other agents, which can be deployed in any RL-based algorithm. The experimental results demonstrate the effectiveness and generality of our proposed policy.


title: Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regression

abstract: Learning from a label distribution has achieved promising results on ordinal regression tasks such as facial age and head pose estimation wherein, the concept of adaptive label distribution learning (ALDL) has drawn lots of attention recently for its superiority in theory. However, compared with the methods assuming fixed form label distribution, ALDL methods have not achieved better performance. We argue that existing ALDL algorithms do not fully exploit the intrinsic properties of ordinal regression. In this paper, we emphatically summarize that learning an adaptive label distribution on ordinal regression tasks should follow three principles. First, the probability corresponding to the ground-truth should be the highest in label distribution. Second, the probabilities of neighboring labels should decrease with the increase of distance away from the ground-truth, i.e., the distribution is unimodal. Third, the label distribution should vary with samples changing, and even be distinct for different instances with the same label, due to the different levels of difficulty and ambiguity. Under the premise of these principles, we propose a novel loss function for fully adaptive label distribution learning, namely unimodal-concentrated loss. Specifically, the unimodal loss derived from the learning to rank strategy constrains the distribution to be unimodal. Furthermore, the estimation error and the variance of the predicted distribution for a specific sample are integrated into the proposed concentrated loss to make the predicted distribution maximize at the ground-truth and vary according to the predicting uncertainty. Extensive experimental results on typical ordinal regression tasks including age and head pose estimation, show the superiority of our proposed unimodal-concentrated loss compared with existing loss functions.


title: Effect of interfacial spin mixing conductance on gyromagnetic ratio of Gd substituted Y$_{3}$Fe$_{5}$O$_{12}$

abstract: Due to its low intrinsic damping, Y$_3$Fe$_5$O$_{12}$ and its substituted variations are often used for ferromagnetic layer at spin pumping experiment. Spin pumping is an interfacial spin current generation in the interface of ferromagnet and non-magnetic metal, governed by spin mixing conductance parameter $G^{\uparrow\downarrow}$. $G^{\uparrow\downarrow}$ has been shown to enhance the damping of the ferromagnetic layer. The theory suggested that the effect of $G^{\uparrow\downarrow}$ on gyromagnetic ratio only come from its negligible imaginary part. In this article, we show that the different damping of ferrimagnetic lattices induced by $G^{\uparrow\downarrow}$ can affect the gyromagnetic ratio of Gd-substituted Y$_3$Fe$_5$O$_{12}$.


title: Speaker verification in mismatch training and testing conditions

abstract: This paper presents an exhaustive study about the robustness of several parameterizations, with a new database specially acquired for the purpose of a speaker recognition application. This database includes the following variations: different recording sessions (including telephonic and microphonic recordings), recording rooms, and languages (it has been obtained from a bilingual set of speakers). This study has been performed with covariance matrices in a text independent speaker verification application. It reveals that the combination of several parameterizations can improve the robustness in all the scenarios.


title: No arbitrage global parametrization for the eSSVI volatility surface

abstract: The article describes a global and arbitrage-free parametrization of the eSSVI surfaces introduced by Hendriks and Martini in 2019. A robust calibration of such surfaces has already been proposed by the quantitative research team at Zeliade in 2019, but it is sequential in expiries and lacks of a global view on the surface. The alternative calibration suggested in this article is faster and always guarantees an arbitrage-free fit of market data.


title: Deep neural networks for solving large linear systems arising from high-dimensional problems

abstract: This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such extremely large linear systems. Our idea is to employ a neural network to characterize the solution with much fewer parameters than the size of the solution under a matrix-free setting. We present an error analysis of the proposed method, indicating that the solution error is bounded by the condition number of the matrix and the neural network approximation error. Several numerical examples from partial differential equations, queueing problems, and probabilistic Boolean networks are presented to demonstrate that the solutions of linear systems can be learned quite accurately.


title: Scalar and vector gauges unification in de Sitter ambient space formalism

abstract: We consider the massless minimally coupled scalar field in the de Sitter ambient space formalism as a gauge potential or connection field. We construct the scalar gauge theory by helping an arbitrary constant five-vector field $B^\alpha$ analogous to the standard gauge theory. The Lagrangian density of the interaction between the scalar and spinor fields is presented in this framework. The Yukawa potential can be extracted from this Lagrangian density at the null curvature limit by an appropriate choice of a constant five-vector field. It is shown that the de Sitter ambient space formalism permits us to unify the scalar and vector gauge fields. By choosing a matrix form for the constant five-vector field $B^\alpha$, the unification of scalar and vector gauge fields in the spectral action of noncommutative geometry can be rewritten. We discuss that if the scalar gauge field is considered as a conformal sector of the background metric field, it may be interpreted as the connection field between the different de Sitter hyperboloids in the quantum geometry from the classical point of view.


title: State-feedback Abstractions for Optimal Control of Piecewise-affine Systems

abstract: In this manuscript, we investigate symbolic abstractions that capture the behavior of piecewise-affine systems under input constraints and bounded external noise. This is accomplished by considering local affine feedback controllers that are jointly designed with the symbolic model, which ensures that an alternating simulation relation between the system and the abstraction holds. The resulting symbolic system is called a state-feedback abstraction and we show that it can be deterministic even when the original piecewise-affine system is unstable and non-deterministic. One benefit of this approach is the fact that the input space need not be discretized and the symbolic-input space is reduced to a finite set of controllers. When ellipsoidal cells and affine controllers are considered, we present necessary and sufficient conditions written as a semi-definite program for the existence of a transition and a robust upper bound on the transition cost. Two examples illustrate particular aspects of the theory and its applicability.


title: On the effects of a wide opening in the domain of the (stochastic) Allen-Cahn equation and the motion of hybrid zones

abstract: We are concerned with a special form of the (stochastic) Allen-Cahn equation, which can be seen as a model of hybrid zones in population genetics. Individuals in the population can be of one of three types; $aa$ are fitter than $AA$, and both are fitter than the $aA$ heterozygotes. The hybrid zone is the region separating a subpopulation consisting entirely of $aa$ individuals from one consisting of $AA$ individuals. We investigate the interplay between the motion of the hybrid zone and the shape of the habitat, both with and without genetic drift (corresponding to stochastic and deterministic models respectively). In the deterministic model, we investigate the effect of a wide opening and provide some explicit sufficient conditions under which the spread of the advantageous type is halted, and complementary conditions under which it sweeps through the whole population. As a standing example, we are interested in the outcome of the advantageous population passing through an isthmus. We also identify rather precise conditions under which genetic drift breaks down the structure of the hybrid zone, complementing previous work that identified conditions on the strength of genetic drift under which the structure of the hybrid zone is preserved. Our results demonstrate that, even in cylindrical domains, it can be misleading to caricature allele frequencies by one-dimensional travelling waves, and that the strength of genetic drift plays an important role in determining the fate of a favoured allele.


title: A solution approach for the anonymous sharing of sensitive supply chain traceability data

abstract: Supply chain traceability systems have become central in many industries, however, traceability data is often commercially sensitive, and firms seek to keep it confidential to protect their competitive advantage. This is at odds with calls for greater transparency in supply chains for sustainability and efficiency. In this research paper, we develop a solution to this conflict. We demonstrate that sanitised data can be used to confirm the authenticity of products and anonymously verify the rights of an actor to access detailed traceability data. Following a design science methodology, we develop a prototype protocol and verify its performance with traceability data based on the global standard EPCIS.


title: Towards gain tuning for numerical KKL observers

abstract: This paper presents a first step towards tuning observers for general nonlinear systems. Relying on recent results around Kazantzis-Kravaris/Luenberger (KKL) observers, we propose an empirical criterion to guide the calibration of the observer, by trading off transient performance and sensitivity to measurement noise. We parametrize the gain matrix and evaluate this criterion over a family of observers for different parameter values. We then use neural networks to learn the mapping between the observer and the nonlinear system, and present a novel method to sample the state-space efficiently for nonlinear regression. We illustrate the merits of this approach in numerical simulations.


title: Parabolic representations and generalized Riley polynomials

abstract: We generalize R. Riley's study about parabolic representations of two bridge knot groups to the general knots in $S^3$. We utilize the parabolic quandle method for general knot diagrams and adopt symplectic quandle for better investigation, which gives such representations and their complex volumes explicitly. For any knot diagram with a specified crossing $c$, we define a generalized Riley polynomial $R_c(y) \in \mathbb{Q}[y]$ whose roots correspond to the conjugacy classes of parabolic representations of the knot group. The sign-type of parabolic quandle is newly introduced and we obtain a formula for the obstruction class to lift to a boundary unipotent $\text{SL}_2 \mathbb{C}$-representation. Moreover, we define another polynomial $g_c(u)\in\mathbb{Q}[u]$, called $u$-polynomial, and prove that $R_c(u^2)=\pm g_c(u)g_c(-u)$. Based on this result, we introduce and investigate Riley field and $u$-field which are closely related to the invariant trace field. This method eventually leads to the complete classification of parabolic representations of knot groups along with their complex volumes and cusp shapes up to 12 crossings.


title: Branch and Price for Submodular Bin Packing

abstract: The Submodular Bin Packing (SMBP) problem asks for packing unsplittable items into a minimal number of bins for which the capacity utilization function is submodular. SMBP is equivalent to chance-constrained and robust bin packing problems under various conditions. SMBP is a hard binary nonlinear programming optimization problem. In this paper, we propose a branch-and-price algorithm to solve this problem. The resulting price subproblems are submodular knapsack problems, and we propose a tailored exact branch-and-cut algorithm based on a piece-wise linear relaxation to solve them. To speed up column generation, we develop a hybrid pricing strategy to replace the exact pricing algorithm with a fast pricing heuristic. We test our algorithms on instances generated as suggested in the literature. The computational results show the efficiency of our branch-and-price algorithm and the proposed pricing techniques.


title: Highly tunable optics across a topological transition in organic polymers

abstract: Controllable topological phase transitions are appealing as they allow for tunable single particle electronic properties. Here, by using state-of-the-art manybody perturbation theory techniques, we show that the topological $Z_2$ phase transition occurring in the single particle spectrum of the recently synthetized ethynylene bridged polyacene polymers is accompanied by a topological excitonic phase transition: the band inversion in the non-trivial phase yields real-space exciton wave functions in which electrons and holes exchange orbital characters with respect to the trivial phase. The topological excitonic phase transition results in a broad tunability of the singlet-triplet splittings, opening appealing perspectives for the occurrence of singlet fission. Finally, the flatness of the single-particle electronic structure in the topological non trivial phase leads to negatively dispersing triplet excitons in a large portion of the Brillouin zone, opening a route for spontaneously coherent energy transport at room temperature.


title: Unitary evolution and elements of reality in consecutive quantum measurements

abstract: Probabilities of the outcomes of consecutive quantum measurements can be obtained by construction probability amplitudes, thus implying unitary evolution of the measured system, broken each time a measurement is made. In practice, the experimenter needs to know all past outcomes at the end of the experiment, and that requires the presence of probes carrying the corresponding records. In this picture a composite system+probes can be seen to undergo an unbroken unitary evolution until the end of the trial, where the state of the probes is examined. For these two descriptions to agree one requires a particular type of coupling between a probe and the system, which we discuss in some details. With this in mind, we consider two different ways to extend the description of a quantum system's past beyond what is actually measured and recorded. One is to look for quantities whose values can be ascertained without altering the existing probabilities. Such "elements of reality" can be found, yet they suffer from the same drawback as their EPR counterparts. The probes designed to measure non-commuting operators frustrate each other if set up to work jointly, so no simultaneous values of such quantities can be established consistently. The other possibility is to investigate the system's response to weekly coupled probes. Such weak probes are shown either to reduce to a small fraction the number of cases where the corresponding values are still accurately measured, or lead only to the evaluation of the system's probability amplitudes, or their combinations. It is difficult, we conclude, to see in quantum mechanics anything other than a formalism for predicting the likelihoods of the recorded outcomes of actually performed observations.


title: Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applications

abstract: Graphs are a powerful tool for representing and analyzing unstructured, non-Euclidean data ubiquitous in the healthcare domain. Two prominent examples are molecule property prediction and brain connectome analysis. Importantly, recent works have shown that considering relationships between input data samples have a positive regularizing effect for the downstream task in healthcare applications. These relationships are naturally modeled by a (possibly unknown) graph structure between input samples. In this work, we propose Graph-in-Graph (GiG), a neural network architecture for protein classification and brain imaging applications that exploits the graph representation of the input data samples and their latent relation. We assume an initially unknown latent-graph structure between graph-valued input data and propose to learn end-to-end a parametric model for message passing within and across input graph samples, along with the latent structure connecting the input graphs. Further, we introduce a degree distribution loss that helps regularize the predicted latent relationships structure. This regularization can significantly improve the downstream task. Moreover, the obtained latent graph can represent patient population models or networks of molecule clusters, providing a level of interpretability and knowledge discovery in the input domain of particular value in healthcare.


title: Role of matter coherence in entanglement due to gravity

abstract: We investigate the quantum nature of gravity in terms of the coherence of quantum objects. As a basic setting, we consider two gravitating objects each in a superposition state of two paths. The evolution of objects is described by the completely positive and trace-preserving (CPTP) map with a population-preserving property. This property reflects that the probability of objects being on each path is preserved. We use the $\ell_1$-norm of coherence to quantify the coherence of objects. In the present paper, the quantum nature of gravity is characterized by an entangling map, which is a CPTP map with the capacity to create entanglement. We introduce the entangling-map witness as an observable to test whether a given map is entangling. We show that, whenever the gravitating objects initially have a finite amount of the $\ell_1$-norm of coherence, the witness tests the entangling map due to gravity. Interestingly, we find that the witness can test such a quantum nature of gravity, even when the objects do not get entangled. This means that the coherence of gravitating objects always becomes the source of the entangling map due to gravity. We further discuss a decoherence effect and an experimental perspective in the present approach.


title: CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection

abstract: In autonomous driving, LiDAR point-clouds and RGB images are two major data modalities with complementary cues for 3D object detection. However, it is quite difficult to sufficiently use them, due to large inter-modal discrepancies. To address this issue, we propose a novel framework, namely Contrastively Augmented Transformer for multi-modal 3D object Detection (CAT-Det). Specifically, CAT-Det adopts a two-stream structure consisting of a Pointformer (PT) branch, an Imageformer (IT) branch along with a Cross-Modal Transformer (CMT) module. PT, IT and CMT jointly encode intra-modal and inter-modal long-range contexts for representing an object, thus fully exploring multi-modal information for detection. Furthermore, we propose an effective One-way Multi-modal Data Augmentation (OMDA) approach via hierarchical contrastive learning at both the point and object levels, significantly improving the accuracy only by augmenting point-clouds, which is free from complex generation of paired samples of the two modalities. Extensive experiments on the KITTI benchmark show that CAT-Det achieves a new state-of-the-art, highlighting its effectiveness.


title: A new Directional Algebraic Fast Multipole Method based iterative solver for the Lippmann-Schwinger equation accelerated with HODLR preconditioner

abstract: We present a fast iterative solver for scattering problems in 2D, where a penetrable object with compact support is considered. By representing the scattered field as a volume potential in terms of the Green's function, we arrive at the Lippmann-Schwinger equation in integral form, which is then discretized using an appropriate quadrature technique. The discretized linear system is then solved using an iterative solver accelerated by Directional Algebraic Fast Multipole Method (DAFMM). The DAFMM presented here relies on the directional admissibility condition of the 2D Helmholtz kernel. And the construction of low-rank factorizations of the appropriate low-rank matrix sub-blocks is based on our new Nested Cross Approximation (NCA)~\cite{ arXiv:2203.14832 [math.NA]}. The advantage of our new NCA is that the search space of so-called far-field pivots is smaller than that of the existing NCAs. Another significant contribution of this work is the use of HODLR based direct solver as a preconditioner to further accelerate the iterative solver. In one of our numerical experiments, the iterative solver does not converge without a preconditioner. We show that the HODLR preconditioner is capable of solving problems that the iterative solver can not. Another noteworthy contribution of this article is that we perform a comparative study of the HODLR based fast direct solver, DAFMM based fast iterative solver, and HODLR preconditioned DAFMM based fast iterative solver for the discretized Lippmann-Schwinger problem. To the best of our knowledge, this work is one of the first to provide a systematic study and comparison of these different solvers for various problem sizes and contrast functions. In the spirit of reproducible computational science, the implementation of the algorithms developed in this article is made available at \url{https://github.com/vaishna77/Lippmann_Schwinger_Solver}.


title: Diverse Preference Augmentation with Multiple Domains for Cold-start Recommendations

abstract: Cold-start issues have been more and more challenging for providing accurate recommendations with the fast increase of users and items. Most existing approaches attempt to solve the intractable problems via content-aware recommendations based on auxiliary information and/or cross-domain recommendations with transfer learning. Their performances are often constrained by the extremely sparse user-item interactions, unavailable side information, or very limited domain-shared users. Recently, meta-learners with meta-augmentation by adding noises to labels have been proven to be effective to avoid overfitting and shown good performance on new tasks. Motivated by the idea of meta-augmentation, in this paper, by treating a user's preference over items as a task, we propose a so-called Diverse Preference Augmentation framework with multiple source domains based on meta-learning (referred to as MetaDPA) to i) generate diverse ratings in a new domain of interest (known as target domain) to handle overfitting on the case of sparse interactions, and to ii) learn a preference model in the target domain via a meta-learning scheme to alleviate cold-start issues. Specifically, we first conduct multi-source domain adaptation by dual conditional variational autoencoders and impose a Multi-domain InfoMax (MDI) constraint on the latent representations to learn domain-shared and domain-specific preference properties. To avoid overfitting, we add a Mutually-Exclusive (ME) constraint on the output of decoders to generate diverse ratings given content data. Finally, these generated diverse ratings and the original ratings are introduced into the meta-training procedure to learn a preference meta-learner, which produces good generalization ability on cold-start recommendation tasks. Experiments on real-world datasets show our proposed MetaDPA clearly outperforms the current state-of-the-art baselines.


title: Products of commutator ideals of some Lie-admissible algebras

abstract: In this article, we mainly study the products of commutator ideals of Lie-admissible algebras such as Novikov algebras, bicommutative algebras, and assosymmetric algebras. More precisely, we first study the properties of the lower central chains for Novikov algebras and bicommutative algebras. Then we show that for every Lie nilpotent Novikov algebra or Lie nilpotent bicommutative algebra $\mathcal{A}$, the ideal of $\mathcal{A}$ generated by the set $\{ab - ba\mid a, b\in \mathcal{A}\}$ is nilpotent. Finally, we study properties of the lower central chains for assosymmetric algebras, study the products of commutator ideals of assosymmetric algebras and show that the products of commutator ideals have a similar property as that for associative algebras.


title: Pentagon Wilson loop with Lagrangian insertion at two loops in ${\mathcal N}=4$ super Yang-Mills theory

abstract: We compute the two-loop result for the null pentagonal Wilson loop with a Lagrangian insertion (normalized by the Wilson loop without insertion) in planar, maximally supersymmetric Yang-Mills theory. This finite observable is closely related to the Amplituhedron, and it is reminiscent of finite parts of planar two-loop five-particle scattering amplitudes. We verify that, up to this loop order, the leading singularities are given by the same conformally invariant expressions that appear in all-plus pure Yang-Mills amplitudes. The accompanying weight-four transcendental functions are expressed in terms of the pentagon functions space known from planar two-loop five-particle amplitudes, but interestingly only a subset of the functions appears. Being a function of four dimensionless variables, the observable has interesting asymptotic limits. We verify that our analytic result is consistent with soft and collinear limits, and find an intriguingly simple pattern in the multi-Regge limit. Thanks to the new result we can also conjecturally predict, for general kinematics, the maximal weight piece of the planar three-loop five-particle all-plus amplitude in pure Yang-Mills theory. Motivated by the Amplituhedron geometry, we investigate positivity properties of the integrated answer. Generalizing previous results at four particles, we find numerical evidence that the two-loop five-particle result has uniform sign in a kinematic region suggested by the loop Amplituhedron.


title: DIP: Deep Inverse Patchmatch for High-Resolution Optical Flow

abstract: Recently, the dense correlation volume method achieves state-of-the-art performance in optical flow. However, the correlation volume computation requires a lot of memory, which makes prediction difficult on high-resolution images. In this paper, we propose a novel Patchmatch-based framework to work on high-resolution optical flow estimation. Specifically, we introduce the first end-to-end Patchmatch based deep learning optical flow. It can get high-precision results with lower memory benefiting from propagation and local search of Patchmatch. Furthermore, a new inverse propagation is proposed to decouple the complex operations of propagation, which can significantly reduce calculations in multiple iterations. At the time of submission, our method ranks first on all the metrics on the popular KITTI2015 benchmark, and ranks second on EPE on the Sintel clean benchmark among published optical flow methods. Experiment shows our method has a strong cross-dataset generalization ability that the F1-all achieves 13.73%, reducing 21% from the best published result 17.4% on KITTI2015. What's more, our method shows a good details preserving result on the high-resolution dataset DAVIS and consumes 2x less memory than RAFT.


title: Using segment-based features of jaw movements to recognize foraging activities in grazing cattle

abstract: Precision livestock farming optimizes livestock production through the use of sensor information and communication technologies to support decision making, proactively and near real-time. Among available technologies to monitor foraging behavior, the acoustic method has been highly reliable and repeatable, but can be subject to further computational improvements to increase precision and specificity of recognition of foraging activities. In this study, an algorithm called Jaw Movement segment-based Foraging Activity Recognizer (JMFAR) is proposed. The method is based on the computation and analysis of temporal, statistical and spectral features of jaw movement sounds for detection of rumination and grazing bouts. They are called JM-segment features because they are extracted from a sound segment and expect to capture JM information of the whole segment rather than individual JMs. Two variants of the method are proposed and tested: (i) the temporal and statistical features only JMFAR-ns; and (ii) a feature selection process (JMFAR-sel). The JMFAR was tested on signals registered in a free grazing environment, achieving an average weighted F1-score of 93%. Then, it was compared with a state-of-the-art algorithm, showing improved performance for estimation of grazing bouts (+19%). The JMFAR-ns variant reduced the computational cost by 25.4%, but achieved a slightly lower performance than the JMFAR. The good performance and low computational cost of JMFAR-ns supports the feasibility of using this algorithm variant for real-time implementation in low-cost embedded systems. The method presented within this publication is protected by a pending patent application: AR P20220100910.


title: Product and sum uncertainty relations based on metric-adjusted skew information

abstract: The metric-adjusted skew information establishes a connection between the geometrical formulation of quantum statistics and the measures of quantum information. We study uncertainty relations in product and summation forms of metric-adjusted skew information. We present lower bounds on product and summation uncertainty inequalities based on metric-adjusted skew information via operator representation of observables. Explicit examples are provided to back our claims.


title: PriMock57: A Dataset Of Primary Care Mock Consultations

abstract: Recent advances in Automatic Speech Recognition (ASR) have made it possible to reliably produce automatic transcripts of clinician-patient conversations. However, access to clinical datasets is heavily restricted due to patient privacy, thus slowing down normal research practices. We detail the development of a public access, high quality dataset comprising of57 mocked primary care consultations, including audio recordings, their manual utterance-level transcriptions, and the associated consultation notes. Our work illustrates how the dataset can be used as a benchmark for conversational medical ASR as well as consultation note generation from transcripts.


title: Cyberbullying detection across social media platforms via platform-aware adversarial encoding

abstract: Despite the increasing interest in cyberbullying detection, existing efforts have largely been limited to experiments on a single platform and their generalisability across different social media platforms have received less attention. We propose XP-CB, a novel cross-platform framework based on Transformers and adversarial learning. XP-CB can enhance a Transformer leveraging unlabelled data from the source and target platforms to come up with a common representation while preventing platform-specific training. To validate our proposed framework, we experiment on cyberbullying datasets from three different platforms through six cross-platform configurations, showing its effectiveness with both BERT and RoBERTa as the underlying Transformer models.


title: Fact-nets: towards a mathematical framework for relational quantum mechanics

abstract: The relational interpretation of quantum mechanics (RQM) has received a growing interest since its first formulation in 1996. Usually presented as an interpretational layer over the usual quantum mechanics formalism, it appears as a philosophical perspective without proper mathematical counterparts. This state of affairs has direct consequences on the scientific debate on RQM which still suffers from misunderstandings and imprecise statements. In an attempt to clarify those debates, the present paper proposes a radical reformulation of the mathematical framework of quantum mechanics which is relational from the start: fact-nets. The core idea is that all statements about the world, facts, are binary entities involving two systems that can be symmetrically thought of as observed and observer. We initiate a study of the fact-nets formalism and outline how it can shed new relational light on some familiar quantum features.


title: Describing model categories througth homotopy tiny objects

abstract: Let $\mathcal C$ be a $\mathcal V$-enriched model category. We say that an object $x$ of $\mathcal C$ is homotopy tiny if the total right derived functor of $\mathcal C(x, -) : \mathcal{C} \rightarrow {\mathcal V}$ preserves homotopy weighted colimits. Let $\mathcal C_0$ be a full subcategory of $\mathcal C$ all of whose objects are homotopy tiny. Our main result says that the homotopy category of the category generated by $\mathcal C_0$ under weak equivalences and homotopy weighted colimits is equivalent to the homotopy category of the category $\mathcal V^{\mathcal C_0^{op}}$ of $\mathcal V$-enriched presheaves on $\mathcal C_0$ with values in $\mathcal V$. If $\mathcal C$ is generated by $\mathcal C_0$, then $\mathcal C$ is Quillen equivalent to $\mathcal V^{\mathcal C_0^{op}}$. Two special cases of our theorem are Schwede-Shipley's theorem on stable model categories and Elmendorf's theorem on equivariant spaces.


title: Relative calibration of the LIGO and Virgo detectors using astrophysical events from their third observing run

abstract: We explore a method to assess the relative scale of the strain measured in the different detectors of the gravitational-wave network, using binary black hole (BBH) events detected during the third observing run (O3). The number of such signals is becoming sufficiently large to adopt a statistical approach based on the ratio of the signal-to-noise ratio (SNR) of the events between the detectors and the number of observed events in each detector. We demonstrate the principle of the method on simulations of BBH signals and we present its application to published O3 events reported by the Multi-Band Template Analysis (MBTA) pipeline. Constraints on the relative calibration of the gravitational-wave network for O3 are obtained at the level of ~3.5% between the two LIGO detectors and at the level of ~10% between the LIGO Livingston detector and the Virgo detector.


title: The isogeometric collocated contact surface approach

abstract: We propose a frictionless contact formulation for isogeometric analysis, which combines a collocated formulation for the contact surfaces with a standard Galerkin treatment of the bulk. We denote it as isogeometric Collocated Contact Surface (CCS) formulation. The approach is based on a simple pointwise enforcement of the contact constraints, performed in this study with the penalty method. Unlike pointwise (node-to-surface or point-to-surface) contact algorithms in the Galerkin framework, the CCS formulation passes the contact patch test to machine precision by naturally exploiting the favorable properties of isogeometric collocation. Compared with approaches where the discretization of both bulk and contact surfaces is based on collocation, the CCS approach does not need enhancements to remove oscillations for highly non-uniform meshes. With respect to integral contact approaches, the CCS algorithm is less expensive, easier to code and can be added to a pre-existing isogeometric analysis code with minimal effort. Numerical examples in both small and large deformations are investigated to compare the CCS approach with some available contact formulations and to demonstrate its accuracy.


title: Self-triggered MPC robust to bounded packet loss via a min-max approach: extended version

abstract: Networked Control Systems typically come with a limited communication bandwidth and thus require special care when designing the underlying control and triggering law. A method that allows to consider hard constraints on the communication traffic as well as on states and inputs is self-triggered model predictive control (MPC). In this scheme, the optimal length of the sampling interval is determined proactively using predictions of the system behavior. However, previous formulations of self-triggered MPC have neglected the widespread phenomenon of packet loss, such that these approaches might fail in practice. In this paper, we present a novel self-triggered MPC scheme which is robust to bounded packet loss by virtue of a min-max optimization problem. We prove recursive feasibility, constraint satisfaction and convergence to the origin for any possible packet loss realization consistent with the boundedness constraint, and demonstrate the advantages of the proposed scheme in a numerical example.


title: Quantum approximate optimization algorithm for qudit systems

abstract: A frequent starting point of quantum computation platforms are two-state quantum systems, i.e., qubits. However, in the context of integer optimization problems, relevant to scheduling optimization and operations research, it is often more resource-efficient to employ quantum systems with more than two basis states, so-called qudits. Here, we discuss the quantum approximate optimization algorithm (QAOA) for qudit systems. We illustrate how the QAOA can be used to formulate a variety of integer optimization problems such as graph coloring problems or electric vehicle (EV) charging optimization. In addition, we comment on the implementation of constraints and describe three methods to include these into a quantum circuit of a QAOA by penalty contributions to the cost Hamiltonian, conditional gates using ancilla qubits, and a dynamical decoupling strategy. Finally, as a showcase of qudit-based QAOA, we present numerical results for a charging optimization problem mapped onto a max-$k$-graph coloring problem. Our work illustrates the flexibility of qudit systems to solve integer optimization problems.


title: Local spectroscopic evidence for a nodeless magnetic kagome superconductor CeRu$_2$

abstract: We report muon spin rotation (${\mu}$SR) experiments on the microscopic properties of superconductivity and magnetism in the kagome superconductor CeRu$_{2}$ with $T_{\rm c}$~${\simeq}$~5~K. From the measurements of the temperature-dependent magnetic penetration depth ${\lambda}$, the superconducting order parameter exhibits nodeless pairing, which fits best to an anisotropic $s$-wave gap symmetry. We further show that the $T_{\rm c}$/$\lambda^{-2}$ ratio is comparable to that of unconventional superconductors. Furthermore, the powerful combination of zero-field (ZF)-${\mu}$SR and high-field ${\mu}$SR has been used to uncover magnetic responses across three characteristic temperatures, identified as $T_1^*$~${\simeq}$~110~K, $T_2^*$~${\simeq}$~65~K, and $T_3^*$~${\simeq}$~40~K. Our experiments classify CeRu$_{2}$ as an exceedingly rare nodeless magnetic kagome superconductor.


title: Magnetism, rotation, and nonthermal emission in cool stars -- Average magnetic field measurements in 292 M dwarfs

abstract: Stellar dynamos generate magnetic fields that are of fundamental importance to the variability and evolution of Sun-like and low-mass stars, and for the development of their planetary systems. We report measurements of surface-average magnetic fields in 292 M dwarfs from a comparison with radiative transfer calculations; for 260 of them, this is the first measurement of this kind. Our data were obtained from more than 15,000 high-resolution spectra taken during the CARMENES project. They reveal a relation between average field strength, <B>, and Rossby number, $Ro$, resembling the well-studied rotation-activity relation. Among the slowly rotating stars, we find that magnetic flux, $\Phi_\textrm{B}$, is proportional to rotation period, $P$, and among the rapidly rotating stars that average surface fields do not grow significantly beyond the level set by the available kinetic energy. Furthermore, we find close relations between nonthermal coronal X-ray emission, chromospheric H$\alpha$ and Ca H&K emission, and magnetic flux. Taken together, these relations demonstrate empirically that the rotation-activity relation can be traced back to a dependence of the magnetic dynamo on rotation. We advocate the picture that the magnetic dynamo generates magnetic flux on the stellar surface proportional to rotation rate with a saturation limit set by the available kinetic energy, and we provide relations for average field strengths and nonthermal emission that are independent of the choice of the convective turnover time. We also find that Ca H&K emission saturates at average field strengths of $\langle B \rangle \approx 800$ G while H$\alpha$ and X-ray emission grow further with stronger fields in the more rapidly rotating stars. This is in conflict with the coronal stripping scenario predicting that in the most rapidly rotating stars coronal plasma would be cooled to chromospheric temperatures.


title: Parameter Estimation for Quantum Trajectories: Convergence Result

abstract: A quantum trajectory describes the evolution of a quantum system undergoing indirect measurement. In the discrete-time setting, the state of the system is updated by applying Kraus operators according to the measurement results. From an experimental perspective, these Kraus operators can depend on unknown physical parameters p. An interesting and powerful method has been proposed in [1] to estimate a parameter in a finite set; however, complete results of convergence were lacking. This article fills this gap by rigorously showing the consistency of the method, whereas there was only numerical evidence so far. When the parameter belongs to a continuous set, we propose an algorithm to approach its value and show simulation results.


title: Majorization for Starlike and Convex functions with respect to Conjugate points

abstract: The concept of majorization is now well-known after the beautiful work of MacGregor, and then followed by Campbell in his sequel of papers. In this paper, we establish the sharp majorization results for the starlike and convex functions with respect to the conjugate points.


title: Polarized Raman Response of Two-Dimensional Quasiperiodic Antiferromagnets: Configuration-Interaction versus Green's Function Approaches

abstract: We study Raman response of Heisenberg antiferromagnets on the $\mathbf{C}_\mathrm{5v}$ Penrose and $\mathbf{C}_\mathrm{8v}$ Ammann-Beenker lattices within and beyond the Loudon-Fleury second-order perturbation scheme intending to explore optical features peculiar to quasiperiodic magnets. Within the Loudon-Fleury mechanism, we find one and only Raman-active mode of $\mathrm{E}_2$ symmetry without any dependence on linear incident and scattered polarizations. Beyond the Loudon-Fleury mechanism, two more symmetry species $\mathrm{A}_1$ and $\mathrm{A}_2$ are activated via dynamic ring exchange and chiral spin fluctuations, respectively, which can be extracted by the use of circular as well as linear polarizations. We employ Green's functions on one hand and configuration-interaction wavefunctions on the other hand to calculate the multimagnon contributions to inelastic light scatterings. Demonstrating the great advantage of the configuration-interaction scheme, we reveal that a major portion of the Shastry-Shraiman fourth-order Raman intensity is mediated by multimagnon fluctuations.


title: A Comparative Study of Machine Learning Methods for X-ray Binary Classification

abstract: X-ray Binaries (XRBs) consist of a compact object that accretes material from an orbiting secondary star. The most secure method we have for determining if the compact object is a black hole is to determine its mass: this is limited to bright objects, and requires substantial time-intensive spectroscopic monitoring. With new X-ray sources being discovered with different X-ray observatories, developing efficient, robust means to classify compact objects becomes increasingly important. We compare three machine learning classification methods (Bayesian Gaussian Processes (BGP), K-Nearest Neighbors (KNN), Support Vector Machines (SVM)) for determining the compact objects as neutron stars or black holes (BHs) in XRB systems. Each machine learning method uses spatial patterns which exist between systems of the same type in 3D Color-Color-Intensity diagrams. We used lightcurves extracted using six years of data with MAXI/GSC for 44 representative sources. We find that all three methods are highly accurate in distinguishing pulsing from non-pulsing neutron stars (NPNS) with 95\% of NPNS and 100\% of pulsars accurately predicted. All three methods have high accuracy distinguishing BHs from pulsars (92\%) but continue to confuse BHs with a subclass of NPNS, called the Bursters, with KNN doing the best at only 50\% accuracy for predicting BHs. The precision of all three methods is high, providing equivalent results over 5-10 independent runs. In a future work, we suggest a fourth dimension be incorporated to mitigate the confusion of BHs with Bursters. This work paves the way towards more robust methods to efficiently distinguish BHs, NPNS, and pulsars.


title: Insuring uninsurable income

abstract: This paper presents a method to avoid the ominous prediction of the previous work: if insured incomes of infinitely lived individuals are unobservable, then efficient allocations lead to permanent welfare inequality between individuals and immiseration of society. The proposed mechanism (i) promises within-period full insurance by postponing risks ; (ii) it does not lead to social ranking among the same age groups; and (iii) it could be sustainable.


title: WavFT: Acoustic model finetuning with labelled and unlabelled data

abstract: Unsupervised and self-supervised learning methods have leveraged unlabelled data to improve the pretrained models. However, these methods need significantly large amount of unlabelled data and the computational cost of training models with such large amount of data can be prohibitively high. We address this issue by using unlabelled data during finetuning, instead of pretraining. We propose acoustic model finetuning (FT) using labelled and unlabelled data. The model is jointly trained to learn representations to classify senones, as well as learn contextual acoustic representations. Our training objective is a combination of cross entropy loss, suitable for classification task, and contrastive loss, suitable to learn acoustic representations. The proposed approach outperforms conventional finetuning with 11.2% and 9.19% word error rate relative (WERR) reduction on Gujarati and Bengali languages respectively.


title: Computation of Optical Refractive Index Structure Parameter from its Statistical Definition Using Radiosonde Data

abstract: Knowledge of the optical refractive index structure parameter $C_n^2$ is of interest for Free Space Optics (FSO) and ground-based optical astronomy, as it depicts the strength of the expected scintillation on the received optical waves. Focus is given here to models using meteorological quantities coming from radiosonde measurements as inputs to estimate the $C_n^2$ profile in the atmosphere. A model relying on the $C_n^2$ statistical definition is presented and applied to recent high-density radiosonde profiles at Trappes (France) and Hilo, HI (USA). It is also compared to thermosonde measurements coming from the T-REX campaign. This model enables to obtain site-specific average profiles and to identify isolated turbulent layers using only pressure and temperature measurements, paving the way for optical site selection. It offers similar performance when compared to a Tatarskii-based model inspired by the literature.

categories: eess.SP astro-ph.IM physics.ao-ph physics.optics


title: Revisiting Shallow Discourse Parsing in the PDTB-3: Handling Intra-sentential Implicits

abstract: In the PDTB-3, several thousand implicit discourse relations were newly annotated \textit{within} individual sentences, adding to the over 15,000 implicit relations annotated \textit{across} adjacent sentences in the PDTB-2. Given that the position of the arguments to these \textit{intra-sentential implicits} is no longer as well-defined as with \textit{inter-sentential implicits}, a discourse parser must identify both their location and their sense. That is the focus of the current work. The paper provides a comprehensive analysis of our results, showcasing model performance under different scenarios, pointing out limitations and noting future directions.


title: Phase transitions of non-Abelian charged nodal links in a spring-mass system

abstract: Although a large class of topological materials have uniformly been identified using symmetry properties of wave functions, the past two years have seen the rise of multi-gap topologies beyond this paradigm. Given recent reports of unexplored features of such phases, platforms that are readily implementable to realize them are therefore desirable. Here, we demonstrate that multi-gap topological phase transitions of non-Abelian charged nodal lines arise in classical phonon waves. By adopting a simple spring-mass system, we construct nodal lines of a three-band system. The braiding process of the nodal lines is readily performed by adjusting the spring constants. The generation and annihilation of the nodal lines are then analyzed using Euler class. Finally, we retrieve topological transitions from trivial nodal lines to a nodal link. Our work provides a simple platform that can offer diverse insights to not only theoretical but also experimental studies on multi-gap topology.


title: On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting

abstract: User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many examples. To solve this problem, previous works try to incorporate self-supervised learning models or apply meta-learning algorithms. But it is unclear whether self-supervised learning and meta-learning are complementary and which combination of the two types of approaches is most effective for few-shot keyword discovery. In this work, we systematically study these questions by utilizing various self-supervised learning models and combining them with a wide variety of meta-learning algorithms. Our result shows that HuBERT combined with Matching network achieves the best result and is robust to the changes of few-shot examples.


title: Impact of spatiotemporal heterogeneity in heat pump loads on generation and storage requirements

abstract: This paper investigates how spatiotemporal heterogeneity in inflexible residential heat pump loads affects the need for storage and generation in the electricity system under business-as-usual and low-carbon emissions budgets. Homogeneous and heterogeneous heat pump loads are generated using population-weighted average and local temperature, respectively, assuming complete residential heat pump penetration. The results of a storage and generation optimal expansion model with network effects for spatiotemporally homogeneous and heterogeneous load profiles are compared. A case study is performed using a 3-bus network of London, Manchester, and Glasgow in Britain for load and weather data for representative weeks. Using heterogeneous heating demand data changes storage sizing: under a business-as-usual budget, 26% more total storage is built on an energy and power basis, and this storage is distributed among all of the buses in the heterogeneous case. Under a low-carbon budget, total energy storage at all buses increases 2 times on an energy basis and 40% on a power basis. The energy to power ratio of storage at each bus also increases when accounting for heterogeneity; this change suggests that storage will be needed to provide energy support in addition to power support for electric heating in high-renewable power systems. Accounting for heterogeneity also increases modeled systems costs, particularly capital costs, because of the need for higher generation capacity in the largest load center and coincidence of local peak demand at different buses. These results show the importance of accounting for heat pump load heterogeneity in power system planning.