title: Bag of Tricks for Long-Tail Visual Recognition of Animal Species in Camera-Trap Images

abstract: Camera traps are a method for monitoring wildlife and they collect a large number of pictures. The number of images collected of each species usually follows a long-tail distribution, i.e., a few classes have a large number of instances, while a lot of species have just a small percentage. Although in most cases these rare species are the ones of interest to ecologists, they are often neglected when using deep-learning models because these models require a large number of images for the training. In this work, a simple and effective framework called Square-Root Sampling Branch (SSB) is proposed, which combines two classification branches that are trained using square-root sampling and instance sampling to improve long-tail visual recognition, and this is compared to state-of-the-art methods for handling this task: square-root sampling, class-balanced focal loss, and balanced group softmax. To achieve a more general conclusion, the methods for handling long-tail visual recognition were systematically evaluated in four families of computer vision models (ResNet, MobileNetV3, EfficientNetV2, and Swin Transformer) and four camera-trap datasets with different characteristics. Initially, a robust baseline with the most recent training tricks was prepared and, then, the methods for improving long-tail recognition were applied. Our experiments show that square-root sampling was the method that most improved the performance for minority classes by around 15%; however, this was at the cost of reducing the majority classes' accuracy by at least 3%. Our proposed framework (SSB) demonstrated itself to be competitive with the other methods and achieved the best or the second-best results for most of the cases for the tail classes; but, unlike the square-root sampling, the loss in the performance of the head classes was minimal, thus achieving the best trade-off among all the evaluated methods.


title: Polarisation of SKT Calabi-Yau $\partial\bar\partial$-manifolds by Aeppli classes

abstract: Given a $\partial\bar\partial$-manifold $X$ with trivial canonical bundle and carrying a metric $\omega$ such that $\partial\bar\partial\omega=0$, we introduce the concept of small deformations of $X$ polarised by the Aeppli cohomology class $[\omega]_A$ of an SKT metric $\omega$. There is a correspondence between the manifolds polarised by $[\omega]_A$ in the Kuranishi family of $X$ and the Bott-Chern classes that are primitive in a sense that we define. We also investigate the existence of a primitive element in an arbitrary Bott-Chern primitive class and compare the metrics on the base space of the subfamily of manifolds polarised by $[\omega]_A$ within the Kuranishi family.


title: A trace formula for scattering resonances of unbalanced quantum graphs

abstract: Given an unbalanced open quantum graph, we derive a formula relating sums over its scattering resonances with integrals outside a strip. We deduce lower bounds on the number of resonances (in bounded regions of the complex plane),that are independent of the size of the graph. We also deduce partial results indicating that Benjamini-Schramm convergence of open quantum graphs should imply convergence of the empirical spectral measures.


title: Semilinear De Morgan monoids and epimorphisms

abstract: A representation theorem is proved for De Morgan monoids that are (i) semilinear, i.e., subdirect products of totally ordered algebras, and (ii) negatively generated, i.e., generated by lower bounds of the neutral element. Using this theorem, we prove that the De Morgan monoids satisfying (i) and (ii) form a locally finite variety. We then prove that epimorphisms are surjective in every variety of negatively generated semilinear De Morgan monoids. In the process, epimorphism-surjectivity is established for several other classes as well, including the variety of all semilinear idempotent commutative residuated lattices and all varieties of negatively generated semilinear Dunn monoids. The results settle natural questions about Beth-style definability for a range of substructural logics.


title: Critical fields of superconductors with magnetic impurities

abstract: The upper critical field $H_{c2} $, the field $H_{c3}$ for nucleation of the surface superconductivity, and the thermodynamic $H_c $ are evaluated within the weak-coupling theory for the isotropic s-wave case and arbitrary transport and pair-breaking scattering. We find that for the standard geometry of a half-space sample in a magnetic field parallel to the surface, the ratio ${\cal R}=H_{c3}/H_{c2}$ is within the window $1.55\lesssim {\cal R}\lesssim 2.34$, regardless of temperature, magnetic or non-magnetic scattering. While the non-magnetic impurities tend to flatten the ${\cal R}\left(T\right)$ variation, the magnetic scattering merely shifts the maximum of ${\cal R}\left(T\right)$ to lower temperatures. Surprisingly, while reducing the transition temperature, magnetic scattering has a milder impact on ${\cal R}$ than the non-magnetic scattering. The surface superconductivity is quite robust; in fact, the ratio ${\cal R}\approx 1.7$ even in the gapless state. We used Eilenberger's energy functional to evaluate the condensation energy $F_c$ and the thermodynamic critical field $H_c$ for any temperature and scattering parameters. By comparing $H_{c2} $ and $H_{c}$, we find that unlike the transport scattering, the pair-breaking pushes materials toward type-I behavior. We find a peculiar behavior of $F_c$ as a function of the pair-breaking scattering parameter at the low-$T$ transition from gapped to gapless phases, which has recently been associated with the topological transition in the superconducting density of states.


title: Risk-averse Contextual Multi-armed Bandit Problem with Linear Payoffs

abstract: In this paper we consider the contextual multi-armed bandit problem for linear payoffs under a risk-averse criterion. At each round, contexts are revealed for each arm, and the decision maker chooses one arm to pull and receives the corresponding reward. In particular, we consider mean-variance as the risk criterion, and the best arm is the one with the largest mean-variance reward. We apply the Thompson Sampling algorithm for the disjoint model, and provide a comprehensive regret analysis for a variant of the proposed algorithm. For $T$ rounds, $K$ actions, and $d$-dimensional feature vectors, we prove a regret bound of $O((1+\rho+\frac{1}{\rho}) d\ln T \ln \frac{K}{\delta}\sqrt{d K T^{1+2\epsilon} \ln \frac{K}{\delta} \frac{1}{\epsilon}})$ that holds with probability $1-\delta$ under the mean-variance criterion with risk tolerance $\rho$, for any $0<\epsilon<\frac{1}{2}$, $0<\delta<1$. The empirical performance of our proposed algorithms is demonstrated via a portfolio selection problem.


title: Motion Estimation for Large Displacements and Deformations

abstract: Large displacement optical flow is an integral part of many computer vision tasks. Variational optical flow techniques based on a coarse-to-fine scheme interpolate sparse matches and locally optimize an energy model conditioned on colour, gradient and smoothness, making them sensitive to noise in the sparse matches, deformations, and arbitrarily large displacements. This paper addresses this problem and presents HybridFlow, a variational motion estimation framework for large displacements and deformations. A multi-scale hybrid matching approach is performed on the image pairs. Coarse-scale clusters formed by classifying pixels according to their feature descriptors are matched using the clusters' context descriptors. We apply a multi-scale graph matching on the finer-scale superpixels contained within each matched pair of coarse-scale clusters. Small clusters that cannot be further subdivided are matched using localized feature matching. Together, these initial matches form the flow, which is propagated by an edge-preserving interpolation and variational refinement. Our approach does not require training and is robust to substantial displacements and rigid and non-rigid transformations due to motion in the scene, making it ideal for large-scale imagery such as Wide-Area Motion Imagery (WAMI). More notably, HybridFlow works on directed graphs of arbitrary topology representing perceptual groups, which improves motion estimation in the presence of significant deformations. We demonstrate HybridFlow's superior performance to state-of-the-art variational techniques on two benchmark datasets and report comparable results with state-of-the-art deep-learning-based techniques.


title: xFitter: An Open Source QCD Analysis Framework. A resource and reference document for the Snowmass study

abstract: We provide an overview of the xFitter open-source software package, review the general capabilities of the program, and highlight applications relevant to the Snowmass study. An updated version of the program (2.2.0) is available on CERN GitLab, a and this has been updated to a C++ codebase with enhanced and extended features. We also discuss some of the ongoing and future code developments that may be useful for precision studies. We survey recent analyses performed by the xFitter developers' team including: W and Z production, photon PDFs, Drell-Yan forward-backward asymmetry studies, resummation of small-x contributions, heavy quark production, constraints on the strange PDF, determination of the pion PDF, and determination of the pion Fragmentation Functions. Finally, we briefly summarize selected applications of xFitter in the literature. The xFitter program is a versatile, flexible, modular, and comprehensive tool that can provide impact studies for possible future facilities. We encourage the use of xFitter, and welcome new contributions from the community.


title: Enhanced symmetry and Entropy of Schwarzschild-deSitter spacetime

abstract: In this paper we show that the equation of motion of a massless scalar particle near the black hole (BH) horizon in the Schwarzschild-deSitter (SdS) spacetime enjoys a hidden conformal symmetry when the two horizons satisfy a quadratic relation, not related with the Nariai limit. This hidden symmetry is $SL(2,\mathbb{R})\times SO(2)$ instead of $SO(2,1)\times SO(2)$, the expected symmetry of $dS_2\times S^2$. We present a structural analysis of SdS spacetime and compute the leading quantum corrections to the entropy of SdS spacetime in a semi-classical way.


title: Time-dependent Schrieffer-Wolff-Lindblad Perturbation Theory: measurement-induced dephasing and second-order Stark shift in dispersive readout

abstract: We develop a time-dependent Schrieffer-Wolff-Lindblad perturbation theory to study effective interactions for driven open quantum systems. The starting point of our analysis is a given Lindblad equation, based on which we obtain an effective (averaged) map that describes the renormalization of both the Hamiltonian and collapse operators due to the drive. As a case study, we apply this method to the dispersive readout of a transmon qubit and derive an effective disperive map that describes measurement-induced dephasing and Stark shift for the transmon. The effective map we derive is completely positive and trace-preserving under adiabatic resonator response. To benchmark our method, we demonstrate good agreement with a numerical computation of the effective rates via the Lindbladian spectrum. Our results are also in agreement with, and extend upon, an earlier derivation of such effects by Gambetta et al. (Phys. Rev. A 74, 042318 (2006)) using the positive P-representation for the resonator field.


title: Emergent Metric Space-Time from Matrix Theory

abstract: The IKKT matrix model yields an emergent space-time. We further develop these ideas and give a proposal for an emergent metric. Based on previous numerical studies of this model, we provide evidence that the emergent space-time is continuous and infinite in extent, both in space and in time, and that the metric is spatially flat. The time evolution describes the transition from a string-theoretic emergent phase to a phase in which the $SO(9)$ symmetry of the model is spontaneously broken to $SO(6) \times SO(3)$, with three dimensions of space expanding, becoming classical and at later times evolving like in a radiation-dominated universe, and the remaining six dimensions of space stabilized at the string scale. We speculate on how this analysis can be extended to yield an early universe cosmology which, in addition to the above-mentioned properties, also leads to a roughly scale-invariant spectrum of cosmological fluctuations and gravitational waves.


title: Burst2Vec: An Adversarial Multi-Task Approach for Predicting Emotion, Age, and Origin from Vocal Bursts

abstract: We present Burst2Vec, our multi-task learning approach to predict emotion, age, and origin (i.e., native country/language) from vocal bursts. Burst2Vec utilises pre-trained speech representations to capture acoustic information from raw waveforms and incorporates the concept of model debiasing via adversarial training. Our models achieve a relative 30 % performance gain over baselines using pre-extracted features and score the highest amongst all participants in the ICML ExVo 2022 Multi-Task Challenge.


title: Flow-Induced Buckling of Elastic Microfilaments with Non-Uniform Bending Stiffness

abstract: Buckling plays a critical role in the transport and dynamics of elastic microfilaments in Stokesian fluids. However, previous work has only considered filaments with homogeneous structural properties. Filament backbone stiffness can be non-uniform in many biological systems like microtubules, where the association and disassociation of proteins can lead to spatial and temporal changes into structure. The consequences of such non-uniformities in the configurational stability and transport of these fibers are yet unknown. Here, we use slender-body theory and Euler-Bernoulli elasticity coupled with various non-uniform bending rigidity profiles to quantify this buckling instability using linear stability analysis and Brownian simulations. In shear flows, we observe more pronounced buckling in areas of reduced rigidity in our simulations. These areas of marked deformations give rise to differences in the particle extra stress, indicating a nontrivial rheological response due to the presence of these filaments. The fundamental mode shapes arising from each rigidity profile are consistent with the predictions from our linear stability analysis. Collectively, these results suggest that non-uniform bending rigidity can drastically alter fluid-structure interactions in physiologically relevant settings, providing a foundation to elucidate the complex interplay between hydrodynamics and the structural properties of biopolymers.


title: Interaction-Dynamics-Aware Perception Zones for Obstacle Detection Safety Evaluation

abstract: To enable safe autonomous vehicle (AV) operations, it is critical that an AV's obstacle detection module can reliably detect obstacles that pose a safety threat (i.e., are safety-critical). It is therefore desirable that the evaluation metric for the perception system captures the safety-criticality of objects. Unfortunately, existing perception evaluation metrics tend to make strong assumptions about the objects and ignore the dynamic interactions between agents, and thus do not accurately capture the safety risks in reality. To address these shortcomings, we introduce an interaction-dynamics-aware obstacle detection evaluation metric by accounting for closed-loop dynamic interactions between an ego vehicle and obstacles in the scene. By borrowing existing theory from optimal control theory, namely Hamilton-Jacobi reachability, we present a computationally tractable method for constructing a ``safety zone'': a region in state space that defines where safety-critical obstacles lie for the purpose of defining safety metrics. Our proposed safety zone is mathematically complete, and can be easily computed to reflect a variety of safety requirements. Using an off-the-shelf detection algorithm from the nuScenes detection challenge leaderboard, we demonstrate that our approach is computationally lightweight, and can better capture safety-critical perception errors than a baseline approach.


title: Gaia Search for stellar Companions of TESS Objects of Interest III

abstract: The latest results from our ongoing multiplicity study of (Community) TESS Objects of Interest are presented, using astro- and photometric data from the ESA-Gaia mission, to detect stellar companions of these stars and characterize their properties. A total of 124 binary and 7 hierarchical triple star systems were detected among 2175 targets, whose multiplicity was investigated in the course of our survey, which are located at distances closer than about 500pc around the Sun. The detected companions and the targets are located at the same distance and share a common proper motion, as expected for components of gravitationally bound stellar systems, as proven with their accurate Gaia EDR3 astrometry. The companions have masses in the range between about 0.09 and 2.5$M_\odot$ and are most frequently found in the mass range between 0.15 and 0.8$M_\odot$. The companions exhibit projected separations to the targets between about 50 to 9700au and their frequency is the highest and constant up to about 500au, while it decreases for larger projected separations. In addition to mainly mid M to early K dwarfs, 4 white dwarf companions were detected in this survey, whose true nature could be identified with their photometric properties.


title: A Phylogenetic Model of the Evolution of Discrete Matrices for the Joint Inference of Lexical and Phonological Language Histories

abstract: We propose a model of the evolution of a matrix along a phylogenetic tree, in which transformations affect either entire rows or columns of the matrix. This represents the change of both lexical and phonological aspects of linguistic data, by allowing for new words to appear and for systematic phonological changes to affect the entire vocabulary. We implement a Sequential Monte Carlo method to sample from the posterior distribution, and infer jointly the phylogeny, model parameters, and latent variables representing cognate births and phonological transformations. We successfully apply this method to synthetic and real data of moderate size.


title: Thirty years of molecular dynamics simulations on posttranslational modifications of proteins

abstract: Posttranslational modifications (PTMs) are an integral component to how cells respond to perturbation. While experimental advances have enabled improved PTM identification capabilities, the same throughput for characterizing how structural changes caused by PTMs equate to altered physiological function has not been maintained. In this Perspective, we cover the history of computational modeling and molecular dynamics simulations which have characterized the structural implications of PTMs. We distinguish results from different molecular dynamics studies based upon the timescales simulated and analysis approaches used for PTM characterization. Lastly, we offer insights into how opportunities for modern research efforts on in silico PTM characterization may proceed given current state-of-the-art computing capabilities and methodological advancements.


title: Unveiling the physics of partial differential equations with heuristics

abstract: Heuristic arguments and order of magnitude estimates for partial differential equations highlight essential features of the physics they describe. We present order of magnitude estimates, and their limitations, for the three classic second order PDEs of mathematical physics (wave, heat, and Laplace equations), for first order transport equations, and for two non-linear wave equations. It is beneficial to expose the beginning student to these considerations before jumping into more rigorous mathematics. Yet these simple arguments are missing from physics textbooks.


title: Adaptive Neural Network Stochastic-Filter-based Controller for Attitude Tracking with Disturbance Rejection

abstract: This paper proposes a real-time neural network (NN) stochastic filter-based controller on the Lie Group of the Special Orthogonal Group $SO(3)$ as a novel approach to the attitude tracking problem. The introduced solution consists of two parts: a filter and a controller. Firstly, an adaptive NN-based stochastic filter is proposed that estimates attitude components and dynamics using measurements supplied by onboard sensors directly. The filter design accounts for measurement uncertainties inherent to the attitude dynamics, namely unknown bias and noise corrupting angular velocity measurements. The closed loop signals of the proposed NN-based stochastic filter have been shown to be semi-globally uniformly ultimately bounded (SGUUB). Secondly, a novel control law on $SO(3)$ coupled with the proposed estimator is presented. The control law addresses unknown disturbances. In addition, the closed loop signals of the proposed filter-based controller have been shown to be SGUUB. The proposed approach offers robust tracking performance by supplying the required control signal given data extracted from low-cost inertial measurement units. While the filter-based controller is presented in continuous form, the discrete implementation is also presented. Additionally, the unit-quaternion form of the proposed approach is given. The effectiveness and robustness of the proposed filter-based controller is demonstrated using its discrete form and considering low sampling rate, high initialization error, high-level of measurement uncertainties, and unknown disturbances. Keywords: Neuro-adaptive, estimator, filter, observer, control system, trajectory tracking, Lyapunov stability, stochastic differential equations, nonlinear filter, attitude tracking control, observer-based controller.


title: Regularized modified log-Sobolev inequalities, and comparison of Markov chains

abstract: In this work, we develop a comparison procedure for the Modified log-Sobolev Inequality (MLSI) constants of two reversible Markov chains on a finite state space. Efficient comparison of the MLSI Dirichlet forms is a well known obstacle in the theory of Markov chains. We approach this problem by introducing a {\it regularized} MLSI constant which, under some assumptions, has the same order of magnitude as the usual MLSI constant yet is amenable for comparison and thus considerably simpler to estimate in certain cases. As an application of this general comparison procedure, we provide a sharp estimate of the MLSI constant of the switch chain on the the set of simple bipartite regular graphs of size $n$ with a fixed degree $d$. Our estimate implies that the total variation mixing time of the switch chain is of order $O_d(n\log n)$. The result is optimal up to a multiple depending on $d$ and resolves a long-standing open problem. We expect that the MLSI comparison technique implemented in this paper will find further applications.


title: Deep-learning Real/Bogus classification for the Tomo-e Gozen transient survey

abstract: We present a deep neural network Real/Bogus classifier that improves classification performance in the Tomo-e Gozen transient survey by handling label errors in the training data. In the wide-field, high-frequency transient survey with Tomo-e Gozen, the performance of conventional convolutional neural network classifier is not sufficient as about $10^6$ bogus detections appear every night. In need of a better classifier, we have developed a new two-stage training method. In this training method, label errors in the training data are first detected by normal supervised learning classification, and then they are unlabeled and used for training of semi-supervised learning. For actual observed data, the classifier with this method achieves an area under the curve (AUC) of 0.9998 and a false positive rate (FPR) of 0.0002 at true positive rate (TPR) of 0.9. This training method saves relabeling effort by humans and works better on training data with a high fraction of label errors. By implementing the developed classifier in the Tomo-e Gozen pipeline, the number of transient candidates was reduced to $\sim$40 objects per night, which is $\sim$1/130 of the previous version, while maintaining the recovery rate of real transients. This enables more efficient selection of targets for follow-up observations.


title: Development of a neutrino detector capable of operating in space

abstract: The $\nu$SOL experiment to operate a neutrino detector close to the Sun is building a small test detector to orbit the Earth to test the concept in space. This detector concept is to provide a new way to detect neutrinos unshielded in space. A double delayed coincidence on Gallium nuclei that have a large cross section for solar neutrino interactions emitting a conversion electron and converting the nuclei into an excited state of Germanium, which decays with a well-known energy and half-life. This unique signature permits operation of the detector volume mostly unshielded in space with a high single particle counting rate from gamma and cosmic ray events. The test detector concept which has been studied in the lab and is planned for a year of operations orbiting Earth which is scheduled for launch in late 2024. It will be surrounded by an active veto and shielding will be operated in a polar orbit around the Earth to validate the detector concept and study detailed background spectrums that can fake the double timing and energy signature from random galactic cosmic or gamma rays. The success of this new technology development will permit the design of a larger spacecraft with a mission to fly close to the Sun and is of importance to the primary science mission of the Heliophysics division of NASA Space Science Mission Directorate, which is to better understand the Sun by measuring details of our Sun's fusion core.


title: Attention-Guided Autoencoder for Automated Progression Prediction of Subjective Cognitive Decline with Structural MRI

abstract: Subjective cognitive decline (SCD) is a preclinical stage of Alzheimer's disease (AD) which occurs even before mild cognitive impairment (MCI). Progressive SCD will convert to MCI with the potential of further evolving to AD. Therefore, early identification of progressive SCD with neuroimaging techniques (e.g., structural MRI) is of great clinical value for early intervention of AD. However, existing MRI-based machine/deep learning methods usually suffer the small-sample-size problem which poses a great challenge to related neuroimaging analysis. The central question we aim to tackle in this paper is how to leverage related domains (e.g., AD/NC) to assist the progression prediction of SCD. Meanwhile, we are concerned about which brain areas are more closely linked to the identification of progressive SCD. To this end, we propose an attention-guided autoencoder model for efficient cross-domain adaptation which facilitates the knowledge transfer from AD to SCD. The proposed model is composed of four key components: 1) a feature encoding module for learning shared subspace representations of different domains, 2) an attention module for automatically locating discriminative brain regions of interest defined in brain atlases, 3) a decoding module for reconstructing the original input, 4) a classification module for identification of brain diseases. Through joint training of these four modules, domain invariant features can be learned. Meanwhile, the brain disease related regions can be highlighted by the attention mechanism. Extensive experiments on the publicly available ADNI dataset and a private CLAS dataset have demonstrated the effectiveness of the proposed method. The proposed model is straightforward to train and test with only 5-10 seconds on CPUs and is suitable for medical tasks with small datasets.


title: Analyzing Explainer Robustness via Probabilistic Lipschitzness of Prediction Functions

abstract: Machine learning methods have significantly improved in their predictive capabilities, but at the same time they are becoming more complex and less transparent. As a result, explainers are often relied on to provide interpretability to these black-box prediction models. As crucial diagnostics tools, it is important that these explainers themselves are robust. In this paper we focus on one particular aspect of robustness, namely that an explainer should give similar explanations for similar data inputs. We formalize this notion by introducing and defining explainer astuteness, analogous to astuteness of prediction functions. Our formalism allows us to connect explainer robustness to the predictor's probabilistic Lipschitzness, which captures the probability of local smoothness of a function. We provide lower bound guarantees on the astuteness of a variety of explainers (e.g., SHAP, RISE, CXPlain) given the Lipschitzness of the prediction function. These theoretical results imply that locally smooth prediction functions lend themselves to locally robust explanations. We evaluate these results empirically on simulated as well as real datasets.


title: Insect-inspired Visually-guided Decentralized Swarming

abstract: This paper addresses the need for fast, lightweight, vision-guided swarming under limited computation and no explicit communication network or position source. The study develops a multi-agent optic flow sensing framework, then integrates perfect information distributed feedback with optic flow sensing to create an analogous visually-guided feedback path for idealized inter-agent velocity and distance structures. The Cucker-Smale flocking example is used to develop vision-guided swarming with rigorous asymptotic convergence guarantees, including under ignorance of agent size.


title: Sparse precision matrix estimation in phenotypic trait evolution models

abstract: Phylogenetic trait evolution models allow for the estimation of evolutionary correlations between a set of traits observed in a sample of related organisms. By directly modeling the evolution of the traits along an estimable phylogenetic tree, the model's structure effectively controls for shared evolutionary history. In these models, relevant correlations are usually assessed through the high posterior density interval of their marginal distributions. However, the selected correlations alone may not provide the full picture regarding trait relationships. Their association structure, expressed through a graph that encodes partial correlations, can in contrast highlight sparsity patterns featuring direct associations between traits. In order to develop a model-based method to identify this association structure we explore the use of Gaussian graphical models (GGM) for covariance selection. We model the precision matrix with a G-Wishart conjugate prior, which results in sparse precision estimates. Furthermore the model naturally allows for Bayes Factor tests of association between the traits, with no additional computation required. We evaluate our approach through Monte Carlo simulations and applications that examine the association structure and evolutionary correlations of phenotypic traits in Darwin's finches and genomic and phenotypic traits in prokaryotes. Our approach provides accurate graph estimates and lower errors for the precision and correlation parameter estimates, particularly for conditionally independent traits, which are the target for sparsity in GGMs.


title: An Intensity and Phase Stacked Analysis of Phase-OTDR System using Deep Transfer Learning and Recurrent Neural Networks

abstract: Distributed acoustic sensors (DAS) are effective apparatus which are widely used in many application areas for recording signals of various events with very high spatial resolution along the optical fiber. To detect and recognize the recorded events properly, advanced signal processing algorithms with high computational demands are crucial. Convolutional neural networks are highly capable tools for extracting spatial information and very suitable for event recognition applications in DAS. Long-short term memory (LSTM) is an effective instrument for processing sequential data. In this study, we proposed a multi-input multi-output, two stage feature extraction methodology that combines the capabilities of these neural network architectures with transfer learning to classify vibrations applied to an optical fiber by a piezo transducer. First, we extracted the differential amplitude and phase information from the Phase-OTDR recordings and stored them in a temporal-spatial data matrix. Then, we used a state-of-the-art pre-trained CNN without dense layers as a feature extractor in the first stage. In the second stage, we used LSTMs to further analyze the features extracted by the CNN. Finally, we used a dense layer to classify the extracted features. To observe the effect of the utilized CNN architecture, we tested our model with five state-of-the art pre-trained models (VGG-16, ResNet-50, DenseNet-121, MobileNet and Inception-v3). The results show that using the VGG-16 architecture in our framework manages to obtain 100% classification accuracy in 50 trainings and got the best results on our Phase-OTDR dataset. Outcomes of this study indicate that the pre-trained CNNs combined with LSTM are very suitable for the analysis of differential amplitude and phase information, represented in a temporal spatial data matrix which is promising for event recognition operations in DAS applications.


title: The syntax-lexicon tradeoff in writing

abstract: As speakers turn their thoughts into sentences, they maintain a balance between the complexity of words and syntax. However, it is unclear whether this syntax-lexicon tradeoff is unique to the spoken language production that is under the pressure of rapid online processing. Alternatively, it is possible that the tradeoff is a basic property of language irrespective of the modality of production. This work evaluates the relationship between the complexity of words and syntactic rules in the written language of neurotypical individuals on three different topics. We found that similar to speaking, constructing sentences in writing involves a tradeoff between the complexity of the lexical and syntactic items. We also show that the reduced online processing demands during writing allows for retrieving more complex words at the cost of incorporating simpler syntax. This work further highlights the role of accessibility of the elements of a sentence as the driving force in the emergence of the syntax-lexicon tradeoff.


title: Variational Bayesian inference for CP tensor completion with side information

abstract: We propose a message passing algorithm, based on variational Bayesian inference, for low-rank tensor completion with automatic rank determination in the canonical polyadic format when additional side information (SI) is given. The SI comes in the form of low-dimensional subspaces the contain the fiber spans of the tensor (columns, rows, tubes, etc.). We validate the regularization properties induced by SI with extensive numerical experiments on synthetic and real-world data and present the results about tensor recovery and rank determination. The results show that the number of samples required for successful completion is significantly reduced in the presence of SI. We also discuss the origin of a bump in the phase transition curves that exists when the dimensionality of SI is comparable with that of the tensor.


title: Asymptotic Muntz-Szasz Theorems

abstract: We define a monomial space to be a subspace of $\ltwo$ that can be approximated by spaces that are spanned by monomial functions. We describe the structure of monomial spaces.


title: Uncertainty principle via variational calculus on modulation spaces

abstract: We approach uncertainty principles of Cowling-Price-Heis-\\enberg-type as a variational principle on modulation spaces. In our discussion we are naturally led to compact localization operators with symbols in modulation spaces. The optimal constant in these uncertainty principles is the smallest eigenvalue of the inverse of a compact localization operator. The Euler-Lagrange equations for the associated functional provide equations for the eigenfunctions of the smallest eigenvalue of these compact localization operators. As a by-product of our proofs we derive a generalization to mixed-norm spaces of an inequality for Wigner and Ambiguity functions due do Lieb.

categories: math.FA math-ph math.MP math.OC quant-ph


title: Predicting within and across language phoneme recognition performance of self-supervised learning speech pre-trained models

abstract: In this work, we analyzed and compared speech representations extracted from different frozen self-supervised learning (SSL) speech pre-trained models on their ability to capture articulatory features (AF) information and their subsequent prediction of phone recognition performance for within and across language scenarios. Specifically, we compared CPC, wav2vec 2.0, and HuBert. First, frame-level AF probing tasks were implemented. Subsequently, phone-level end-to-end ASR systems for phoneme recognition tasks were implemented, and the performance on the frame-level AF probing task and the phone accuracy were correlated. Compared to the conventional speech representation MFCC, all SSL pre-trained speech representations captured more AF information, and achieved better phoneme recognition performance within and across languages, with HuBert performing best. The frame-level AF probing task is a good predictor of phoneme recognition performance, showing the importance of capturing AF information in the speech representations. Compared with MFCC, in the within-language scenario, the performance of these SSL speech pre-trained models on AF probing tasks achieved a maximum relative increase of 34.4%, and it resulted in the lowest PER of 10.2%. In the cross-language scenario, the maximum relative increase of 26.7% also resulted in the lowest PER of 23.0%.


title: Arithmetic Circuits, Structured Matrices and (not so) Deep Learning

abstract: This survey presents a necessarily incomplete (and biased) overview of results at the intersection of arithmetic circuit complexity, structured matrices and deep learning. Recently there has been some research activity in replacing unstructured weight matrices in neural networks by structured ones (with the aim of reducing the size of the corresponding deep learning models). Most of this work has been experimental and in this survey, we formalize the research question and show how a recent work that combines arithmetic circuit complexity, structured matrices and deep learning essentially answers this question. This survey is targeted at complexity theorists who might enjoy reading about how tools developed in arithmetic circuit complexity helped design (to the best of our knowledge) a new family of structured matrices, which in turn seem well-suited for applications in deep learning. However, we hope that folks primarily interested in deep learning would also appreciate the connections to complexity theory.


title: Beyond one-axis twisting: Simultaneous spin-momentum squeezing

abstract: The creation and manipulation of quantum entanglement is central to improving precision measurements. A principal method of generating entanglement for use in atom interferometry is the process of spin squeezing whereupon the states become more sensitive to $SU(2)$ rotations. One possibility to generate this entanglement is provided by one-axis twisting (OAT), where a many-particle entangled state of one degree of freedom is generated by a non-linear Hamiltonian. We introduce a novel method which goes beyond OAT to create squeezing and entanglement across two distinct degrees of freedom. We present our work in the specific physical context of a system consisting of collective atomic energy levels and discrete collective momentum states, but also consider other possible realizations. Our system uses a nonlinear Hamiltonian to generate dynamics in $SU(4)$, thereby creating the opportunity for dynamics not possible in typical $SU(2)$ one-axis twisting. This leads to three axes undergoing twisting due to the two degrees of freedom and their entanglement, with the resulting potential for a more rich context of quantum entanglement. The states prepared in this system are potentially more versatile for use in multi-parameter or auxiliary measurement schemes than those prepared by standard spin squeezing.


title: Guidelines for Artifacts to Support Industry-Relevant Research on Self-Adaptation

abstract: Artifacts support evaluating new research results and help comparing them with the state of the art in a field of interest. Over the past years, several artifacts have been introduced to support research in the field of self-adaptive systems. While these artifacts have shown their value, it is not clear to what extent these artifacts support research on problems in self-adaptation that are relevant to industry. This paper provides a set of guidelines for artifacts that aim at supporting industry-relevant research on self-adaptation. The guidelines that are grounded on data obtained from a survey with practitioners were derived during working sessions at the 17th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. Artifact providers can use the guidelines for aligning future artifacts with industry needs; they can also be used to evaluate the industrial relevance of existing artifacts. We also propose an artifact template.


title: RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environments

abstract: We propose RAPid-Learn: Learning to Recover and Plan Again, a hybrid planning and learning method, to tackle the problem of adapting to sudden and unexpected changes in an agent's environment (i.e., novelties). RAPid-Learn is designed to formulate and solve modifications to a task's Markov Decision Process (MDPs) on-the-fly and is capable of exploiting domain knowledge to learn any new dynamics caused by the environmental changes. It is capable of exploiting the domain knowledge to learn action executors which can be further used to resolve execution impasses, leading to a successful plan execution. This novelty information is reflected in its updated domain model. We demonstrate its efficacy by introducing a wide variety of novelties in a gridworld environment inspired by Minecraft, and compare our algorithm with transfer learning baselines from the literature. Our method is (1) effective even in the presence of multiple novelties, (2) more sample efficient than transfer learning RL baselines, and (3) robust to incomplete model information, as opposed to pure symbolic planning approaches.


title: Multitask vocal burst modeling with ResNets and pre-trained paralinguistic Conformers

abstract: This technical report presents the modeling approaches used in our submission to the ICML Expressive Vocalizations Workshop & Competition multitask track (ExVo-MultiTask). We first applied image classification models of various sizes on mel-spectrogram representations of the vocal bursts, as is standard in sound event detection literature. Results from these models show an increase of 21.24% over the baseline system with respect to the harmonic mean of the task metrics, and comprise our team's main submission to the MultiTask track. We then sought to characterize the headroom in the MultiTask track by applying a large pre-trained Conformer model that previously achieved state-of-the-art results on paralinguistic tasks like speech emotion recognition and mask detection. We additionally investigated the relationship between the sub-tasks of emotional expression, country of origin, and age prediction, and discovered that the best performing models are trained as single-task models, questioning whether the problem truly benefits from a multitask setting.


title: Arcadia: A Fast and Reliable Persistent Memory Replicated Log

abstract: The performance properties of byte-addressable persistent memory (PMEM) have the potential to significantly improve system performance over a wide spectrum of applications. But persistent memory brings considerable new challenges to the programmer: only 8-byte write atomicity, out of order flush and availability limited by node failure. It's possible to work with the atomicity and ordering constraints of PMEM directly by carefully sequencing the order of store operations and inserting explicit flush and fence operations at each ordering point. But this is tedious and error-prone: too many flush operations defeat the performance benefits of PMEM, and even with generous use, it is difficult to prove that a given program is crash-consistent. Logging is a great abstraction to deal with these issues but prior work on PMEM logging has not successfully hidden the idiosyncrasies of PMEM. Moreover, shortcomings in the log interface and design have prevented attainment of full PMEM performance. We believe that a log design that hides the idiosyncrasies from programmers while delivering full performance is key to success. In this paper, we present the design and implementation of Arcadia, a generic replicated log on PMEM to address these problems. Arcadia handles atomicity, integrity, and replication of log records to reduce programmer burden. Our design has several novel aspects including concurrent log writes with in-order commit, atomicity and integrity primitives for local and remote PMEM writes, and a frequency-based log force policy for providing low overhead persistence with guaranteed bounded loss of uncommitted records. Our evaluation shows that Arcadia outperforms state-of-the-art PMEM logs, such as PMDK's libpmemlog, FLEX, and Query Fresh by several times while providing stronger log record durability guarantees. We expect Arcadia to become the leading off-the-shelf PMEM log design.


title: Computationally-Efficient Decomposition Heuristic for the Static Traffic Assignment Problem

abstract: Applications such as megaregional planning require efficient methods for solving traffic assignment problems (TAPs) on large-scale networks. We propose a decomposition heuristic that generates approximate TAP solutions by partitioning the complete network into subnetworks which are solved in parallel and use an iterative-refinement algorithm for improving the network partitions. A novel network transformation and three-stage algorithm are also proposed to solve a constrained shortest path problem as a subproblem of the heuristic. Experiments on various networks show that the heuristic can generate 15.1-67.8% computational savings in finding solutions with initial relative gap of 0.02. The performance benefits of the proposed heuristic when warmstarting standard TAP algorithms are demonstrated with an average computational savings of 10-35% over a TAP solver without warmstarting.


title: Modelling time delays from two reprocessors in active galactic nuclei

abstract: Context. Continuum time delays from accretion disks in active galactic nuclei (AGN) has been proposed long time ago as a tool for measuring distances to the monitored sources. However, the method faces serious problems as a number of effects must be taken into account, including the contribution from the Broad Line Region (BLR). Aims. In this paper, we model the expected time delays when both the disk reprocessing of the incident X-ray flux and further reprocessing by the BLR are included, with the aim to see if the two effects can be disentangled. Methods. We use simple response function for the accretion disk, without relativistic effects, and we use a parametric description to account for the BLR contribution. We include only scattering of the disk emission by the BLR inter-cloud medium. We also use artificial lightcurves with 1-day sampling to check if the effects are likely to be seen in real data. Results. We show that the effect of the BLR scattering on the predicted time delay is very similar to the effect of rising height of the X-ray source, without any BLR contribution. This brings additional degeneracy if we want in the future to recover the parameters of the system from the observed time delays in a specific object. Both effects, however, modify the slope of the delay versus wavelength curve when plotted in log space which opens a way to obtaining bare disk time delay needed for cosmology. In addition, when the disk irradiation is strong, the modification of the predicted delay by the BLR scattering and by X-ray source height become considerably different. However, the required data quality must be high since our artificial curves with 1-day sampling give rather noisy results.


title: Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints

abstract: We consider a category-level perception problem, where one is given 2D or 3D sensor data picturing an object of a given category (e.g., a car), and has to reconstruct the 3D pose and shape of the object despite intra-class variability (i.e., different car models have different shapes). We consider an active shape model, where -- for an object category -- we are given a library of potential CAD models describing objects in that category, and we adopt a standard formulation where pose and shape are estimated from 2D or 3D keypoints via non-convex optimization. Our first contribution is to develop PACE3D* and PACE2D*, the first certifiably optimal solvers for pose and shape estimation using 3D and 2D keypoints, respectively. Both solvers rely on the design of tight (i.e., exact) semidefinite relaxations. Our second contribution is to develop outlier-robust versions of both solvers, named PACE3D# and PACE2D#. Towards this goal, we propose ROBIN, a general graph-theoretic framework to prune outliers, which uses compatibility hypergraphs to model measurements' compatibility. We show that in category-level perception problems these hypergraphs can be built from the winding orders of the keypoints (in 2D) or their convex hulls (in 3D), and many outliers can be filtered out via maximum hyperclique computation. The last contribution is an extensive experimental evaluation. Besides providing an ablation study on simulated datasets and on the PASCAL3D+ dataset, we combine our solver with a deep keypoint detector, and show that PACE3D# improves over the state of the art in vehicle pose estimation in the ApolloScape datasets, and its runtime is compatible with practical applications. We release our code at https://github.com/MIT-SPARK/PACE.


title: On five types of crucial permutations with respect to monotone patterns

abstract: A crucial permutation is a permutation that avoids a given set of prohibitions, but any of its extensions, in an allowable way, results in a prohibition being introduced. In this paper, we introduce five natural types of crucial permutations with respect to monotone patterns, notably quadrocrucial permutations that are linked most closely to Erd\H{o}s-Szekeres extremal permutations. The way we define right-crucial and bicrucial permutations is consistent with the definition of respective permutations studied in the literature in the contexts of other prohibitions. For each of the five types, we provide its characterization in terms of Young tableaux via the RSK correspondence. Moreover, we use the characterizations to prove that the number of such permutations of length $n$ is growing when $n\to\infty$, and to enumerate minimal crucial permutations in all but one case. We also provide other enumerative results.


title: Computing the Minimum Bottleneck Moving Spanning Tree

abstract: Given a set $P$ of $n$ points that are moving in the plane, we consider the problem of computing a spanning tree for these moving points that does not change its combinatorial structure during the point movement. The objective is to minimize the bottleneck weight of the spanning tree (i.e., the largest Euclidean length of all edges) during the whole movement. The problem was solved in $O(n^2)$ time previously [Akitaya, Biniaz, Bose, De Carufel, Maheshwari, Silveira, and Smid, WADS 2021]. In this paper, we present a new algorithm of $O(n^{4/3} \log^3 n)$ time.


title: A Complex Multiphase DLA Associated with a Compact Group at z=2.431 Traces Accretion, Outflows, and Tidal Streams

abstract: As part of our program to identify host galaxies of known z=2-3 MgII absorbers with the Keck Cosmic Web Imager (KCWI), we discovered a compact group giving rise to a z=2.431 DLA with ultra-strong MgII absorption in quasar field J234628+124859. The group consists of four star-forming galaxies within 8-28 kpc and $v\sim40-340$ km s$^{-1}$ of each other, where tidal streams are weakly visible in deep HST imaging. The group geometric centre is D=25 kpc from the quasar (D=20-40 kpc for each galaxy). Galaxy G1 dominates the group ($1.66L_{\ast}$, ${\rm SFR}_{\rm FUV}=11.6$ M$_{\odot}$ yr$^{-1}$) while G2, G3, and G4 are less massive ($0.1-0.3L_{\ast}$, ${\rm SFR}_{\rm FUV}=1.4-2.0$ M$_{\odot}$ yr$^{-1}$). Using a VLT/UVES quasar spectrum covering the HI Lyman series and metal lines such as MgII, SiIII, and CIV, we characterised the kinematic structure and physical conditions along the line-of-sight with cloud-by-cloud multiphase Bayesian modelling. The absorption system has a total $\log(N(HI)/{\rm cm}^{-2})=20.53$ and an $N(HI)$-weighted mean metallicity of $\log(Z/Z_{\odot})=-0.68$, with a very large MgII linewidth of $\Delta v\sim700$ km s$^{-1}$. The highly kinematically complex profile is well-modelled with 30 clouds across low and intermediate ionisation phases with values ${13\lesssim\log(N(HI)/{\rm cm}^{-2})\lesssim20}$ and $-3\lesssim\log(Z/Z_{\odot})\lesssim1$. Comparing these properties to the galaxy properties, we infer a wide range of gaseous environments, including metal-rich outflows, metal-poor IGM accretion, and tidal streams from galaxy--galaxy interactions. This diversity of structures forms the intragroup medium around a complex compact group environment at the epoch of peak star formation activity. Surveys of low redshift compact groups would benefit from obtaining a more complete census of this medium for characterising evolutionary pathways.


title: Non-autonomous multidimensional Toda system and multiple interpolation problem

abstract: We study the interpolation analogue of the Hermite-Pad\'e type I approximation problem. We provide its determinant solution and we write down the corresponding integrable discrete system as an admissible reduction of Hirota's discrete Kadomtsev-Petviashvili equations. Apart from the $\tau$-function form of the system we provide its variant, which in the simplest case of dimension two reduces to the non-autonomous discrete-time Toda equations.


title: Multi-Modal and Multi-Factor Branching Time Active Inference

abstract: Active inference is a state-of-the-art framework for modelling the brain that explains a wide range of mechanisms such as habit formation, dopaminergic discharge and curiosity. Recently, two versions of branching time active inference (BTAI) based on Monte-Carlo tree search have been developed to handle the exponential (space and time) complexity class that occurs when computing the prior over all possible policies up to the time horizon. However, those two versions of BTAI still suffer from an exponential complexity class w.r.t the number of observed and latent variables being modelled. In the present paper, we resolve this limitation by first allowing the modelling of several observations, each of them having its own likelihood mapping. Similarly, we allow each latent state to have its own transition mapping. The inference algorithm then exploits the factorisation of the likelihood and transition mappings to accelerate the computation of the posterior. Those two optimisations were tested on the dSprites environment in which the metadata of the dSprites dataset was used as input to the model instead of the dSprites images. On this task, $BTAI_{VMP}$ (Champion et al., 2022b,a) was able to solve 96.9\% of the task in 5.1 seconds, and $BTAI_{BF}$ (Champion et al., 2021a) was able to solve 98.6\% of the task in 17.5 seconds. Our new approach ($BTAI_{3MF}$) outperformed both of its predecessors by solving the task completly (100\%) in only 2.559 seconds. Finally, $BTAI_{3MF}$ has been implemented in a flexible and easy to use (python) package, and we developed a graphical user interface to enable the inspection of the model's beliefs, planning process and behaviour.


title: Gamma-ray detector and mission design simulations

abstract: Detectors for gamma-ray astronomy are complex: they often comprise multiple sub-systems and utilize new and/or custom-developed detector components and readout electronics. Gamma rays are typically not detected directly: ground-based detectors measure extensive air showers of charged particles initiated by cosmic gamma-rays, and even so-called "direct detection" experiments on balloons or satellites usually reconstruct the incoming gamma-ray photons' properties from the secondary particles produced in the detector. At the same time, there are few "standard candles" and no feasible terrestrial sources of high-energy and very-high-energy gamma rays that could be used to calibrate the detectors. Simulations of particles interacting in the atmosphere and/or with the instrument are thus ubiquitous in gamma-ray astronomy. These simulations are used in event reconstruction and data analysis, to characterize detector performance, and to optimize detector design. In this chapter, we give an overview of how and why simulations are used in gamma-ray astronomy, as well as their limitations. We discuss extensive air shower simulations, simulations of gamma rays and secondary particles interacting in the detector, and simulations of the readout electronics. We provide examples for software packages that are used for various aspects of simulations in gamma-ray astronomy. Lastly, we describe the performance metrics and instrument response functions that are generated from these simulations, which are critical to instrument design and data analysis.


title: Stain Based Contrastive Co-training for Histopathological Image Analysis

abstract: We propose a novel semi-supervised learning approach for classification of histopathology images. We employ strong supervision with patch-level annotations combined with a novel co-training loss to create a semi-supervised learning framework. Co-training relies on multiple conditionally independent and sufficient views of the data. We separate the hematoxylin and eosin channels in pathology images using color deconvolution to create two views of each slide that can partially fulfill these requirements. Two separate CNNs are used to embed the two views into a joint feature space. We use a contrastive loss between the views in this feature space to implement co-training. We evaluate our approach in clear cell renal cell and prostate carcinomas, and demonstrate improvement over state-of-the-art semi-supervised learning methods.


title: Multiwavelength temporal and spectral study of TeV blazar 1ES 1727+502 during 2014 to 2021

abstract: One of the most important questions in blazar physics is the origin of broadband emission and fast-flux variation. In this work, we studied the broadband temporal and spectral properties of a TeV blazar 1ES 1727+502 and explore the one-zone synchrotron-self Compton (SSC) model to fit the broadband spectral energy distribution (SED). We collected the long-term (2014-2021) multiband data which includes both the low and high flux states of the source. The entire light curve is divided into three segments of different flux states and the best-fit parameters obtained by broadband SED modeling corresponding to three flux states were then compared. The TeV blazar 1ES 1727+502 has been observed to show the brightest flaring episode in X-ray followed by optical-UV and gamma-ray. The fractional variability estimated during various segments behaves differently in multiple wavebands, suggesting a complex nature of emission in this source. This source has shown a range of variability time from days scale to month scale during this long period of observations between 2014-2021. A "harder-when-brighter" trend is not prominent in X-ray but seen in optical-UV and an opposite trend is observed in gamma-ray. The complex nature of correlation among various bands is observed. The SED modeling suggests that the one-zone SSC emission model can reproduce the broadband spectrum in the energy range from optical-UV to very high energy gamma-ray.


title: Electromagnetic Nonreciprocity in a Magnetized Plasma Circulator

abstract: Nonreciprocal transport of electromagnetic waves within magnetized plasma is a powerful building block towards understanding and exploiting the properties of more general topological systems. Much recent attention has been paid to the theoretical issues of wave interaction within such a medium, but there is a lack of experimental verification that such systems can be viable in a lab or industrial setting. This work provides an experimental proof-of-concept by demonstrating nonreciprocity in a unit component, a microwave plasma circulator. We design an E-plane Y junction plasma circulator operating in the range of 4 to 6 GHz using standardized waveguide specifications. From both simulations and experiments, we observe wide band isolation for the power transmission through the circulator. The performance and the frequency band of the circulator can be easily tuned by changing the plasma density and the magnetic field strength. By linking simulations and experimental results, we estimate the plasma density for the device.


title: The Temporal Evolution of Modality-Independent Representations of Conceptual Categories

abstract: To what extent does language production activate amodal conceptual representations? In picture naming, we view specific exemplars of concepts and then name them with a category label, like 'dog'. In contrast, in overt reading, the written word expresses the category (dog), not an exemplar. Here we used a decoding approach with magnetoencephalography to address whether picture naming and overt word reading involve shared representations of semantic categories. This addresses a fundamental question about the modality-generality of conceptual representations and their temporal evolution. Crucially, we do this using a language production task that does not require explicit categorization judgment and that controls for word form properties across semantic categories. We trained our models to classify the animal/tool distinction using MEG data of one modality at each time point and then tested the generalization of those models on the other modality. We obtained evidence for the automatic activation of modality-independent semantic category representations for both pictures and words starting at ~150ms and lasting until about 500ms. The time course of lexical activation was also assessed revealing that semantic category is represented before lexical access for pictures but after lexical access for words. Notably, this earlier activation of semantic category in pictures occurred simultaneously with visual representations. We thus show evidence for the spontaneous activation of modality-independent semantic categories in picture naming and word reading, supporting theories in which amodal conceptual representations exist. Together, these results serve to anchor a more comprehensive spatio-temporal delineation of the semantic feature space during production planning.


title: Mutual-Information Based Optimal Experimental Design for Hyperpolarized $^{13}$C-Pyruvate MRI

abstract: A key parameter of interest recovered from hyperpolarized (HP) MRI measurements is the apparent pyruvate-to-lactate exchange rate, $k_{PL}$, for measuring tumor metabolism. This manuscript presents an information-theory-based optimal experimental design (OED) approach that minimizes the uncertainty in the rate parameter, $k_{PL}$, recovered from HP-MRI measurements. Mutual information (MI) is employed to measure the information content of the HP measurements with respect to the first-order exchange kinetics of the pyruvate conversion to lactate. Flip angles of the pulse sequence acquisition are optimized with respect to the mutual information. Further, a spatially varying model (high-fidelity) based on the Block-Torrey equations is proposed and utilized as a control. A time-varying flip angle scheme leads to a higher parameter optimization that can further improve the quantitative value of mutual information over a constant flip angle scheme. However, the constant flip angle scheme leads to the best accuracy and precision when considering inference from noise-corrupted data. For the particular MRI data examined here, pyruvate and lactate flip angles of 35 and 28 degrees, respectively, were the best choice in terms of accuracy and precision of the parameter recovery. Moreover, the recovery of rate parameter $k_{PL}$ from the data generated from the high-fidelity model highlights the influence of diffusion and strength of vascular source on the recovered rate parameter. Since the existing pharmacokinetic models for HP-MRI do not account for spatial variation, the optimized design parameters may not be fully optimal in a more general 3D setting.


title: Black Box Optimization Using QUBO and the Cross Entropy Method

abstract: Black-box optimization (BBO) can be used to optimize functions whose analytic form is unknown. A common approach to realising BBO is to learn a surrogate model which approximates the target black-box function which can then be solved via white-box optimization methods. In this paper, we present our approach BOX-QUBO, where the surrogate model is a QUBO matrix. However, unlike in previous state-of-the-art approaches, this matrix is not trained entirely by regression, but mostly by classification between 'good' and 'bad' solutions. This better accounts for the low capacity of the QUBO matrix, resulting in significantly better solutions overall. We tested our approach against the state-of-the-art on four domains and in all of them BOX-QUBO showed better results. A second contribution of this paper is the idea to also solve white-box problems, i.e. problems which could be directly formulated as QUBO, by means of black-box optimization in order to reduce the size of the QUBOs to the information-theoretic minimum. Experiments show that this significantly improves the results for MAX-k-SAT.


title: Cost-efficiency in Incomplete Markets

abstract: This paper studies the topic of cost-efficiency in incomplete markets. A portfolio payoff is called cost-efficient if it achieves a given probability distribution at some given investment horizon with a minimum initial budget. Extensive literature exists for the case of a complete financial market. We show how the problem can be extended to incomplete markets and that the main results from the theory of complete markets still hold in adapted form. In particular, we find that in incomplete markets, the optimal portfolio choice for law-invariant non-decreasing preferences must be "perfectly" cost-efficient. This notion of perfect cost-efficiency is shown to be equivalent to the fact that the payoff can be rationalized, i.e., it is the solution to an expected utility problem.


title: Placental Vessel Segmentation and Registration in Fetoscopy: Literature Review and MICCAI FetReg2021 Challenge Findings

abstract: Fetoscopy laser photocoagulation is a widely adopted procedure for treating Twin-to-Twin Transfusion Syndrome (TTTS). The procedure involves photocoagulation pathological anastomoses to regulate blood exchange among twins. The procedure is particularly challenging due to the limited field of view, poor manoeuvrability of the fetoscope, poor visibility, and variability in illumination. These challenges may lead to increased surgery time and incomplete ablation. Computer-assisted intervention (CAI) can provide surgeons with decision support and context awareness by identifying key structures in the scene and expanding the fetoscopic field of view through video mosaicking. Research in this domain has been hampered by the lack of high-quality data to design, develop and test CAI algorithms. Through the Fetoscopic Placental Vessel Segmentation and Registration (FetReg2021) challenge, which was organized as part of the MICCAI2021 Endoscopic Vision challenge, we released the first largescale multicentre TTTS dataset for the development of generalized and robust semantic segmentation and video mosaicking algorithms. For this challenge, we released a dataset of 2060 images, pixel-annotated for vessels, tool, fetus and background classes, from 18 in-vivo TTTS fetoscopy procedures and 18 short video clips. Seven teams participated in this challenge and their model performance was assessed on an unseen test dataset of 658 pixel-annotated images from 6 fetoscopic procedures and 6 short clips. The challenge provided an opportunity for creating generalized solutions for fetoscopic scene understanding and mosaicking. In this paper, we present the findings of the FetReg2021 challenge alongside reporting a detailed literature review for CAI in TTTS fetoscopy. Through this challenge, its analysis and the release of multi-centre fetoscopic data, we provide a benchmark for future research in this field.


title: Domain Generalization with Relaxed Instance Frequency-wise Normalization for Multi-device Acoustic Scene Classification

abstract: While using two-dimensional convolutional neural networks (2D-CNNs) in image processing, it is possible to manipulate domain information using channel statistics, and instance normalization has been a promising way to get domain-invariant features. However, unlike image processing, we analyze that domain-relevant information in an audio feature is dominant in frequency statistics rather than channel statistics. Motivated by our analysis, we introduce Relaxed Instance Frequency-wise Normalization (RFN): a plug-and-play, explicit normalization module along the frequency axis which can eliminate instance-specific domain discrepancy in an audio feature while relaxing undesirable loss of useful discriminative information. Empirically, simply adding RFN to networks shows clear margins compared to previous domain generalization approaches on acoustic scene classification and yields improved robustness for multiple audio devices. Especially, the proposed RFN won the DCASE2021 challenge TASK1A, low-complexity acoustic scene classification with multiple devices, with a clear margin, and RFN is an extended work of our technical report.


title: DetIE: Multilingual Open Information Extraction Inspired by Object Detection

abstract: State of the art neural methods for open information extraction (OpenIE) usually extract triplets (or tuples) iteratively in an autoregressive or predicate-based manner in order not to produce duplicates. In this work, we propose a different approach to the problem that can be equally or more successful. Namely, we present a novel single-pass method for OpenIE inspired by object detection algorithms from computer vision. We use an order-agnostic loss based on bipartite matching that forces unique predictions and a Transformer-based encoder-only architecture for sequence labeling. The proposed approach is faster and shows superior or similar performance in comparison with state of the art models on standard benchmarks in terms of both quality metrics and inference time. Our model sets the new state of the art performance of 67.7% F1 on CaRB evaluated as OIE2016 while being 3.35x faster at inference than previous state of the art. We also evaluate the multilingual version of our model in the zero-shot setting for two languages and introduce a strategy for generating synthetic multilingual data to fine-tune the model for each specific language. In this setting, we show performance improvement 15% on multilingual Re-OIE2016, reaching 75% F1 for both Portuguese and Spanish languages. Code and models are available at https://github.com/sberbank-ai/DetIE.


title: Universal Relations for the Increase in the Mass and Radius of a Rotating Neutron Star

abstract: Rotation causes an increase in a neutron star's mass and equatorial radius. The mass and radius depend sensitively on the unknown equation of state (EOS) of cold, dense matter. However, the increases in mass and radius due to rotation are almost independent of the EOS. The EOS independence leads to the idea of neutron star universality. In this paper, we compute sequences of rotating neutron stars with constant central density. We use a collection of randomly generated EOS to construct simple correction factors to the mass and radius computed from the equations of hydrostatic equilibrium for non-rotating neutron stars. The correction factors depend only on the non-rotating star's mass and radius and are almost independent of the EOS. This makes it computationally inexpensive to include observations of rotating neutron stars in EOS inference codes. We also construct a mapping from the measured mass and radius of a rotating neutron star to a corresponding non-rotating star. The mapping makes it possible to construct a zero-spin mass-radius curve if the masses and radii of many neutron stars with different spins are measured. We show that the changes in polar and equatorial radii are symmetric, in that the polar radius shrinks at the same rate that the equatorial radius grows. This symmetry is related to the observation that the equatorial compactness (the ratio of mass to radius) is almost constant on one of the constant-density sequences.


title: On the computation of rational solutions of underdetermined systems over a finite field

abstract: We design and analyze an algorithm for computing solutions with coefficients in a finite field $\mathbb{F}_q$ of underdetermined systems defined over $\mathbb{F}_q$. The algorithm is based on reductions to zero-dimensional searches. The searches are performed on "vertical strips", namely parallel linear spaces of suitable dimension in a given direction. Our results show that, on average, less than three searches suffice to obtain a solution of the original system, with a probability of success which grows exponentially with the number of searches. The analysis of our algorithm relies on results on the probability that the solution set (over the algebraic closure of $\mathbb{F}_q$) of a random system with coefficients in $\mathbb{F}_q$ satisfies certain geometric and algebraic properties which is of independent interest.


title: First search for the weak radiative decays $\Lambda_c^+ \to \Sigma^+ \gamma$ and $\Xi_c^0 \to \Xi^0 \gamma$

abstract: We present the first search for the weak radiative decays $\Lambda_c^+ \to \Sigma^+ \gamma$ and $\Xi_c^0 \to \Xi^0 \gamma$ using a data sample of 980~fb$^{-1}$ collected by the Belle detector operating at the KEKB asymmetric-energy $e^+e^-$ collider. There are no evident $\Lambda_c^+ \to \Sigma^+ \gamma$ or $\Xi_c^0 \to \Xi^0 \gamma$ signals. Taking the decays $\Lambda_c^+ \to p K^- \pi^+$ and $\Xi_c^0 \to \Xi^- \pi^+$ as normalization channels, the upper limits at 90\% credibility level on the ratios of branching fractions ${\cal B}(\Lambda_c^+ \to \Sigma^+ \gamma)/{\cal B}(\Lambda_c^+ \to p K^{-} \pi^+) < 4.0 \times 10^{-3}$ and ${\cal B}(\Xi_c^0 \to \Xi^0 \gamma)/{\cal B}(\Xi_c^0 \to \Xi^- \pi^+) < 1.2 \times 10^{-2}$ are determined. We obtain the upper limits at 90\% credibility level on the absolute branching fractions ${\cal B}(\Lambda_c^+ \to \Sigma^+ \gamma) < 2.6 \times 10^{-4}$ and ${\cal B}(\Xi_c^0 \to \Xi^0 \gamma) < 1.8 \times 10^{-4}$.


title: Nucleon axial form factor at large momentum transfers

abstract: Using a Poincar\'e-covariant quark+diquark Faddeev equation and related symmetry-preserving weak interaction current, we deliver parameter-free predictions for the nucleon axialvector form factor, $G_A(Q^2)$, on the domain $0\leq x=Q^2/m_N^2\leq 10$, where $m_N$ is the nucleon mass. We also provide a detailed analysis of the flavour separation of the proton $G_A$ into contributions from valence $u$ and $d$ quarks; and with form factors available on such a large $Q^2$ domain, predictions for the flavour-separated axial-charge light-front transverse spatial density profiles. Our calculated axial charge ratio $g_A^d/g_A^u=-0.32(2)$ is consistent with available experimental data and markedly larger in magnitude than the value typical of nonrelativistic quark models. The value of this ratio is sensitive to the strength of axialvector diquark correlations in the Poincar\'e-covariant nucleon wave function. Working with a realistic axialvector diquark content, the $d$ and $u$ quark transverse density profiles are similar. Some of these predictions could potentially be tested with new data on threshold pion electroproduction from the proton at large $Q^2$.


title: Nambu mechanics viewed as a Clebsch parameterized Poisson algebra -- toward canonicalization and quantization

abstract: In his pioneering paper [Phys. Rev. E 7, 2405 (1973)], Nambu proposed the idea of multiple Hamiltonian systems. The explicit example examined there is equivalent to the so(3) Lie-Poisson system, which represents noncanonical Hamiltonian dynamics with a Casimir; the Casimir corresponds to the second Hamiltonian of Nambu's formulation. The vortex dynamics of ideal fluid, while it is infinite dimensional, has a similar structure, in which the Casimir is the helicity. These noncanonical Poisson algebras are derived by the reduction, i.e., restricting the phase space to some submanifold embedded in the canonical phase space. We may reverse the reduction to canonicalize some Nambu dynamics, i.e., view the Nambu dynamics as the subalgebra of a larger canonical Poisson algebra. Then, we can invoke the standard corresponding principle for quantizing the canonicalized system. The inverse of the reduction, i.e., representing the noncanonical variables by some canonical variables may be said "Clebsch parameterization" following the fluid mechanical example.

categories: math-ph math.MP physics.flu-dyn physics.plasm-ph quant-ph


title: Learning to learn online with neuromodulated synaptic plasticity in spiking neural networks

abstract: We propose that in order to harness our understanding of neuroscience toward machine learning, we must first have powerful tools for training brain-like models of learning. Although substantial progress has been made toward understanding the dynamics of learning in the brain, neuroscience-derived models of learning have yet to demonstrate the same performance capabilities as methods in deep learning such as gradient descent. Inspired by the successes of machine learning using gradient descent, we demonstrate that models of neuromodulated synaptic plasticity from neuroscience can be trained in Spiking Neural Networks (SNNs) with a framework of learning to learn through gradient descent to address challenging online learning problems. This framework opens a new path toward developing neuroscience inspired online learning algorithms.


title: An objective vortex identification method

abstract: Generally, the vortex structures should be independent of the observers who are moving, especially when their coordinates are non-inertial, which may result in confusions in communications between researchers. The property that not being influenced by the choice of coordinate is called objective. Mostly, researchers would like to gather data in the inertial coordinate because most physical laws are valid in the inertial coordinate. As a result, how to transfer the observations in a non-inertial coordinate to those in an inertial coordinate raises interest. In this paper, methods are provided to obtain velocity and velocity gradient tensor in an inertial coordinate from the non-inertial observations based on one known zero-vorticity point which can be chosen from physical fact such as the point is located in the inviscid region.Further, objective vortex structure can be calculated from the objective velocity or velocity gradient tensor. With Liutex chosen as the indicator of the vortex, two numerical examples are used to test the proposed methods. The results show that the methods perform very well and the relative error is extremely small.


title: Possible Universal Limit for Valence Parton Distributions

abstract: We report the observation of the existence of a possible universal limit for valence parton distributions that should exist once partonic degrees of freedom are relevant for high energy scattering from strongly interacting bound systems like a nucleon, meson or a few nucleon system at very short distances. Our observation is based on the notion that the Bjorken x weighted valence parton distribution function has a peak, $x_p$, that characterizes the average momentum fraction carried out by the valence quarks in the system. Within the residual mean-field model of the valence quark distribution we found that $x_p$ has an upper limit: $x_p \leq {1\over 2(n_V-1)}$, where $n_V$ is the number of valence quarks which can be considered in the cluster embedded in the strongly interacting environment of the bound system. The existence of such a limit imposes a new constraint on choosing the starting resolution scale $Q_0$ for PDFs. Our prediction for the nucleon is that $x_p\mid_{Q\to Q_0}\le{1\over 4}$, which is in agreement with all the available valence PDFs that employ the standard approach for selecting starting $Q_0$. We also demonstrate how the existence of this limit can be used to check the onset of quark-clusters in short range nucleon correlations in nuclei.


title: MMSE Symbol Level Precoding Under a Per Antenna Power Constraint for Multiuser MIMO Systems With PSK Modulation

abstract: This study proposes a symbol-level precoding algorithm based on the minimum mean squared error design objective under a strict per antenna power constraint for PSK modulation. The proposed design is then formulated in the standard form of a second-order cone program, allowing for an optimal solution via the interior point method. Numerical results indicate that the proposed design is superior to the existing approaches in terms of bit-error-rate for the low and intermediate SNR regime.


title: Special geometry of quartic curves

abstract: We classify maximal quartic generalised projective special real curves up to equivalence. A maximal quartic generalised projective special real curve consists of connected components of the intersection of the hyperbolic points of a quartic homogeneous real polynomial $h:\mathbb{R}^2\to\mathbb{R}$ and its level set $\{h=1\}$. Two such curves are called equivalent if they are related by a linear coordinate transformation. As an application of our results we prove that quartic generalised projective special real manifolds that are homogeneous spaces have non-regular boundary behaviour, meaning that the differential of each of these spaces' defining polynomials vanishes identically on a ray in the boundary of the cone spanned by the corresponding manifold. Lastly we describe the asymptotic behaviour of each curve.


title: Causality for Complex Continuous-time Functional Longitudinal Studies

abstract: The paramount obstacle in longitudinal studies for causal inference is the complex "treatment-confounder feedback." Traditional methodologies for elucidating causal effects in longitudinal analyses are primarily based on the assumption that time moves in specific intervals or that changes in treatment occur discretely. This conventional view confines treatment-confounder feedback to a limited, countable scope. The advent of real-time monitoring in modern medical research introduces functional longitudinal data with dynamically time-varying outcomes, treatments, and confounders, necessitating dealing with a potentially uncountably infinite treatment-confounder feedback. Thus, there is an urgent need for a more elaborate and refined theoretical framework to navigate these intricacies. Recently, Ying (2024) proposed a preliminary framework focusing on end-of-study outcomes and addressing the causality in functional longitudinal data. Our paper expands significantly upon his foundation in fourfold: First, we conduct a comprehensive review of existing literature, which not only fosters a deeper understanding of the underlying concepts but also illuminates the genesis of both Ying (2024)'s and ours. Second, we extend Ying (2024) to fully embrace a functional time-varying outcome process, incorporating right censoring and truncation by death, which are both significant and practical concerns. Third, we formalize previously informal propositions in Ying (2024), demonstrating how this framework broadens the existing frameworks in a nonparametric manner. Lastly, we delve into a detailed discussion on the interpretability and feasibility of our assumptions, and outlining a strategy for future numerical studies.


title: The semigroup of endomorphisms with restricted range of an independence algebra

abstract: Since its introduction by Symons, the semigroup of maps with restricted range has been studied in the context of transformations on a set, or of linear maps on a vector space. Sets and vector spaces being particular examples of independence algebras, a natural question that arises is whether by taking the semigroup $T(\mathcal{A},\mathcal{B})$ of all endomorphisms of an independence algebra $\mathcal{A}$ whose image lie in a subalgebra $\mathcal{B}$, one can obtain corresponding results as in the cases of sets and vector spaces. In this paper, we put under a common framework the research from Sanwong, Sommanee, Sullivan, Mendes-Gon\c{c}alves and all their predecessors. We describe Green's relations as well as the ideals of $T(\mathcal{A},\mathcal{B})$ following their lead. We then take a new direction, completely describing all of the extended Green's relations on $T(\mathcal{A},\mathcal{B})$. We make no restriction on the dimension of our algebras as the results in the finite and infinite dimensional cases generally take the same form.


title: Infinite Impulse Response Graph Neural Networks for Cyberattack Localization in Smart Grids

abstract: This study employs Infinite Impulse Response (IIR) Graph Neural Networks (GNN) to efficiently model the inherent graph network structure of the smart grid data to address the cyberattack localization problem. First, we numerically analyze the empirical frequency response of the Finite Impulse Response (FIR) and IIR graph filters (GFs) to approximate an ideal spectral response. We show that, for the same filter order, IIR GFs provide a better approximation to the desired spectral response and they also present the same level of approximation to a lower order GF due to their rational type filter response. Second, we propose an IIR GNN model to efficiently predict the presence of cyberattacks at the bus level. Finally, we evaluate the model under various cyberattacks at both sample-wise (SW) and bus-wise (BW) level, and compare the results with the existing architectures. It is experimentally verified that the proposed model outperforms the state-of-the-art FIR GNN model by 9.2% and 14% in terms of SW and BW localization, respectively.


title: Predicting Stock Price Movement after Disclosure of Corporate Annual Reports: A Case Study of 2021 China CSI 300 Stocks

abstract: In the current stock market, computer science and technology are more and more widely used to analyse stocks. Not same as most related machine learning stock price prediction work, this work study the predicting the tendency of the stock price on the second day right after the disclosure of the companies' annual reports. We use a variety of different models, including decision tree, logistic regression, random forest, neural network, prototypical networks. We use two sets of financial indicators (key and expanded) to conduct experiments, these financial indicators are obtained from the EastMoney website disclosed by companies, and finally we find that these models are not well behaved to predict the tendency. In addition, we also filter stocks with ROE greater than 0.15 and net cash ratio greater than 0.9. We conclude that according to the financial indicators based on the just-released annual report of the company, the predictability of the stock price movement on the second day after disclosure is weak, with maximum accuracy about 59.6% and maximum precision about 0.56 on our test set by the random forest classifier, and the stock filtering does not improve the performance. And random forests perform best in general among all these models which conforms to some work's findings.


title: Probing Causes of Hallucinations in Neural Machine Translations

abstract: Hallucination, one kind of pathological translations that bothers Neural Machine Translation, has recently drawn much attention. In simple terms, hallucinated translations are fluent sentences but barely related to source inputs. Arguably, it remains an open problem how hallucination occurs. In this paper, we propose to use probing methods to investigate the causes of hallucinations from the perspective of model architecture, aiming to avoid such problems in future architecture designs. By conducting experiments over various NMT datasets, we find that hallucination is often accompanied by the deficient encoder, especially embeddings, and vulnerable cross-attentions, while, interestingly, cross-attention mitigates some errors caused by the encoder.


title: Backward Stochastic Differential Equations and Backward Stochastic Volterra Integral Equations with Anticipating Generators

abstract: For a backward stochastic differential equation (BSDE, for short), when the generator is not progressively measurable, it might not admit adapted solutions, shown by an example. However, for backward stochastic Volterra integral equations (BSVIEs, for short), the generators are allowed to be anticipating. This gives, among other things, an essential difference between BSDEs and BSVIEs. Under some proper conditions, the well-posedness of such kinds of BSVIEs is established. Further, the results are extended to path-dependent BSVIEs, in which the generators can depend on the future paths of unknown processes. An additional finding is that for path-dependent BSVIEs, in general, the situation of anticipating generators is not avoidable and the adaptedness condition similar to that imposed for anticipated BSDEs by Peng--Yang [22] is not necessary.


title: Maximum independent set (stable set) problem: Computational testing with binary search and convex programming using a bin packing approach

abstract: This paper deals with the maximum independent set (M.I.S.) problem, also known as the stable set problem. The basic mathematical programming model that captures this problem is an Integer Program (I.P.) with zero-one variables $x_j$ and only the \textit{edge inequalities} with an objective function value of the form $~\textstyle \sum_{j=1}^N x_j~$ where $N$ is the number of vertices in the input. We consider $LP(k)$, which is the Linear programming (LP) relaxation of the I.P. with an additional constraint $\textstyle \sum_{j=1}^N x_j = k ~~ (0 \le k \le N). ~~ $ We then consider a convex programming variant $CP(k)$ of $LP(k)$, which is the same as $LP(k)$, except that the objective function is a nonlinear convex function (which we minimise). $~$The M.I.S. problem can be solved by solving $CP(k)$ for every value of $k$ in the interval $~0 \le k \le N~$ where the convex function is minimised using a \it{bin packing} type of approach. In this paper, we present efforts to developing a convex function for $CP(k)$.. However, in the latest version, in the absence of a convex function, we have introduced a new function; and for a certain instance, when we provide partial solutions (that is, for 5 vertices out of 150), the frequency of hitting an optimal complete integer solution increases significantly.


title: Causal Scoring: A Framework for Effect Estimation, Effect Ordering, and Effect Classification

abstract: This paper introduces causal scoring as a novel approach to frame causal estimation in the context of decision making. Causal scoring entails the estimation of scores that support decision making by providing insights into causal effects. We present three valuable causal interpretations of these scores: effect estimation (EE), effect ordering (EO), and effect classification (EC). In the EE interpretation, the causal score represents the effect itself. The EO interpretation implies that the score can serve as a proxy for the magnitude of the effect, enabling the sorting of individuals based on their causal effects. The EC interpretation enables the classification of individuals into high- and low-effect categories using a predefined threshold. We demonstrate the value of these alternative causal interpretations (EO and EC) through two key results. First, we show that aligning the statistical modeling with the desired causal interpretation improves the accuracy of causal estimation. Second, we establish that more flexible causal interpretations are plausible in a wider range of settings and propose conditions to assess their validity. We showcase the practical utility of causal scoring through diverse scenarios, including situations involving unobserved confounding due to self-selection, lack of data on the primary outcome of interest, or lack of data on how individuals behave when intervened. These examples illustrate how causal scoring facilitates reasoning about flexible causal interpretations of statistical estimates in various contexts. They encompass confounded estimates, effect estimates on surrogate outcomes, and even predictions about non-causal quantities as potential causal scores.


title: From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering

abstract: In order to achieve a general visual question answering (VQA) system, it is essential to learn to answer deeper questions that require compositional reasoning on the image and external knowledge. Meanwhile, the reasoning process should be explicit and explainable to understand the working mechanism of the model. It is effortless for human but challenging for machines. In this paper, we propose a Hierarchical Graph Neural Module Network (HGNMN) that reasons over multi-layer graphs with neural modules to address the above issues. Specifically, we first encode the image by multi-layer graphs from the visual, semantic and commonsense views since the clues that support the answer may exist in different modalities. Our model consists of several well-designed neural modules that perform specific functions over graphs, which can be used to conduct multi-step reasoning within and between different graphs. Compared to existing modular networks, we extend visual reasoning from one graph to more graphs. We can explicitly trace the reasoning process according to module weights and graph attentions. Experiments show that our model not only achieves state-of-the-art performance on the CRIC dataset but also obtains explicit and explainable reasoning procedures.


title: SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videos

abstract: Self-supervised methods have significantly closed the gap with end-to-end supervised learning for image classification. In the case of human action videos, however, where both appearance and motion are significant factors of variation, this gap remains significant. One of the key reasons for this is that sampling pairs of similar video clips, a required step for many self-supervised contrastive learning methods, is currently done conservatively to avoid false positives. A typical assumption is that similar clips only occur temporally close within a single video, leading to insufficient examples of motion similarity. To mitigate this, we propose SLIC, a clustering-based self-supervised contrastive learning method for human action videos. Our key contribution is that we improve upon the traditional intra-video positive sampling by using iterative clustering to group similar video instances. This enables our method to leverage pseudo-labels from the cluster assignments to sample harder positives and negatives. SLIC outperforms state-of-the-art video retrieval baselines by +15.4% on top-1 recall on UCF101 and by +5.7% when directly transferred to HMDB51. With end-to-end finetuning for action classification, SLIC achieves 83.2% top-1 accuracy (+0.8%) on UCF101 and 54.5% on HMDB51 (+1.6%). SLIC is also competitive with the state-of-the-art in action classification after self-supervised pretraining on Kinetics400.


title: On the homology of several number-theoretic set families

abstract: This paper describes the homology of various simplicial complexes associated to set families from combinatorial number theory, including primitive sets, pairwise coprime sets, product-free sets, and coprime-free sets. We present a condition on a set family that results in easy computation of the homology groups, and show that the first three examples, among many others, admit such a structure. We then extend our techniques to address the complexes associated to coprime-free sets and a generalization of primitive sets.


title: A gated group sequential design for seamless Phase II/III trial with subpopulation selection

abstract: Due to the high cost and high failure rate of Phase III trials, seamless Phase II/III designs are more and more popular to trial efficiency. A potential attraction of Phase II/III design is to allow a randomized proof-of-concept stage prior to committing to the full cost of the Phase III trial. Population selection during the trial allows a trial to adapt and focus investment where it is most likely to provide patient benefit. Motivated by a clinical trial to find the population that potential benefits with dual-primary endpoints progression free survival (PFS) and overall survival (OS), we propose a gated group sequential design for a seamless Phase II/III trial design with population selection. The investigated design controls the familywise error rate and allows multiple interim analyses to enable early stopping for efficacy or futility. Simulations and an illustrative example suggest that the proposed gated group sequential design can have more power than the commonly used classical group sequential design, and reduces the patient's exposure to less effective treatment if the complementary sub-group has less significant treatment effect. The proposed design has the potential to save drug development cost and more quickly fulfill unmet medical needs.