title: Multi-Objective GFlowNets

abstract: We study the problem of generating diverse candidates in the context of Multi-Objective Optimization. In many applications of machine learning such as drug discovery and material design, the goal is to generate candidates which simultaneously optimize a set of potentially conflicting objectives. Moreover, these objectives are often imperfect evaluations of some underlying property of interest, making it important to generate diverse candidates to have multiple options for expensive downstream evaluations. We propose Multi-Objective GFlowNets (MOGFNs), a novel method for generating diverse Pareto optimal solutions, based on GFlowNets. We introduce two variants of MOGFNs: MOGFN-PC, which models a family of independent sub-problems defined by a scalarization function, with reward-conditional GFlowNets, and MOGFN-AL, which solves a sequence of sub-problems defined by an acquisition function in an active learning loop. Our experiments on wide variety of synthetic and benchmark tasks demonstrate advantages of the proposed methods in terms of the Pareto performance and importantly, improved candidate diversity, which is the main contribution of this work.


title: Antenna source of radio-frequency emission in ion-proton pulsars

abstract: The growth of a longitudinal or quasi-longitudinal Langmuir mode in the outward-moving beam of ions and protons that forms the open sector of an ion-proton pulsar magnetosphere radiates as an analogue of an end-fed high-impedance horizontal straight-wire antenna an integral number of half-waves in length. The radiation has, broadly, the energy flux, linear polarization and spectral index that are widely observed: also, the notch phenomenon seen in some integrated pulse profiles occurs naturally. The new field of pulsar observations below 100 MHz may lead to productive tests of the radio emission mechanism.


title: Falsehoods that ML researchers believe about OOD detection

abstract: An intuitive way to detect out-of-distribution (OOD) data is via the density function of a fitted probabilistic generative model: points with low density may be classed as OOD. But this approach has been found to fail, in deep learning settings. In this paper, we list some falsehoods that machine learning researchers believe about density-based OOD detection. Many recent works have proposed likelihood-ratio-based methods to `fix' the problem. We propose a framework, the OOD proxy framework, to unify these methods, and we argue that likelihood ratio is a principled method for OOD detection and not a mere `fix'. Finally, we discuss the relationship between domain discrimination and semantics.


title: kafe2 -- a Modern Tool for Model Fitting in Physics Lab Courses

abstract: Fitting models to measured data is one of the standard tasks in the natural sciences, typically addressed early on in physics education in the context of laboratory courses, in which statistical methods play a central role in analysing and interpreting experimental results. The increased emphasis placed on such methods in modern school curricula, together with the availability of powerful free and open-source software tools geared towards scientific data analysis, form an excellent premise for the development of new teaching concepts for these methods at the university level. In this article, we present kafe2, a new tool developed at the Faculty of Physics at the Karlsruhe Institute of Technology, which has been used in physics laboratory courses for several years. Written in the {\it Python} programming language and making extensive use of established numerical and optimization libraries, {\it kafe2} provides simple but powerful interfaces for numerically fitting model functions to data. The tools provided allow for fine-grained control over many aspects of the fitting procedure, including the specification of the input data and of arbitrarily complex model functions, the construction of complex uncertainty models, and the visualization of the resulting confidence intervals of the model parameters.


title: A new approach to classical Einstein-Yang-Mills Theory

abstract: The conventional Rosenfeld-Bergmann-Dirac constrained Hamiltonian algorithm applied to Einstein-Yang-Mills theory is shown to be equivalent to a local gauge theoretic extension of Cartan's invariant integral approach to classical mechanics. In addition, the Hamiltonian generators of Legendre-projectable spacetime diffeomorphism and gauge symmetries are derived directly as vanishing Noether charges. This leads directly to their interpretation as delivering the correct symmetry variations of both configuration and momentum feld variables.


title: Exploring the Value of Pre-trained Language Models for Clinical Named Entity Recognition

abstract: The practice of fine-tuning Pre-trained Language Models (PLMs) from general or domain-specific data to a specific task with limited resources, has gained popularity within the field of natural language processing (NLP). In this work, we re-visit this assumption and carry out an investigation in clinical NLP, specifically Named Entity Recognition on drugs and their related attributes. We compare Transformer models that are trained from scratch to fine-tuned BERT-based LLMs namely BERT, BioBERT, and ClinicalBERT. Furthermore, we examine the impact of an additional CRF layer on such models to encourage contextual learning. We use n2c2-2018 shared task data for model development and evaluations. The experimental outcomes show that 1) CRF layers improved all language models; 2) referring to BIO-strict span level evaluation using macro-average F1 score, although the fine-tuned LLMs achieved 0.83+ scores, the TransformerCRF model trained from scratch achieved 0.78+, demonstrating comparable performances with much lower cost - e.g. with 39.80\% less training parameters; 3) referring to BIO-strict span-level evaluation using weighted-average F1 score, ClinicalBERT-CRF, BERT-CRF, and TransformerCRF exhibited lower score differences, with 97.59\%/97.44\%/96.84\% respectively. 4) applying efficient training by down-sampling for better data distribution further reduced the training cost and need for data, while maintaining similar scores - i.e. around 0.02 points lower compared to using the full dataset. Our models will be hosted at \url{https://github.com/HECTA-UoM/TransformerCRF}


title: Stationary Flows Revisited

abstract: In this paper we revisit the subject of stationary flows of Lax hierarchies of a coupled KdV class. We explain the main ideas in the standard KdV case and then consider the dispersive water waves (DWW) case, with respectively 2 and 3 Hamiltonian representations. Each Hamiltonian representation gives us a different form of stationary flow. Comparing these, we construct Poisson maps, which, being non-canonical, give rise to bi-Hamiltonian representations of the stationary flows. An alternative approach is to use the Miura maps, which we do in the case of the DWW hierarchy, which has two ''modifications''. This structure gives us 3 sequences of Poisson related stationary flows. We use the Poisson maps to build a tri-Hamiltonian representation of each of the three stationary hierarchies. One of the Hamiltonian representations allows a multi-component squared eigenfunction expansion, which gives $N$ degrees of freedom Hamiltonians, with first integrals. A Lax representation for each of the stationary flows is derived from the coupled KdV matrices. In the case of 3 degrees of freedom, we give a generalisation of our Lax matrices and Hamiltonian functions, which allows a connection with the rational Calogero-Moser (CM) system. This gives a coupling of the CM system with other potentials, along with a Lax representation. We present the particular case of coupling one of the integrable H\'enon-Heiles systems to CM.


title: Electroanatomic Mapping to determine Scar Regions in patients with Atrial Fibrillation

abstract: Left atrial voltage maps are routinely acquired during electroanatomic mapping in patients undergoing catheter ablation for atrial fibrillation. For patients, who have prior catheter ablation when they are in sinus rhythm, the voltage map can be used to identify low voltage areas using a threshold of 0.2 - 0.45 mV. However, such a voltage threshold for maps acquired during atrial fibrillation has not been well established. A prerequisite for defining a voltage threshold is to maximize the topologically matched low voltage areas between the electroanatomic mapping acquired during atrial fibrillation and sinus rhythm. This paper demonstrates a new technique to improve the sensitivity and specificity of the matched low voltage areas. This is achieved by computing omni-directional bipolar voltages and applying Gaussian Process Regression based interpolation to derive the atrial fibrillation map. The proposed method is evaluated on a test cohort of 7 male patients, and a total of 46,589 data points were included in analysis. The low voltage areas in the posterior left atrium and pulmonary vein junction are determined using the standard method and the proposed method. Overall, the proposed method showed patient-specific sensitivity and specificity in matching low voltage areas of 75.70% and 65.55% for a geometric mean of 70.69%. On average, there was an improvement of 3.00% in the geometric mean, 7.88% improvement in sensitivity, 0.30% improvement in specificity compared to the standard method. The results show that the proposed method is an improvement in matching low voltage areas. This may help develop the voltage threshold to better identify low voltage areas in the left atrium for patients in atrial fibrillation.

categories: physics.med-ph cs.SY eess.IV eess.SP eess.SY


title: Note on the Existence of Minimizers for Variational Geometric Active Contours

abstract: We propose here a proof of existence of a minimizer of a segmentation functional based on a priori information on target shapes, and formulated with level sets. The existence of a minimizer is very important, because it guarantees the convergence of any numerical methods (either gradient descents techniques and variants, or PDE resolutions) used to solve the segmentation model. This work can also be used in many other segmentation models to prove the existence of a minimizer.


title: Manifold Alignment with Label Information

abstract: Multi-domain data is becoming increasingly common and presents both challenges and opportunities in the data science community. The integration of distinct data-views can be used for exploratory data analysis, and benefit downstream analysis including machine learning related tasks. With this in mind, we present a novel manifold alignment method called MALI (Manifold alignment with label information) that learns a correspondence between two distinct domains. MALI can be considered as belonging to a middle ground between the more commonly addressed semi-supervised manifold alignment problem with some known correspondences between the two domains, and the purely unsupervised case, where no known correspondences are provided. To do this, MALI learns the manifold structure in both domains via a diffusion process and then leverages discrete class labels to guide the alignment. By aligning two distinct domains, MALI recovers a pairing and a common representation that reveals related samples in both domains. Additionally, MALI can be used for the transfer learning problem known as domain adaptation. We show that MALI outperforms the current state-of-the-art manifold alignment methods across multiple datasets.


title: McQueen: a Benchmark for Multimodal Conversational Query Rewrite

abstract: The task of query rewrite aims to convert an in-context query to its fully-specified version where ellipsis and coreference are completed and referred-back according to the history context. Although much progress has been made, less efforts have been paid to real scenario conversations that involve drawing information from more than one modalities. In this paper, we propose the task of multimodal conversational query rewrite (McQR), which performs query rewrite under the multimodal visual conversation setting. We collect a large-scale dataset named McQueen based on manual annotation, which contains 15k visual conversations and over 80k queries where each one is associated with a fully-specified rewrite version. In addition, for entities appearing in the rewrite, we provide the corresponding image box annotation. We then use the McQueen dataset to benchmark a state-of-the-art method for effectively tackling the McQR task, which is based on a multimodal pre-trained model with pointer generator. Extensive experiments are performed to demonstrate the effectiveness of our model on this task\footnote{The dataset and code of this paper are both available in \url{https://github.com/yfyuan01/MQR}


title: Metadata Privacy Beyond Tunneling for Instant Messaging

abstract: Transport layer data leaks metadata unintentionally -- such as who communicates with whom. While tools for strong transport layer privacy exist, they have adoption obstacles, including performance overheads incompatible with mobile devices. We posit that by changing the objective of metadata privacy for $\textit{all traffic}$, we can open up a new design space for pragmatic approaches to transport layer privacy. As a first step in this direction, we propose using techniques from information flow control and present a principled approach to constructing formal models of systems with metadata privacy for $\textit{some}$, deniable, traffic. We prove that deniable traffic achieves metadata privacy against strong adversaries -- this constitutes the first bridging of information flow control and anonymous communication to our knowledge. Additionally, we show that existing state-of-the-art protocols can be extended to support metadata privacy, by designing a novel protocol for $\textit{deniable instant messaging}$ (DenIM), which is a variant of the Signal protocol. To show the efficacy of our approach, we implement and evaluate a proof-of-concept instant messaging system running DenIM on top of unmodified Signal. We empirically show that the DenIM on Signal can maintain low-latency for unmodified Signal traffic without breaking existing features, while at the same time supporting deniable Signal traffic.


title: Generating Accurate and Faithful Discharge Instructions: Task, Dataset, and Model

abstract: The "Patient Instruction" (PI), known as "Discharge Instruction", which contains critical instructional information provided both to carers and to the patient at the time of discharge, is essential for the patient to manage their condition outside hospital. An accurate and easy-to-follow PI can improve the self-management of patients which can in turn reduce hospital readmission rates. However, writing an appropriate PI can be extremely time-consuming for physicians, and is subject to being incomplete or error-prone for (potentially overworked) physicians. Therefore, we propose a new task that can provide an objective means of avoiding incompleteness, while reducing clinical workload: the automatic generation of the PI, which is imagined as being a document that the clinician can review, modify, and approve as necessary (rather than taking the human "out of the loop"). We build a benchmark clinical dataset and propose the Re3Writer, which imitates the working patterns of physicians to first retrieve related working experience from historical PIs written by physicians, then reason related medical knowledge. Finally, it refines the retrieved working experience and reasoned medical knowledge to extract useful information, which is used to generate the PI for previously-unseen patient according to their health records during hospitalization. Our experiments show that, using our method, the performance of five different models can be substantially boosted across all metrics, with up to 20%, 11%, and 19% relative improvements in BLEU-4, ROUGE-L, and METEOR, respectively. Meanwhile, we show results from human evaluations to measure the effectiveness in terms of its usefulness for clinical practice. The code is available at https://github.com/AI-in-Hospitals/Patient-Instructions


abstract: Spectral Clustering (SC) is widely used for clustering data on a nonlinear manifold. SC aims to cluster data by considering the preservation of the local neighborhood structure on the manifold data. This paper extends Spectral Clustering to Local and Global Structure Preservation Based Spectral Clustering (LGPSC) that incorporates both global structure and local neighborhood structure simultaneously. For this extension, LGPSC proposes two models to extend local structures preservation to local and global structures preservation: Spectral clustering guided Principal component analysis model and Multilevel model. Finally, we compare the experimental results of the state-of-the-art methods with our two models of LGPSC on various data sets such that the experimental results confirm the effectiveness of our LGPSC models to cluster nonlinear data.


title: Islands of shape coexistence in proxy-SU(3) symmetry and in covariant density functional theory

abstract: Shape coexistence in even-even nuclei is observed when the ground state band of a nucleus is accompanied by another K=0 band at similar energy but with radically different structure. We attempt to predict regions of shape coexistence throughout the nuclear chart using the parameter-free proxy-SU(3) symmetry and standard covariant density functional theory. Within the proxy-SU(3) symmetry the interplay of shell model magic numbers, formed by the spin-orbit interaction, and the 3-dimensional isotropic harmonic oscillator magic numbers, leads to the prediction of specific horizontal and vertical stripes on the nuclear chart in which shape coexistence should be possible. Within covariant density functional theory, specific islands on the nuclear chart are found, in which particle-hole excitations leading to shape coexistence are observed. The role played by particle-hole excitations across magic numbers as well as the collapse of magic numbers as deformation sets in is clarified.


title: Independence of current components, polarization vectors, and reference frames in the light-front quark model analysis of meson decay constants

abstract: The issue of resulting in the same physical observables with different current components, in particular from the minus current, has been challenging in the light-front quark model (LFQM) even for the computation of the two-point functions such as meson decay constants. At the level of one-body current matrix element computation, we show the uniqueness of pseudoscalar and vector meson decay constants using all available components including the minus component of the current in the LFQM consistent with the Bakamjian-Thomas construction. Regardless of the current components, the polarization vectors, and the reference frames, the meson decay constants are uniquely determined in the non-interacting constituent quark and antiquark basis while the interactions of the constituents are added to the meson mass operator in the LFQM.


title: Automorphisms of affine Veronese surfaces

abstract: We prove that every derivation and every locally nilpotent derivation of the subalgebra $K[x^n, x^{n-1}y,\ldots,xy^{n-1}, y^n]$, where $n\geq 2$, of the polynomial algebra $K[x,y]$ in two variables over a field $K$ of characteristic zero is induced by a derivation and a locally nilpotent derivation of $K[x,y]$, respectively. Moreover, we prove that every automorphism of $K[x^n, x^{n-1}y,\ldots,xy^{n-1}, y^n]$ over an algebraically closed field $K$ of characteristic zero is induced by an automorphism of $K[x,y]$. We also show that the group of automorphisms of $K[x^n, x^{n-1}y,\ldots,xy^{n-1}, y^n]$ admits an amalgamated free product structure.


title: Compressing Explicit Voxel Grid Representations: fast NeRFs become also small

abstract: NeRFs have revolutionized the world of per-scene radiance field reconstruction because of their intrinsic compactness. One of the main limitations of NeRFs is their slow rendering speed, both at training and inference time. Recent research focuses on the optimization of an explicit voxel grid (EVG) that represents the scene, which can be paired with neural networks to learn radiance fields. This approach significantly enhances the speed both at train and inference time, but at the cost of large memory occupation. In this work we propose Re:NeRF, an approach that specifically targets EVG-NeRFs compressibility, aiming to reduce memory storage of NeRF models while maintaining comparable performance. We benchmark our approach with three different EVG-NeRF architectures on four popular benchmarks, showing Re:NeRF's broad usability and effectiveness.


title: An experimental analysis from the magnetic interactions in nanowire arrays

abstract: We study the magnetic interactions experimentally in nanostructures of nanowire arrays. The intensity value obtained from the interactions provides information about its magnetic behavior. We observed two types of experimental magnetic behavior, i. e., demagnetized and magnetized. Our approach represents the first experimental way to analyze the magnetic behavior of a nanostructure considering its magnetic dependence, which is very important for applications in sensors, for example.


title: On the top-dimensional cohomology of arithmetic Chevalley groups

abstract: Let $\mathbb{K}$ be a number field with ring of integers $\mathfrak{O}$ and let $\mathcal{G}$ be a Chevalley group scheme not of type $\mathtt{E}_8$, $\mathtt{F}_4$ or $\mathtt{G}_2$. We use the theory of Tits buildings and a result of T\'oth on Steinberg modules to prove that $H^{\operatorname{vcd}}(\mathcal{G}(\mathfrak{O}); \mathbb{Q}) = 0$ if $\mathfrak{O}$ is Euclidean.


title: An Improved RaftStereo Trained with A Mixed Dataset for the Robust Vision Challenge 2022

abstract: Stereo-matching is a fundamental problem in computer vision. Despite recent progress by deep learning, improving the robustness is ineluctable when deploying stereo-matching models to real-world applications. Different from the common practices, i.e., developing an elaborate model to achieve robustness, we argue that collecting multiple available datasets for training is a cheaper way to increase generalization ability. Specifically, this report presents an improved RaftStereo trained with a mixed dataset of seven public datasets for the robust vision challenge (denoted as iRaftStereo_RVC). When evaluated on the training sets of Middlebury, KITTI-2015, and ETH3D, the model outperforms its counterparts trained with only one dataset, such as the popular Sceneflow. After fine-tuning the pre-trained model on the three datasets of the challenge, it ranks at 2nd place on the stereo leaderboard, demonstrating the benefits of mixed dataset pre-training.


title: When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks

abstract: Humans can reason compositionally whilst grounding language utterances to the real world. Recent benchmarks like ReaSCAN use navigation tasks grounded in a grid world to assess whether neural models exhibit similar capabilities. In this work, we present a simple transformer-based model that outperforms specialized architectures on ReaSCAN and a modified version of gSCAN. On analyzing the task, we find that identifying the target location in the grid world is the main challenge for the models. Furthermore, we show that a particular split in ReaSCAN, which tests depth generalization, is unfair. On an amended version of this split, we show that transformers can generalize to deeper input structures. Finally, we design a simpler grounded compositional generalization task, RefEx, to investigate how transformers reason compositionally. We show that a single self-attention layer with a single head generalizes to novel combinations of object attributes. Moreover, we derive a precise mathematical construction of the transformer's computations from the learned network. Overall, we provide valuable insights about the grounded compositional generalization task and the behaviour of transformers on it, which would be useful for researchers working in this area.


title: Respecting Transfer Gap in Knowledge Distillation

abstract: Knowledge distillation (KD) is essentially a process of transferring a teacher model's behavior, e.g., network response, to a student model. The network response serves as additional supervision to formulate the machine domain, which uses the data collected from the human domain as a transfer set. Traditional KD methods hold an underlying assumption that the data collected in both human domain and machine domain are both independent and identically distributed (IID). We point out that this naive assumption is unrealistic and there is indeed a transfer gap between the two domains. Although the gap offers the student model external knowledge from the machine domain, the imbalanced teacher knowledge would make us incorrectly estimate how much to transfer from teacher to student per sample on the non-IID transfer set. To tackle this challenge, we propose Inverse Probability Weighting Distillation (IPWD) that estimates the propensity score of a training sample belonging to the machine domain, and assigns its inverse amount to compensate for under-represented samples. Experiments on CIFAR-100 and ImageNet demonstrate the effectiveness of IPWD for both two-stage distillation and one-stage self-distillation.


title: Expander graphs are globally synchronizing

abstract: The Kuramoto model is fundamental to the study of synchronization. It consists of a collection of oscillators with interactions given by a network, which we identify respectively with vertices and edges of a graph. In this paper, we show that a graph with sufficient expansion must be globally synchronizing, meaning that a homogeneous Kuramoto model of identical oscillators on such a graph will converge to the fully synchronized state with all the oscillators having the same phase, for every initial state up to a set of measure zero. In particular, we show that for any $\varepsilon > 0$ and $p \geq (1 + \varepsilon) (\log n) / n$, the homogeneous Kuramoto model on the Erd\H{o}s-R\'enyi random graph $G(n, p)$ is globally synchronizing with probability tending to one as $n$ goes to infinity. This improves on a previous result of Kassabov, Strogatz, and Townsend and solves a conjecture of Ling, Xu, and Bandeira. We also show that the model is globally synchronizing on any $d$-regular Ramanujan graph, and on typical $d$-regular graphs, for large enough degree $d$.


title: Clustering-based Tile Embedding (CTE): A General Representation for Level Design with Skewed Tile Distributions

abstract: There has been significant research interest in Procedural Level Generation via Machine Learning (PLGML), applying ML techniques to automated level generation. One recent trend is in the direction of learning representations for level design via embeddings, such as tile embeddings. Tile Embeddings are continuous vector representations of game levels unifying their visual, contextual and behavioural information. However, the original tile embedding struggled to generate levels with skewed tile distributions. For instance, Super Mario Bros. (SMB) wherein a majority of tiles represent the background. To remedy this, we present a modified tile embedding representation referred to as Clustering-based Tile Embedding (CTE). Further, we employ clustering to discretize the continuous CTE representation and present a novel two-step level generation to leverage both these representations. We evaluate the performance of our approach in generating levels for seen and unseen games with skewed tile distributions and outperform the original tile embeddings.


title: A genuine test for hyperuniformity

abstract: We devise the first rigorous significance test for hyperuniformity with sensitive results, even for a single sample. Our starting point is a detailed study of the empirical Fourier transform of a stationary point process on $\mathbb{R}^d$. For large system sizes, we derive the asymptotic covariances and prove a multivariate central limit theorem (CLT). The scattering intensity is then used as the standard estimator of the structure factor. The above CLT holds for a preferably large class of point processes, and whenever this is the case, the scattering intensity satisfies a multivariate limit theorem as well. Hence, we can use the likelihood ratio principle to test for hyperuniformity. Remarkably, the asymptotic distribution of the resulting test statistic is universal under the null hypothesis of hyperuniformity. We obtain its explicit form from simulations with very high accuracy. The novel test precisely keeps a nominal significance level for hyperuniform models, and it rejects non-hyperuniform examples with high power even in borderline cases. Moreover, it does so given only a single sample with a practically relevant system size.

categories: math.ST cond-mat.dis-nn cond-mat.soft math.PR stat.TH


title: O-type Stars Stellar Parameter Estimation Using Recurrent Neural Networks

abstract: In this paper, we present a deep learning system approach to estimating luminosity, effective temperature, and surface gravity of O-type stars using the optical region of the stellar spectra. In previous work, we compare a set of machine learning and deep learning algorithms in order to establish a reliable way to fit a stellar model using two methods: the classification of the stellar spectra models and the estimation of the physical parameters in a regression-type task. Here we present the process to estimate individual physical parameters from an artificial neural network perspective with the capacity to handle stellar spectra with a low signal-to-noise ratio (S/N), in the $<$20 S/N boundaries. The development of three different recurrent neural network systems, the training process using stellar spectra models, the test over nine different observed stellar spectra, and the comparison with estimations in previous works are presented. Additionally, characterization methods for stellar spectra in order to reduce the dimensionality of the input data for the system and optimize the computational resources are discussed.


title: Primary disks and their observational appearance in collapsing magnetic rotating protostellar clouds

abstract: The collapse of the magnetic rotating protostellar cloud with mass of $10\,M_{\odot}$ is numerically studied. The initial ratios of the thermal, magnetic, and rotational energies of the cloud to the modulus of its gravitational energy are 0.3, 0.2 and 0.01, respectively. The emphasis is on the evolution and properties of the quasi-magnetostatic primary disk formed at the isothermal stage of the collapse. Simulations show that the primary disk size and mass increase during evolution from $1500$ au to $7400$ au and from $0.3\,M_{\odot}$ to $5.2\,M_{\odot}$, respectively. Magnetic field is quasi-radial in the cloud envelope and quasi-uniform within the primary disk. A toroidal magnetic field is generated behind the front of the fast shock MHD wave propagating from the primary disk boundary and in the region of the outflow formed near the first hydrostatic core. The hierarchical structure of collapsing protostellar clouds can be revealed in observations in terms of the magnetic field geometry and the angular momentum distribution.


title: The Geometry of Rings of Components of Hurwitz Spaces

abstract: We study a variant of the ring of components of Hurwitz moduli spaces for covers, introduced by Ellenberg, Venkatesh and Westerland in 2016 in their proof of the Cohen-Lenstra conjecture for function fields. For $G$-covers of the projective line, we show that the ring of components is a commutative algebra of finite type. We therefore study it using tools from algebraic geometry. We obtain a description of the spectrum, relating its geometry to group-theoretical properties and combinatorial aspects of Galois covers. When $G$ is a symmetric group, we are able to fully describe the geometric points of the spectrum.


title: Variable population manipulations of reallocation rules in economies with single-peaked preferences

abstract: In a one-commodity economy with single-peaked preferences and individual endowments, we study different ways in which reallocation rules can be strategically distorted by affecting the set of active agents. We introduce and characterize the family of monotonic reallocation rules and show that each rule in this class is withdrawal-proof and endowments-merging-proof, at least one is endowments-splitting-proof and that no such rule is pre-delivery-proof.


title: Realistic Data Augmentation Framework for Enhancing Tabular Reasoning

abstract: Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully automatic methods. However, the former is expensive and time-consuming and thus limits scale, and the latter often produces naive examples that may lack complex reasoning. This paper develops a realistic semi-automated framework for data augmentation for tabular inference. Instead of manually generating a hypothesis for each table, our methodology generates hypothesis templates transferable to similar tables. In addition, our framework entails the creation of rational counterfactual tables based on human written logical constraints and premise paraphrasing. For our case study, we use the InfoTabs, which is an entity-centric tabular inference dataset. We observed that our framework could generate human-like tabular inference examples, which could benefit training data augmentation, especially in the scenario with limited supervision.


title: Admissible Causal Structures and Correlations

abstract: It is well-known that if one assumes quantum theory to hold locally, then processes with indefinite causal order and cyclic causal structures become feasible. Here, we study qualitative limitations on causal structures and correlations imposed by local quantum theory. For one, we find a necessary graph theoretic criterion--the "siblings-on-cycles" property--for a causal structure to be admissible: Only such causal structures admit a realization consistent with local quantum theory. We conjecture that this property is moreover sufficient. This conjecture is motivated by an explicit construction of quantum causal models, and supported by numerical calculations. We show that these causal models, in a restricted setting, are indeed consistent. For another, we identify two sets of causal structures that, in the classical-deterministic case, give rise to causal and non-causal correlations respectively.


title: Spectra of CO2-Rg2 and CO2-Rg-He trimers (Rg = Ne, Ar, Kr, and Xe): intermolecular CO2 rock, vibrational shifts and three-body effects

abstract: Weakly-bound CO2-Rg2 trimers are studied by high resolution (0.002 cm-1) infrared spectroscopy in the region of the CO2 nu3 fundamental band (~2350 cm-1), using a tunable OPO to probe a pulsed supersonic slit jet expansion with an effective rotational temperature of about 2 K. CO2-Ar2 spectra have been reported previously, but are extended here to include Rg = Ne, Kr, and Xe as well as new combination and hot bands. For Kr and Xe, a unified scaled parameter scheme is used to account for the many possible isotopic species. Vibrational shifts of CO2-Rg2 trimers are compared to those of CO2-Rg dimers, and in all cases the trimer shifts are slightly more positive (blue-shifted) than expected on the basis of linear extrapolation from the dimer. Combination bands directly measure an intermolecular vibrational mode (the CO2 rock), and gives values of about 32.2, 33.8, and 34.7 cm-1 for CO2-Ar2, -Kr2, and -Xe2. Structural parameters derived for CO2-Rg2 trimers are compared with those of CO2-Rg and Rg2 dimers. Spectra of the mixed trimers CO2-Rg-He are also reported.


title: MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences

abstract: Existing multimodal tasks mostly target at the complete input modality setting, i.e., each modality is either complete or completely missing in both training and test sets. However, the randomly missing situations have still been underexplored. In this paper, we present a novel approach named MM-Align to address the missing-modality inference problem. Concretely, we propose 1) an alignment dynamics learning module based on the theory of optimal transport (OT) for indirect missing data imputation; 2) a denoising training algorithm to simultaneously enhance the imputation results and backbone network performance. Compared with previous methods which devote to reconstructing the missing inputs, MM-Align learns to capture and imitate the alignment dynamics between modality sequences. Results of comprehensive experiments on three datasets covering two multimodal tasks empirically demonstrate that our method can perform more accurate and faster inference and relieve overfitting under various missing conditions.


title: Crystal growth, characterization and electronic band structure of TiSeS

abstract: Layered semimetallic van der Waals materials TiSe2 has attracted a lot of attention because of interplay of a charge density wave (CDW) state and superconductivity. Its sister compound TiS2, being isovalent to TiSe2 and having the same crystal structure, shows a semiconducting behavior. The natural rises what happens at the transition point in TiSe2-xSx, which is expected for x close to 1. Here we report the growth and characterization of TiSeS single crystals and the study of the electronic structure using density functional theory (DFT) and angle-resolved photoemission (ARPES). We show that TiSeS single crystals have the same morphology as TiSe2. Transport measurements reveal a metallic state, no evidence of CDW was found. DFT calculations suggest that the electronic band structure in TiSeS is similar to that of TiSe2, but the electron and hole pockets in TiSeS are much smaller. The ARPES results are in good agreement with the calculations.


title: Effective observables for electromagnetic duality from novel amplitude decomposition

abstract: We introduce a decomposition of D-dimensional vector amplitudes in terms of building blocks that preserve all partial amplitude relations of the parent gauge-theory. Using this decomposition, we derive a new set of amplitude relations between nonlinear sigma model pions and the pure-scalar sector of Yang-Mills-scalar theory. These new relations indicate an equivalence between Born-Infeld duality invariance and that of Einstein-Maxwell theory, considering their known double-copy construction from the two scalar theories with Yang Mills. This observation motivates a general framework for constructing duality-invariant effective field theory observables at any multiplicity using the building blocks in our amplitude decomposition. Finally, we conjecture a subtle relationship between these duality-invariant building blocks and the bosonic sector of N=4 super Yang-Mills.


title: Minimum length (scale) in Quantum Field Theory, Generalized Uncertainty Principle and the non-renormalisability of gravity

abstract: The notions of minimum geometrical length and minimum length scale are discussed with reference to correlation functions obtained from in-in and in-out amplitudes in quantum field theory. Whereas the in-in propagator for metric perturbations does not admit the former, the in-out Feynman propagator shows the emergence of the latter. A connection between the Feynman propagator of quantum field theories of gravity and the deformation parameter $\delta_0$ of the generalised uncertainty principle (GUP) is then exhibited, which allows to determine an exact expression for $\delta_0$ in terms of the residues of the causal propagator. A correspondence between the non-renormalisability of (some) theories (of gravity) and the existence of a minimum length scale is then conjectured to support the idea that non-renormalisable theories are self-complete and finite. The role played by the sign of the deformation parameter is further discussed by considering an implementation of the GUP on the lattice.


title: Translation Word-Level Auto-Completion: What can we achieve out of the box?

abstract: Research on Machine Translation (MT) has achieved important breakthroughs in several areas. While there is much more to be done in order to build on this success, we believe that the language industry needs better ways to take full advantage of current achievements. Due to a combination of factors, including time, resources, and skills, businesses tend to apply pragmatism into their AI workflows. Hence, they concentrate more on outcomes, e.g. delivery, shipping, releases, and features, and adopt high-level working production solutions, where possible. Among the features thought to be helpful for translators are sentence-level and word-level translation auto-suggestion and auto-completion. Suggesting alternatives can inspire translators and limit their need to refer to external resources, which hopefully boosts their productivity. This work describes our submissions to WMT's shared task on word-level auto-completion, for the Chinese-to-English, English-to-Chinese, German-to-English, and English-to-German language directions. We investigate the possibility of using pre-trained models and out-of-the-box features from available libraries. We employ random sampling to generate diverse alternatives, which reveals good results. Furthermore, we introduce our open-source API, based on CTranslate2, to serve translations, auto-suggestions, and auto-completions.


title: LQGNet: Hybrid Model-Based and Data-Driven Linear Quadratic Stochastic Control

abstract: Stochastic control deals with finding an optimal control signal for a dynamical system in a setting with uncertainty, playing a key role in numerous applications. The linear quadratic Gaussian (LQG) is a widely-used setting, where the system dynamics is represented as a linear Gaussian statespace (SS) model, and the objective function is quadratic. For this setting, the optimal controller is obtained in closed form by the separation principle. However, in practice, the underlying system dynamics often cannot be faithfully captured by a fully known linear Gaussian SS model, limiting its performance. Here, we present LQGNet, a stochastic controller that leverages data to operate under partially known dynamics. LQGNet augments the state tracking module of separation-based control with a dedicated trainable algorithm. The resulting system preserves the operation of classic LQG control while learning to cope with partially known SS models without having to fully identify the dynamics. We empirically show that LQGNet outperforms classic stochastic control by overcoming mismatched SS models.


title: Search for spatial coincidence between IceCube neutrinos and radio pulsars

abstract: We search for a spatial association between radio pulsars and ultra-high energy neutrinos using the publicly available IceCube point source neutrino events catalog. For this purpose we use the unbinned maximum likelihood method to search for a statistically significant excess from each of the pulsars in the ATNF catalog. We do not find any pulsars with detection significance much higher than that expected from a Gaussian distribution, Therefore, we conclude that none of the currently known pulsars contribute to the diffuse neutrino flux detected by IceCube.


title: Optimal Design of Volt/VAR Control Rules for Inverter-Interfaced Distributed Energy Resources

abstract: The IEEE 1547 Standard for the interconnection of distributed energy resources (DERs) to distribution grids provisions that smart inverters could be implementing Volt/VAR control rules among other options. Such rules enable DERs to respond autonomously in response to time-varying grid loading conditions. The rules comprise affine droop control augmented with a deadband and saturation regions. Nonetheless, selecting the shape of these rules is not an obvious task, and the default options may not be optimal or dynamically stable. To this end, this work develops a novel methodology for customizing Volt/VAR rules on a per-bus basis for a single-phase feeder. The rules are adjusted by the utility every few hours depending on anticipated demand and solar scenarios. Using a projected gradient descent-based algorithm, rules are designed to improve the feeder's voltage profile, comply with IEEE 1547 constraints, and guarantee stability of the underlying nonlinear grid dynamics. The stability region is inner approximated by a polytope and the rules are judiciously parameterized so their feasible set is convex. Numerical tests using real-world data on the IEEE 141-bus feeder corroborate the scalability of the methodology and its explore the trade-offs of Volt/VAR control with alternatives.


title: Active Exploration for Robotic Manipulation

abstract: Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when there is continuous contact between the objects being manipulated. This paper proposes a model-based active exploration approach that enables efficient learning in sparse-reward robotic manipulation tasks. The proposed method estimates an information gain objective using an ensemble of probabilistic models and deploys model predictive control (MPC) to plan actions online that maximize the expected reward while also performing directed exploration. We evaluate our proposed algorithm in simulation and on a real robot, trained from scratch with our method, on a challenging ball pushing task on tilted tables, where the target ball position is not known to the agent a-priori. Our real-world robot experiment serves as a fundamental application of active exploration in model-based reinforcement learning of complex robotic manipulation tasks.


title: HKF: Hierarchical Kalman Filtering with Online Learned Evolution Priors for Adaptive ECG Denoising

abstract: Electrocardiography (ECG) signals play a pivotal role in many healthcare applications, especially in at-home monitoring of vital signs. Wearable technologies, which these applications often depend upon, frequently produce low-quality ECG signals. While several methods exist for ECG denoising to enhance signal quality and aid clinical interpretation, they often underperform with ECG data from wearable technology due to limited noise tolerance or inadequate flexibility in capturing ECG dynamics. This paper introduces HKF, a hierarchical and adaptive Kalman filter, which uses a proprietary state space model to effectively capture both intra- and inter-heartbeat dynamics for ECG signal denoising. HKF learns a patient-specific structured prior for the ECG signal's intra-heartbeat dynamics in an online manner, resulting in a filter that adapts to the specific ECG signal characteristics of each patient. In an empirical study, HKF demonstrated superior denoising performance (reduced mean-squared error) while preserving the unique properties of the waveform. In a comparative analysis, HKF outperformed previously proposed methods for ECG denoising, such as the model-based Kalman filter and data-driven autoencoders. This makes it a suitable candidate for applications in extramural healthcare settings.


title: Flow-Level Packet Loss Detection via Sketch Decomposition and Matrix Optimization

abstract: For cloud service providers, fine-grained packet loss detection across data centers is crucial in improving their service level and increasing business income. However, the inability to obtain sufficient measurements makes it difficult owing to the fundamental limit that the wide-area network links responsible for communication are not under their management. Moreover, millisecond-level delay jitter and clock synchronization errors in the WAN disable many tools that perform well in data center networks on this issue. Therefore, there is an urgent need to develop a new tool or method. In this work, we propose SketchDecomp, a novel loss detection method, from a mathematical perspective that has never been considered before. Its key is to decompose sketches upstream and downstream into several sub-sketches and builds a low-rank matrix optimization model to solve them. Extensive experiments on the test bed demonstrate its superiority.


title: Data Augmentation for Automated Essay Scoring using Transformer Models

abstract: Automated essay scoring is one of the most important problem in Natural Language Processing. It has been explored for a number of years, and it remains partially solved. In addition to its economic and educational usefulness, it presents research problems. Transfer learning has proved to be beneficial in NLP. Data augmentation techniques have also helped build state-of-the-art models for automated essay scoring. Many works in the past have attempted to solve this problem by using RNNs, LSTMs, etc. This work examines the transformer models like BERT, RoBERTa, etc. We empirically demonstrate the effectiveness of transformer models and data augmentation for automated essay grading across many topics using a single model.


title: Code4Struct: Code Generation for Few-Shot Event Structure Prediction

abstract: Large Language Model (LLM) trained on a mixture of text and code has demonstrated impressive capability in translating natural language (NL) into structured code. We observe that semantic structures can be conveniently translated into code and propose Code4Struct to leverage such text-to-structure translation capability to tackle structured prediction tasks. As a case study, we formulate Event Argument Extraction (EAE) as converting text into event-argument structures that can be represented as a class object using code. This alignment between structures and code enables us to take advantage of Programming Language (PL) features such as inheritance and type annotation to introduce external knowledge or add constraints. We show that, with sufficient in-context examples, formulating EAE as a code generation problem is advantageous over using variants of text-based prompts. Despite only using 20 training event instances for each event type, Code4Struct is comparable to supervised models trained on 4,202 instances and outperforms current state-of-the-art (SOTA) trained on 20-shot data by 29.5% absolute F1. Code4Struct can use 10-shot training data from a sibling event type to predict arguments for zero-resource event types and outperforms the zero-shot baseline by 12% absolute F1.


title: Unsupervised particle sorting for cryo-EM using probabilistic PCA

abstract: Single-particle cryo-electron microscopy (cryo-EM) is a leading technology to resolve the structure of molecules. Early in the process, the user detects potential particle images in the raw data. Typically, there are many false detections as a result of high levels of noise and contamination. Currently, removing the false detections requires human intervention to sort the hundred thousands of images. We propose a statistically-established unsupervised algorithm to remove non-particle images. We model the particle images as a union of low-dimensional subspaces, assuming non-particle images are arbitrarily scattered in the high-dimensional space. The algorithm is based on an extension of the probabilistic PCA framework to robustly learn a non-linear model of union of subspaces. This provides a flexible model for cryo-EM data, and allows to automatically remove images that correspond to pure noise and contamination. Numerical experiments corroborate the effectiveness of the sorting algorithm.


title: Symmetric (Optimistic) Natural Policy Gradient for Multi-agent Learning with Parameter Convergence

abstract: Multi-agent interactions are increasingly important in the context of reinforcement learning, and the theoretical foundations of policy gradient methods have attracted surging research interest. We investigate the global convergence of natural policy gradient (NPG) algorithms in multi-agent learning. We first show that vanilla NPG may not have parameter convergence, i.e., the convergence of the vector that parameterizes the policy, even when the costs are regularized (which enabled strong convergence guarantees in the policy space in the literature). This non-convergence of parameters leads to stability issues in learning, which becomes especially relevant in the function approximation setting, where we can only operate on low-dimensional parameters, instead of the high-dimensional policy. We then propose variants of the NPG algorithm, for several standard multi-agent learning scenarios: two-player zero-sum matrix and Markov games, and multi-player monotone games, with global last-iterate parameter convergence guarantees. We also generalize the results to certain function approximation settings. Note that in our algorithms, the agents take symmetric roles. Our results might also be of independent interest for solving nonconvex-nonconcave minimax optimization problems with certain structures. Simulations are also provided to corroborate our theoretical findings.


title: TAPE: Assessing Few-shot Russian Language Understanding

abstract: Recent advances in zero-shot and few-shot learning have shown promise for a scope of research and practical purposes. However, this fast-growing area lacks standardized evaluation suites for non-English languages, hindering progress outside the Anglo-centric paradigm. To address this line of research, we propose TAPE (Text Attack and Perturbation Evaluation), a novel benchmark that includes six more complex NLU tasks for Russian, covering multi-hop reasoning, ethical concepts, logic and commonsense knowledge. The TAPE's design focuses on systematic zero-shot and few-shot NLU evaluation: (i) linguistic-oriented adversarial attacks and perturbations for analyzing robustness, and (ii) subpopulations for nuanced interpretation. The detailed analysis of testing the autoregressive baselines indicates that simple spelling-based perturbations affect the performance the most, while paraphrasing the input has a more negligible effect. At the same time, the results demonstrate a significant gap between the neural and human baselines for most tasks. We publicly release TAPE (tape-benchmark.com) to foster research on robust LMs that can generalize to new tasks when little to no supervision is available.


title: RuCoLA: Russian Corpus of Linguistic Acceptability

abstract: Linguistic acceptability (LA) attracts the attention of the research community due to its many uses, such as testing the grammatical knowledge of language models and filtering implausible texts with acceptability classifiers. However, the application scope of LA in languages other than English is limited due to the lack of high-quality resources. To this end, we introduce the Russian Corpus of Linguistic Acceptability (RuCoLA), built from the ground up under the well-established binary LA approach. RuCoLA consists of $9.8$k in-domain sentences from linguistic publications and $3.6$k out-of-domain sentences produced by generative models. The out-of-domain set is created to facilitate the practical use of acceptability for improving language generation. Our paper describes the data collection protocol and presents a fine-grained analysis of acceptability classification experiments with a range of baseline approaches. In particular, we demonstrate that the most widely used language models still fall behind humans by a large margin, especially when detecting morphological and semantic errors. We release RuCoLA, the code of experiments, and a public leaderboard (rucola-benchmark.com) to assess the linguistic competence of language models for Russian.


title: Dwarf galaxy formation with and without dark matter-baryon streaming velocities

abstract: We study how supersonic streaming velocities of baryons relative to dark matter -- a large-scale effect imprinted at recombination and coherent over $\sim 3$ Mpc scales -- affects the formation of dwarf galaxies at $z \gtrsim 5$. We perform cosmological hydrodynamic simulations, including and excluding streaming velocities, in regions centered on halos with $M_{\rm vir}(z=0) \approx 10^{10}$ M$_{\odot}$; the simulations are part of the Feedback In Realistic Environments (FIRE) project and run with FIRE-3 physics. Our simulations comprise many thousands of systems with halo masses between $M_{\rm vir} = 2\times10^{5}$ M$_{\odot}$ and $2\times10^9$ M$_{\odot}$ in the redshift range $z=20-5$. A few hundred of these galaxies form stars and have stellar masses ranging from 100 to $10^7$ M$_{\odot}$. While star formation is globally delayed by approximately 50 Myr in the streaming relative to non-streaming simulations and the number of luminous galaxies is correspondingly suppressed at high redshift in the streaming runs, these effects decay with time. By $z=5$, the properties of the simulated galaxies are nearly identical in the streaming versus non-streaming runs, indicating that any effects of streaming velocities on the properties of galaxies at the mass scale of classical dwarfs and larger do not persist to $z=0$.


title: Simple Alternating Minimization Provably Solves Complete Dictionary Learning

abstract: This paper focuses on complete dictionary learning problem, where the goal is to reparametrize a set of given signals as linear combinations of atoms from a learned dictionary. There are two main challenges faced by theoretical and practical studies of dictionary learning: the lack of theoretical guarantees for practically-used heuristic algorithms, and their poor scalability when dealing with huge-scale datasets. Towards addressing these issues, we show that when the dictionary to be learned is orthogonal, that an alternating minimization method directly applied to the nonconvex and discrete formulation of the problem exactly recovers the ground truth. For the huge-scale, potentially online setting, we propose a minibatch version of our algorithm, which can provably learn a complete dictionary from a huge-scale dataset with minimal sample complexity, linear sparsity level, and linear convergence rate, thereby negating the need for any convex relaxation for the problem. Our numerical experiments showcase the superiority of our method compared with the existing techniques when applied to tasks on real data.


title: The Point-Boundary Art Gallery Problem is $\exists\mathbb{R}$-hard

abstract: We resolve the complexity of the point-boundary variant of the art gallery problem, showing that it is $\exists\mathbb{R}$-complete, meaning that it is equivalent under polynomial time reductions to deciding whether a system of polynomial equations has a real solution. Introduced by Victor Klee in 1973, the art gallery problem concerns finding configurations of \emph{guards} which together can see every point inside of an \emph{art gallery} shaped like a polygon. The original version of this problem has previously been shown to $\exists\mathbb{R}$-hard, but until now the complexity of the variant where guards only need to guard the walls of the art gallery was an open problem. Our results can also be used to provide a simpler proof of the $\exists\mathbb{R}$-hardness of the point-point art gallery problem. In particular, we show how the algebraic constraints describing a polynomial system of equations can occur somewhat naturally in an art gallery setting.


title: Pushing the Efficiency Limit Using Structured Sparse Convolutions

abstract: Weight pruning is among the most popular approaches for compressing deep convolutional neural networks. Recent work suggests that in a randomly initialized deep neural network, there exist sparse subnetworks that achieve performance comparable to the original network. Unfortunately, finding these subnetworks involves iterative stages of training and pruning, which can be computationally expensive. We propose Structured Sparse Convolution (SSC), which leverages the inherent structure in images to reduce the parameters in the convolutional filter. This leads to improved efficiency of convolutional architectures compared to existing methods that perform pruning at initialization. We show that SSC is a generalization of commonly used layers (depthwise, groupwise and pointwise convolution) in ``efficient architectures.'' Extensive experiments on well-known CNN models and datasets show the effectiveness of the proposed method. Architectures based on SSC achieve state-of-the-art performance compared to baselines on CIFAR-10, CIFAR-100, Tiny-ImageNet, and ImageNet classification benchmarks.


title: Two-gap superconductivity and decisive role of rare-earth $d$ electrons in infinite-layer nickelates

abstract: The discovery of superconductivity in infinite-layer nickelates, with transition temperature ($T_c$) up to 23 K, provides an exciting new avenue to study correlated electrons and emergent phases. Superconductivity in the nickelates has been mostly perceived to be unconventional and originated from the Ni $d$-electrons due to its analog to cuprate superconductors. The conventional mechanism for superconductivity - phonon-mediated pairing - was presumably ruled out because density functional theory (DFT) calculations reported a very weak electron-phonon coupling in the nickelates. Here, by including electron self-energy effects on the electronic structure and electron-phonon coupling (with $\textit{ab initio}$ $GW$ calculations), we discover that infinite-layer Nd$_{0.8}$Sr$_{0.2}$NiO$_2$ is a dominantly two-gap phonon-mediated superconductor. We show electron correlations alter the character of its multi-band Fermi surface and also strongly enhance the electron-phonon coupling, leading to a large $T_c$ in agreement with experiment. The computed electron-phonon coupling constant $\lambda$ is enhanced by an unprecedented factor of 5.5 as compared to DFT. Solutions of the anisotropic Eliashberg equations yield two dominant $s$-wave gaps - a large gap on states of rare-earth Nd $d$-electron and interstitial orbital characters but a small gap on those of transition-metal Ni $d$-electron character. The superconducting quasiparticle density of states prominently reflects the two-gap nature and explains well tunneling experiments. Our results demonstrate that the phonon mechanism accounts for superconductivity in the nickelates, revealing an unforeseen two-gap $s$-wave nature as well as providing new insights to demystify the similarities and distinctions between the nickelate and cuprate superconductors.


title: An Interpretable Deep Semantic Segmentation Method for Earth Observation

abstract: Earth observation is fundamental for a range of human activities including flood response as it offers vital information to decision makers. Semantic segmentation plays a key role in mapping the raw hyper-spectral data coming from the satellites into a human understandable form assigning class labels to each pixel. In this paper, we introduce a prototype-based interpretable deep semantic segmentation (IDSS) method, which is highly accurate as well as interpretable. Its parameters are in orders of magnitude less than the number of parameters used by deep networks such as U-Net and are clearly interpretable by humans. The proposed here IDSS offers a transparent structure that allows users to inspect and audit the algorithm's decision. Results have demonstrated that IDSS could surpass other algorithms, including U-Net, in terms of IoU (Intersection over Union) total water and Recall total water. We used WorldFloods data set for our experiments and plan to use the semantic segmentation results combined with masks for permanent water to detect flood events.


title: Incidence matrices for the class $\mathcal{O}_6$ of lines external to the twisted cubic in $\mathrm{PG}(3,q)$

abstract: We consider the structures of the plane-line and point-line incidence matrices of the projective space $\mathrm{PG}(3,q)$ connected with orbits of planes, points, and lines under the stabilizer group of the twisted cubic. In the literature, lines are partitioned into classes, each of which is a union of line orbits. In this paper, for all $q$, even and odd, we determine the incidence matrices connected with a family of orbits of the class named $\mathcal{O}_6$. This class contains lines external to the twisted cubic. The considered family include an essential part of all $\mathcal{O}_6$ orbits, whose complete classification is an open problem.


title: The Chromatic Fourier Transform

abstract: We develop a general theory of higher semiadditive Fourier transforms that includes both the classical discrete Fourier transform for finite abelian groups at height $n=0$, as well as a certain duality for the $E_n$-(co)homology of $\pi$-finite spectra, established by Hopkins and Lurie, at heights $n\ge 1$. We use this theory to generalize said duality in three different directions. First, we extend it from $\mathbb{Z}$-module spectra to all (suitably finite) spectra and use it to compute the discrepancy spectrum of $E_n$. Second, we lift it to the telescopic setting by replacing $E_n$ with $T(n)$-local higher cyclotomic extensions, from which we deduce various results on affineness, Eilenberg--Moore formulas and Galois extensions in the telescopic setting. Third, we categorify their result into an equivalence of two symmetric monoidal $\infty$-categories of local systems of $K(n)$-local $E_n$-modules, and relate it to (semiadditive) redshift phenomena.


title: Enumeration of left braces with additive group $C_4 \times C_4 \times C_4$

abstract: We show that the number of isomorphism classes of left braces of order 64 with additive group isomorphic to $C_4 \times C_4 \times C_4$ is 1\,515\,429.


title: Class number for pseudo-Anosovs

abstract: Given two automorphisms of a group $G$, one is interested in knowing whether they are conjugate in the automorphism group of $G$, or in the abstract commensurator of $G$, and how these two properties may differ. When $G$ is the fundamental group of a closed orientable surface, we present a uniform finiteness theorem for the class of pseudo-Anosov automorphisms. We present an explicit example of a commensurably conjugate pair of pseudo-Anosov automorphisms of a genus $3$ surface, that are not conjugate in the Mapping Class Group, and we also show that infinitely many independent automorphisms of hyperbolic orbifolds have class number equal to one. In the appendix, we briefly survey the Latimer-MacDuffee theorem that addresses the case of automorphisms of $\mathbb{Z}^n$, with a point of view that is suited to an analogy with surface group automorphisms.


title: Patient-Specific Heart Model Towards Atrial Fibrillation

abstract: Atrial fibrillation is a heart rhythm disorder that affects tens of millions people worldwide. The most effective treatment is catheter ablation. This involves irreversible heating of abnormal cardiac tissue facilitated by electroanatomical mapping. However, it is difficult to consistently identify the triggers and sources that may initiate or perpetuate atrial fibrillation due to its chaotic behavior. We developed a patient-specific computational heart model that can accurately reproduce the activation patterns to help in localizing these triggers and sources. Our model has high spatial resolution, with whole-atrium temporal synchronous activity, and has patient-specific accurate electrophysiological activation patterns. A total of 15 patients data were processed: 8 in sinus rhythm, 6 in atrial flutter and 1 in atrial tachycardia. For resolution, the average simulation geometry voxel is a cube of 2.47 mm length. For synchrony, the model takes in about 1,500 local electrogram recordings, optimally fits parameters to the individual's atrium geometry and then generates whole-atrium activation patterns. For accuracy, the average local activation time error is 5.47 ms for sinus rhythm, 10.97 ms for flutter and tachycardia; and the average correlation is 0.95 for sinus rhythm, 0.81 for flutter and tachycardia. This promising result demonstrates our model is an effective building block in capturing more complex rhythms such as atrial fibrillation to guide physicians for effective ablation therapy.


title: Towards Real-Time Text2Video via CLIP-Guided, Pixel-Level Optimization

abstract: We introduce an approach to generating videos based on a series of given language descriptions. Frames of the video are generated sequentially and optimized by guidance from the CLIP image-text encoder; iterating through language descriptions, weighting the current description higher than others. As opposed to optimizing through an image generator model itself, which tends to be computationally heavy, the proposed approach computes the CLIP loss directly at the pixel level, achieving general content at a speed suitable for near real-time systems. The approach can generate videos in up to 720p resolution, variable frame-rates, and arbitrary aspect ratios at a rate of 1-2 frames per second. Please visit our website to view videos and access our open-source code: https://pschaldenbrand.github.io/text2video/ .


title: Tripling of the scattering vector range of X-ray reflectivity on liquid surfaces using a double crystal deflector

abstract: We achieved a tripling of the maximum range of perpendicular momentum transfer (q_z) of X-ray scattering from liquid surfaces using a double crystal deflector setup to tilt the incident X-ray beam. This is obtained by using Miller indices of the reflecting crystal atomic planes that are three times higher than usual. We calculate the deviation from the exact Bragg angle condition induced by a misalignment between the X-ray beam axis and the main rotation axis of the double crystal deflector and deduce a fast and straightforward procedure to align them. We show measurements of X-ray reflectivity up to q_z=7A^(-1) on the bare surface of liquid copper and on graphene on liquid copper.


title: Towards Pragmatic Production Strategies for Natural Language Generation Tasks

abstract: This position paper proposes a conceptual framework for the design of Natural Language Generation (NLG) systems that follow efficient and effective production strategies in order to achieve complex communicative goals. In this general framework, efficiency is characterised as the parsimonious regulation of production and comprehension costs while effectiveness is measured with respect to task-oriented and contextually grounded communicative goals. We provide concrete suggestions for the estimation of goals, costs, and utility via modern statistical methods, demonstrating applications of our framework to the classic pragmatic task of visually grounded referential games and to abstractive text summarisation, two popular generation tasks with real-world applications. In sum, we advocate for the development of NLG systems that learn to make pragmatic production decisions from experience, by reasoning about goals, costs, and utility in a human-like way.


title: Numerical simulation of microscale acoustic streaming flow

abstract: The efficient mixing of fluid samples in miniaturized total analysis systems is essential for numerous applications including biological screening assays, chemical extraction, polymerization, cell analysis, and protein folding. Miniaturized microfluidic platforms have recently emerged for microscale fluid mixing with their capabilities of high-throughput sample processing and reduced sample depletion. However, microscale fluid mixing is inherently hampered due to the characteristics of a low Reynolds number flows in diminutive channels. Microscale fluid mixing mainly depends on molecular diffusion and thus requires long processing time. In order to address the conundrum, a variety of active microfluidic approaches for swift and efficient mixing have been developed using electro-kinetic flow, laser-induced flow, magnetic stirring, and acoustic streaming flow (ASF). Among these techniques with external force fields, acoustofluidic fluid mixing has been acclaimed due to its on-demand, controllable, non-invasive and biocompatible nature. In this study, we performed numerical simulations of acoustic streaming flows, induced by with a highly localized surface acoustic waves (SAWs), in a microscale fluidic channel based on an acoustic wave attenuation model


title: Exploring ultra-high-intensity wakefields in carbon nanotube arrays: an effective plasma-density approach

abstract: Charged particle acceleration using solid-state nanostructures has attracted attention in recent years as a method of achieving ultra-high-gradient acceleration in the TV/m domain. More concretely, metallic hollow nanostructures could be suitable for particle acceleration through the excitation of wakefields by a laser or a high-intensity charged particle beam in a high-density solid-state plasma. For instance, due to their special channelling properties as well as optoelectronic and thermo-mechanical properties, carbon nanotubes could be an excellent medium for this purpose. This article investigates the feasibility of generating ultra-high gradient acceleration using carbon nanotube arrays, modelled as solid-state plasmas in conventional particle-in-cell simulations performed in a two-dimensional axisymmetric quasi}-3D geometry. The generation of beam-driven plasma wakefields depending on different parameters of the solid structure is discussed in detail. Furthermore, by adopting an effective plasma-density approach, existing analytical expressions, originally derived for homogeneous plasmas, can be used to describe wakefields driven in periodic non-uniform plasmas.


title: Neutron Emission Spectrometer To Measure Ion Temperature On The Fusion Demonstration Plant

abstract: General Fusion is building the Fusion Demonstration Plant to demonstrate a magnetized target fusion scheme in which a deuterium plasma is heated from 200 eV to 10 keV by piston-driven compression of a liquid-lithium liner. The multilayer coaxial time-of-flight (MCTOF) neutron emission spectrometer is designed to measure the ion temperature near peak compression at which time the neutron yield will approach $10^{18}$ neutrons/s. The neutron energy distribution is expected to be Gaussian since the machine uses no neutral beam or radiofrequency heating. In this case, analysis shows that as few as 500 coincidence events should be sufficient to accurately measure the ion temperature. This enables a fast time resolution of 10 $\mu s$, which is required to track the rapid change in temperature approaching peak compression. We overcome the challenges of neutron pileup and event ambiguity with a compact design having two layers of segmented scintillators. The error in the ion temperature measurement is computed as a function of the neutron spectrometer's geometric parameters and used to optimize the design for the case of reaching 10 keV at peak compression.


title: Functional Bayesian Networks for Discovering Causality from Multivariate Functional Data

abstract: Multivariate functional data arise in a wide range of applications. One fundamental task is to understand the causal relationships among these functional objects of interest, which has not yet been fully explored. In this article, we develop a novel Bayesian network model for multivariate functional data where the conditional independence and causal structure are both encoded by a directed acyclic graph. Specifically, we allow the functional objects to deviate from Gaussian process, which is adopted by most existing functional data analysis models. The more reasonable non-Gaussian assumption is the key for unique causal structure identification even when the functions are measured with noises. A fully Bayesian framework is designed to infer the functional Bayesian network model with natural uncertainty quantification through posterior summaries. Simulation studies and real data examples are used to demonstrate the practical utility of the proposed model.


title: Position-controlled Telecom Single Photon Emitters Operating at Elevated Temperatures

abstract: Single photon emitters are a key component for enabling the practical use of quantum key distribution protocols for secure communications. For long-haul optical networks it is imperative to use photons at wavelengths that are compatible with standard single mode fibers: 1.31 {\mu}m and 1.55 {\mu}m. We demonstrate high purity single photon emission at 1.31 {\mu}m using deterministically positioned InP photonic waveguide nanowires containing single InAsP quantum dot-in-a-rod structures. At 4 K the detected count rate in fiber was 1.9 Mcps under above-band pulsed laser excitation at 80 MHz corresponding to a single photon collection efficiency at the first lens of 25%. At this count rate, the probability of multiphoton emission is g(2)(0) = 0.021. We have also evaluated the performance of the source as a function of temperature. Multiphoton emission probability increases with temperature with values of 0.11, 0.34 and 0.57 at 77 K, 220 K and 300 K, respectively, which is attributed to an overlap of temperature-broadened excitonic emission lines. These results are a promising step towards scalably fabricating telecom single photon emitters that operate under relaxed cooling requirements.


title: Cover Your Basis: Comprehensive Data-Driven Characterization of the Binary Black Hole Population

abstract: We introduce the first complete non-parametric model for the astrophysical distribution of the binary black hole (BBH) population. Constructed from basis splines, we use these models to conduct the most comprehensive data-driven investigation of the BBH population to date, simultaneously fitting non-parametric models for the BBH mass ratio, spin magnitude and misalignment, and redshift distributions. With GWTC-3, we report the same features previously recovered with similarly flexible models of the mass distribution, most notably the peaks in merger rates at primary masses of ${\sim}10\,M_\odot$ and ${\sim}35\,M_\odot$. Our model reports a suppressed merger rate at low primary masses and a mass ratio distribution consistent with a power law. We infer a distribution for primary spin misalignments that peaks away from alignment, supporting conclusions of recent work. We find broad agreement with the previous inferences of the spin magnitude distribution: the majority of BBH spins are small ($a<0.5$), the distribution peaks at $a\sim0.2$, and there is mild support for a non-spinning subpopulation, which may be resolved with larger catalogs. With a modulated power law describing the BBH merger rate's evolution in redshift, we see hints of the rate evolution either flattening or decreasing at $z\sim0.2-0.5$, but the full distribution remains entirely consistent with a monotonically increasing power law. We conclude with a discussion of the astrophysical context of our new findings and how non-parametric methods in gravitational-wave population inference are uniquely poised to complement to the parametric approach as we enter the data-rich era of gravitational-wave astronomy.


title: Total order compatible with addition on commutative semigroups

abstract: In the paper, we describe all total orders $\succ$ compatible with addition on additive subsemigroup $S$ of finite dimensional spaces over rational numbers. We provide a necessary and sufficient condition under which a finitely generated semigroups $S$ equipped with an order $\succ$ is a well-ordered set. We also present some auxiliary results on orders compatible with addition on additive subsemigroups of finite dimensional spaces over real numbers. All arguments in this paper are based on two simple theorems in the geometry of convex (not necessarily closed) sets. Proofs of these theorems are presented for readers' convenience. A first version of this paper was written as a handout for my graduate course on the theory of Newton--Okounkov bodies.


title: Ramsey partitions of metric spaces

abstract: We investigate the existence of metric spaces which, for any coloring with a fixed number of colors, contain monochromatic isomorphic copies of a fixed starting space K. In the main theorem we construct such a space of size \(2^{\aleph_0}\) for colorings with \(\aleph_0\) colors and any metric space \(K\) of size \(\aleph_0\). We also give a slightly weaker theorem for countable ultrametric \(K\) where, however, the resulting space has size~\(\aleph_1\).


title: Estimating Gaussian graphical models of multi-study data with Multi-Study Factor Analysis

abstract: Network models are powerful tools for gaining new insights from complex biological data. Most lines of investigation in biology involve comparing datasets in the setting where the same predictors are measured across multiple studies or conditions (multi-study data). Consequently, the development of statistical tools for network modeling of multi-study data is a highly active area of research. Multi-study factor analysis (MSFA) is a method for estimation of latent variables (factors) in multi-study data. In this work, we generalize MSFA by adding the capacity to estimate Gaussian graphical models (GGMs). Our new tool, MSFA-X, is a framework for latent variable-based graphical modeling of shared and study-specific signals in multi-study data. We demonstrate through simulation that MSFA-X can recover shared and study-specific GGMs and outperforms a graphical lasso benchmark. We apply MSFA-X to analyze maternal response to an oral glucose tolerance test in targeted metabolomic profiles from the Hyperglycemia and Adverse Pregnancy Outcomes (HAPO) Study, identifying network-level differences in glucose metabolism between women with and without gestational diabetes mellitus.


title: Partial Pontryagin duality for actions of quantum groups on C*-algebras

abstract: We compare actions on C*-algebras of two constructions of locally compact quantum groups, the bicrossed product and the double crossed product. We give a duality between them as a generalization of Baaj-Skandalis duality. In the case of quantum doubles, this duality also preserves monoidal structures given by twisted tensor products. We also discuss its consequences for equivariant Kasparov theories in relation to the quantum analogue of the Baum-Connes conjecture.


title: Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity

abstract: Bilevel optimization recently has received tremendous attention due to its great success in solving important machine learning problems like meta learning, reinforcement learning, and hyperparameter optimization. Extending single-agent training on bilevel problems to the decentralized setting is a natural generalization, and there has been a flurry of work studying decentralized bilevel optimization algorithms. However, it remains unknown how to design the distributed algorithm with sample complexity and convergence rate comparable to SGD for stochastic optimization, and at the same time without directly computing the exact Hessian or Jacobian matrices. In this paper we propose such an algorithm. More specifically, we propose a novel decentralized stochastic bilevel optimization (DSBO) algorithm that only requires first order stochastic oracle, Hessian-vector product and Jacobian-vector product oracle. The sample complexity of our algorithm matches the currently best known results for DSBO, and the advantage of our algorithm is that it does not require estimating the full Hessian and Jacobian matrices, thereby having improved per-iteration complexity.


title: Radical isogenies and modular curves

abstract: This article explores the connection between radical isogenies and modular curves. Radical isogenies are formulas designed for the computation of chains of isogenies of fixed small degree $N$, introduced by Castryck, Decru, and Vercauteren at Asiacrypt 2020. One significant advantage of radical isogeny formulas over other formulas with a similar purpose is that they eliminate the need to generate a point of order $N$ that generates the kernel of the isogeny. While radical isogeny formulas were originally developed using elliptic curves in Tate normal form, Onuki and Moriya have proposed radical isogeny formulas of degrees $3$ and $4$ on Montgomery curves and attempted to obtain a simpler form of radical isogenies using enhanced elliptic and modular curves. In this article, we translate the original setup of radical isogenies in Tate normal form into the language of modular curves. Additionally, we solve an open problem introduced by Onuki and Moriya regarding radical isogeny formulas on $X_0(N).$


title: A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayal

abstract: In this paper we present a Reinforcement Learning environment that leverages agent cooperation and communication, aimed at detection, learning and ultimately penalizing betrayal patterns that emerge in the behavior of self-interested agents. We provide a description of game rules, along with interesting cases of betrayal and trade-offs that arise. Preliminary experimental investigations illustrate a) betrayal emergence, b) deceptive agents outperforming honest baselines and b) betrayal detection based on classification of behavioral features, which surpasses probabilistic detection baselines. Finally, we propose approaches for penalizing betrayal, list directions for future work and suggest interesting extensions of the environment towards capturing and exploring increasingly complex patterns of social interactions.


title: Entropic exercises around the Kneser-Poulsen conjecture

abstract: We develop an information-theoretic approach to study the Kneser--Poulsen conjecture in discrete geometry. This leads us to a broad question regarding whether R\'enyi entropies of independent sums decrease when one of the summands is contracted by a $1$-Lipschitz map. We answer this question affirmatively in various cases.


title: Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification

abstract: Vision Transformer (ViT) has become one of the most popular neural architectures due to its great scalability, computational efficiency, and compelling performance in many vision tasks. However, ViT has shown inferior performance to Convolutional Neural Network (CNN) on medical tasks due to its data-hungry nature and the lack of annotated medical data. In this paper, we pre-train ViTs on 266,340 chest X-rays using Masked Autoencoders (MAE) which reconstruct missing pixels from a small part of each image. For comparison, CNNs are also pre-trained on the same 266,340 X-rays using advanced self-supervised methods (e.g., MoCo v2). The results show that our pre-trained ViT performs comparably (sometimes better) to the state-of-the-art CNN (DenseNet-121) for multi-label thorax disease classification. This performance is attributed to the strong recipes extracted from our empirical studies for pre-training and fine-tuning ViT. The pre-training recipe signifies that medical reconstruction requires a much smaller proportion of an image (10% vs. 25%) and a more moderate random resized crop range (0.5~1.0 vs. 0.2~1.0) compared with natural imaging. Furthermore, we remark that in-domain transfer learning is preferred whenever possible. The fine-tuning recipe discloses that layer-wise LR decay, RandAug magnitude, and DropPath rate are significant factors to consider. We hope that this study can direct future research on the application of Transformers to a larger variety of medical imaging tasks.


title: Assorted inequalities for pattern occurrences

abstract: In this note, we present several inequalities in the context of pattern containment, utilizing elementary applications of the Fortuin-Kasteleyn-Ginibre (FKG) inequality and Shearer's lemma.


title: Projective model structures on diffeological spaces and smooth sets and the smooth Oka principle

abstract: We prove that the category of diffeological spaces does not admit a model structure transferred via the smooth singular complex functor from simplicial sets, resolving in the negative a conjecture of Christensen and Wu. Embedding diffeological spaces into sheaves of sets (not necessarily concrete) on the site of smooth manifolds, we then prove the existence of a proper combinatorial model structure on such sheaves transferred via the smooth singular complex functor from simplicial sets. We show the resulting model category to be Quillen equivalent to the model category of simplicial sets. We then show that this model structure is cartesian, all smooth manifolds are cofibrant, and establish the existence of model structures on categories of algebras over operads. We use these results to establish analogous model structures on simplicial presheaves on smooth manifolds, as well as presheaves valued in left proper combinatorial model categories, and prove a generalization of the smooth Oka principle established in arXiv:1912.10544. We finish by establishing classification theorems for differential-geometric objects like closed differential forms, principal bundles with connection, and higher bundle gerbes with connection on arbitrary cofibrant diffeological spaces.


title: EUREKA: EUphemism Recognition Enhanced through Knn-based methods and Augmentation

abstract: We introduce EUREKA, an ensemble-based approach for performing automatic euphemism detection. We (1) identify and correct potentially mislabelled rows in the dataset, (2) curate an expanded corpus called EuphAug, (3) leverage model representations of Potentially Euphemistic Terms (PETs), and (4) explore using representations of semantically close sentences to aid in classification. Using our augmented dataset and kNN-based methods, EUREKA was able to achieve state-of-the-art results on the public leaderboard of the Euphemism Detection Shared Task, ranking first with a macro F1 score of 0.881. Our code is available at https://github.com/sedrickkeh/EUREKA.


title: The Mantis Network IV: A titanium cold-trap on the ultra-hot Jupiter WASP-121 b

abstract: Observations of WASP-121 b have suggested an under-abundance of titanium and titanium-oxide from its terminator region. In this study, we aim to determine whether this depletion is global by investigating the day-side emission spectrum. We analyse 8 epochs of high-resolution spectra obtained with ESPRESSO, targeting orbital phases when the day-side is in view. We use a cross-correlation method to search for various atoms, TiO and VO and compare to models. We constrain the velocities and phase-function of the emission signal using a Bayesian framework. We report significant detections of Ca I, V I, Cr I, Mn I, Fe I, Co I and Ni I, but not T i or TiO. Models containing Ti are unable to reproduce the data. The detected signals are consistent with the known orbital and systemic velocities and with peak emission originating from the sub-stellar point. We find that Ti is depleted from regions of the atmosphere where transmission and emission spectroscopy are sensitive. We interpret this as evidence for the night-side condensation of titanium, preventing it from being mixed back into the upper layers of the atmosphere elsewhere on the planet. Species with lower condensation temperatures are unaffected, implying sharp chemical transitions exist between ultra-hot Jupiters that have slight differences in temperature or dynamical properties. As TiO can act as a strong source of stratospheric heating, cold-trapping creates a coupling between the thermal structures on the day-side and night-side, and thus condensation chemistry needs to be included in global circulation models. Observed elemental abundances in hot Jupiters are not reliably representative of bulk abundances unless night-side condensation is accounted for or the planet is hot enough to avoid night-side cold-traps entirely. Planetary rotation may significantly lower the apparent orbital velocity of emission signals.


title: Lifting $Q$-commuting and $Q$-intertwining operators

abstract: There are several proofs of the classical commutant lifting and intertwining lifting theorems in the literature. In this article, we present analogous proofs to a few $Q$-commuting lifting and $Q$-intertwining lifting theorems. We provide several proofs and show explicit constructions of Ando-type dilations for a pair of $Q$-commuting contractions $(T_1,T_2)$ when $Q$ is a bounded operator. We establish a few connections of these results with graph theory.


title: Learning to Advise Humans in High-Stakes Settings

abstract: Expert decision-makers (DMs) in high-stakes AI-assisted decision-making (AIaDM) settings receive and reconcile recommendations from AI systems before making their final decisions. We identify distinct properties of these settings which are key to developing AIaDM models that effectively benefit team performance. First, DMs incur reconciliation costs from exerting decision-making resources (e.g., time and effort) when reconciling AI recommendations that contradict their own judgment. Second, DMs in AIaDM settings exhibit algorithm discretion behavior (ADB), i.e., an idiosyncratic tendency to imperfectly accept or reject algorithmic recommendations for any given decision task. The human's reconciliation costs and imperfect discretion behavior introduce the need to develop AI systems which (1) provide recommendations selectively, (2) leverage the human partner's ADB to maximize the team's decision accuracy while regularizing for reconciliation costs, and (3) are inherently interpretable. We refer to the task of developing AI to advise humans in AIaDM settings as learning to advise and we address this task by first introducing the AI-assisted Team (AIaT)-Learning Framework. We instantiate our framework to develop TeamRules (TR): an algorithm that produces rule-based models and recommendations for AIaDM settings. TR is optimized to selectively advise a human and to trade-off reconciliation costs and team accuracy for a given environment by leveraging the human partner's ADB. Evaluations on synthetic and real-world benchmark datasets with a variety of simulated human accuracy and discretion behaviors show that TR robustly improves the team's objective across settings over interpretable, rule-based alternatives.


title: Relatively geometric actions of K\"ahler groups on CAT(0) cube complexes

abstract: We prove that for $n\geq 2$, a non-uniform lattice in $\text{PU}(n,1)$ does not admit a relatively geometric action on a $\mathrm{CAT}(0)$ cube complex, in the sense of Einstein and Groves. As a consequence, if $\Gamma$ is a non-uniform lattice in a non-compact semisimple Lie group $G$ without compact factors that admits a relatively geometric action on a $\mathrm{CAT}(0)$ cube complex, then $G$ is commensurable with $\text{SO}(n,1)$. We also prove that if a K\"ahler group is hyperbolic relative to residually finite parabolic subgroups, and acts relatively geometrically on a $\mathrm{CAT}(0)$ cube complex, then it is virtually a surface group.


title: Lazy Incremental Search for Efficient Replanning with Bounded Suboptimality Guarantees

abstract: We present a lazy incremental search algorithm, Lifelong-GLS (L-GLS), along with its bounded suboptimal version, Bounded L-GLS (B-LGLS) that combine the search efficiency of incremental search algorithms with the evaluation efficiency of lazy search algorithms for fast replanning in problem domains where edge-evaluations are more expensive than vertex-expansions. The proposed algorithms generalize Lifelong Planning A* (LPA*) and its bounded suboptimal version, Truncated LPA* (TLPA*), within the Generalized Lazy Search (GLS) framework, so as to restrict expensive edge evaluations only to the current shortest subpath when the cost-to-come inconsistencies are propagated during repair. We also present dynamic versions of the L-GLS and B-LGLS algorithms, called Generalized D* (GD*) and Bounded Generalized D* (B-GD*), respectively, for efficient replanning with non-stationary queries, designed specifically for navigation of mobile robots. We prove that the proposed algorithms are complete and correct in finding a solution that is guaranteed not to exceed the optimal solution cost by a user-chosen factor. Our numerical and experimental results support the claim that the proposed integration of the incremental and lazy search frameworks can help find solutions faster compared to the regular incremental or regular lazy search algorithms when the underlying graph representation changes often.


title: 1st Place Solution of The Robust Vision Challenge 2022 Semantic Segmentation Track

abstract: This report describes the winning solution to the Robust Vision Challenge (RVC) semantic segmentation track at ECCV 2022. Our method adopts the FAN-B-Hybrid model as the encoder and uses SegFormer as the segmentation framework. The model is trained on a composite dataset consisting of images from 9 datasets (ADE20K, Cityscapes, Mapillary Vistas, ScanNet, VIPER, WildDash 2, IDD, BDD, and COCO) with a simple dataset balancing strategy. All the original labels are projected to a 256-class unified label space, and the model is trained using a cross-entropy loss. Without significant hyperparameter tuning or any specific loss weighting, our solution ranks the first place on all the testing semantic segmentation benchmarks from multiple domains (ADE20K, Cityscapes, Mapillary Vistas, ScanNet, VIPER, and WildDash 2). The proposed method can serve as a strong baseline for the multi-domain segmentation task and benefit future works. Code will be available at https://github.com/lambert-x/RVC_Segmentation.


title: Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Data

abstract: Recently, many deep-learning techniques have been applied to various weather-related prediction tasks, including precipitation nowcasting (i.e., predicting precipitation levels and locations in the near future). Most existing deep-learning-based approaches for precipitation nowcasting, however, consider only radar and/or satellite images as inputs, and meteorological observations collected from ground weather stations, which are sparsely located, are relatively unexplored. In this paper, we propose ASOC, a novel attentive method for effectively exploiting ground-based meteorological observations from multiple weather stations. ASOC is designed to capture temporal dynamics of the observations and also contextual relationships between them. ASOC is easily combined with existing image-based precipitation nowcasting models without changing their architectures. We show that such a combination improves the average critical success index (CSI) of predicting heavy (at least 10 mm/hr) and light (at least 1 mm/hr) rainfall events at 1-6 hr lead times by 5.7%, compared to the original image-based model, using the radar images and ground-based observations around South Korea collected from 2014 to 2020.