title: Stability and convergence of the Euler scheme for stochastic linear evolution equations in Banach spaces

abstract: For the Euler scheme of the stochastic linear evolution equations, discrete stochastic maximal $ L^p $-regularity estimate is established, and a sharp error estimate in the norm $ \|\cdot\|_{L^p((0,T)\times\Omega;L^q(\mathcal O))} $, $ p,q \in [2,\infty) $, is derived via a duality argument.


title: Robust nonparametric regression: review and practical considerations

abstract: Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have been proposed in the literature, most of them can be highly sensitive to the presence of a small proportion of atypical observations in the training set. In this paper we review outlier robust estimation methods for nonparametric regression models, paying particular attention to practical considerations. Since outliers can also influence negatively the regression estimator by affecting the selection of bandwidths or smoothing parameters, we also discuss available robust alternatives for this task. Finally, since using many of the ``classical'' nonparametric regression estimators (and their robust counterparts) can be very challenging in settings with a moderate or large number of explanatory variables, we review recent robust nonparametric regression methods that scale well with a growing number of covariates.


title: Thermodynamic uncertainty relation in nondegenerate and degenerate maser heat engines

abstract: We investigate the thermodynamic uncertainty relation (TUR), \textit{i.e.} a trade-off between entropy production rate and relative power fluctuations, for nondegenerate three-level and degenerate four-level maser heat engines. In the nondegenerate case, we consider two slightly different configurations of three-level maser heat engine and contrast their degree of violation of standard TUR. In the high-temperature limit, standard TUR relation is always violated for both configurations. We also uncover an invariance of TUR under simultaneous rescaling of the matter-field coupling constant and system-bath coupling constants. For the degenerate four level engine, we study the effects of noise-induced coherence on TUR. We show that depending on the parametric regime of operation, noise-induced coherence can either suppress or enhance the relative power fluctuations.


title: Anomaly Detection in Multiplex Dynamic Networks: from Blockchain Security to Brain Disease Prediction

abstract: The problem of identifying anomalies in dynamic networks is a fundamental task with a wide range of applications. However, it raises critical challenges due to the complex nature of anomalies, lack of ground truth knowledge, and complex and dynamic interactions in the network. Most existing approaches usually study networks with a single type of connection between vertices, while in many applications interactions between objects vary, yielding multiplex networks. We propose ANOMULY, a general, unsupervised edge anomaly detection framework for multiplex dynamic networks. In each relation type, ANOMULY sees node embeddings at different GNN layers as hierarchical node states and employs a GRU cell to capture temporal properties of the network and update node embeddings over time. We then add an attention mechanism that incorporates information across different types of relations. Our case study on brain networks shows how this approach could be employed as a new tool to understand abnormal brain activity that might reveal a brain disease or disorder. Extensive experiments on nine real-world datasets demonstrate that ANOMULY achieves state-of-the-art performance.


title: Music Instrument Classification Reprogrammed

abstract: The performance of approaches to Music Instrument Classification, a popular task in Music Information Retrieval, is often impacted and limited by the lack of availability of annotated data for training. We propose to address this issue with "reprogramming," a technique that utilizes pre-trained deep and complex neural networks originally targeting a different task by modifying and mapping both the input and output of the pre-trained model. We demonstrate that reprogramming can effectively leverage the power of the representation learned for a different task and that the resulting reprogrammed system can perform on par or even outperform state-of-the-art systems at a fraction of training parameters. Our results, therefore, indicate that reprogramming is a promising technique potentially applicable to other tasks impeded by data scarcity.


title: Empowering Language Models with Knowledge Graph Reasoning for Question Answering

abstract: Answering open-domain questions requires world knowledge about in-context entities. As pre-trained Language Models (LMs) lack the power to store all required knowledge, external knowledge sources, such as knowledge graphs, are often used to augment LMs. In this work, we propose knOwledge REasOning empowered Language Model (OREO-LM), which consists of a novel Knowledge Interaction Layer that can be flexibly plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. In this way, LM guides KG to walk towards the desired answer, while the retrieved knowledge improves LM. By adopting OREO-LM to RoBERTa and T5, we show significant performance gain, achieving state-of-art results in the Closed-Book setting. The performance enhancement is mainly from the KG reasoning's capacity to infer missing relational facts. In addition, OREO-LM provides reasoning paths as rationales to interpret the model's decision.


title: Optimizing Polymatroid Functions

abstract: We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming technique, based on duality and projections, can be used to rederive some structural results that were previously established using more ad hoc methods. We then show that this technique can be used to obtain a polynomial-time algorithm for a certain type of simple difference constraints. Finally we give lower bound results that show that certain possible extensions of these results are probably not feasible.


title: Chainlink Polytopes and Ehrhart-Equivalence

abstract: We introduce a class of polytopes that we call chainlink polytopes and which allow us to construct infinite families of pairs of non isomorphic rational polytopes with the same Ehrhart quasi-polynomial. Our construction is based on circular fence posets, which admit a non-obvious and non-trivial symmetry in their rank sequences that turns out to be reflected in the polytope level. We introduce the related class of chainlink posets and show that they exhibit the same symmetry properties. We further prove an outstanding conjecture on the unimodality of circular rank polynomials.


title: Springer isomorphisms over a general base scheme

abstract: We establish the existence of Springer isomorphisms for reductive group schemes over general base schemes. For this, we first study centralizers of fiberwise regular sections of reductive group schemes, and we establish their flatness in many cases. At the end, we give several arguments to show that the hypotheses in our results are essentially optimal. Our results clarify some aspects of Springer isomorphisms even over a field, and the arguments simplify considerably in this case.


title: Universal Distributional Decision-based Black-box Adversarial Attack with Reinforcement Learning

abstract: The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on the one hand and finding targeted defenses on the other. However, most of the adversarial attacks today leverage the gradient or logit information from the models to generate adversarial perturbation. Works in the more realistic domain: decision-based attacks, which generate adversarial perturbation solely based on observing the output label of the targeted model, are still relatively rare and mostly use gradient-estimation strategies. In this work, we propose a pixel-wise decision-based attack algorithm that finds a distribution of adversarial perturbation through a reinforcement learning algorithm. We call this method Decision-based Black-box Attack with Reinforcement learning (DBAR). Experiments show that the proposed approach outperforms state-of-the-art decision-based attacks with a higher attack success rate and greater transferability.


title: CardiacGen: A Hierarchical Deep Generative Model for Cardiac Signals

abstract: We present CardiacGen, a Deep Learning framework for generating synthetic but physiologically plausible cardiac signals like ECG. Based on the physiology of cardiovascular system function, we propose a modular hierarchical generative model and impose explicit regularizing constraints for training each module using multi-objective loss functions. The model comprises 2 modules, an HRV module focused on producing realistic Heart-Rate-Variability characteristics and a Morphology module focused on generating realistic signal morphologies for different modalities. We empirically show that in addition to having realistic physiological features, the synthetic data from CardiacGen can be used for data augmentation to improve the performance of Deep Learning based classifiers. CardiacGen code is available at https://github.com/SENSE-Lab-OSU/cardiac_gen_model.


title: Generative Long-form Question Answering: Relevance, Faithfulness and Succinctness

abstract: In this thesis, we investigated the relevance, faithfulness, and succinctness aspects of Long Form Question Answering (LFQA). LFQA aims to generate an in-depth, paragraph-length answer for a given question, to help bridge the gap between real scenarios and the existing open-domain QA models which can only extract short-span answers. LFQA is quite challenging and under-explored. Few works have been done to build an effective LFQA system. It is even more challenging to generate a good-quality long-form answer relevant to the query and faithful to facts, since a considerable amount of redundant, complementary, or contradictory information will be contained in the retrieved documents. Moreover, no prior work has been investigated to generate succinct answers. We are among the first to research the LFQA task. We pioneered the research direction to improve the answer quality in terms of 1) query-relevance, 2) answer faithfulness, and 3) answer succinctness.


title: AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation

abstract: Lexically constrained text generation is one of the constrained text generation tasks, which aims to generate text that covers all the given constraint lexicons. While the existing approaches tackle this problem using a lexically constrained beam search algorithm or dedicated model using non-autoregressive decoding, there is a trade-off between the generated text quality and the hard constraint satisfaction. We introduce AutoTemplate, a simple yet effective lexically constrained text generation framework divided into template generation and lexicalization tasks. The template generation is to generate the text with the placeholders, and lexicalization replaces them into the constraint lexicons to perform lexically constrained text generation. We conducted the experiments on two tasks: keywords-to-sentence generations and entity-guided summarization. Experimental results show that the AutoTemplate outperforms the competitive baselines on both tasks while satisfying the hard lexical constraints.


title: Photometric identification of compact galaxies, stars and quasars using multiple neural networks

abstract: We present MargNet, a deep learning-based classifier for identifying stars, quasars and compact galaxies using photometric parameters and images from the Sloan Digital Sky Survey (SDSS) Data Release 16 (DR16) catalogue. MargNet consists of a combination of Convolutional Neural Network (CNN) and Artificial Neural Network (ANN) architectures. Using a carefully curated dataset consisting of 240,000 compact objects and an additional 150,000 faint objects, the machine learns classification directly from the data, minimising the need for human intervention. MargNet is the first classifier focusing exclusively on compact galaxies and performs better than other methods to classify compact galaxies from stars and quasars, even at fainter magnitudes. This model and feature engineering in such deep learning architectures will provide greater success in identifying objects in the ongoing and upcoming surveys, such as Dark Energy Survey (DES) and images from the Vera C. Rubin Observatory.


title: The metaplectic action on modulation spaces

abstract: We study the mapping properties of metaplectic operators $\widehat{S}\in \mathrm{Mp}(2d,\mathbb{R})$ on modulation spaces of the type $\mathrm{M}^{p,q}_m(\mathbb{R}^d)$. Our main result is a full characterisation of the pairs $(\widehat{S},\mathrm{M}^{p,q}(\mathbb{R}^d))$ for which the operator $\widehat{S}:\mathrm{M}^{p,q}(\mathbb{R}^d) \to \mathrm{M}^{p,q}(\mathbb{R}^d)$ is (i) well-defined, (ii) bounded. It turns out that these two properties are equivalent, and they entail that $\widehat{S}$ is a Banach space automorphism. For polynomially bounded weight functions, we provide a simple sufficient criterion to determine whether the well-definedness (boundedness) of ${\widehat{S}:\mathrm{M}^{p,q}{}(\mathbb{R}^d)\to \mathrm{M}^{p,q}(\mathbb{R}^d)}$ transfers to $\widehat{S}:\mathrm{M}^{p,q}_m(\mathbb{R}^d)\to \mathrm{M}^{p,q}_m(\mathbb{R}^d)$.


title: A New Technique for Improving Energy Efficiency in 5G Mm-wave Hybrid Precoding Systems

abstract: In this article, we present a new approach to optimizing the energy efficiency of the cost-efficiency of quantized hybrid pre-encoding (HP) design. We present effective alternating minimization algorithms (AMA) based on the zero gradient method to produce completely connected structures (CCSs) and partially connected structures (PCSs). Alternative minimization algorithms offer lower complexity by introducing orthogonal constraints on digital pre-codes to concurrently maximize computing complexity and communication power. As a result, by improving CCS through advanced phase extraction, the alternating minimization technique enhances hybrid pre-encoding. For PCS, the energy-saving ratio grew by 45.3 %, while for CCS, it increased by 18.12 %.


title: Factorization in the Monoid of Integrally Closed Ideals

abstract: Given a Noetherian ring $A$, the collection of all integrally closed ideals in $A$ which contain a nonzerodivisor, denoted $ic(A)$, forms a cancellative monoid under the operation $I*J=\overline{IJ}$, the integral closure of the product. The monoid is torsion-free and atomic -- every integrally closed ideal in $A$ containing a nonzerodivisor can be factored in this $*$-product into $*$-irreducible integrally closed ideals. Restricting to the case where $A$ is a polynomial ring and the ideals in question are monomial, we show that there is a surjective homomorphism from the Integral Polytope Group onto the Grothendieck group of integrally closed monomial ideals under translation invariance of their Newton Polyhedra. Notably, the Integral Polytope Group, the Grothendieck group of polytopes with integer vertices under Minkowski addition and translation invariance, has an explicit basis, allowing for explicit factoring in the monoid.


title: Far-from-equilibrium universality in two-dimensional Heisenberg antiferromagnets

abstract: We study the far-from-equilibrium dynamics of isolated two-dimensional Heisenberg antiferromagnets. We consider spin spiral initial conditions which imprint a position-dependent staggered-magnetization (or Neel order) in the two-dimensional lattice. Remarkably, we find a long-lived prethermal regime characterized by self-similar behavior of staggered magnetization fluctuations, although the system has no long-range order at finite energy and the staggered magnetization does not couple with conserved charges. Exploiting the separation of length scales introduced by the initial condition, we derive a simplified analytical model that allow us to compute the spatial-temporal scaling exponents and power-law distribution of the staggered magnetization fluctuations analytically, and find excellent agreement with numerical simulations using phase space methods. The scaling exponents are insensitive to details of the initial condition, in particular, no fine-tuning of energy is required to trigger the self-similar scaling regime. Compared with recent results on far-from-equilibrium universality on the Heisenberg ferromagnet, we find quantitatively distinct spatial-temporal scaling exponents, therefore suggesting that the same model with ferromagnetic and antiferromagnetic initial conditions can host different universal regimes. Our predictions are relevant to ultra-cold atoms simulators of Heisenberg magnets and driven antiferromagnetic insulators.


title: On the Performance of Direct Loss Minimization for Bayesian Neural Networks

abstract: Direct Loss Minimization (DLM) has been proposed as a pseudo-Bayesian method motivated as regularized loss minimization. Compared to variational inference, it replaces the loss term in the evidence lower bound (ELBO) with the predictive log loss, which is the same loss function used in evaluation. A number of theoretical and empirical results in prior work suggest that DLM can significantly improve over ELBO optimization for some models. However, as we point out in this paper, this is not the case for Bayesian neural networks (BNNs). The paper explores the practical performance of DLM for BNN, the reasons for its failure and its relationship to optimizing the ELBO, uncovering some interesting facts about both algorithms.


title: Quasilinear Schr\"{o}dinger equations with concave and convex nonlinearities

abstract: In this paper, we consider the following quasilinear Schr\"{o}dinger equation \begin{align*} -\Delta u-u\Delta(u^{2})=k(x)\left\vert u\right\vert ^{q-2}u-h(x)\left\vert u\right\vert ^{s-2}u\text{, }u\in D^{1,2}(\mathbb{R}^{N})\text{,} \end{align*} where $1<q<2<s<+\infty$. Unlike most results in the literature, the exponent $s$ here is allowed to be supercritical $s>2\cdot2^{\ast}$. By taking advantage of geometric properties of a nonlinear transformation $f$ and a variant of Clark's theorem, we get a sequence of solutions with negative energy in a space smaller than $D^{1,2}(\mathbb{R}^{N})$. Nonnegative solution at negative energy level is also obtained.


title: New Six Solutions to Solve Sixth Degree Polynomial Equation in General Forms by Relying on Radical Expressions

abstract: This paper presents new six solutions for sixth degree polynomial equation in general forms basing on new theorems, where the possibility to calculate the six roots of any sixth degree equation nearly simultaneously. The proposed roots for sixth degree polynomials in this paper are structured basing on new proposed solutions for quartic polynomial equations, which we developed in order to reduce the expression of any sixth degree polynomial to an expression of fourth degree polynomial.


title: Surreal fields stable under exponential, logarithmic, derivative and anti-derivative functions

abstract: The class of surreal numbers, denoted by $\textbf{No}$, initially proposed by Conway, is a universal ordered field in the sense that any ordered field can be embedded in it. They include in particular the real numbers and the ordinal numbers. They have strong relations with other fields such as field of transseries. Following Gonshor, surreal numbers can be seen as signs sequences of ordinal length, with some exponential and logarithmic functions that extend the usual functions over the reals. $\textbf{No}$ can actually be seen as an elegant (generalized) power series field with real coefficients, namely Hahn series with exponents in $\textbf{No}$ itself. Some years ago, Berarducci and Mantova considered derivation over the surreal numbers, seeing them as germs of functions, in correspondence to transseries. In this article, following our previous work, we exhibit a sufficient condition on the structure of a surreal field to be stable under all operations among exponential, logarithm, derivation and anti-derivation. Motivated, in the long term, by computability considerations, we also provide a non-trivial application of this theorem: the existence of a pretty reasonable field that only requires ordinals up to $\epsilon_\omega$, which is far smaller than $\omega_1^{CK}$ (resp. $\omega_1$), the first non-computable (resp. uncountable) ordinal.


title: Local learning through propagation delays in spiking neural networks

abstract: We propose a novel local learning rule for spiking neural networks in which spike propagation times undergo activity-dependent plasticity. Our plasticity rule aligns pre-synaptic spike times to produce a stronger and more rapid response. Inputs are encoded by latency coding and outputs decoded by matching similar patterns of output spiking activity. We demonstrate the use of this method in a three-layer feedfoward network with inputs from a database of handwritten digits. Networks consistently improve their classification accuracy after training, and training with this method also allowed networks to generalize to an input class unseen during training. Our proposed method takes advantage of the ability of spiking neurons to support many different time-locked sequences of spikes, each of which can be activated by different input activations. The proof-of-concept shown here demonstrates the great potential for local delay learning to expand the memory capacity and generalizability of spiking neural networks.


title: Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection

abstract: Detecting 3D objects from multi-view images is a fundamental problem in 3D computer vision. Recently, significant breakthrough has been made in multi-view 3D detection tasks. However, the unprecedented detection performance of these vision BEV (bird's-eye-view) detection models is accompanied with enormous parameters and computation, which make them unaffordable on edge devices. To address this problem, in this paper, we propose a structured knowledge distillation framework, aiming to improve the efficiency of modern vision-only BEV detection models. The proposed framework mainly includes: (a) spatial-temporal distillation which distills teacher knowledge of information fusion from different timestamps and views, (b) BEV response distillation which distills teacher response to different pillars, and (c) weight-inheriting which solves the problem of inconsistent inputs between students and teacher in modern transformer architectures. Experimental results show that our method leads to an average improvement of 2.16 mAP and 2.27 NDS on the nuScenes benchmark, outperforming multiple baselines by a large margin.


title: Active Learning Framework to Automate NetworkTraffic Classification

abstract: Recent network traffic classification methods benefitfrom machine learning (ML) technology. However, there aremany challenges due to use of ML, such as: lack of high-qualityannotated datasets, data-drifts and other effects causing aging ofdatasets and ML models, high volumes of network traffic etc. Thispaper argues that it is necessary to augment traditional workflowsof ML training&deployment and adapt Active Learning concepton network traffic analysis. The paper presents a novel ActiveLearning Framework (ALF) to address this topic. ALF providesprepared software components that can be used to deploy an activelearning loop and maintain an ALF instance that continuouslyevolves a dataset and ML model automatically. The resultingsolution is deployable for IP flow-based analysis of high-speed(100 Gb/s) networks, and also supports research experiments ondifferent strategies and methods for annotation, evaluation, datasetoptimization, etc. Finally, the paper lists some research challengesthat emerge from the first experiments with ALF in practice.


title: Air Pollution Hotspot Detection and Source Feature Analysis using Cross-domain Urban Data

abstract: Air pollution is a major global environmental health threat, in particular for people who live or work near pollution sources. Areas adjacent to pollution sources often have high ambient pollution concentrations, and those areas are commonly referred to as air pollution hotspots. Detecting and characterizing pollution hotspots are of great importance for air quality management, but are challenging due to the high spatial and temporal variability of air pollutants. In this work, we explore the use of mobile sensing data (i.e., air quality sensors installed on vehicles) to detect pollution hotspots. One major challenge with mobile sensing data is uneven sampling, i.e., data collection can vary by both space and time. To address this challenge, we propose a two-step approach to detect hotspots from mobile sensing data, which includes local spike detection and sample-weighted clustering. Essentially, this approach tackles the uneven sampling issue by weighting samples based on their spatial frequency and temporal hit rate, so as to identify robust and persistent hotspots. To contextualize the hotspots and discover potential pollution source characteristics, we explore a variety of cross-domain urban data and extract features from them. As a soft-validation of the extracted features, we build hotspot inference models for cities with and without mobile sensing data. Evaluation results using real-world mobile sensing air quality data as well as cross-domain urban data demonstrate the effectiveness of our approach in detecting and inferring pollution hotspots. Furthermore, the empirical analysis of hotspots and source features yields useful insights regarding neighborhood pollution sources.


title: iTUAVs: Intermittently Tethered UAVs for Future Wireless Networks

abstract: We propose the intermittently tethered unmanned aerial vehicle (iTUAV) as a tradeoff between the power availability of a tethered UAV (TUAV) and the flexibility of an untethered UAV. An iTUAV can provide cellular connectivity while being temporarily tethered to the most adequate ground anchor. Also, it can flexibly detach from one anchor, travel, then attach to another one to maintain/improve the coverage quality for mobile users. Hence, we discuss here the existing UAV-based cellular networking technologies, followed by a detailed description of the iTUAV system, its components, and mode of operation. Subsequently, we present a comparative study of the existing and proposed systems highlighting the differences in key features such as mobility and energy. To emphasize the potential of iTUAV systems, we conduct a case study, evaluate the iTUAV performance, and compare it to benchmarks. Obtained results show that with only 10 anchors in the area, the iTUAV system can serve up to 90% of the users covered by the untethered UAV swapping system. Moreover, results from a small case study prove that the iTUAV allows to balance performance/cost and can be implemented realistically. For instance, when user locations are clustered, with only 2 active iTUAVs and 4 anchors, achieved performance is superior to that of the system with 3 TUAVs, while when considering a single UAV on a 100 minutes event, a system with only 6 anchors outperforms the untethered UAV as it combines location flexibility with increased mission time.


title: Introducing Semantics into Speech Encoders

abstract: Recent studies find existing self-supervised speech encoders contain primarily acoustic rather than semantic information. As a result, pipelined supervised automatic speech recognition (ASR) to large language model (LLM) systems achieve state-of-the-art results on semantic spoken language tasks by utilizing rich semantic representations from the LLM. These systems come at the cost of labeled audio transcriptions, which is expensive and time-consuming to obtain. We propose a task-agnostic unsupervised way of incorporating semantic information from LLMs into self-supervised speech encoders without labeled audio transcriptions. By introducing semantics, we improve existing speech encoder spoken language understanding performance by over 10\% on intent classification, with modest gains in named entity resolution and slot filling, and spoken question answering FF1 score by over 2\%. Our unsupervised approach achieves similar performance as supervised methods trained on over 100 hours of labeled audio transcripts, demonstrating the feasibility of unsupervised semantic augmentations to existing speech encoders.


title: REPAIR: REnormalizing Permuted Activations for Interpolation Repair

abstract: In this paper we look into the conjecture of Entezari et al. (2021) which states that if the permutation invariance of neural networks is taken into account, then there is likely no loss barrier to the linear interpolation between SGD solutions. First, we observe that neuron alignment methods alone are insufficient to establish low-barrier linear connectivity between SGD solutions due to a phenomenon we call variance collapse: interpolated deep networks suffer a collapse in the variance of their activations, causing poor performance. Next, we propose REPAIR (REnormalizing Permuted Activations for Interpolation Repair) which mitigates variance collapse by rescaling the preactivations of such interpolated networks. We explore the interaction between our method and the choice of normalization layer, network width, and depth, and demonstrate that using REPAIR on top of neuron alignment methods leads to 60%-100% relative barrier reduction across a wide variety of architecture families and tasks. In particular, we report a 74% barrier reduction for ResNet50 on ImageNet and 90% barrier reduction for ResNet18 on CIFAR10.


title: Non-Linear Coordination Graphs

abstract: Value decomposition multi-agent reinforcement learning methods learn the global value function as a mixing of each agent's individual utility functions. Coordination graphs (CGs) represent a higher-order decomposition by incorporating pairwise payoff functions and thus is supposed to have a more powerful representational capacity. However, CGs decompose the global value function linearly over local value functions, severely limiting the complexity of the value function class that can be represented. In this paper, we propose the first non-linear coordination graph by extending CG value decomposition beyond the linear case. One major challenge is to conduct greedy action selections in this new function class to which commonly adopted DCOP algorithms are no longer applicable. We study how to solve this problem when mixing networks with LeakyReLU activation are used. An enumeration method with a global optimality guarantee is proposed and motivates an efficient iterative optimization method with a local optimality guarantee. We find that our method can achieve superior performance on challenging multi-agent coordination tasks like MACO.


title: Multimodal Generative Models for Bankruptcy Prediction Using Textual Data

abstract: Textual data from financial filings, e.g., the Management's Discussion & Analysis (MDA) section in Form 10-K, has been used to improve the prediction accuracy of bankruptcy models. In practice, however, we cannot obtain the MDA section for all public companies, which limits the use of MDA data in traditional bankruptcy models, as they need complete data to make predictions. The two main reasons for the lack of MDA are: (i) not all companies are obliged to submit the MDA and (ii) technical problems arise when crawling and scrapping the MDA section. To solve this limitation, this research introduces the Conditional Multimodal Discriminative (CMMD) model that learns multimodal representations that embed information from accounting, market, and textual data modalities. The CMMD model needs a sample with all data modalities for model training. At test time, the CMMD model only needs access to accounting and market modalities to generate multimodal representations, which are further used to make bankruptcy predictions and to generate words from the missing MDA modality. With this novel methodology, it is realistic to use textual data in bankruptcy prediction models, since accounting and market data are available for all companies, unlike textual data. The empirical results of this research show that if financial regulators, or investors, were to use traditional models using MDA data, they would only be able to make predictions for 60% of the companies. Furthermore, the classification performance of our proposed methodology is superior to that of a large number of traditional classifier models, taking into account all the companies in our sample.


title: Incorporating Pre-training Paradigm for Antibody Sequence-Structure Co-design

abstract: Antibodies are versatile proteins that can bind to pathogens and provide effective protection for human body. Recently, deep learning-based computational antibody design has attracted popular attention since it automatically mines the antibody patterns from data that could be complementary to human experiences. However, the computational methods heavily rely on high-quality antibody structure data, which is quite limited. Besides, the complementarity-determining region (CDR), which is the key component of an antibody that determines the specificity and binding affinity, is highly variable and hard to predict. Therefore, the data limitation issue further raises the difficulty of CDR generation for antibodies. Fortunately, there exists a large amount of sequence data of antibodies that can help model the CDR and alleviate the reliance on structure data. By witnessing the success of pre-training models for protein modeling, in this paper, we develop the antibody pre-training language model and incorporate it into the (antigen-specific) antibody design model in a systemic way. Specifically, we first pre-train an antibody language model based on the sequence data, then propose a one-shot way for sequence and structure generation of CDR to avoid the heavy cost and error propagation from an autoregressive manner, and finally leverage the pre-trained antibody model for the antigen-specific antibody generation model with some carefully designed modules. Through various experiments, we show that our method achieves superior performances over previous baselines on different tasks, such as sequence and structure generation and antigen-binding CDR-H3 design.


title: Trust-Awareness to Secure Swarm Intelligence from Data Injection Attack

abstract: Enabled by the emerging industrial agent (IA) technology, swarm intelligence (SI) is envisaged to play an important role in future industrial Internet of Things (IIoT) that is shaped by Sixth Generation (6G) mobile communications and digital twin (DT). However, its fragility against data injection attack may halt it from practical deployment. In this paper we propose an efficient trust approach to address this security concern for SI.


title: On the biological plausibility of orthogonal initialisation for solving gradient instability in deep neural networks

abstract: Initialising the synaptic weights of artificial neural networks (ANNs) with orthogonal matrices is known to alleviate vanishing and exploding gradient problems. A major objection against such initialisation schemes is that they are deemed biologically implausible as they mandate factorization techniques that are difficult to attribute to a neurobiological process. This paper presents two initialisation schemes that allow a network to naturally evolve its weights to form orthogonal matrices, provides theoretical analysis that pre-training orthogonalisation always converges, and empirically confirms that the proposed schemes outperform randomly initialised recurrent and feedforward networks.


title: Colored sl(N) homology and SU(N) representations I: the trefoil and the Hopf link

abstract: We provide the first complete computations of colored sl(N) homology for a nontrivial knot. In doing so, we show that the colored sl(N) homology of the trefoil labeled by an exterior power of the defining representation is isomorphic to the cohomology of a closed manifold naturally associated to the trefoil. This manifold is the set of homomorphisms from the fundamental group of the complement of the trefoil to SU(N) that send meridians to a particular conjugacy class depending on the label. We also provide complete computations and analogous isomorphisms for the first nontrivial link, the Hopf link.


title: Low Latency Conversion of Artificial Neural Network Models to Rate-encoded Spiking Neural Networks

abstract: Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window is used to fire the neurons. The maximum number of spikes in this time window is also the latency of the network in performing a single inference, as well as determines the overall energy efficiency of the model. The aim of this paper is to reduce this while maintaining accuracy when converting ANNs to their equivalent SNNs. The state-of-the-art conversion schemes yield SNNs with accuracies comparable with ANNs only for large window sizes. In this paper, we start with understanding the information loss when converting from pre-existing ANN models to standard rate-encoded SNN models. From these insights, we propose a suite of novel techniques that together mitigate the information lost in the conversion, and achieve state-of-art SNN accuracies along with very low latency. Our method achieved a Top-1 SNN accuracy of 98.73% (1 time step) on the MNIST dataset, 76.38% (8 time steps) on the CIFAR-100 dataset, and 93.71% (8 time steps) on the CIFAR-10 dataset. On ImageNet, an SNN accuracy of 75.35%/79.16% was achieved with 100/200 time steps.


title: Large Language Models Struggle to Learn Long-Tail Knowledge

abstract: The Internet contains a wealth of knowledge -- from the birthdays of historical figures to tutorials on how to code -- all of which may be learned by language models. However, while certain pieces of information are ubiquitous on the web, others appear extremely rarely. In this paper, we study the relationship between the knowledge memorized by large language models and the information in pre-training datasets scraped from the web. In particular, we show that a language model's ability to answer a fact-based question relates to how many documents associated with that question were seen during pre-training. We identify these relevant documents by entity linking pre-training datasets and counting documents that contain the same entities as a given question-answer pair. Our results demonstrate strong correlational and causal relationships between accuracy and relevant document count for numerous question answering datasets (e.g., TriviaQA), pre-training corpora (e.g., ROOTS), and model sizes (e.g., 176B parameters). Moreover, while larger models are better at learning long-tail knowledge, we estimate that today's models must be scaled by many orders of magnitude to reach competitive QA performance on questions with little support in the pre-training data. Finally, we show that retrieval-augmentation can reduce the dependence on relevant pre-training information, presenting a promising approach for capturing the long-tail.


title: Evaluating the Factual Consistency of Large Language Models Through News Summarization

abstract: While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new benchmark called FIB(Factual Inconsistency Benchmark) that focuses on the task of summarization. Specifically, our benchmark involves comparing the scores an LLM assigns to a factually consistent versus a factually inconsistent summary for an input news article. For factually consistent summaries, we use human-written reference summaries that we manually verify as factually consistent. To generate summaries that are factually inconsistent, we generate summaries from a suite of summarization models that we have manually annotated as factually inconsistent. A model's factual consistency is then measured according to its accuracy, i.e.\ the proportion of documents where it assigns a higher score to the factually consistent summary. To validate the usefulness of FIB, we evaluate 23 large language models ranging from 1B to 176B parameters from six different model families including BLOOM and OPT. We find that existing LLMs generally assign a higher score to factually consistent summaries than to factually inconsistent summaries. However, if the factually inconsistent summaries occur verbatim in the document, then LLMs assign a higher score to these factually inconsistent summaries than factually consistent summaries. We validate design choices in our benchmark including the scoring method and source of distractor summaries. Our code and benchmark data can be found at https://github.com/r-three/fib.


title: Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges

abstract: In recent years, Federated Learning (FL) has gained relevance in training collaborative models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the most common approach in the literature, where a central entity creates a global model. However, a centralized approach leads to increased latency due to bottlenecks, heightened vulnerability to system failures, and trustworthiness concerns affecting the entity responsible for the global model creation. Decentralized Federated Learning (DFL) emerged to address these concerns by promoting decentralized model aggregation and minimizing reliance on centralized architectures. However, despite the work done in DFL, the literature has not (i) studied the main aspects differentiating DFL and CFL; (ii) analyzed DFL frameworks to create and evaluate new solutions; and (iii) reviewed application scenarios using DFL. Thus, this article identifies and analyzes the main fundamentals of DFL in terms of federation architectures, topologies, communication mechanisms, security approaches, and key performance indicators. Additionally, the paper at hand explores existing mechanisms to optimize critical DFL fundamentals. Then, the most relevant features of the current DFL frameworks are reviewed and compared. After that, it analyzes the most used DFL application scenarios, identifying solutions based on the fundamentals and frameworks previously defined. Finally, the evolution of existing DFL solutions is studied to provide a list of trends, lessons learned, and open challenges.


title: Model free variable importance for high dimensional data

abstract: A model-agnostic variable importance method can be used with arbitrary prediction functions. Here we present some model-free methods that do not require access to the prediction function. This is useful when that function is proprietary and not available, or just extremely expensive. It is also useful when studying residuals from a model. The cohort Shapley (CS) method is model-free but has exponential cost in the dimension of the input space. A supervised on-manifold Shapley method from Frye et al. (2020) is also model free but requires as input a second black box model that has to be trained for the Shapley value problem. We introduce an integrated gradient (IG) version of cohort Shapley, called IGCS, with cost $\mathcal{O}(nd)$. We show that over the vast majority of the relevant unit cube that the IGCS value function is close to a multilinear function for which IGCS matches CS. Another benefit of IGCS is that is allows IG methods to be used with binary predictors. We use some area between curves (ABC) measures to quantify the performance of IGCS. On a problem from high energy physics we verify that IGCS has nearly the same ABCs as CS does. We also use it on a problem from computational chemistry in 1024 variables. We see there that IGCS attains much higher ABCs than we get from Monte Carlo sampling. The code is publicly available at https://github.com/cohortshapley/cohortintgrad


title: Online Anomalous Subtrajectory Detection on Road Networks with Deep Reinforcement Learning

abstract: Detecting anomalous trajectories has become an important task in many location-based applications. While many approaches have been proposed for this task, they suffer from various issues including (1) incapability of detecting anomalous subtrajectories, which are finer-grained anomalies in trajectory data, and/or (2) non-data driven, and/or (3) requirement of sufficient supervision labels which are costly to collect. In this paper, we propose a novel reinforcement learning based solution called RL4OASD, which avoids all aforementioned issues of existing approaches. RL4OASD involves two networks, one responsible for learning features of road networks and trajectories and the other responsible for detecting anomalous subtrajectories based on the learned features, and the two networks can be trained iteratively without labeled data. Extensive experiments are conducted on two real datasets, and the results show that our solution can significantly outperform the state-of-the-art methods (with 20-30% improvement) and is efficient for online detection (it takes less than 0.1ms to process each newly generated data point).


title: Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment

abstract: With the rapid growth of computing powers and recent advances in deep learning, we have witnessed impressive demonstrations of novel robot capabilities in research settings. Nonetheless, these learning systems exhibit brittle generalization and require excessive training data for practical tasks. To harness the capabilities of state-of-the-art robot learning models while embracing their imperfections, we present Sirius, a principled framework for humans and robots to collaborate through a division of work. In this framework, partially autonomous robots are tasked with handling a major portion of decision-making where they work reliably; meanwhile, human operators monitor the process and intervene in challenging situations. Such a human-robot team ensures safe deployments in complex tasks. Further, we introduce a new learning algorithm to improve the policy's performance on the data collected from the task executions. The core idea is re-weighing training samples with approximated human trust and optimizing the policies with weighted behavioral cloning. We evaluate Sirius in simulation and on real hardware, showing that Sirius consistently outperforms baselines over a collection of contact-rich manipulation tasks, achieving an 8% boost in simulation and 27% on real hardware than the state-of-the-art methods in policy success rate, with twice faster convergence and 85% memory size reduction. Videos and more details are available at https://ut-austin-rpl.github.io/sirius/


title: Acyclic colourings of graphs with obstructions

abstract: Given a graph $G$, a colouring of $G$ is acyclic if it is a proper colouring of $G$ and every cycle contains at least three colours. Its acyclic chromatic number $\chi_a(G)$ is the minimum $k$ such that there exists a proper $k$-colouring of $G$ with no bicoloured cycle. In general, when $G$ has maximum degree $\Delta$, it is known that $\chi_a(G) = O(\Delta^{4/3})$ as $\Delta \to \infty$. We study the effect on this bound of further requiring that $G$ does not contain some fixed subgraph $F$ on $t$ vertices. We establish that the bound is constant if $F$ is a subdivided tree, $O(t^{8/3}\Delta^{2/3})$ if $F$ is a forest, $O(\sqrt{t}\Delta)$ if $F$ is bipartite and 1-acyclic, $2\Delta + o(\Delta)$ if $F$ is an even cycle of length at least $6$, and $O(t^{1/4}\Delta^{5/4})$ if $F=K_{3,t}$.


title: On the long-time behavior of scale-invariant solutions to the 2d Euler equation and applications

abstract: We study the long-time behavior of scale-invariant solutions of the 2d Euler equation satisfying a discrete symmetry. We show that all scale-invariant solutions with bounded variation on $\mathbb{S}^1$ relax to states that are piece-wise constant with finitely many jumps. All continuous scale-invariant solutions become singular and homogenize in infinite time. On $\mathbb{R}^2$, this corresponds to generic infinite-time spiral and cusp formation. The main tool in our analysis is the discovery of a monotone quantity that measures the number of particles that are moving away from the origin. This monotonicity also applies locally to solutions of the 2d Euler equation that are $m$-fold symmetric ($m\geq 4$) and have radial limits at the point of symmetry. Our results are also applicable to the Euler equation on a large class of surfaces of revolution (like $\mathbb{S}^2$ and $\mathbb{T}^2$). Our analysis then gives generic spiraling of trajectories and infinite-time loss of regularity for globally smooth solutions on any such smooth surface, under a discrete symmetry.


title: Participation Interfaces for Human-Centered AI

abstract: Emerging artificial intelligence (AI) applications often balance the preferences and impacts among diverse and contentious stakeholder groups. Accommodating these stakeholder groups during system design, development, and deployment requires tools for the elicitation of disparate system interests and collaboration interfaces supporting negotiation balancing those interests. This paper introduces interactive visual "participation interfaces" for Markov Decision Processes (MDPs) and collaborative ranking problems as examples restoring a human-centered locus of control.


title: Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regression

abstract: We demonstrate the use of symbolic regression in deriving analytical formulas, which are needed at various stages of a typical experimental analysis in collider phenomenology. As a first application, we consider kinematic variables like the stransverse mass, $M_{T2}$, which are defined algorithmically through an optimization procedure and not in terms of an analytical formula. We then train a symbolic regression and obtain the correct analytical expressions for all known special cases of $M_{T2}$ in the literature. As a second application, we reproduce the correct analytical expression for a next-to-leading order (NLO) kinematic distribution from data, which is simulated with a NLO event generator. Finally, we derive analytical approximations for the NLO kinematic distributions after detector simulation, for which no known analytical formulas currently exist.


title: Drag resistance mediated by quantum spin liquids

abstract: Recent advances in material synthesis made it possible to realize two-dimensional monolayers of candidate materials for a quantum spin liquid (QSL) such as $\alpha$-RuCl$_3$,1T-TaSe$_2$ and 1T-TaS$_2$. In this work, we propose an experimental setup that exploits nonlocal electrical probes to gain information on the transport properties of a gapless QSL. The proposed setup is a spinon-mediated drag experiment: a current is injected in one of the two layers and a voltage is measured on the second metallic film. The overall momentum transfer mechanism is a two-step process mediated by Kondo interaction between the local moments in the quantum spin liquid and the spins of the electrons. In the limit of negligible momentum relaxed within the QSL layer, we calculate the drag relaxation rate for Kitaev, $\mathbb{Z}_2$, and U(1) QSLs using Aslamazov-Larkin diagrams. We find, however, that the case of dominant momentum relaxation within the QSL layer is far more relevant and thus develop a model based on the Boltzmann kinetic equation to describe the proposed setup. Within this framework we calculate the low temperature scaling behavior of the drag resistivity, both for U(1) and $\mathbb{Z}_2$ QSLs with Fermi surfaces. In some regimes we find a crossover in the temperature scaling that is different between the $\mathbb{Z}_2$ and U(1) QSL both because of the non-Fermi liquid nature of the U(1) QSL, and because of the qualitatively different momentum relaxation mechanism within the QSL layer. Our findings suggest that parameters of the system can be tuned to make the spinon-mediated drag a significant fraction of the total transresistance.


title: Mechanistic Mode Connectivity

abstract: We study neural network loss landscapes through the lens of mode connectivity, the observation that minimizers of neural networks retrieved via training on a dataset are connected via simple paths of low loss. Specifically, we ask the following question: are minimizers that rely on different mechanisms for making their predictions connected via simple paths of low loss? We provide a definition of mechanistic similarity as shared invariances to input transformations and demonstrate that lack of linear connectivity between two models implies they use dissimilar mechanisms for making their predictions. Relevant to practice, this result helps us demonstrate that naive fine-tuning on a downstream dataset can fail to alter a model's mechanisms, e.g., fine-tuning can fail to eliminate a model's reliance on spurious attributes. Our analysis also motivates a method for targeted alteration of a model's mechanisms, named connectivity-based fine-tuning (CBFT), which we analyze using several synthetic datasets for the task of reducing a model's reliance on spurious attributes.


title: The inefficiency of stellar feedback in driving galactic outflows in massive galaxies at high redshift

abstract: Recent observations indicate that galactic outflows are ubiquitous in high redshift galaxies, including normal star forming galaxies, quasar hosts, and dusty star forming galaxies (DSFGs). However, the impact of outflows on the evolution of their hosts is still an open question. Here, we analyse the star formation histories (SFH) and galactic outflow properties of galaxies in massive haloes ($10^{12}M_{\odot}<M_{\rm vir} <5\times 10^{12}M_{\odot}$) at $z\gtrsim5.5$ in three zoom-in cosmological simulations from the MassiveFIRE suite, as part of the Feedback In Realistic Environments (FIRE) project. The simulations were run with the FIRE-2 model, which does not include feedback from active galactic nuclei (AGN). The simulated galaxies resemble $z>4$ DSFGs, with SFRs of $\sim 1000\ M_{\odot}\rm yr^{-1}$ and molecular gas masses of $M_{\rm mol}\sim 10^{10}\ M_{\odot}$. However, the simulated galaxies are characterised by higher circular velocities than those observed in high-z DSFGs. The mass loading factors from stellar feedback are of the order of $\sim 0.1$, implying that stellar feedback is inefficient in driving galactic outflows and gas is consumed by star formation on much shorter time-scales than it is expelled from the interstellar medium (ISM). We also find that stellar feedback is highly inefficient in self-regulating star formation in this regime, with an average integrated star formation efficiency (SFE) per dynamical time of $30\%$. Finally, compared to FIRE-2 galaxies hosted in similarly massive haloes at lower redshift, we find lower mass loading factors and higher SFEs in the high redshift sample. We argue that both effects originate from the higher total and gas surface densities that characterise high$-z$ massive systems.


title: Cyclic Generative Adversarial Networks With Congruent Image-Report Generation For Explainable Medical Image Analysis

abstract: We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from prior methods that focus on medical report generation from images or vice-versa, we novelly generate congruent image--report pairs employing a cyclic-Generative Adversarial Network (cycleGAN); thereby, the generated report will adequately explain a medical image, while a report-generated image that effectively characterizes the text visually should (sufficiently) resemble the original. The aim of the work is to generate trustworthy and faithful explanations for the outputs of a model diagnosing chest x-ray images by pointing a human user to similar cases in support of a diagnostic decision. Apart from enabling transparent medical image labeling and interpretation, we achieve report and image-based labeling comparable to prior methods, including state-of-the-art performance in some cases as evidenced by experiments on the Indiana Chest X-ray dataset


title: A Rigorous Study Of The Deep Taylor Decomposition

abstract: Saliency methods attempt to explain deep neural networks by highlighting the most salient features of a sample. Some widely used methods are based on a theoretical framework called Deep Taylor Decomposition (DTD), which formalizes the recursive application of the Taylor Theorem to the network's layers. However, recent work has found these methods to be independent of the network's deeper layers and appear to respond only to lower-level image structure. Here, we investigate the DTD theory to better understand this perplexing behavior and found that the Deep Taylor Decomposition is equivalent to the basic gradient$\times$input method when the Taylor root points (an important parameter of the algorithm chosen by the user) are locally constant. If the root points are locally input-dependent, then one can justify any explanation. In this case, the theory is under-constrained. In an empirical evaluation, we find that DTD roots do not lie in the same linear regions as the input - contrary to a fundamental assumption of the Taylor theorem. The theoretical foundations of DTD were cited as a source of reliability for the explanations. However, our findings urge caution in making such claims.


title: Automatic penalty and degree continuation for parallel pre-conditioned mesh curving on virtual geometry

abstract: We present a distributed parallel mesh curving method for virtual geometry. The main application is to generate large-scale curved meshes on complex geometry suitable for analysis with unstructured high-order methods. Accordingly, we devise the technique to generate geometrically accurate meshes composed of high-quality elements. To this end, we advocate for degree continuation on a penalty-based second-order optimizer that uses global tight tolerances to converge the distortion residuals. To reduce the method memory footprint, waiting time, and energy consumption, we combine three main ingredients. First, we propose a matrix-free GMRES solver pre-conditioned with successive over-relaxation by blocks to reduce the memory footprint three times. We also propose an adaptive penalty technique, to reduce the number of non-linear iterations. Third, we propose an indicator of the required linear solver tolerance to reduce the number of linear iterations. On thousands of cores, the method curves meshes composed of millions of quartic elements featuring highly stretched elements while matching a virtual topology.


title: Conformal marked bisection for local refinement of $n$-dimensional unstructured simplicial meshes

abstract: We present an $n$-dimensional marked bisection method for unstructured conformal meshes. We devise the method for local refinement in adaptive $n$-dimensional applications. To this end, we propose a mesh marking pre-process and three marked bisection stages. The pre-process marks the initial mesh conformingly. Then, in the first $n-1$ bisections, the method accumulates in reverse order a list of new vertices. In the second stage, the $n$-th bisection, the method uses the reversed list to cast the bisected simplices as reflected simplices, a simplex type suitable for newest vertex bisection. In the final stage, beyond the $n$-th bisection, the method switches to newest vertex bisection. To allow this switch, after the second stage, we check that under uniform bisection the mesh simplices are conformal and reflected. These conditions are sufficient to use newest vertex bisection, a bisection scheme guaranteeing key advantages for local refinement. Finally, the results show that the proposed bisection is well-suited for local refinement of unstructured conformal meshes.


title: CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming

abstract: Recent years have witnessed the dramatic growth of Internet video traffic, where the video bitstreams are often compressed and delivered in low quality to fit the streamer's uplink bandwidth. To alleviate the quality degradation, it comes the rise of Neural-enhanced Video Streaming (NVS), which shows great prospects for recovering low-quality videos by mostly deploying neural super-resolution (SR) on the media server. Despite its benefit, we reveal that current mainstream works with SR enhancement have not achieved the desired rate-distortion trade-off between bitrate saving and quality restoration, due to: (1) overemphasizing the enhancement on the decoder side while omitting the co-design of encoder, (2) limited generative capacity to recover high-fidelity perceptual details, and (3) optimizing the compression-and-restoration pipeline from the resolution perspective solely, without considering color bit-depth. Aiming at overcoming these limitations, we are the first to conduct an encoder-decoder (i.e., codec) synergy by leveraging the inherent visual-generative property of diffusion models. Specifically, we present the Codec-aware Diffusion Modeling (CaDM), a novel NVS paradigm to significantly reduce streaming delivery bitrates while holding pretty higher restoration capacity over existing methods. First, CaDM improves the encoder's compression efficiency by simultaneously reducing resolution and color bit-depth of video frames. Second, CaDM empowers the decoder with high-quality enhancement by making the denoising diffusion restoration aware of encoder's resolution-color conditions. Evaluation on public cloud services with OpenMMLab benchmarks shows that CaDM effectively saves up to 5.12 - 21.44 times bitrates based on common video standards and achieves much better recovery quality (e.g., FID of 0.61) over state-of-the-art neural-enhancing methods.


title: An Automatic ICD Coding Network Using Partition-Based Label Attention

abstract: International Classification of Diseases (ICD) is a global medical classification system which provides unique codes for diagnoses and procedures appropriate to a patient's clinical record. However, manual coding by human coders is expensive and error-prone. Automatic ICD coding has the potential to solve this problem. With the advancement of deep learning technologies, many deep learning-based methods for automatic ICD coding are being developed. In particular, a label attention mechanism is effective for multi-label classification, i.e., the ICD coding. It effectively obtains the label-specific representations from the input clinical records. However, because the existing label attention mechanism finds key tokens in the entire text at once, the important information dispersed in each paragraph may be omitted from the attention map. To overcome this, we propose a novel neural network architecture composed of two parts of encoders and two kinds of label attention layers. The input text is segmentally encoded in the former encoder and integrated by the follower. Then, the conventional and partition-based label attention mechanisms extract important global and local feature representations. Our classifier effectively integrates them to enhance the ICD coding performance. We verified the proposed method using the MIMIC-III, a benchmark dataset of the ICD coding. Our results show that our network improves the ICD coding performance based on the partition-based mechanism.


title: Power-law Scaling to Assist with Key Challenges in Artificial Intelligence

abstract: Power-law scaling, a central concept in critical phenomena, is found to be useful in deep learning, where optimized test errors on handwritten digit examples converge as a power-law to zero with database size. For rapid decision making with one training epoch, each example is presented only once to the trained network, the power-law exponent increased with the number of hidden layers. For the largest dataset, the obtained test error was estimated to be in the proximity of state-of-the-art algorithms for large epoch numbers. Power-law scaling assists with key challenges found in current artificial intelligence applications and facilitates an a priori dataset size estimation to achieve a desired test accuracy. It establishes a benchmark for measuring training complexity and a quantitative hierarchy of machine learning tasks and algorithms.


title: Baryogenesis, Primordial Black Holes and MHz-GHz Gravitational Waves

abstract: Gravitational waves (GWs) in the MHz - GHz frequency range are motivated by a host of early Universe phenomena such as oscillons, preheating, and cosmic strings. We point out that baryogenesis too serves as a motivation to probe GWs in this frequency range. The connection is through primordial black holes (PBHs): on the one hand, PBHs induce baryogenesis by Hawking evaporating into a species that has baryon number and $CP$ violating decays; on the other, PBHs induce GWs through second order effects when the scalar fluctuations responsible for their formation re-enter the horizon. We describe the interplay of the parameters responsible for successful baryogenesis on the plane of the strain and frequency of the induced GWs, being careful to delineate regimes where PBH domination or washout effects occur. We provide semi-analytic scalings of the GW strain with the baryon number to entropy ratio and other parameters important for baryogenesis. Along the way, we sketch a solution to the dark matter-baryogenesis coincidence problem with two populations of PBHs, which leads to a double-peaked GW signal. Our results underscore the importance of probing the ultra high frequency GW frontier.


title: Axion Detection with Optomechanical Cavities

abstract: We propose a novel technique to search for axions with an optomechanical cavity filled with a material such as superfluid helium. Axion absorption converts a pump laser photon to a photon plus a phonon. The axion absorption rate is enhanced by the high occupation number of coherent photons or phonons in the cavity, allowing our proposal to largely overcome the extremely small axion coupling. The axion mass probed is set by the relative frequency of the photon produced in the final state and the Stokes mode. Because neither the axion mass nor momentum need to be matched to the physical size of the cavity, we can scale up the cavity size while maintaining access to a wide range of axion masses (up to a meV) complementary to other cavity proposals.


title: i-SPin: An integrator for multicomponent Schr\"{o}dinger-Poisson systems with self-interactions

abstract: We provide an algorithm and a publicly available code to numerically evolve multicomponent Schr\"{o}dinger-Poisson (SP) systems with a SO($n$) symmetry, including attractive or repulsive self-interactions in addition to gravity. Focusing on the case where the SP system represents the non-relativistic limit of a massive vector field, non-gravitational self-interactions (in particular spin-spin interactions) introduce complexities related to mass and spin conservation which are not present in purely gravitational systems. We address them with an analytical solution for the `kick' step in the algorithm, where we are able to decouple the multicomponent system completely. Equipped with this analytical solution, the full field evolution is second order accurate, preserves spin and mass to machine precision, and is reversible. Our algorithm allows for an expanding universe relevant for cosmology, and the inclusion of external potentials relevant for laboratory settings.

categories: astro-ph.CO cond-mat.quant-gas hep-ph physics.comp-ph


title: Chaos and Thermalization in the Spin-Boson Dicke Model

abstract: We present a detailed analysis of the connection between chaos and the onset of thermalization in the spin-boson Dicke model. This system has a well-defined classical limit with two degrees of freedom, and it presents both regular and chaotic regions. Our studies of the eigenstate expectation values and the distributions of the off-diagonal elements of the number of photons and the number of excited atoms validate the diagonal and off-diagonal eigenstate thermalization hypothesis (ETH) in the chaotic region, thus ensuring thermalization. The validity of the ETH reflects the chaotic structure of the eigenstates, which we corroborate using the von Neumann entanglement entropy and the Shannon entropy. Our results for the Shannon entropy also make evident the advantages of the so-called "efficient basis" over the widespread employed Fock basis when investigating the unbounded spectrum of the Dicke model. The efficient basis gives us access to a larger number of converged states than what can be reached with the Fock basis.


title: Gravito-diamagnetic forces for mass independent large spatial superpositions

abstract: Creating a massive spatial quantum superposition, such as the Schr\"odinger cat state, where the mass and the superposition size within the range $10^{-19}-10^{-14}$ kg and $\Delta x \sim 10~{\rm nm}-100~\mu {\rm m}$, is a challenging task. The methods employed so far rely either on wavepacket expansion or on a quantum ancilla, e.g. single spin dependent forces, which scale inversely with mass. In this paper, we present a novel approach that combines gravitational acceleration and diamagnetic repulsion to generate a large spatial superposition in a relatively short time. After first creating a modest initial spatial superposition of $1~\mu {\rm m}$, achieved through techniques such as the Stern-Gerlach (SG) apparatus, we will show that we can achieve an $\sim 10^{2}-10^{3}$ fold improvement to the spatial superposition size ($1~{\rm \mu m}\rightarrow 980~\mu {\rm m}$) between the wave packets in less than $0.02$~s by using the Earth's gravitational acceleration and then the diamagnetic repulsive scattering of the nanocrystal, neither of which depend on the object mass. Finally, the wave packet trajectories can be closed so that spatial interference fringes can be observed. Our findings highlight the potential of combining gravitational acceleration and diamagnetic repulsion to create and manipulate large spatial superpositions, offering new insights into creating macroscopic quantum superpositions.


title: Gauging Noninvertible Defects: A 2-Categorical Perspective

abstract: We generalize the notion of an anomaly for a symmetry to a noninvertible symmetry enacted by surface operators using the framework of condensation in 2-categories. Given a multifusion 2-category, potentially with some additional levels of monoidality, we prove theorems about the structure of the 2-category obtained by condensing a suitable algebra object. We give examples where the resulting category displays grouplike fusion rules and through a cohomology computation, find the obstruction to condensing further to the vacuum theory.


title: An ever-present $Gaia$ snail shell triggered by a dark matter wake

abstract: We utilize a novel numerical technique to model star formation in cosmological simulations of galaxy formation - called Superstars - to simulate a Milky Way-like galaxy with $\gtrsim10^8$ star particles to study the formation and evolution of out-of-equilibrium stellar disc structures in a full cosmological setting. In the plane defined by the coordinate and velocity perpendicular to the mid-plane (vertical phase space, $\{Z,V_Z\}$), stars in Solar-like volumes at late times exhibit clear spirals qualitatively similar in shape and amplitude to the $Gaia$ ``Snail shell'' phase spiral. We show that the phase spiral forms at a look back time of $\sim 6$ Gyr during the pericentric passage of a $\sim10^{10}$ $\rm M_{\odot}$ satellite on a polar orbit. This satellite stimulates the formation of a resonant wake in the dark matter halo while losing mass at a rate of $\sim0.5$-$1$ dex per orbit loop. The peak magnitude of the wake-induced gravitational torque at the Solar radius is $\sim 8$ times that from the satellite, and triggers the formation of a disc warp that wraps up into a vertical phase spiral over time. As the wake decays, the phase spiral propagates several Gigayears to present-day and can be described as ``ever-present'' once stable disc evolution is established. These results suggest an alternative scenario to explain the $Gaia$ phase spiral which does not rely on a perturbation from bar buckling or a recent direct hit from a satellite.


title: Orbital magnetic quadrupole moment in higher order topological phases

abstract: We study the orbital magnetic quadrupole moment (MQM) in three dimensional higher-order topological phases. Much like electric quadrupole moment, which is associated with a charge response on the boundaries of a finite sample, the diagonal components of the MQM manifest as surface-localized magnetization and hinge currents. The hinge current is generally not equal to the difference of surface magnetizations that intersect at the hinge, and we show this mismatch is precisely quantified by the bulk MQM. We derive a quantum mechanical formula for the layer-resolved magnetization in slab geometries and use it to define the MQM of systems with gapped boundaries. Our formalism is then applied to several higher-order topological phases, and we show that the MQM can distinguish phases in some intrinsic and boundary-obstructed higher-order topological insulators. We then show that derivatives of the MQM with respect to the chemical potential can act as quantized topological invariants, similar to obtaining the 2D Chern number as a derivative of the magnetization with respect to the chemical potential. These invariants provide a new way to characterize 3D time-reversal breaking insulators that have vanishing magnetization.


title: Towards an electrostatic storage ring for fundamental physics measurements

abstract: We describe a new table-top electrostatic storage ring concept for $30$ keV polarized ions at frozen spin condition. The device will ultimately be capable of measuring magnetic fields with a resolution of 10$^{-21}$ T with sub-mHz bandwidth. With the possibility to store different kinds of ions or ionic molecules and access to prepare and probe states of the systems using lasers and SQUIDs, it can be used to search for electric dipole moments (EDMs) of electrons and nucleons, as well as axion-like particle dark matter and dark photon dark matter. Its sensitivity potential stems from several hours of storage time, comparably long spin coherence times, and the possibility to trap up to 10$^9$ particles in bunches with possibly different state preparations for differential measurements. As a dark matter experiment, it is most sensitive in the mass range of 10$^{-10}$ to 10$^{-19}$ eV, where it can potentially probe couplings orders of magnitude below current and proposed laboratory experiments.

categories: hep-ex astro-ph.CO hep-ph physics.atom-ph


title: The White Dwarf Binary Pathways Survey -- IX. Three long period white dwarf plus subgiant binaries

abstract: Virtually all binaries consisting of a white dwarf with a non-degenerate companion can be classified as either close post-interaction systems (with orbital periods of a few days or less), or wide systems (with periods longer than decades), in which both components have effectively evolved as single stars. Binaries with periods between these two extremes can help constrain common envelope efficiency, or highlight alternative pathways towards the creation of compact binaries. To date such binaries have remained mostly elusive. Here we present three white dwarfs in binaries with evolved subgiant stars with orbital periods of 41, 52 and 461 d. Using Hubble Space Telescope spectroscopy we find that all three systems contain low mass white dwarfs ($\leq$0.4 M$_{\odot}$). One system, TYC 8394$-$1331$-$1, is the inner binary of a hierarchical triple, where the white dwarf plus subgiant binary is orbited by a more distant companion star. These binaries were likely formed from a phase of stable but non-conservative mass transfer, as opposed to common envelope evolution. All three systems will undergo a common envelope phase in the future, but the two shorter period systems are expected to merge during this event, while the longest period system is likely to survive and create a close binary with two low mass white dwarfs.


title: Turbulent dynamics in two-dimensional paraxial fluid of light

abstract: Turbulence in quantum fluids has, surprisingly, a lot in common with its classical counterpart. Recently, cold atomic gases has emerged as a well controlled experimental platform to study turbulent dynamics. In this work, we introduce a novel system to study quantum turbulence in optics, with the major advantage of having access to a wide range of characterization tools available for light fields. In particular we report the temporal dynamics of density and phase and we show the emergence of isotropy in momentum space and the presence of different scaling laws in the incompressible kinetic energy spectrum. The microscopic origin of the algebraic exponents in the energy spectrum is discussed by studying the internal structure of quantized vortices within the healing length and their clustering at larger length scales. These results are obtained using two counter-streaming fluids of light, which allows for a precise preparation of the initial state and the in-situ measurement of the compressible and incompressible fluid velocity.


title: The impact of stochastic modeling on the predictive power of galaxy formation simulations

abstract: All modern galaxy formation models employ stochastic elements in their sub-grid prescriptions to discretise continuous equations across the time domain. In this paper, we investigate how the stochastic nature of these models, notably star formation, black hole accretion, and their associated feedback, that act on small ($<$ kpc) scales, can back-react on macroscopic galaxy properties (e.g. stellar mass and size) across long ($>$ Gyr) timescales. We find that the scatter in scaling relations predicted by the EAGLE model implemented in the SWIFT code can be significantly impacted by random variability between re-simulations of the same object, even when galaxies are resolved by tens of thousands of particles. We then illustrate how re-simulations of the same object can be used to better understand the underlying model, by showing how correlations between galaxy stellar mass and black hole mass disappear at the highest black hole masses ($M_{\rm BH} > 10^8$ M$_\odot$), indicating that the feedback cycle may be interrupted by external processes. We find that although properties that are collected cumulatively over many objects are relatively robust against random variability (e.g. the median of a scaling relation), the properties of individual galaxies (such as galaxy stellar mass) can vary by up to 25\%, even far into the well-resolved regime, driven by bursty physics (black hole feedback) and mergers between galaxies. We suggest that studies of individual objects within cosmological simulations be treated with caution, and that any studies aiming to closely investigate such objects must account for random variability within their results.


title: Using supernova neutrinos to probe strange spin of proton with JUNO and THEIA

abstract: The strange quark contribution to proton's spin ($\Delta s$) is a fundamental quantity that is poorly determined from current experiments. Neutrino-proton elastic scattering (pES) is a promising channel to measure this quantity, and requires an intense source of low-energy neutrinos and a low-threshold detector with excellent resolution. In this paper, we propose that neutrinos from a galactic supernova and their interactions with protons in large-volume scintillation detectors can be utilized to determine $\Delta s$. The spectra of all flavors of supernova neutrinos can be independently determined using a combination of DUNE and Super-(Hyper-)Kamiokande. This allows us to predict pES event rates in JUNO and THEIA, and estimate $\Delta s$ by comparing with detected events. We find that the projected sensitivity for a supernova at 1 kpc (10 kpc), is approximately $\pm 0.01$ ($\pm 0.15$). Interestingly, the limits from a nearby supernova would be comparable to the results from lattice QCD, and better than polarized deep-inelastic scattering experiments. Using supernova neutrinos provides a true $Q^2\rightarrow 0$ measurement, and thus an axial-mass independent determination of $\Delta s$.


title: Turbulent reconnection acceleration

abstract: The ubiquitous turbulence in astrophysical plasmas is important for both magnetic reconnection and reconnection acceleration. We study the particle acceleration during fast 3D turbulent reconnection with reconnection-driven turbulence. Particles bounce back and forth between the reconnection-driven inflows due to the mirror reflection and convergence of strong magnetic fields. Via successive head-on collisions, the kinetic energy of the inflows is converted into the accelerated particles. Turbulence not only regulates the inflow speed but also introduces various inflow obliquities with respect to the local turbulent magnetic fields. As both the energy gain and escape probability of particles depend on the inflow speed, the spectral index of particle energy spectrum is not universal. We find it in the range from $\approx 2.5$ to $4$, with the steepest spectrum expected at a strong guide field, i.e. a small angle between the total incoming magnetic field and the guide field. Without scattering diffusion needed for confining particles, the reconnection acceleration can be very efficient at a large inflow speed and a weak guide field.


title: Constraints on the Doublet Left-Right Symmetric Model from Higgs data

abstract: We study the constraints on the doublet left-right symmetric model (DLRSM) arising due to the Higgs data. The $SU(2)_L$ symmetry of this model is broken by three vacuum expectation values, $\kappa_1$, $\kappa_2$, and $v_L$. Most studies of this model assume that the ratios $r = \kappa_2/\kappa_1$ and $w = v_L/\kappa_1$ are very small. In this work, we study the constraints imposed on $r$ and $w$ by the Higgs data from LHC. We consider the most general scalar potential and calculate the masses of the CP-even scalars and the couplings of the lightest of these scalars to itself, to $W$ and $Z$ gauge bosons, and to the third generation quarks. We find that there is no lower bound on either $r$ or $w$. Equating the mass of the lightest CP-even scalar to $125$ GeV leads to an upper limit $w < 6.7$. The requirement that the Yukawa coupling of the quarks to the Higgs bidoublet of the model should be perturbative yields the upper bounds $r < 0.8$ and $w < 3.5$. The Yukawa coupling of the bottom quark to the lightest CP-even scalar strongly disfavours value of $r, w < 0.1$ and shows a marked preference for values of $w \sim \mathcal{O}(1)$.


title: The parton-level structure of $e^+e^-$ to 2 jets at N$^3$LO

abstract: We investigate the quantum chromodynamics (QCD) corrections to hadronic final states in electron-positron collisions at $\mathcal{O}(\alpha_s^3)$ in the strong coupling constant $\alpha_s$. Namely, we analytically compute the total cross section for this process by separately integrating the tree-level five-parton, the one-loop four-parton, the two-loop three-parton, and the three-loop two-parton matrix elements over the respective phase space. All the contributions to the calculation are treated in a common framework whereby phase space integrals are expressed as physical cuts of the four-loop two-point function. We check the cancellation of infrared poles at all colour levels and we reproduce the known result for the $R$-ratio at order $\alpha_s^3$.


title: SexWEs: Domain-Aware Word Embeddings via Cross-lingual Semantic Specialisation for Chinese Sexism Detection in Social Media

abstract: The goal of sexism detection is to mitigate negative online content targeting certain gender groups of people. However, the limited availability of labeled sexism-related datasets makes it problematic to identify online sexism for low-resource languages. In this paper, we address the task of automatic sexism detection in social media for one low-resource language -- Chinese. Rather than collecting new sexism data or building cross-lingual transfer learning models, we develop a cross-lingual domain-aware semantic specialisation system in order to make the most of existing data. Semantic specialisation is a technique for retrofitting pre-trained distributional word vectors by integrating external linguistic knowledge (such as lexico-semantic relations) into the specialised feature space. To do this, we leverage semantic resources for sexism from a high-resource language (English) to specialise pre-trained word vectors in the target language (Chinese) to inject domain knowledge. We demonstrate the benefit of our sexist word embeddings (SexWEs) specialised by our framework via intrinsic evaluation of word similarity and extrinsic evaluation of sexism detection. Compared with other specialisation approaches and Chinese baseline word vectors, our SexWEs shows an average score improvement of 0.033 and 0.064 in both intrinsic and extrinsic evaluations, respectively. The ablative results and visualisation of SexWEs also prove the effectiveness of our framework on retrofitting word vectors in low-resource languages.


title: Large $N$ Matrix Quantum Mechanics as a Quantum Memory

abstract: In this paper, we explore the possibility of building a quantum memory that is robust to thermal noise using large $N$ matrix quantum mechanics models. First, we investigate the gauged $SU(N)$ matrix harmonic oscillator and different ways to encode quantum information in it. By calculating the mutual information between the system and a reference which purifies the encoded information, we identify a transition temperature, $T_c$, below which the encoded quantum information is protected from thermal noise for a memory time scaling as $N^2$. Conversely, for temperatures higher than $T_c$, the information is quickly destroyed by thermal noise. Second, we relax the requirement of gauge invariance and study a matrix harmonic oscillator model with only global symmetry. Finally, we further relax even the symmetry requirement and propose a model that consists of a large number $N^2$ of qubits, with interactions derived from an approximate $SU(N)$ symmetry. In both ungauged models, we find that the effects of gauging can be mimicked using an energy penalty to give a similar result for the memory time. The final qubit model also has the potential to be realized in the laboratory.


title: Enhanced eigenvector sensitivity and algebraic classification of sublattice-symmetric exceptional points

abstract: Exceptional points (EPs) are degeneracy of non-Hermitian Hamiltonians, at which the eigenvalues, along with their eigenvectors, coalesce. Their orders are given by the Jordan decomposition. Here, we focus on higher-order EPs arising in fermionic systems with a sublattice symmetry, which restricts the eigenvalues of the Hamitlonian to appear in pairs of $\lbrace E, -E\rbrace $. Thus, a naive prediction might lead to only even-order EPs at zero energy. However, we show that odd-order EPs can exist and exhibit enhanced sensitivity in the behaviour of eigenvector-coalescence in their neighbourhood, depending on how we approach the degenerate point. The odd-order EPs can be understood as a mixture of higher- and lower-valued even-order EPs. Such an anomalous behaviour is related to the irregular topology of the EPs as the subspace of the Hamiltonians in question, which is a unique feature of the Jordan blocks. The enhanced eigenvector sensitivity can be described by observing how the quantum distance to the target eigenvector converges to zero. In order to capture the eigenvector-coalescence, we provide an algebraic method to describe the conditions for the existence of these EPs. This complements previous studies based on resultants and discriminants, and unveils heretofore unexplored structures of higher-order exceptional degeneracy.

categories: quant-ph cond-mat.mes-hall hep-th physics.optics


title: Geometry Optimization for Long-lived Particle Detectors

abstract: The proposed designs of many auxiliary long-lived particle (LLP) detectors at the LHC call for the instrumentation of a large surface area inside the detector volume, in order to reliably reconstruct tracks and LLP decay vertices. Taking the CODEX-b detector as an example, we provide a proof-of-concept optimization analysis that demonstrates the required instrumented surface area can be substantially reduced for many LLP models, while only marginally affecting the LLP signal efficiency. This optimization permits a significant reduction in cost and installation time, and may also inform the installation order for modular detector elements. We derive a branch-and-bound based optimization algorithm that permits highly computationally efficient determination of optimal detector configurations, subject to any specified LLP vertex and track reconstruction requirements. We outline the features of a newly-developed generalized simulation framework, for the computation of LLP signal efficiencies across a range of LLP models and detector geometries.


title: kogito: A Commonsense Knowledge Inference Toolkit

abstract: In this paper, we present kogito, an open-source tool for generating commonsense inferences about situations described in text. kogito provides an intuitive and extensible interface to interact with natural language generation models that can be used for hypothesizing commonsense knowledge inference from a textual input. In particular, kogito offers several features for targeted, multi-granularity knowledge generation. These include a standardized API for training and evaluating knowledge models, and generating and filtering inferences from them. We also include helper functions for converting natural language texts into a format ingestible by knowledge models - intermediate pipeline stages such as knowledge head extraction from text, heuristic and model-based knowledge head-relation matching, and an ability to define and use custom knowledge relations. We make the code for kogito available at https://github.com/epfl-nlp/kogito along with thorough documentation at https://kogito.readthedocs.io.


title: Character sums over sparse elements of finite fields

abstract: We estimate mixed character sums of polynomial values over elements of a finite field $\mathbb F_{q^r}$ with sparse representations in a fixed ordered basis over the subfield $\mathbb F_q$. First we use a combination of the inclusion-exclusion principle with bounds on character sums over linear subspaces to get nontrivial bounds for large $q$. Then we focus on the particular case $q=2$, which is more intricate. The bounds depend on certain natural restrictions. We also provide families of examples for which the conditions of our bounds are fulfilled. In particular, we completely classify all monomials as argument of the additive character for which our bound is applicable. Moreover, we also show that it is applicable for a large family of rational functions, which includes all reciprocal monomials.


title: Improved techniques for deterministic l2 robustness

abstract: Training convolutional neural networks (CNNs) with a strict 1-Lipschitz constraint under the $l_{2}$ norm is useful for adversarial robustness, interpretable gradients and stable training. 1-Lipschitz CNNs are usually designed by enforcing each layer to have an orthogonal Jacobian matrix (for all inputs) to prevent the gradients from vanishing during backpropagation. However, their performance often significantly lags behind that of heuristic methods to enforce Lipschitz constraints where the resulting CNN is not \textit{provably} 1-Lipschitz. In this work, we reduce this gap by introducing (a) a procedure to certify robustness of 1-Lipschitz CNNs by replacing the last linear layer with a 1-hidden layer MLP that significantly improves their performance for both standard and provably robust accuracy, (b) a method to significantly reduce the training time per epoch for Skew Orthogonal Convolution (SOC) layers (>30\% reduction for deeper networks) and (c) a class of pooling layers using the mathematical property that the $l_{2}$ distance of an input to a manifold is 1-Lipschitz. Using these methods, we significantly advance the state-of-the-art for standard and provable robust accuracies on CIFAR-10 (gains of +1.79\% and +3.82\%) and similarly on CIFAR-100 (+3.78\% and +4.75\%) across all networks. Code is available at \url{https://github.com/singlasahil14/improved_l2_robustness}.


title: Flexible Hybrid Beamforming for Spectrally Efficient 6G Joint Radar-Communications

abstract: Joint radar-communications (JRC) benefits from multi-functionality of radar and communication operations using same hardware and radio frequency (RF) spectrum resources. Thus JRC systems possess very high potential to be employed into the sixth generation (6G) standards. This paper designs a flexible beamformer for multiple-input multiple output (MIMO) JRC with maximized spectral efficiency (SE). Hybrid beamforming is implemented which constitutes lesser number of RF chains than number of transmitter antennas. We jointly express JRC rate with communication and radar entities including a weighting factor which depicts the dominance of one operation over the other. The joint-SE based proposed method optimally selects the number of RF chains with flexible hynrid beamforming design. Furthermore, when the communication operation takes place the proposed method takes into account the interference occurring from the radar operation and vice-versa. Fractional programming based selection procedure is used for flexible beamforming and optimal number of RF chains while considering interference of each operation. Simulation results are presented and compared with different baselines to show effectiveness of the proposed flexible hybrid beamforming method.


title: Point-wise Symmetry of Birkhoff-James Orthogonality and Geometry of $\mathbb{B}(\ell_\infty^n,\ell_1^m)$

abstract: We study the relationship between the point-wise symmetry of Birkhoff-James orthogonality and the geometry of the space of operators $\mathbb{B}(\ell_\infty^n,\ell_1^m)$. We show that any non-zero left-symmetric point in this space is a smooth point. We also show that for $n\geq4$, any unit norm right-symmetric point of this space is an extreme point of the closed unit ball. This marks the first step towards characterizing the extreme points of these unit balls and finding the Grothendieck constants $G(m,n)$ using Birkhoff-James orthogonality techniques.


title: Microscopic dynamics at the Running of the Bulls (San Fermin Festival) in the context of the Social Force Model

abstract: This research explores the dynamics of the emergency evacuation during the "Running of the Bulls" festival (Spain, 2013). As people run to escape from danger, many pedestrians stumble and fall down, while others will try to pass over them. We carefully examined three specific recordings of the running, that show this kind of behavior. We developed a microscopic model mimicking the stumbling mechanism in the context of the Social Force Model (SFM). In our model, "moving" individuals can suddenly switch to a "fallen" state when they are in the vicinity of a fallen individual. We arrived to the conclusion that the presence of a fallen pedestrian increases dramatically the falling probability of the pedestrians nearby. Also, the product between the local density gradient and the velocity of each pedestrian appears as a relevant indicator for an imminent fall. We call this the pedestrian "falling susceptibility (f_s)".


title: Millimeter Wave Channel Estimation for Lens based Hybrid MIMO with Low Resolution ADCs

abstract: The high path loss associated with millimeter wave (mmWave) frequency communication can be compensated by large scale antenna arrays such as multiple-input multiple-output (MIMO) systems. The hybrid beamforming architecture which uses fewer radio frequency chains is implemented to reduce power consumption and hardware complexity, while still supporting multi-stream communication. We propose an efficient expectation-maximization (EM)-based mmWave channel estimator for a lens-based hybrid MIMO system with low resolution sampling at the receiver. The lens-based beamformer is investigated to provide increased antenna gain and reduced implementation complexity as the conventional beam selection network is excluded. Low resolution sampling at the analog-to-digital converters is implemented for reduced power consumption. The proposed solution with a robust maximum a posteriori estimator based on the EM algorithm performs better than the conventional EM approach and minimum mean square error baselines in medium to high signal-to-noise ratio regions.