title: Data-Efficient Double-Win Lottery Tickets from Robust Pre-training

abstract: Pre-training serves as a broadly adopted starting point for transfer learning on various downstream tasks. Recent investigations of lottery tickets hypothesis (LTH) demonstrate such enormous pre-trained models can be replaced by extremely sparse subnetworks (a.k.a. matching subnetworks) without sacrificing transferability. However, practical security-crucial applications usually pose more challenging requirements beyond standard transfer, which also demand these subnetworks to overcome adversarial vulnerability. In this paper, we formulate a more rigorous concept, Double-Win Lottery Tickets, in which a located subnetwork from a pre-trained model can be independently transferred on diverse downstream tasks, to reach BOTH the same standard and robust generalization, under BOTH standard and adversarial training regimes, as the full pre-trained model can do. We comprehensively examine various pre-training mechanisms and find that robust pre-training tends to craft sparser double-win lottery tickets with superior performance over the standard counterparts. For example, on downstream CIFAR-10/100 datasets, we identify double-win matching subnetworks with the standard, fast adversarial, and adversarial pre-training from ImageNet, at 89.26%/73.79%, 89.26%/79.03%, and 91.41%/83.22% sparsity, respectively. Furthermore, we observe the obtained double-win lottery tickets can be more data-efficient to transfer, under practical data-limited (e.g., 1% and 10%) downstream schemes. Our results show that the benefits from robust pre-training are amplified by the lottery ticket scheme, as well as the data-limited transfer setting. Codes are available at https://github.com/VITA-Group/Double-Win-LTH.


title: Neural Bregman Divergences for Distance Learning

abstract: Many metric learning tasks, such as triplet learning, nearest neighbor retrieval, and visualization, are treated primarily as embedding tasks where the ultimate metric is some variant of the Euclidean distance (e.g., cosine or Mahalanobis), and the algorithm must learn to embed points into the pre-chosen space. The study of non-Euclidean geometries is often not explored, which we believe is due to a lack of tools for learning non-Euclidean measures of distance. Recent work has shown that Bregman divergences can be learned from data, opening a promising approach to learning asymmetric distances. We propose a new approach to learning arbitrary Bergman divergences in a differentiable manner via input convex neural networks and show that it overcomes significant limitations of previous works. We also demonstrate that our method more faithfully learns divergences over a set of both new and previously studied tasks, including asymmetric regression, ranking, and clustering. Our tests further extend to known asymmetric, but non-Bregman tasks, where our method still performs competitively despite misspecification, showing the general utility of our approach for asymmetric learning.


title: Magnetic Fields on FIRE: Comparing B-fields in the multiphase ISM and CGM of Simulated L$_*$ Galaxies to Observations

abstract: The physics of magnetic fields ($\textbf{B}$) and cosmic rays (CRs) have recently been included in simulations of galaxy formation. However, significant uncertainties remain in how these components affect galaxy evolution. To understand their common observational tracers, we analyze the magnetic fields in a set of high-resolution, magneto-hydrodynamic, cosmological simulations of Milky-Way-like galaxies from the FIRE-2 project. We compare mock observables of magnetic field tracers for simulations with and without CRs to observations of Zeeman splitting and rotation/dispersion measures. We find reasonable agreement between simulations and observations in both the neutral and the ionised interstellar medium (ISM). We find that the simulated galaxies with CRs show weaker ISM $|\textbf{B}|$ fields on average compared to their magnetic-field-only counterparts. This is a manifestation of the effects of CRs in the diffuse, low density inner circum-galactic medium (CGM). We find that equipartition between magnetic and cosmic ray energy densities may be valid at large ($>$ 1 kpc) scales for typical ISM densities of Milky-Way-like galaxies, but not in their halos. Within the ISM, the magnetic fields in our simulated galaxies follow a power-law scaling with gas density. The scaling extends down to hydrogen number densities $<$ 300 cm$^{-3}$, in contrast to observationally-derived models, but consistent with the observational measurements. Finally, we generate synthetic rotation measure (RM) profiles for projections of the simulated galaxies and compare to observational constraints in the CGM. While consistent with upper limits, improved data are needed to detect the predicted CGM RMs at 10-200 kpc and better constrain theoretical predictions.


title: On the Gravitational Wave to Matter Coupling of Superfluid Fermi Gases Near Unitarity

abstract: It is well known that gravitational waves distort equilibrium matter globally, making them amenable to detection with laser interferometers. Less well known is the fact that gravitational waves create local non-equilibrium stresses inside matter, which could conceivably lead to alternative detection methods. The gravitational wave to matter coupling $\kappa$ is a transport coefficient depending on the material, and is poorly known for most substances. In the present work, we calculate $\kappa$ for a superfluid Fermi gas near unitarity using large-$N$ techniques, finding $\kappa= \frac{n}{12m}$, with $n$ the number density and $m$ the mass of the fermion, matching the result for free Dirac fermions at zero temperature. Our prediction is amenable to non-perturbative theoretical as well as experimental tests.


title: Developing synthetic individual-level population datasets: The case of contextualizing maps of privacy-preserving census data

abstract: The purpose of this paper is to describe the development of a synthetic population dataset that is open and realistic and can be used to facilitate understanding the cartographic process and contextualizing the cartographic artifacts. We first discuss an optimization model that is designed to construct the synthetic population by minimizing the difference between the summarized information of the synthetic populations and the statistics published in census data tables. We then illustrate how the synthetic population dataset can be used to contextualize maps made using privacy-preserving census data. Two counties in Ohio are used as case studies.


title: What Do We Mean When We Say "Insight"? A Formal Synthesis of Existing Theory

abstract: Researchers have derived many theoretical models for specifying users' insights as they interact with a visualization system. These representations are essential for understanding the insight discovery process, such as when inferring user interaction patterns that lead to insight or assessing the rigor of reported insights. However, theoretical models can be difficult to apply to existing tools and user studies, often due to discrepancies in how insight and its constituent parts are defined. This paper calls attention to the consistent structures that recur across the visualization literature and describes how they connect multiple theoretical representations of insight. We synthesize a unified formalism for insights using these structures, enabling a wider audience of researchers and developers to adopt the corresponding models. Through a series of theoretical case studies, we use our formalism to compare and contrast existing theories, revealing interesting research challenges in reasoning about a user's domain knowledge and leveraging synergistic approaches in data mining and data management research.


title: Perspective: Molecular beam epitaxy of antiperovskite oxides

abstract: Antiperovskites, or inverse perovskites, have recently emerged as a material class with a plethora of promising electronic properties. This perspective describes the molecular beam epitaxy (MBE) growth of oxide antiperovskites Sr$_3$PbO and Sr$_3$SnO. We show that MBE offers great potential not only in growing antiperovskites with high structural quality, but also in providing a means to seamlessly connect with advanced characterization tools, including x-ray photoelectron spectroscopy (XPS), low-energy electron diffraction (LEED), reflection high-energy electron diffraction (RHEED), and scanning tunneling microscopy (STM), to facilitate the analyses of their intrinsic properties. The initial results point toward the feasibility of atomically controlled antiperovskite growth, which could open doors to study topological and correlated electronic states in an electronic environment quite distinct from what is available in conventional complex oxides.


title: CLAP: Learning Audio Concepts From Natural Language Supervision

abstract: Mainstream Audio Analytics models are trained to learn under the paradigm of one class label to many recordings focusing on one task. Learning under such restricted supervision limits the flexibility of models because they require labeled audio for training and can only predict the predefined categories. Instead, we propose to learn audio concepts from natural language supervision. We call our approach Contrastive Language-Audio Pretraining (CLAP), which learns to connect language and audio by using two encoders and a contrastive learning to bring audio and text descriptions into a joint multimodal space. We trained CLAP with 128k audio and text pairs and evaluated it on 16 downstream tasks across 8 domains, such as Sound Event Classification, Music tasks, and Speech-related tasks. Although CLAP was trained with significantly less pairs than similar computer vision models, it establishes SoTA for Zero-Shot performance. Additionally, we evaluated CLAP in a supervised learning setup and achieve SoTA in 5 tasks. Hence, CLAP's Zero-Shot capability removes the need of training with class labels, enables flexible class prediction at inference time, and generalizes to multiple downstream tasks.


title: A Continuous-Time Perspective on Global Acceleration for Monotone Equation Problems

abstract: We propose a new framework to design and analyze accelerated methods that solve general monotone equation (ME) problems $F(x)=0$. Traditional approaches include generalized steepest descent methods and inexact Newton-type methods. If $F$ is uniformly monotone and twice differentiable, these methods achieve local convergence rates while the latter methods are globally convergent thanks to line search and hyperplane projection. However, a global rate is unknown for these methods. The variational inequality methods can be applied to yield a global rate that is expressed in terms of $\|F(x)\|$ but these results are restricted to first-order methods and a Lipschitz continuous operator. It has not been clear how to obtain global acceleration using high-order Lipschitz continuity. This paper takes a continuous-time perspective where accelerated methods are viewed as the discretization of dynamical systems. Our contribution is to propose accelerated rescaled gradient systems and prove that they are equivalent to closed-loop control systems. Based on this connection, we establish the properties of solution trajectories. Moreover, we provide a unified algorithmic framework obtained from discretization of our system, which together with two approximation subroutines yields both existing high-order methods and new first-order methods. We prove that the $p^{th}$-order method achieves a global rate of $O(k^{-p/2})$ in terms of $\|F(x)\|$ if $F$ is $p^{th}$-order Lipschitz continuous and the first-order method achieves the same rate if $F$ is $p^{th}$-order strongly Lipschitz continuous. If $F$ is strongly monotone, the restarted versions achieve local convergence with order $p$ when $p \geq 2$. Our discrete-time analysis is largely motivated by the continuous-time analysis and demonstrates the fundamental role that rescaled gradients play in global acceleration for solving ME problems.


title: Joint Entropy Search for Maximally-Informed Bayesian Optimization

abstract: Information-theoretic Bayesian optimization techniques have become popular for optimizing expensive-to-evaluate black-box functions due to their non-myopic qualities. Entropy Search and Predictive Entropy Search both consider the entropy over the optimum in the input space, while the recent Max-value Entropy Search considers the entropy over the optimal value in the output space. We propose Joint Entropy Search (JES), a novel information-theoretic acquisition function that considers an entirely new quantity, namely the entropy over the joint optimal probability density over both input and output space. To incorporate this information, we consider the reduction in entropy from conditioning on fantasized optimal input/output pairs. The resulting approach primarily relies on standard GP machinery and removes complex approximations typically associated with information-theoretic methods. With minimal computational overhead, JES shows superior decision-making, and yields state-of-the-art performance for information-theoretic approaches across a wide suite of tasks. As a light-weight approach with superior results, JES provides a new go-to acquisition function for Bayesian optimization.


title: Generalizations of Snyder model to curved spaces

abstract: We consider generalizations of the Snyder algebra to a curved spacetime background with de Sitter symmetry. As special cases, we obtain the algebras of the Yang model and of triply special relativity. We discuss the realizations of these algebras in terms of canonical phase space coordinates, up to fourth order in the deformation parameters. In the case of triply special relativity we also find exact realization, exploiting its algebraic relation with the Snyder model.


title: To What Extent Do Disadvantaged Neighborhoods Mediate Social Assistance Dependency? Evidence from Sweden

abstract: Occasional social assistance prevents individuals from a range of social ills, particularly unemployment and poverty. It remains unclear, however, how and to what extent continued reliance on social assistance leads to individuals becoming trapped in social assistance dependency. In this paper, we build on the theory of cumulative disadvantage and examine whether the accumulated use of social assistance over the life course is associated with an increased risk of future social assistance recipiency. We also analyze the extent to which living in disadvantaged neighborhoods constitutes an important mechanism in the explanation of this association. Our analyses use Swedish population registers for the full population of individuals born in 1981, and these individuals are followed for approximately 17 years. While most studies are limited by a lack of granular, life-history data, our granular individual-level data allow us to apply causal-mediation analysis, and thereby quantify the extent to which the likelihood of ending up in social assistance dependency is affected by residing in disadvantaged neighborhoods. Our findings show the accumulation of social assistance over the studied period is associated with a more than four-fold increase on a risk ratio scale for future social assistance recipiency, compared to never having received social assistance during the period examined. Then, we examine how social assistance dependency is mediated by prolonged exposure to disadvantaged neighborhoods. Our results suggest that the indirect effect of disadvantaged neighborhoods is weak to moderate. Therefore, social assistance dependency may be a multilevel process. Future research is to explore how the mediating effects of disadvantaged neighborhoods vary in different contexts.


title: An approximation algorithm for random generation of capacities

abstract: Capacities on a finite set are sets functions vanishing on the empty set and being monotonic w.r.t. inclusion. Since the set of capacities is an order polytope, the problem of randomly generating capacities amounts to generating all linear extensions of the Boolean lattice. This problem is known to be intractable even as soon as $n>5$, therefore approximate methods have been proposed, most notably one based on Markov chains. Although quite accurate, this method is time consuming. In this paper, we propose the 2-layer approximation method, which generates a subset of linear extensions, eliminating those with very low probability. We show that our method has similar performance compared to the Markov chain but is much less time consuming.


title: Polyhedral compactifications of Bruhat-Tits buildings of quasi-reductive groups

abstract: Given a quasi-reductive group $G$ over a local field $k$, using Berkovich geometry, we exhibit a family of $G(k)$-equivariant compactifications of the Bruhat-Tits building $\mathcal B(G, k)$, constructed and investigated by Solleveld and Louren\c{c}o. The compactification procedure consists in mapping the building in the analytification $G^{\mathrm{an}}$ of $G$, then composing this map with the projections from $G^{\mathrm{an}}$ to its (in general non-compact) pseudo-flag varieties $(G/P)^{\mathrm{an}}$, for $P$ ranging among the pseudo-parabolic subgroups of $G$. This generalises previous constructions of Berkovich, then R\'emy, Thuillier and Werner. To define the embedding, we are led to giving a partial extension to the quasi-reductive context of results due to Rousseau on the functoriality of Bruhat-Tits buildings with respect to field extensions, which are of independent interest. Finally, we conclude by investigating the geometry at infinity of these compactifications. The boundaries are shown to be stratified, each stratum being equivariantly homeomorphic to the Bruhat-Tits building of the maximal quasi-reductive quotient of a pseudo-parabolic subgroup.


title: What should AI see? Using the Public's Opinion to Determine the Perception of an AI

abstract: Deep neural networks (DNN) have made impressive progress in the interpretation of image data, so that it is conceivable and to some degree realistic to use them in safety critical applications like automated driving. From an ethical standpoint, the AI algorithm should take into account the vulnerability of objects or subjects on the street that ranges from "not at all", e.g. the road itself, to "high vulnerability" of pedestrians. One way to take this into account is to define the cost of confusion of one semantic category with another and use cost-based decision rules for the interpretation of probabilities, which are the output of DNNs. However, it is an open problem how to define the cost structure, who should be in charge to do that, and thereby define what AI-algorithms will actually "see". As one possible answer, we follow a participatory approach and set up an online survey to ask the public to define the cost structure. We present the survey design and the data acquired along with an evaluation that also distinguishes between perspective (car passenger vs. external traffic participant) and gender. Using simulation based $F$-tests, we find highly significant differences between the groups. These differences have consequences on the reliable detection of pedestrians in a safety critical distance to the self-driving car. We discuss the ethical problems that are related to this approach and also discuss the problems emerging from human-machine interaction through the survey from a psychological point of view. Finally, we include comments from industry leaders in the field of AI safety on the applicability of survey based elements in the design of AI functionalities in automated driving.


title: Trimmed Maximum Likelihood Estimation for Robust Learning in Generalized Linear Models

abstract: We study the problem of learning generalized linear models under adversarial corruptions. We analyze a classical heuristic called the iterative trimmed maximum likelihood estimator which is known to be effective against label corruptions in practice. Under label corruptions, we prove that this simple estimator achieves minimax near-optimal risk on a wide range of generalized linear models, including Gaussian regression, Poisson regression and Binomial regression. Finally, we extend the estimator to the more challenging setting of label and covariate corruptions and demonstrate its robustness and optimality in that setting as well.


title: Dominance Regions for Rank Two Cluster Algebras

abstract: We study the polygons defining the dominance order on $\mathbf{g}$-vectors in cluster algebras of rank 2.


title: Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations

abstract: Offline reinforcement learning has shown great promise in leveraging large pre-collected datasets for policy learning, allowing agents to forgo often-expensive online data collection. However, offline reinforcement learning from visual observations with continuous action spaces remains under-explored, with a limited understanding of the key challenges in this complex domain. In this paper, we establish simple baselines for continuous control in the visual domain and introduce a suite of benchmarking tasks for offline reinforcement learning from visual observations designed to better represent the data distributions present in real-world offline RL problems and guided by a set of desiderata for offline RL from visual observations, including robustness to visual distractions and visually identifiable changes in dynamics. Using this suite of benchmarking tasks, we show that simple modifications to two popular vision-based online reinforcement learning algorithms, DreamerV2 and DrQ-v2, suffice to outperform existing offline RL methods and establish competitive baselines for continuous control in the visual domain. We rigorously evaluate these algorithms and perform an empirical evaluation of the differences between state-of-the-art model-based and model-free offline RL methods for continuous control from visual observations. All code and data used in this evaluation are open-sourced to facilitate progress in this domain.


title: Speak Like a Dog: Human to Non-human creature Voice Conversion

abstract: This paper proposes a new voice conversion (VC) task from human speech to dog-like speech while preserving linguistic information as an example of human to non-human creature voice conversion (H2NH-VC) tasks. Although most VC studies deal with human to human VC, H2NH-VC aims to convert human speech into non-human creature-like speech. Non-parallel VC allows us to develop H2NH-VC, because we cannot collect a parallel dataset that non-human creatures speak human language. In this study, we propose to use dogs as an example of a non-human creature target domain and define the "speak like a dog" task. To clarify the possibilities and characteristics of the "speak like a dog" task, we conducted a comparative experiment using existing representative non-parallel VC methods in acoustic features (Mel-cepstral coefficients and Mel-spectrograms), network architectures (five different kernel-size settings), and training criteria (variational autoencoder (VAE)- based and generative adversarial network-based). Finally, the converted voices were evaluated using mean opinion scores: dog-likeness, sound quality and intelligibility, and character error rate (CER). The experiment showed that the employment of the Mel-spectrogram improved the dog-likeness of the converted speech, while it is challenging to preserve linguistic information. Challenges and limitations of the current VC methods for H2NH-VC are highlighted.


title: Land-Use Filtering for Nonstationary Prediction of Collective Efficacy in an Urban Environment

abstract: Collective efficacy -- the capacity of communities to exert social control toward the realization of their shared goals -- is a foundational concept in the urban sociology and neighborhood effects literature. Traditionally, empirical studies of collective efficacy use large sample surveys to estimate collective efficacy of different neighborhoods within an urban setting. Such studies have demonstrated an association between collective efficacy and local variation in community violence, educational achievement, and health. Unlike traditional collective efficacy measurement strategies, the Adolescent Health and Development in Context (AHDC) Study implemented a new approach, obtaining spatially-referenced, place-based ratings of collective efficacy from a representative sample of individuals residing in Columbus, OH. In this paper, we introduce a novel nonstationary spatial model for interpolation of the AHDC collective efficacy ratings across the study area which leverages administrative data on land use. Our constructive model specification strategy involves dimension expansion of a latent spatial process and the use of a filter defined by the land-use partition of the study region to connect the latent multivariate spatial process to the observed ordinal ratings of collective efficacy. Careful consideration is given to the issues of parameter identifiability, computational efficiency of an MCMC algorithm for model fitting, and fine-scale spatial prediction of collective efficacy.


title: Gliders in shape-changing active matter

abstract: We report in experiment and simulation the spontaneous formation of dynamically bound pairs of shape changing smarticle robots undergoing locally repulsive collisions. Borrowing terminology from Conway's simulated Game of Life, these physical `gliders' robustly emerge from an ensemble of individually undulating three-link two-motor smarticles and can remain bound for hundreds of undulations and travel for multiple robot dimensions. Gliders occur in two distinct binding symmetries and form over a wide range of angular flapping extent. This parameter sets the maximal concavity which influences formation probability and translation characteristics. Analysis of dynamics in simulation reveals the mechanism of effective dynamical attraction -- a result of the emergent interplay of appropriately oriented and timed repulsive interactions.


title: ReFace: Real-time Adversarial Attacks on Face Recognition Systems

abstract: Deep neural network based face recognition models have been shown to be vulnerable to adversarial examples. However, many of the past attacks require the adversary to solve an input-dependent optimization problem using gradient descent which makes the attack impractical in real-time. These adversarial examples are also tightly coupled to the attacked model and are not as successful in transferring to different models. In this work, we propose ReFace, a real-time, highly-transferable attack on face recognition models based on Adversarial Transformation Networks (ATNs). ATNs model adversarial example generation as a feed-forward neural network. We find that the white-box attack success rate of a pure U-Net ATN falls substantially short of gradient-based attacks like PGD on large face recognition datasets. We therefore propose a new architecture for ATNs that closes this gap while maintaining a 10000x speedup over PGD. Furthermore, we find that at a given perturbation magnitude, our ATN adversarial perturbations are more effective in transferring to new face recognition models than PGD. ReFace attacks can successfully deceive commercial face recognition services in a transfer attack setting and reduce face identification accuracy from 82% to 16.4% for AWS SearchFaces API and Azure face verification accuracy from 91% to 50.1%.


title: On the Bias-Variance Characteristics of LIME and SHAP in High Sparsity Movie Recommendation Explanation Tasks

abstract: We evaluate two popular local explainability techniques, LIME and SHAP, on a movie recommendation task. We discover that the two methods behave very differently depending on the sparsity of the data set. LIME does better than SHAP in dense segments of the data set and SHAP does better in sparse segments. We trace this difference to the differing bias-variance characteristics of the underlying estimators of LIME and SHAP. We find that SHAP exhibits lower variance in sparse segments of the data compared to LIME. We attribute this lower variance to the completeness constraint property inherent in SHAP and missing in LIME. This constraint acts as a regularizer and therefore increases the bias of the SHAP estimator but decreases its variance, leading to a favorable bias-variance trade-off especially in high sparsity data settings. With this insight, we introduce the same constraint into LIME and formulate a novel local explainabilty framework called Completeness-Constrained LIME (CLIMB) that is superior to LIME and much faster than SHAP.


title: Building Spatio-temporal Transformers for Egocentric 3D Pose Estimation

abstract: Egocentric 3D human pose estimation (HPE) from images is challenging due to severe self-occlusions and strong distortion introduced by the fish-eye view from the head mounted camera. Although existing works use intermediate heatmap-based representations to counter distortion with some success, addressing self-occlusion remains an open problem. In this work, we leverage information from past frames to guide our self-attention-based 3D HPE estimation procedure -- Ego-STAN. Specifically, we build a spatio-temporal Transformer model that attends to semantically rich convolutional neural network-based feature maps. We also propose feature map tokens: a new set of learnable parameters to attend to these feature maps. Finally, we demonstrate Ego-STAN's superior performance on the xR-EgoPose dataset where it achieves a 30.6% improvement on the overall mean per-joint position error, while leading to a 22% drop in parameters compared to the state-of-the-art.


title: Nanomechanical Characterization of an Antiferromagnetic Topological Insulator

abstract: The antiferromagnetic topological insulator MnBi2Te4 (MBT) exhibits an ideal platform to study exotic topological phenomena and magnetic properties. The transport signatures of magnetic phase transitions in the MBT family materials have been well-studied. However, their mechanical properties and magneto-mechanical coupling have not been well-explored. We use nanoelectromechanical systems to study the intrinsic magnetism in MBT thin flakes via their magnetostrictive coupling. We investigate mechanical resonance signatures of magnetic phase transitions from antiferromagnetic (AFM) to canted antiferromagnetic (cAFM) to ferromagnetic (FM) phases versus magnetic field at different temperatures. The spin-flop transitions in MBT are revealed by frequency shifts of mechanical resonance. With temperatures going above TN, the transitions disappear in the resonance frequency map, consistent with transport measurements. We use a magnetostrictive model to correlate the frequency shifts with the spin-canting states. Our work demonstrates a technique to study magnetic phase transitions, magnetization and magnetoelastic properties of the magnetic topological insulator.


title: Sequential Flows by Irrelevant Operators

abstract: We explore whether one can $T \overline{T}$ deform a collection of theories that are already $T \overline{T}$-deformed. This allows us to define classes of irrelevant deformations that know about subsystems. In some basic cases, we explore the spectrum that results from this procedure and we provide numerical evidence in favor of modular invariance. We also study the flow of the classical Lagrangian for free bosons and free fermions under successive deformations. Some of the models found by sequentially flowing are likely to have interesting holographic interpretations.


title: Dynamics of fractionalized mean-field theories: consequences for Kitaev materials

abstract: There have been substantial recent efforts, both experimentally and theoretically, to find a material realization of the Kitaev spin-liquid--the ground state of the exactly solvable Kitaev model on the honeycomb lattice. Candidate materials are now plentiful, but the presence of non-Kitaev terms makes comparison between theory and experiment challenging. We rederive time-dependent Majorana mean-field theory and extend it to include quantum phase information, allowing the direct computation of the experimentally relevant dynamical spin-spin correlator, which reproduces exact results for the unperturbed model. In contrast to previous work, we find that small perturbations do not substantially alter the exact result, implying that $\alpha$-RuCl${}_3$ is perhaps farther from the Kitaev phase than originally thought. Our approach generalizes to any correlator and to any model where Majorana mean-field theory is a valid starting point.


title: Comprehensive Fair Meta-learned Recommender System

abstract: In recommender systems, one common challenge is the cold-start problem, where interactions are very limited for fresh users in the systems. To address this challenge, recently, many works introduce the meta-optimization idea into the recommendation scenarios, i.e. learning to learn the user preference by only a few past interaction items. The core idea is to learn global shared meta-initialization parameters for all users and rapidly adapt them into local parameters for each user respectively. They aim at deriving general knowledge across preference learning of various users, so as to rapidly adapt to the future new user with the learned prior and a small amount of training data. However, previous works have shown that recommender systems are generally vulnerable to bias and unfairness. Despite the success of meta-learning at improving the recommendation performance with cold-start, the fairness issues are largely overlooked. In this paper, we propose a comprehensive fair meta-learning framework, named CLOVER, for ensuring the fairness of meta-learned recommendation models. We systematically study three kinds of fairness - individual fairness, counterfactual fairness, and group fairness in the recommender systems, and propose to satisfy all three kinds via a multi-task adversarial learning scheme. Our framework offers a generic training paradigm that is applicable to different meta-learned recommender systems. We demonstrate the effectiveness of CLOVER on the representative meta-learned user preference estimator on three real-world data sets. Empirical results show that CLOVER achieves comprehensive fairness without deteriorating the overall cold-start recommendation performance.


title: Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition

abstract: We address the problem of data augmentation for video action recognition. Standard augmentation strategies in video are hand-designed and sample the space of possible augmented data points either at random, without knowing which augmented points will be better, or through heuristics. We propose to learn what makes a good video for action recognition and select only high-quality samples for augmentation. In particular, we choose video compositing of a foreground and a background video as the data augmentation process, which results in diverse and realistic new samples. We learn which pairs of videos to augment without having to actually composite them. This reduces the space of possible augmentations, which has two advantages: it saves computational cost and increases the accuracy of the final trained classifier, as the augmented pairs are of higher quality than average. We present experimental results on the entire spectrum of training settings: few-shot, semi-supervised and fully supervised. We observe consistent improvements across all of them over prior work and baselines on Kinetics, UCF101, HMDB51, and achieve a new state-of-the-art on settings with limited data. We see improvements of up to 8.6% in the semi-supervised setting.


title: Learning Reduced Nonlinear State-Space Models: an Output-Error Based Canonical Approach

abstract: The identification of a nonlinear dynamic model is an open topic in control theory, especially from sparse input-output measurements. A fundamental challenge of this problem is that very few to zero prior knowledge is available on both the state and the nonlinear system model. To cope with this challenge, we investigate the effectiveness of deep learning in the modeling of dynamic systems with nonlinear behavior by advocating an approach which relies on three main ingredients: (i) we show that under some structural conditions on the to-be-identified model, the state can be expressed in function of a sequence of the past inputs and outputs; (ii) this relation which we call the state map can be modelled by resorting to the well-documented approximation power of deep neural networks; (iii) taking then advantage of existing learning schemes, a state-space model can be finally identified. After the formulation and analysis of the approach, we show its ability to identify three different nonlinear systems. The performances are evaluated in terms of open-loop prediction on test data generated in simulation as well as a real world data-set of unmanned aerial vehicle flight measurements.


title: Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream

abstract: Online anomaly detection from a data stream is critical for the safety and security of many applications but is facing severe challenges due to complex and evolving data streams from IoT devices and cloud-based infrastructures. Unfortunately, existing approaches fall too short for these challenges; online anomaly detection methods bear the burden of handling the complexity while offline deep anomaly detection methods suffer from the evolving data distribution. This paper presents a framework for online deep anomaly detection, ARCUS, which can be instantiated with any autoencoder-based deep anomaly detection methods. It handles the complex and evolving data streams using an adaptive model pooling approach with two novel techniques: concept-driven inference and drift-aware model pool update; the former detects anomalies with a combination of models most appropriate for the complexity, and the latter adapts the model pool dynamically to fit the evolving data streams. In comprehensive experiments with ten data sets which are both high-dimensional and concept-drifted, ARCUS improved the anomaly detection accuracy of the streaming variants of state-of-the-art autoencoder-based methods and that of the state-of-the-art streaming anomaly detection methods by up to 22% and 37%, respectively.


title: Securing AI-based Healthcare Systems using Blockchain Technology: A State-of-the-Art Systematic Literature Review and Future Research Directions

abstract: Healthcare systems are increasingly incorporating Artificial Intelligence into their systems, but it is not a solution for all difficulties. AI's extraordinary potential is being held back by challenges such as a lack of medical datasets for training AI models, adversarial attacks, and a lack of trust due to its black box working style. We explored how blockchain technology can improve the reliability and trustworthiness of AI-based healthcare. This paper has conducted a Systematic Literature Review to explore the state-of-the-art research studies conducted in healthcare applications developed with different AI techniques and Blockchain Technology. This systematic literature review proceeds with three different paths as natural language processing-based healthcare systems, computer vision-based healthcare systems and acoustic AI-based healthcare systems. We found that 1) Defence techniques for adversarial attacks on AI are available for specific kind of attacks and even adversarial training is AI based technique which in further prone to different attacks. 2) Blockchain can address security and privacy issues in healthcare fraternity. 3) Medical data verification and user provenance can be enabled with Blockchain. 4) Blockchain can protect distributed learning on heterogeneous medical data. 5) The issues like single point of failure, non-transparency in healthcare systems can be resolved with Blockchain. Nevertheless, it has been identified that research is at the initial stage. As a result, we have synthesized a conceptual framework using Blockchain Technology for AI-based healthcare applications that considers the needs of each NLP, Computer Vision, and Acoustic AI application. A global solution for all sort of adversarial attacks on AI based healthcare. However, this technique has significant limits and challenges that need to be addressed in future studies.


title: Optimization for Infrastructure Cyber-Physical Systems

abstract: Cyber-physical systems (CPS) are systems where a decision making (cyber/control) component is tightly integrated with a physical system (with sensing/actuation) to enable real-time monitoring and control. Recently, there has been significant research effort in viewing and optimizing physical infrastructure in built environments as CPS, even if the control action is not in real-time. Some examples of infrastructure CPS include electrical power grids; water distribution networks; transportation and logistics networks; heating, ventilation, and air conditioning (HVAC) in buildings; etc. Complexity arises in infrastructure CPS from the large scale of operations; heterogeneity of system components; dynamic and uncertain operating conditions; and goal-driven decision making and control with time-bounded task completion guarantees. For control optimization, an infrastructure CPS is typically viewed as a system of semi-autonomous sub-systems with a network of sensors and uses distributed control optimization to achieve system-wide objectives that are typically measured and quantified by better, cheaper, or faster system performance. In this article, we first illustrate the scope for control optimization in common infrastructure CPS. Next, we present a brief overview of current optimization techniques. Finally, we share our research position with a description of specific optimization approaches and their challenges for infrastructure CPS of the future.


title: Precise Calculation of Electrical Capacitance by means of Quadruple Integrals in Method of Moments Technique

abstract: In this paper, the capacitance of a parallel plate air-gap rectangular capacitor, and a unit cube capacitor have been calculated. Because of its generality and simplicity, the method of moments (MOM) Technique is utilized. In order to improve the accuracy of the calculations, the use of quadratic integrals instead of binary integrals has been proposed. A neat form is provided for the analytical solution of the integrals required for the method of moment. The results show that there is a very small error in calculating the capacity even with coarse boundary division. The described formulas and codes can easily be used for similar purposes.


title: Scale up your In-Memory Accelerator: Leveraging Wireless-on-Chip Communication for AIMC-based CNN Inference

abstract: Analog In-Memory Computing (AIMC) is emerging as a disruptive paradigm for heterogeneous computing, potentially delivering orders of magnitude better peak performance and efficiency over traditional digital signal processing architectures on Matrix-Vector multiplication. However, to sustain this throughput in real-world applications, AIMC tiles must be supplied with data at very high bandwidth and low latency; this poses an unprecedented pressure on the on-chip communication infrastructure, which becomes the system's performance and efficiency bottleneck. In this context, the performance and plasticity of emerging on-chip wireless communication paradigms provide the required breakthrough to up-scale on-chip communication in large AIMC devices. This work presents a many-tile AIMC architecture with inter-tile wireless communication that integrates multiple heterogeneous computing clusters, embedding a mix of parallel RISC-V cores and AIMC tiles. We perform an extensive design space exploration of the proposed architecture and discuss the benefits of exploiting emerging on-chip communication technologies such as wireless transceivers in the millimeter-wave and terahertz bands.


title: Memory-efficient model-based deep learning with convergence and robustness guarantees

abstract: Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned regularization priors have emerged as more powerful alternatives for image recovery. The main focus of this paper is to introduce a memory efficient model-based algorithm with similar theoretical guarantees as CS methods. The proposed iterative algorithm alternates between a gradient descent involving the score function and a conjugate gradient algorithm to encourage data consistency. The score function is modeled as a monotone convolutional neural network. Our analysis shows that the monotone constraint is necessary and sufficient to enforce the uniqueness of the fixed point in arbitrary inverse problems. In addition, it also guarantees the convergence to a fixed point, which is robust to input perturbations. We introduce two implementations of the proposed MOL framework, which differ in the way the monotone property is imposed. The first approach enforces a strict monotone constraint, while the second one relies on an approximation. The guarantees are not valid for the second approach in the strict sense. However, our empirical studies show that the convergence and robustness of both approaches are comparable, while the less constrained approximate implementation offers better performance. The proposed deep equilibrium formulation is significantly more memory efficient than unrolled methods, which allows us to apply it to 3D or 2D+time problems that current unrolled algorithms cannot handle.


title: A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs

abstract: Reasoning on large-scale knowledge graphs has been long dominated by embedding methods. While path-based methods possess the inductive capacity that embeddings lack, their scalability is limited by the exponential number of paths. Here we present A*Net, a scalable path-based method for knowledge graph reasoning. Inspired by the A* algorithm for shortest path problems, our A*Net learns a priority function to select important nodes and edges at each iteration, to reduce time and memory footprint for both training and inference. The ratio of selected nodes and edges can be specified to trade off between performance and efficiency. Experiments on both transductive and inductive knowledge graph reasoning benchmarks show that A*Net achieves competitive performance with existing state-of-the-art path-based methods, while merely visiting 10% nodes and 10% edges at each iteration. On a million-scale dataset ogbl-wikikg2, A*Net not only achieves a new state-of-the-art result, but also converges faster than embedding methods. A*Net is the first path-based method for knowledge graph reasoning at such scale.


title: Computational thermal multi-phase flow for metal additive manufacturing

abstract: Thermal multi-phase flow simulations are indispensable to understanding the multi-scale and multi-physics phenomena in metal additive manufacturing (AM) processes, yet accurate and robust predictions remain challenging. This book chapter summarizes the recent method development at UIUC for simulating thermal multiphase flows in laser powder bed fusion (LPBF) and directed energy deposition (DED) processes. Two main method developments are discussed. The first is a mixed interface-capturing/interface-tracking computational framework aiming to explicitly treat the gas-metal interface without mesh motion/re-meshing. The second is a physics-based and non-empirical deposit geometry model for DED processes. The proposed framework's accuracy is assessed by thoroughly comparing the simulated results against experimental measurements on various quantities. We also report critical quantities that experiments can not measure to show the predictive capability of the developed methods.


title: Explainable Artificial Intelligence (XAI) for Internet of Things: A Survey

abstract: Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are critical, such black-box AI models are not sufficient. Explainable Artificial Intelligence (XAI) addresses this problem and defines a set of AI models that are interpretable by the users. Recently, several number of XAI models have been to address the issues surrounding by lack of interpretability and explainability of black-box models in various application areas such as healthcare, military, energy, financial and industrial domains. Although the concept of XAI has gained great deal of attention recently, its integration into the IoT domain has not yet been fully defined. In this paper, we provide an in-depth and systematic review of recent studies using XAI models in the scope of IoT domain. We categorize the studies according to their methodology and applications areas. In addition, we aim to focus on the challenging problems and open issues and give future directions to guide the developers and researchers for prospective future investigations.


title: Learning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs

abstract: Knowledge bases, and their representations in the form of knowledge graphs (KGs), are naturally incomplete. Since scientific and industrial applications have extensively adopted them, there is a high demand for solutions that complete their information. Several recent works tackle this challenge by learning embeddings for entities and relations, then employing them to predict new relations among the entities. Despite their aggrandizement, most of those methods focus only on the local neighbors of a relation to learn the embeddings. As a result, they may fail to capture the KGs' context information by neglecting long-term dependencies and the propagation of entities' semantics. In this manuscript, we propose {\AE}MP (Attention-based Embeddings from Multiple Patterns), a novel model for learning contextualized representations by: (i) acquiring entities' context information through an attention-enhanced message-passing scheme, which captures the entities' local semantics while focusing on different aspects of their neighborhood; and (ii) capturing the semantic context, by leveraging the paths and their relationships between entities. Our empirical findings draw insights into how attention mechanisms can improve entities' context representation and how combining entities and semantic path contexts improves the general representation of entities and the relation predictions. Experimental results on several large and small knowledge graph benchmarks show that {\AE}MP either outperforms or competes with state-of-the-art relation prediction methods.


title: Modular Light Sources for Microscopy and Beyond (ModLight)

abstract: Delivering light to an object is one of the key steps in any imaging exercise. Tools such as LEDs and lasers are available to achieve this. These components are integrated into systems such as microscopy, medical imaging, remote sensing, and so many more. Motivated by the need for affordable and open access alternatives that are globally relevant, we share the designs and build instructions for modular light source devices that use simple, off-the-shelf components. Light emitted by near-infrared, red, green and blue LEDs are combined with a choice of mirrors or X-Cube prisms to deliver collimated beams of light.


title: Detecting Anomalous Cryptocurrency Transactions: an AML/CFT Application of Machine Learning-based Forensics

abstract: In shaping the Internet of Money, the application of blockchain and distributed ledger technologies (DLTs) to the financial sector triggered regulatory concerns. Notably, while the user anonymity enabled in this field may safeguard privacy and data protection, the lack of identifiability hinders accountability and challenges the fight against money laundering and the financing of terrorism and proliferation (AML/CFT). As law enforcement agencies and the private sector apply forensics to track crypto transfers across ecosystems that are socio-technical in nature, this paper focuses on the growing relevance of these techniques in a domain where their deployment impacts the traits and evolution of the sphere. In particular, this work offers contextualized insights into the application of methods of machine learning and transaction graph analysis. Namely, it analyzes a real-world dataset of Bitcoin transactions represented as a directed graph network through various techniques. The modeling of blockchain transactions as a complex network suggests that the use of graph-based data analysis methods can help classify transactions and identify illicit ones. Indeed, this work shows that the neural network types known as Graph Convolutional Networks (GCN) and Graph Attention Networks (GAT) are a promising AML/CFT solution. Notably, in this scenario GCN outperform other classic approaches and GAT are applied for the first time to detect anomalies in Bitcoin. Ultimately, the paper upholds the value of public-private synergies to devise forensic strategies conscious of the spirit of explainability and data openness.


title: Theoretical Error Performance Analysis for Variational Quantum Circuit Based Functional Regression

abstract: The noisy intermediate-scale quantum (NISQ) devices enable the implementation of the variational quantum circuit (VQC) for quantum neural networks (QNN). Although the VQC-based QNN has succeeded in many machine learning tasks, the representation and generalization powers of VQC still require further investigation, particularly when the dimensionality of classical inputs is concerned. In this work, we first put forth an end-to-end quantum neural network, TTN-VQC, which consists of a quantum tensor network based on a tensor-train network (TTN) for dimensionality reduction and a VQC for functional regression. Then, we aim at the error performance analysis for the TTN-VQC in terms of representation and generalization powers. We also characterize the optimization properties of TTN-VQC by leveraging the Polyak-Lojasiewicz (PL) condition. Moreover, we conduct the experiments of functional regression on a handwritten digit classification dataset to justify our theoretical analysis.


title: Motif Mining and Unsupervised Representation Learning for BirdCLEF 2022

abstract: We build a classification model for the BirdCLEF 2022 challenge using unsupervised methods. We implement an unsupervised representation of the training dataset using a triplet loss on spectrogram representation of audio motifs. Our best model performs with a score of 0.48 on the public leaderboard.


title: Syntactic Inductive Biases for Deep Learning Methods

abstract: In this thesis, we try to build a connection between the two schools by introducing syntactic inductive biases for deep learning models. We propose two families of inductive biases, one for constituency structure and another one for dependency structure. The constituency inductive bias encourages deep learning models to use different units (or neurons) to separately process long-term and short-term information. This separation provides a way for deep learning models to build the latent hierarchical representations from sequential inputs, that a higher-level representation is composed of and can be decomposed into a series of lower-level representations. For example, without knowing the ground-truth structure, our proposed model learns to process logical expression through composing representations of variables and operators into representations of expressions according to its syntactic structure. On the other hand, the dependency inductive bias encourages models to find the latent relations between entities in the input sequence. For natural language, the latent relations are usually modeled as a directed dependency graph, where a word has exactly one parent node and zero or several children nodes. After applying this constraint to a Transformer-like model, we find the model is capable of inducing directed graphs that are close to human expert annotations, and it also outperforms the standard transformer model on different tasks. We believe that these experimental results demonstrate an interesting alternative for the future development of deep learning models.


title: Hybrid electroluminescent devices composed of (In,Ga)N micro-LEDs and monolayers of transition metal dichalcogenides

abstract: We demonstrate a novel electro-luminescence device in which GaN-based $\mu$-LEDs are used to trigger the emission spectra of monolayers of transition metal dichalcogenides, which are deposited directly on the $\mu$-LED surface. A special $\mu$-LED design enables the operation of our structures even in the limit of low temperatures. A device equipped with a selected WSe$_2$ monolayer flake is shown to act as a stand-alone, electrically-driven single-photon source.


title: Raveling the Role of Dopants on Charge Carrier Kinetics of TiO$_2$ Electrodes using Electrochemical Impedance Spectroscopy

abstract: We synthesized the pure and co-doped titanium dioxide (TiO$_2$) electrodes via spin coating. We examined the optical and electronic properties of as-prepared thin film electrodes with co-doping of transition metals and non-metals. The co-doping of Cu, Zn, and N increase the absorption of the radiation in the visible region. The doping leads to the formation of defect states in the electrodes. In this article, we have studied the carrier kinetics in pristine and co-doped TiO2 electrodes. To study the role of dopants in carrier transport of the synthesized TiO2 based electrodes, the electrochemical impedance spectroscopy measurement is performed in the frequency range of 10-1 Hz to 106 Hz. The study reveals the influence of dopants on electron-hole recombination in the defect sites present in bulk and the transport mechanism of the electrons and ions to the surface/interface of the electrodes.


title: Renormalization group evolution of optical potentials: explorations using a toy model

abstract: To take full advantage of experimental facilities such as FRIB for applications to nuclear astrophysics, nuclear structure, and explorations of neutrinos and fundamental symmetries, we need a better understanding of the interplay of reaction and structure theory. The renormalization group (RG) is the natural tool for maintaining a consistent treatment of reaction and structure. Here we make a first study of RG for optical potentials, which are important ingredients for direct reactions. To simplify the analysis, we use a pedagogical one-dimensional model and evolve toward low RG resolution using the similarity RG (or SRG). We show how SRG decoupling at low resolution carries over to the optical potential and enhances perturbative approximations, and how induced SRG nonlocality compares to the nonlocality of the optical potential. We discuss the results in the larger context of consistent SRG evolution of operators and wave functions in the analysis of direct reactions.


title: Apsidal Alignment and Anti-Alignment of Planets in Mean-Motion Resonance: Disk-Driven Migration and Eccentricity Driving

abstract: Planets migrating in their natal discs can be captured into mean-motion resonance (MMR), in which the planets' periods are related by integer ratios. Recent observations indicate that planets in MMR can be either apsidally aligned or anti-aligned. How these different configurations arise is unclear. In this paper, we study the MMR capture process of migrating planets, focusing on the property of the apsidal angles of the captured planets. We show that the standard picture of MMR capture, in which the planets undergo convergent migration and experience eccentricity damping due to planet-disc interactions, always leads to apsidal anti-alignment of the captured planets. However, when the planets experience eccentricity driving from the disc, apsidally aligned configuration in MMR can be produced. In this configuration, both planets' resonance angles circulate, but a "mixed" resonance angle librates and traps the planets near the nominal resonance location. The MMR capture process in the presence of disc eccentricity driving is generally complex and irregular, and can lead to various outcomes, including apsidal alignment and anti-alignment, as well as the disruption of the resonance. We suggest that the two resonant planets in the K2-19 system, with their moderate eccentricities and aligned apsides, have experienced eccentricity driving from their natal disc in the past.


title: Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems

abstract: Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available from the system. Ensemble Kalman filter (EnKF) is a DA algorithm that is widely used in applications involving high-dimensional nonlinear dynamical systems. However, EnKF requires evolving large ensembles of forecasts using the dynamical model of the system. This often becomes computationally intractable, especially when the number of states of the system is very large, e.g., for weather prediction. With small ensembles, the estimated background error covariance matrix in the EnKF algorithm suffers from sampling error, leading to an erroneous estimate of the analysis state (initial condition for the next forecast cycle). In this work, we propose hybrid ensemble Kalman filter (H-EnKF), which is applied to a two-layer quasi-geostrophic flow system as a test case. This framework utilizes a pre-trained deep learning-based data-driven surrogate that inexpensively generates and evolves a large data-driven ensemble of the states of the system to accurately compute the background error covariance matrix with less sampling error. The H-EnKF framework estimates a better initial condition without the need for any ad-hoc localization strategies. H-EnKF can be extended to any ensemble-based DA algorithm, e.g., particle filters, which are currently difficult to use for high dimensional systems.

categories: cs.LG physics.comp-ph physics.data-an physics.flu-dyn physics.geo-ph


title: The Case for a Single Model that can Both Generate Continuations and Fill in the Blank

abstract: The task of inserting text into a specified position in a passage, known as fill in the blank (FitB), is useful for a variety of applications where writers interact with a natural language generation (NLG) system to craft text. While previous work has tackled this problem with models trained specifically to do the fill-in-the-blank task, a more useful model is one that can effectively perform _both_ FitB and continuation. In this work, we evaluate the feasibility of using a single model to do both tasks. We show that models pre-trained with a FitB-style objective are capable of both tasks, while models pre-trained for continuation are not. Finally, we show how FitB models can be easily finetuned to allow for fine-grained control over the length and word choice of the generation.


title: Low-dissipation self-assembly protocols of active sticky particles

abstract: We use neuroevolutionary learning to identify time-dependent protocols for low-dissipation self-assembly in a model of generic active particles with interactions. When the time allotted for assembly is sufficiently long, low-dissipation protocols use only interparticle attractions, producing an amount of entropy that scales as the number of particles. When time is too short to allow assembly to proceed via diffusive motion, low-dissipation assembly protocols instead require particle self-propulsion, producing an amount of entropy that scales with the number of particles and the swim length required to cause assembly. Self-propulsion therefore provides an expensive but necessary mechanism for inducing assembly when time is of the essence.


title: Universal Properties of Partial Quantum Maps

abstract: We provide a universal construction of the category of finite-dimensional C*-algebras and completely positive trace-nonincreasing maps from the rig category of finite-dimensional Hilbert spaces and unitaries. This construction, which can be applied to any dagger rig category, is described in three steps, each associated with their own universal property, and draws on results from dilation theory in finite dimension. In this way, we explicitly construct the category that captures hybrid quantum/classical computation with possible nontermination from the category of its reversible foundations. We discuss how this construction can be used in the design and semantics of quantum programming languages.


title: Connections between graphs and matrix spaces

abstract: Given a bipartite graph $G$, the graphical matrix space $\mathcal{S}_G$ consists of matrices whose non-zero entries can only be at those positions corresponding to edges in $G$. Tutte (J. London Math. Soc., 1947), Edmonds (J. Res. Nat. Bur. Standards Sect. B, 1967) and Lov\'asz (FCT, 1979) observed connections between perfect matchings in $G$ and full-rank matrices in $\mathcal{S}_G$. Dieudonn\'e ({Arch. Math., 1948) proved a tight upper bound on the dimensions of those matrix spaces containing only singular matrices. The starting point of this paper is a simultaneous generalization of these two classical results: we show that the largest dimension over subspaces of $\mathcal{S}_G$ containing only singular matrices is equal to the maximum size over subgraphs of $G$ without perfect matchings, based on Meshulam's proof of Dieudonn\'e's result (Quart. J. Math., 1985). Starting from this result, we go on to establish more connections between properties of graphs and matrix spaces. For example, we establish connections between acyclicity and nilpotency, between strong connectivity and irreducibility, and between isomorphism and conjugacy/congruence. For each connection, we study three types of correspondences, namely the basic correspondence, the inherited correspondence (for subgraphs and subspaces), and the induced correspondence (for induced subgraphs and restrictions). Some correspondences lead to intriguing generalizations of classical results, such as for Dieudonn\'e's result mentioned above, and for a celebrated theorem of Gerstenhaber regarding the largest dimension of nil matrix spaces (Amer. J. Math., 1958). Finally, we show some implications of our results to quantum information and present open problems in computational complexity motivated by these results.


title: Empirical Bayes approach to Truth Discovery problems

abstract: When aggregating information from conflicting sources, one's goal is to find the truth. Most real-value \emph{truth discovery} (TD) algorithms try to achieve this goal by estimating the competence of each source and then aggregating the conflicting information by weighing each source's answer proportionally to her competence. However, each of those algorithms requires more than a single source for such estimation and usually does not consider different estimation methods other than a weighted mean. Therefore, in this work we formulate, prove, and empirically test the conditions for an Empirical Bayes Estimator (EBE) to dominate the weighted mean aggregation. Our main result demonstrates that EBE, under mild conditions, can be used as a second step of any TD algorithm in order to reduce the expected error.


title: The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon

abstract: The grokking phenomenon as reported by Power et al. ( arXiv:2201.02177 ) refers to a regime where a long period of overfitting is followed by a seemingly sudden transition to perfect generalization. In this paper, we attempt to reveal the underpinnings of Grokking via a series of empirical studies. Specifically, we uncover an optimization anomaly plaguing adaptive optimizers at extremely late stages of training, referred to as the Slingshot Mechanism. A prominent artifact of the Slingshot Mechanism can be measured by the cyclic phase transitions between stable and unstable training regimes, and can be easily monitored by the cyclic behavior of the norm of the last layers weights. We empirically observe that without explicit regularization, Grokking as reported in ( arXiv:2201.02177 ) almost exclusively happens at the onset of Slingshots, and is absent without it. While common and easily reproduced in more general settings, the Slingshot Mechanism does not follow from any known optimization theories that we are aware of, and can be easily overlooked without an in depth examination. Our work points to a surprising and useful inductive bias of adaptive gradient optimizers at late stages of training, calling for a revised theoretical analysis of their origin.


title: Is there a Granular Potential?

abstract: Granular materials, such as sand or grain, exhibit many structural and dynamic characteristics similar to those observed in molecular systems, despite temperature playing no role in their properties. This has led to an effort to develop a statistical mechanics for granular materials that has focused on establishing an equivalent to the microcanonical ensemble and a temperature-like thermodynamic variable. Here, we expand on these ideas by introducing a granular potential into the Edwards ensemble, as an analogue to the chemical potential, and explore its properties using a simple model of a granular system. A simple kinetic Monte Carlo simulation of the model shows the effect of mass transport leading to equilibrium and how this is connected to the redistribution of volume in the system. An exact analytical treatment of the model shows that the compactivity and the ratio of the granular potential to the compactivity determine the equilibrium between two open systems that are able to exchange volume and particles, and that mass moves from high to low values of this ratio. Analysis of the granular potential shows that adding a particle to the system increases the entropy at high compactivity, but decreases the entropy at low compactivity. Finally, we demonstrate the use of a small system thermodynamics method for the measurement of granular potential differences.


title: A (semi)-exact Hamiltonian for the curvature perturbation $\zeta$

abstract: The total Hamiltonian in general relativity, which involves the first class Hamiltonian and momentum constraints, weakly vanishes. However, when the action is expanded around a classical solution as in the case of a single scalar field inflationary model, there appears a non-vanishing Hamiltonian and additional first class constraints; but this time the theory becomes perturbative in the number of fluctuation fields. We show that one can reorganize this expansion and solve the Hamiltonian constraint exactly, which yield an explicit all order action. On the other hand, the momentum constraint can be solved perturbatively in the tensor modes $\gamma_{ij}$ by still keeping the curvature perturbation $\zeta$ dependence exact. In this way, after gauge fixing, one can obtain a semi-exact Hamiltonian for $\zeta$ which only gets corrections from the interactions with the tensor modes (hence the Hamiltonian becomes exact when the tensor perturbations set to zero). The equations of motion clearly exhibit when the evolution of $\zeta$ involves a logarithmic time dependence, which is a subtle point that has been debated in the literature. We discuss the long wavelength and late time limits, and obtain some simple but non-trivial classical solutions of the $\zeta$ zero-mode.


title: Propagation of Singularity with Normally Hyperbolic Trapping

abstract: We prove microlocal estimates with normally hyperbolic trapping. We use a new type of symbol class which is constructed by blowing up the intersection of the unstable manifold and the fiber infinity. The extra loss of the microlocal estimates compared with the standard propagation of singularities is arbitrarily small.


title: Moments of zeta and correlations of divisor-sums: stratification and Vandermonde integrals

abstract: We refine a recent heuristic developed by Keating and the second author. Our improvement leads to a new integral expression for the conjectured asymptotic formula for shifted moments of the Riemann zeta-function. This expression is analogous to a formula, recently discovered by Brad Rodgers and Kannan Soundararajan, for moments of characteristic polynomials of random matrices from the unitary group.


title: On the harmonious chromatic number of graphs

abstract: The harmonious chromatic number of a graph $G$ is the minimum number of colors that can be assigned to the vertices of $G$ in a proper way such that any two distinct edges have different color pairs. This paper gives various results on harmonious chromatic number related to homomorphisms, incidence graphs of finite linear systems, and some circulant graphs.


title: Membership Inference via Backdooring

abstract: Recently issued data privacy regulations like GDPR (General Data Protection Regulation) grant individuals the right to be forgotten. In the context of machine learning, this requires a model to forget about a training data sample if requested by the data owner (i.e., machine unlearning). As an essential step prior to machine unlearning, it is still a challenge for a data owner to tell whether or not her data have been used by an unauthorized party to train a machine learning model. Membership inference is a recently emerging technique to identify whether a data sample was used to train a target model, and seems to be a promising solution to this challenge. However, straightforward adoption of existing membership inference approaches fails to address the challenge effectively due to being originally designed for attacking membership privacy and suffering from several severe limitations such as low inference accuracy on well-generalized models. In this paper, we propose a novel membership inference approach inspired by the backdoor technology to address the said challenge. Specifically, our approach of Membership Inference via Backdooring (MIB) leverages the key observation that a backdoored model behaves very differently from a clean model when predicting on deliberately marked samples created by a data owner. Appealingly, MIB requires data owners' marking a small number of samples for membership inference and only black-box access to the target model, with theoretical guarantees for inference results. We perform extensive experiments on various datasets and deep neural network architectures, and the results validate the efficacy of our approach, e.g., marking only 0.1% of the training dataset is practically sufficient for effective membership inference.


title: Effect of Localization on Photoluminescence and Zero-Field Splitting of Silicon Color Centers

abstract: The study of defect centers in silicon has been recently reinvigorated by their potential applications in optical quantum information processing. A number of silicon defect centers emit single photons in the telecommunication $O$-band, making them promising building blocks for quantum networks between computing nodes. The two-carbon G-center, self-interstitial W-center, and spin-$1/2$ T-center are the most intensively studied silicon defect centers, yet despite this, there is no consensus on the precise configurations of defect atoms in these centers, and their electronic structures remain ambiguous. Here we employ \textit{ab initio} density functional theory to characterize these defect centers, providing insight into the relaxed structures, bandstructures, and photoluminescence spectra, which are compared to experimental results. Motivation is provided for how these properties are intimately related to the localization of electronic states in the defect centers. In particular, we present the calculation of the zero-field splitting for the excited triplet state of the G-center defect as the structure is transformed from the A-configuration to the B-configuration, showing a sudden increase in the magnitude of the $D_{zz}$ component of the zero-field splitting tensor. By performing projections onto the local orbital states of the defect, we analyze this transition in terms of the symmetry and bonding character of the G-center defect which sheds light on its potential application as a spin-photon interface.


title: Derived invariants and motives, Part I, Integral Grothendieck Riemann-Roch and non-commutative motives

abstract: The goal of this series of papers is to give a new non-commutative approach to problems about the density of reductions such as the conjecture of Joshi-Rajan, and the generalization of the conjecture of Serre. In this paper, we prove integral Grothendieck Riemann-Roch which was proved by Papas in the case ch$(k)=0$. As a corollary we prove an integral analogue of Kontsevich's comparison theorem, and we show that if a smooth projective variety $X$ has a full exceptional collection then there is an explicit formula of the motive of $X$ up to bounded torsion.


title: Derived invariants and motives, Part II integral derived invariants and some applications

abstract: In this paper we construct new derived invariants with integral coefficients using the theory of motifs, and give several applications. Specifically, we obtain the following results: For complex algebraic surfaces, we prove that certain torsion in the abelianized fundamental group is a derived invariant. We prove that the collection of Hodge-Witt cohomology groups is a derived invariant. In particular, Hodge-Witt reduction and ordinary reduction are preserved by derived equivalence when the characteristic is sufficiently large. Finally, using the techniques of non-commutative algebraic geometry, we prove that Serre's ordinary density conjecture is true for cubic $4$-folds which contain a $\mathbb{P}^2$.


title: A Quasi-Optimal Spectral Solver for the Heat and Poisson Equations in a Closed Cylinder

abstract: We develop a spectral method to solve the heat equation in a closed cylinder, achieving a quasi-optimal $\mathcal{O}(N\log N)$ complexity and high-order, spectral accuracy. The algorithm relies on a Chebyshev--Chebyshev--Fourier (CCF) discretization of the cylinder, which is easily implemented and decouples the heat equation into a collection of smaller, sparse Sylvester equations. In turn, each of these equations is solved using the alternating direction implicit (ADI) method in quasi-optimal time; overall, this represents an improvement in the heat equation solver from $\mathcal{O}(N^{4/3})$ (in previous Chebyshev-based methods) to $\mathcal{O}(N\log N)$. While Legendre-based methods have recently been developed to achieve similar computation times, our Chebyshev discretization allows for far faster coefficient transforms; we demonstrate the application of this by outlining a spectral method to solve the incompressible Navier--Stokes equations in the cylinder in quasi-optimal time. Lastly, we provide numerical simulations of the heat equation, demonstrating significant speed-ups over traditional spectral collocation methods and finite difference methods.


title: Machine learning prediction of network dynamics with privacy protection

abstract: Predicting network dynamics based on data, a problem with broad applications, has been studied extensively in the past, but most existing approaches assume that the complete set of historical data from the whole network is available. This requirement presents a great challenge in applications, especially for large, distributed networks in the real world, where data collection is accomplished by many clients in a parallel fashion. Often, each client only has the time series data from a partial set of nodes and the client has access to only partial timestamps of the whole time series data and partial structure of the network. Due to privacy concerns or license related issues, the data collected by different clients cannot be shared. To accurately predict the network dynamics while protecting the privacy of different parties is a critical problem in the modern time. Here, we propose a solution based on federated graph neural networks (FGNNs) that enables the training of a global dynamic model for all parties without data sharing. We validate the working of our FGNN framework through two types of simulations to predict a variety of network dynamics (four discrete and three continuous dynamics). As a significant real-world application, we demonstrate successful prediction of State-wise influenza spreading in the USA. Our FGNN scheme represents a general framework to predict diverse network dynamics through collaborative fusing of the data from different parties without disclosing their privacy.


title: Impact of dynamics, entanglement, and Markovian noise on the fidelity of few-qubit digital quantum simulation

abstract: For quantum computations without error correction, the dynamics of a simulation can strongly influence the overall fidelity decay rate as well as the relative impact of different noise processes on the fidelity. Theoretical models of Markovian noise that include incoherent Lindblad noise, gate-based errors, and stochastic Hamiltonian noise qualitatively agree that greater diffusion and entanglement throughout Hilbert space typically increase the fidelity decay rate. Simulations of the gate-efficient quantum sawtooth map support these predictions, and experiments performed on three qubits on the IBM-Q quantum hardware platform at fixed gate count qualitatively confirm the predictions. A pure depolarizing noise model, often used within randomized benchmarking (RB) theory, cannot explain the observed effect, but gate-based Lindblad models can provide an explanation. They can also estimate the effective Lindblad coherence times during gates, and find a consistent $2\text{-}3\times$ shorter effective $T_2$ dephasing time than reported for idle qubits. Additionally, the observed error per CNOT gate exceeds IBM-Q's reported value from RB by $3.0\times$ during localized dynamics and $4.5\times$ during diffusive dynamics. This demonstrates the magnitude by which RB understates error in a complex quantum simulation due to dynamics and crosstalk.


title: Electron-hole coherence in core-shell nanowires with partial proximity induced superconductivity

abstract: By solving the Bogoliubov-de Gennes Hamiltonian, the electron-hole coherence within a partially proximitized n-doped semiconductor shell of a core-shell nanowire heterostructure is investigated numerically and compared with the Andreev reflection interpretation of proximity induced superconductivity. Partial proximitization is considered to quantify the effects of a reduced coherence length. Three cases of partial proximitization of the shell are explored: radial, angular and longitudinal. For the radial case, it is found that the boundary conditions impose localization probability maxima in the center of the shell in spite of off-center radial proximitization. The induced superconductivity gap is calculated as a function of the ratio between the proximitized shell thickness and the total shell thickness. In the angular case, the lowest energy state of a hexagonal wire with a single proximitized side is found to display the essence of Andreev reflection, only by lengthwise summation of the localization probability. In the longitudinal case, a clear correspondence with Andreev reflection is seen in the localization probability as a function of length along a half-proximitized wire. The effect of an external magnetic field oriented along the wire is explored.


title: R4D: Utilizing Reference Objects for Long-Range Distance Estimation

abstract: Estimating the distance of objects is a safety-critical task for autonomous driving. Focusing on short-range objects, existing methods and datasets neglect the equally important long-range objects. In this paper, we introduce a challenging and under-explored task, which we refer to as Long-Range Distance Estimation, as well as two datasets to validate new methods developed for this task. We then proposeR4D, the first framework to accurately estimate the distance of long-range objects by using references with known distances in the scene. Drawing inspiration from human perception, R4D builds a graph by connecting a target object to all references. An edge in the graph encodes the relative distance information between a pair of target and reference objects. An attention module is then used to weigh the importance of reference objects and combine them into one target object distance prediction. Experiments on the two proposed datasets demonstrate the effectiveness and robustness of R4D by showing significant improvements compared to existing baselines. We are looking to make the proposed dataset, Waymo OpenDataset - Long-Range Labels, available publicly at waymo.com/open/download.


title: Unifying Multimodal Source and Propagation Graph for Rumour Detection on Social Media with Missing Features

abstract: With the rapid development of online social media platforms, the spread of rumours has become a critical societal concern. Current methods for rumour detection can be categorized into image-text pair classification and source-reply graph classification. In this paper, we propose a novel approach that combines multimodal source and propagation graph features for rumour classification. We introduce the Unified Multimodal Graph Transformer Network (UMGTN) which integrates Transformer encoders to fuse these features. Given that not every message in social media is associated with an image and community responses in propagation graphs do not immediately follow source messages, our aim is to build a network architecture that handles missing features such as images or replies. To enhance the model's robustness to data with missing features, we adopt a multitask learning framework that simultaneously learns representations between samples with complete and missing features. We evaluate our proposed method on four real-world datasets, augmenting them by recovering images and replies from Twitter and Weibo. Experimental results demonstrate that our UMGTN with multitask learning achieves state-of-the-art performance, improving F1-score by 1.0% to 4.0%, while maintaining detection robustness to missing features within 2% accuracy and F1-score compared to models trained without the multitask learning framework. We have made our models and datasets publicly available at: https://thcheung.github.io/umgtn/.


title: Training Neural Networks using SAT solvers

abstract: We propose an algorithm to explore the global optimization method, using SAT solvers, for training a neural net. Deep Neural Networks have achieved great feats in tasks like-image recognition, speech recognition, etc. Much of their success can be attributed to the gradient-based optimisation methods, which scale well to huge datasets while still giving solutions, better than any other existing methods. However, there exist learning problems like the parity function and the Fast Fourier Transform, where a neural network using gradient-based optimisation algorithm can not capture the underlying structure of the learning task properly. Thus, exploring global optimisation methods is of utmost interest as the gradient-based methods get stuck in local optima. In the experiments, we demonstrate the effectiveness of our algorithm against the ADAM optimiser in certain tasks like parity learning. However, in the case of image classification on the MNIST Dataset, the performance of our algorithm was less than satisfactory. We further discuss the role of the size of the training dataset and the hyper-parameter settings in keeping things scalable for a SAT solver.


title: Persistent Homology for Resource Coverage: A Case Study of Access to Polling Sites

abstract: It is important to choose the geographical distributions of public resources in a fair and equitable manner. However, it is complicated to quantify the equity of such a distribution; important factors include distances to resource sites, availability of transportation, and ease of travel. We use persistent homology, which is a tool from topological data analysis, to study the effective availability and coverage of polling sites. The information from persistent homology allows us to infer holes in the distribution of polling sites. We analyze and compare the coverage of polling sites in Los Angeles County and five cities (Atlanta, Chicago, Jacksonville, New York City, and Salt Lake City), and we conclude that computation of persistent homology appears to be a reasonable approach to analyzing resource coverage.


title: Communication Efficient Distributed Learning for Kernelized Contextual Bandits

abstract: We tackle the communication efficiency challenge of learning kernelized contextual bandits in a distributed setting. Despite the recent advances in communication-efficient distributed bandit learning, existing solutions are restricted to simple models like multi-armed bandits and linear bandits, which hamper their practical utility. In this paper, instead of assuming the existence of a linear reward mapping from the features to the expected rewards, we consider non-linear reward mappings, by letting agents collaboratively search in a reproducing kernel Hilbert space (RKHS). This introduces significant challenges in communication efficiency as distributed kernel learning requires the transfer of raw data, leading to a communication cost that grows linearly w.r.t. time horizon $T$. We addresses this issue by equipping all agents to communicate via a common Nystr\"{o}m embedding that gets updated adaptively as more data points are collected. We rigorously proved that our algorithm can attain sub-linear rate in both regret and communication cost.


title: Black Holes with Electric and Magnetic Charges in $F(R)$ Gravity

abstract: We construct spherically symmetric and static solutions in $F(R)$ gravity coupled with electromagnetic fields. The solutions include new types of black holes with electric and magnetic charges. We show that the higher-derivative terms make the curvature singularity much softer than that in the charged black holes in Einstein's general relativity. We calculate some thermodynamical quantities of the obtained black holes like entropy, Hawking radiation, and quasi-local energy and we confirm that the black hole solutions satisfy the first law of thermodynamics. Finally, we study the stability analysis using the odd-type mode and show that there are stable black hole solutions and the radial speed of the parity-odd mode is unit, that is, the speed of light.


title: Some Extremal Symmetric Inequalities

abstract: Let $\mathcal{H}_{n,d} := \mathbb{R}[x_1$,$\ldots$, $x_n]_d$ be the set of all the homogeneous polynomials of degree $d$, and let $\mathcal{H}_{n,d}^s := \mathcal{H}_{n,d}^{\mathfrak{S}_n}$ be the subset of all the symmetric polynomials. For a semialgebraic subset of $A \subset \mathbb{R}^n$ and a vector subspace $\mathcal{H} \subset \mathcal{H}_{n,d}$, we define a PSD cone $\mathcal{P}(A$, $\mathcal{H})$ by $\mathcal{P}(A$, $\mathcal{H}) := \big\{f \in \mathcal{H}$ $\big|$ $f(a) \geq 0$ ($\forall a \in A$)$\big\}$. In this article, we study a family of extremal symmetric polynomials of $\mathcal{P}_{3,6} := \mathcal{P}(\mathbb{R}^3$, $\mathcal{H}_{3,6})$ and that of $\mathcal{P}_{4,4} := \mathcal{P}(\mathbb{R}^4$, $\mathcal{H}_{4,4})$. We also determine all the extremal polynomials of $\mathcal{P}_{3,5}^{s+} := \mathcal{P}(\mathbb{R}_+^3$, $\mathcal{H}_{3,5}^s)$ where $\mathbb{R}_+ := \big\{ x \in \mathbb{R}$, $x \geq 0 \big\}$. Some of them provide extremal polynomials of $\mathcal{P}_{3,10}$.


title: In Defense of Core-set: A Density-aware Core-set Selection for Active Learning

abstract: Active learning enables the efficient construction of a labeled dataset by labeling informative samples from an unlabeled dataset. In a real-world active learning scenario, considering the diversity of the selected samples is crucial because many redundant or highly similar samples exist. Core-set approach is the promising diversity-based method selecting diverse samples based on the distance between samples. However, the approach poorly performs compared to the uncertainty-based approaches that select the most difficult samples where neural models reveal low confidence. In this work, we analyze the feature space through the lens of the density and, interestingly, observe that locally sparse regions tend to have more informative samples than dense regions. Motivated by our analysis, we empower the core-set approach with the density-awareness and propose a density-aware core-set (DACS). The strategy is to estimate the density of the unlabeled samples and select diverse samples mainly from sparse regions. To reduce the computational bottlenecks in estimating the density, we also introduce a new density approximation based on locality-sensitive hashing. Experimental results clearly demonstrate the efficacy of DACS in both classification and regression tasks and specifically show that DACS can produce state-of-the-art performance in a practical scenario. Since DACS is weakly dependent on neural architectures, we present a simple yet effective combination method to show that the existing methods can be beneficially combined with DACS.


title: BRST symmetry as a mechanism for confinement in the inter gauge framework

abstract: The finite field dependent BRST (FFBRST) technique generally interrelates two different gauge fixed theories. Here we propose a new and unique FFBRST transformation that transforms the effective theory in Lorenz gauge, which represents perturbative or deconfined phase of QCD to massive gauge theory. The exercise serves two purposes. First is of course that it is a distinct connection where one of the theories is not gauge fixed and BRST invariant therefore, it is expected to give newer insights into FFBRST technique itself. Second is that a particular case of this transformation holds a novel physical significance of acting as general mechanism for confinement across two different gauge theories. Thus, the present task identifies a profound non-perturbative implication of the BRST symmetry in a general setting.


title: Normal forms, differentiable conjugacies and elementary bifurcations of maps

abstract: We strengthen the standard bifurcation theorems for saddle-node, transcritical, pitchfork, and period-doubling bifurcations of maps. Our new formulation involves adding one or two extra terms to the standard truncated normal forms with coefficients determined by algebraic equations. These extended normal forms are differentiably conjugate to the original maps on basins of attraction and repulsion of fixed points or periodic orbits. This reflects common assumptions about the additional information in normal forms despite standard bifurcation theorems being formulated only in terms of topological equivalence.


title: Hierarchical mixtures of Gaussians for combined dimensionality reduction and clustering

abstract: To avoid the curse of dimensionality, a common approach to clustering high-dimensional data is to first project the data into a space of reduced dimension, and then cluster the projected data. Although effective, this two-stage approach prevents joint optimization of the dimensionality-reduction and clustering models, and obscures how well the complete model describes the data. Here, we show how a family of such two-stage models can be combined into a single, hierarchical model that we call a hierarchical mixture of Gaussians (HMoG). An HMoG simultaneously captures both dimensionality-reduction and clustering, and its performance is quantified in closed-form by the likelihood function. By formulating and extending existing models with exponential family theory, we show how to maximize the likelihood of HMoGs with expectation-maximization. We apply HMoGs to synthetic data and RNA sequencing data, and demonstrate how they exceed the limitations of two-stage models. Ultimately, HMoGs are a rigorous generalization of a common statistical framework, and provide researchers with a method to improve model performance when clustering high-dimensional data.


title: On Generalizations of a Conjecture of Kang and Park

abstract: Let $\Delta_d^{(a,-)}(n) = q_d^{(a)}(n) - Q_d^{(a,-)}(n)$ where $q_d^{(a)}(n)$ counts the number of partitions of $n$ into parts with difference at least $d$ and size at least $a$, and $Q_d^{(a,-)}(n)$ counts the number of partitions into parts $\equiv \pm a \pmod{d + 3}$ excluding the $d+3-a$ part. Motivated by generalizing a conjecture of Kang and Park, Duncan, Khunger, Swisher, and the second author conjectured that $\Delta_d^{(3,-)}(n)\geq 0$ for all $d\geq 1$ and $n\geq 1$ and were able to prove this when $d \geq 31$ is divisible by $3$. They were also able to conjecture an analog for higher values of $a$ that the modified difference function $\Delta_{d}^{(a,-,-)}(n) = q_{d}^{(a)}(n) - Q_{d}^{(a,-,-)}(n) \geq 0$ where $Q_{d}^{(a,-,-)}(n)$ counts the number of partitions into parts $\equiv \pm a \pmod{d + 3}$ excluding the $a$ and $d+3-a$ parts and proved it for infinitely many classes of $n$ and $d$. We prove that $\Delta_{d}^{(3,-)}(n) \geq 0$ for all but finitely many $d$. We also provide a proof of the generalized conjecture for all but finitely many $d$ for fixed $a$ and strengthen the results of Duncan, Khunger, Swisher, and the second author. We provide a conditional proof of a linear lower bound on $d$ for the generalized conjecture, which improves our unconditional result based on a conjectural modification of a recently proven conjecture of Alder. Using this modification, we obtain a strengthening of this generalization of Kang and Park's conjecture which remarkably allows $a$ as a part. Additionally, we provide asymptotic evidence that this strengthened conjecture holds.