title: multi-GPA-Tree: Statistical Approach for Pleiotropy Informed and Functional Annotation Tree Guided Prioritization of GWAS Results

abstract: Genome-wide association studies (GWAS) have successfully identified over two hundred thousand genotype-trait associations. Yet some challenges remain. First, complex traits are often associated with many single nucleotide polymorphisms (SNPs), most with small or moderate effect sizes, making them difficult to detect. Second, many complex traits share a common genetic basis due to `pleiotropy' and and though few methods consider it, leveraging pleiotropy can improve statistical power to detect genotype-trait associations with weaker effect sizes. Third, currently available statistical methods are limited in explaining the functional mechanisms through which genetic variants are associated with specific or multiple traits. We propose multi-GPA-Tree to address these challenges. The multi-GPA-Tree approach can identify risk SNPs associated with single as well as multiple traits while also identifying the combinations of functional annotations that can explain the mechanisms through which risk-associated SNPs are linked with the traits. First, we implemented simulation studies to evaluate the proposed multi-GPA-Tree method and compared its performance with an existing statistical approach.The results indicate that multi-GPA-Tree outperforms the existing statistical approach in detecting risk-associated SNPs for multiple traits. Second, we applied multi-GPA-Tree to a systemic lupus erythematosus (SLE) and rheumatoid arthritis (RA), and to a Crohn's disease (CD) and ulcertive colitis (UC) GWAS, and functional annotation data including GenoSkyline and GenoSkylinePlus. Our results demonstrate that multi-GPA-Tree can be a powerful tool that improves association mapping while facilitating understanding of the underlying genetic architecture of complex traits and potential mechanisms linking risk-associated SNPs with complex traits.


title: Hybrid path-lifting algorithm and Equivalence of Stability results for MRP-based control strategies

abstract: The modified Rodrigues parameters (MRP) consist of two numerically different triplets that, by switching between them, yield a minimal globally non-singular attitude description with advantageous properties. The MRP space results from the Alexandroff compactification of the three-dimensional Euclidean space and is a double cover of $\mathrm{SO(3)}$. By capitalizing on instrumental properties of the covering map, this paper proposes a novel hybrid dynamic path-lifting mechanism to unambiguously and robustly extract the MRP from the attitude space. This hybrid solution allows applying an MRP-based feedback controller to the attitude dynamics in the base space while preserving its asymptotic and exponential stability properties. Furthermore, by profiting from the distinct characteristics of the MRP, the resulting interconnection is impervious to the unwinding phenomenon. The design and validation of an MRP-based controller exemplify the application of the proposed algorithm alongside the novel results for equivalence of stability between spaces. The solution renders the attitude space tracking dynamics robustly globally exponentially stable, demonstrating the potential of this novel methodology.


title: PSST! Prosodic Speech Segmentation with Transformers

abstract: Self-attention mechanisms have enabled transformers to achieve superhuman-level performance on many speech-to-text (STT) tasks, yet the challenge of automatic prosodic segmentation has remained unsolved. In this paper we finetune Whisper, a pretrained STT model, to annotate intonation unit (IU) boundaries by repurposing low-frequency tokens. Our approach achieves an accuracy of 95.8%, outperforming previous methods without the need for large-scale labeled data or enterprise grade compute resources. We also diminish input signals by applying a series of filters, finding that low pass filters at a 3.2 kHz level improve segmentation performance in out of sample and out of distribution contexts. We release our model as both a transcription tool and a baseline for further improvements in prosodic segmentation.


title: VR-LENS: Super Learning-based Cybersickness Detection and Explainable AI-Guided Deployment in Virtual Reality

abstract: A plethora of recent research has proposed several automated methods based on machine learning (ML) and deep learning (DL) to detect cybersickness in Virtual reality (VR). However, these detection methods are perceived as computationally intensive and black-box methods. Thus, those techniques are neither trustworthy nor practical for deploying on standalone VR head-mounted displays (HMDs). This work presents an explainable artificial intelligence (XAI)-based framework VR-LENS for developing cybersickness detection ML models, explaining them, reducing their size, and deploying them in a Qualcomm Snapdragon 750G processor-based Samsung A52 device. Specifically, we first develop a novel super learning-based ensemble ML model for cybersickness detection. Next, we employ a post-hoc explanation method, such as SHapley Additive exPlanations (SHAP), Morris Sensitivity Analysis (MSA), Local Interpretable Model-Agnostic Explanations (LIME), and Partial Dependence Plot (PDP) to explain the expected results and identify the most dominant features. The super learner cybersickness model is then retrained using the identified dominant features. Our proposed method identified eye tracking, player position, and galvanic skin/heart rate response as the most dominant features for the integrated sensor, gameplay, and bio-physiological datasets. We also show that the proposed XAI-guided feature reduction significantly reduces the model training and inference time by 1.91X and 2.15X while maintaining baseline accuracy. For instance, using the integrated sensor dataset, our reduced super learner model outperforms the state-of-the-art works by classifying cybersickness into 4 classes (none, low, medium, and high) with an accuracy of 96% and regressing (FMS 1-10) with a Root Mean Square Error (RMSE) of 0.03.


title: Study of atomic disorder in Ni-V alloys

abstract: We present a pair distribution function (PDF) analysis from neutron diffraction data of the Ni$_{1-x}$V$_x$ alloy in the Ni-rich regime. Such structural study aims to clarify the origin of the magnetic inhomogeneities associated with the quantum Griffiths phase close to the ferromagnetic-paramagnetic quantum phase transition. The PDF analysis successfully reveals the details of the structure and chemical distribution of our Ni$_{1-x}$V$_x$ polycrystalline samples prepared with high-temperature annealing and rapid cooling protocol. This study confirms the expectations that all Ni$_{1-x}$V$_x$ samples with 0$ \leq x \leq $0.15 crystallize in a single phase fcc structure with some residual strain. The increase of the lattice constant and the atomic displacement parameter with V-concentration $x$ is consistently explained by a random occupation of V and Ni-atoms on the lattice, with a radius ratio ($r_{V}/r_{Ni}$) of 1.05. Probing alternate, simple models of the local PDF, such as V-clusters or ordered structures (Ni$_8$V, Ni$_3$V) give inferior results compared to a random occupation. This investigation strongly supports that the magnetic clusters in the binary alloy Ni$_{1-x}$V$_x$ originate from Ni-rich regions created from "random" occupation rather than from chemical clusters. It reveals that Ni$_{1-x}$V$_x$ is one of the rare examples of a solid solution in a wide concentration regime (up to x=0.15) persisting down to low temperatures (T=15 K).


title: Hierarchical Graph Neural Networks for Causal Discovery and Root Cause Localization

abstract: In this paper, we propose REASON, a novel framework that enables the automatic discovery of both intra-level (i.e., within-network) and inter-level (i.e., across-network) causal relationships for root cause localization. REASON consists of Topological Causal Discovery and Individual Causal Discovery. The Topological Causal Discovery component aims to model the fault propagation in order to trace back to the root causes. To achieve this, we propose novel hierarchical graph neural networks to construct interdependent causal networks by modeling both intra-level and inter-level non-linear causal relations. Based on the learned interdependent causal networks, we then leverage random walks with restarts to model the network propagation of a system fault. The Individual Causal Discovery component focuses on capturing abrupt change patterns of a single system entity. This component examines the temporal patterns of each entity's metric data (i.e., time series), and estimates its likelihood of being a root cause based on the Extreme Value theory. Combining the topological and individual causal scores, the top K system entities are identified as root causes. Extensive experiments on three real-world datasets with case studies demonstrate the effectiveness and superiority of the proposed framework.


title: Multiple-Order Singularity Expansion Method

abstract: Physical systems and signals are often characterized by complex functions of frequency in the harmonic-domain. The extension of such functions to the complex frequency plane has been a topic of growing interest as it was shown that specific complex frequencies could be used to describe both ordinary and exceptional physical properties. In particular, expansions and factorized forms of the harmonic-domain functions in terms of their poles and zeros under multiple physical considerations have been used. In this work, we start from a general property of continuity and differentiability of the complex functions to derive the multiple-order singularity expansion method. We rigorously derive the common singularity and zero expansion and factorization expressions, and generalize them to the case of singularities of arbitrary order, whilst deducing the behaviour of these complex frequencies from the simple hypothesis that we are dealing with physically realistic signals.


title: Robust and Verifiable Proportionality Axioms for Multiwinner Voting

abstract: When selecting a subset of candidates (a so-called committee) based on the preferences of voters, proportional representation is often a major desideratum. When going beyond simplistic models such as party-list or district-based elections, it is surprisingly challenging to capture proportionality formally. As a consequence, the literature has produced numerous competing criteria of when a selected committee qualifies as proportional. Two of the most prominent notions are Dummett's proportionality for solid coalitions (PSC) and Aziz et al.'s extended justified representation (EJR). Both guarantee proportional representation to groups of voters who have very similar preferences; such groups are referred to as solid coalitions by Dummett and as cohesive groups by Aziz et al. However, these notions lose their bite when groups are only almost solid or almost cohesive. In this paper, we propose proportionality axioms that are more robust: they guarantee representation also to groups that do not qualify as solid or cohesive. Further, our novel axioms can be easily verified: Given a committee, we can check in polynomial time whether it satisfies the axiom or not. This is in contrast to many established notions like EJR, for which the corresponding verification problem is known to be intractable. In the setting with approval preferences, we propose a robust and verifiable variant of EJR and a simply greedy procedure to compute committees satisfying it. In the setting with ranked preferences, we propose a robust variant PSC, which can be efficiently verified even for general weak preferences. In the special case of strict preferences, our notion is the first known satisfiable proportionality axiom that is violated by the Single Transferable Vote (STV). We also discuss implications of our results for participatory budgeting, querying procedures, and to the notion of proportionality degree.


title: HADES: Hardware/Algorithm Co-design in DNN accelerators using Energy-efficient Approximate Alphabet Set Multipliers

abstract: Edge computing must be capable of executing computationally intensive algorithms, such as Deep Neural Networks (DNNs) while operating within a constrained computational resource budget. Such computations involve Matrix Vector Multiplications (MVMs) which are the dominant contributor to the memory and energy budget of DNNs. To alleviate the computational intensity and storage demand of MVMs, we propose circuit-algorithm co-design techniques with low-complexity approximate Multiply-Accumulate (MAC) units derived from the principles of Alphabet Set Multipliers (ASMs). Selection of few and proper alphabets from ASMs lead to a Multiplier-less DNN implementation, and enables encoding of low precision weights and input activations into fewer bits. To maintain accuracy under alphabet set approximations, we developed a novel ASM-alphabet aware training. The proposed low-complexity multiplication-aware algorithm was implemented In-Memory and Near-Memory with efficient shift operations to further improve the data-movement cost between memory and processing unit. We benchmark our design on CIFAR10 and ImageNet datasets for ResNet and MobileNet models and attain <1-2% accuracy degradation against full precision with energy benefits of >50% compared to standard Von-Neumann counterpart.


title: Offloading Deep Learning Powered Vision Tasks from UAV to 5G Edge Server with Denoising

abstract: Offloading computationally heavy tasks from an unmanned aerial vehicle (UAV) to a remote server helps improve the battery life and can help reduce resource requirements. Deep learning based state-of-the-art computer vision tasks, such as object segmentation and object detection, are computationally heavy algorithms, requiring large memory and computing power. Many UAVs are using (pretrained) off-the-shelf versions of such algorithms. Offloading such power-hungry algorithms to a remote server could help UAVs save power significantly. However, deep learning based algorithms are susceptible to noise, and a wireless communication system, by its nature, introduces noise to the original signal. When the signal represents an image, noise affects the image. There has not been much work studying the effect of the noise introduced by the communication system on pretrained deep networks. In this work, we first analyze how reliable it is to offload deep learning based computer vision tasks (including both object segmentation and detection) by focusing on the effect of various parameters of a 5G wireless communication system on the transmitted image and demonstrate how the introduced noise of the used 5G wireless communication system reduces the performance of the offloaded deep learning task. Then solutions are introduced to eliminate (or reduce) the negative effect of the noise. The proposed framework starts with introducing many classical techniques as alternative solutions first, and then introduces a novel deep learning based solution to denoise the given noisy input image. The performance of various denoising algorithms on offloading both object segmentation and object detection tasks are compared. Our proposed deep transformer-based denoiser algorithm (NR-Net) yields the state-of-the-art results on reducing the negative effect of the noise in our experiments.


title: Newtonion Quantum Gravity, WIMPs and Celestial Mechanics -- Summary of Results

abstract: We discuss the leading term in the semi-classical asymptotics of Newtonian quantum gravity for the Kepler problem. For dark matter, ice or dust particles in the gravitational field of a star or massive planet this explains how rapidly planets or ring systems can be formed by considering semi-classical equations for the asymptotic of the relevant Schrodinger wave function. We extend this treatment to isotropic harmonic oscillator potentials in two and three dimensions finding explicit solutions, with important applications to the Trojan asteroids. More detailed results on the restricted 3-body problem are in a forthcoming paper. Further in two dimensions, we find the explicit solutions for Newton's corresponding revolving orbits, explaining planetary perihelion advance in these terms. A general implicit approach to solving our equations is given using Cauchy characteristic curves giving necessary and sufficient conditions for existence and uniqueness of our solutions. Using this method we solve the two-dimensional Power Law Problem in our setting. Our methods give an insight to the behavior of semi-classical orbits in the neighborhood of classical orbits showing how complex constants of the motion emerge from the SO(4) symmetry group and what the particle densities have to be for circular spirals for different central potentials. Such constants have an important role in revolving orbits. Moreover, they and the aforementioned densities could give rise to observable effects in the early history of planetary ring systems. We believe the quantum spirals here associated with classical Keplerian elliptical orbits explain the evolution of galaxies, with a neutron star or black hole at their centre, from spiral to elliptical. In this connection we include a brief account of some recent results on quantum curvature, torsion as well as anti-gravity and spiral splitting, acid tests of our ideas.


title: ALLIANCE: Spectral solver for kinetic plasma turbulence

abstract: The ALLIANCE code is developed to solve a new set of four-dimensional electromagnetic drift-kinetic equations in slab geometry [J. Plasma Phys. 88 905880117 (2022)]. The nonlinear equations are useful for the study of magnetized plasma systems at scales comparable to, or larger than the ion gyroradius. In particular, it is suited for the study the kinetic turbulent cascade in astrophysical plasma, while preserving finite Larmor radius effects at the fluid-kinetic transition. The equations solved are in spectral Fourier-Laguerre-Hermite form, a pseudo-spectral approach is used for the nonlinear terms, and the code is parallelised over multiple directions. After a presentation of the code, validation runs are shown, and benchmarks for serial and parallel computations are presented.


title: Analysis of a fully discretized FDM-FEM scheme for solving thermo-elastic-damage coupled nonlinear PDE systems

abstract: In this paper, we consider a nonlinear PDE system governed by a parabolic heat equation coupled in a nonlinear way with a hyperbolic momentum equation describing the behavior of a displacement field coupled with a nonlinear elliptic equation based on an internal damage variable. We present a numerical scheme based on a low-order Galerkin finite element method (FEM) for the space discretization of the time-dependent nonlinear PDE system and an implicit finite difference method (FDM) to discretize in the direction of the time variable. Moreover, we present a priori estimates for the exact and discrete solutions for the pointwise-in-time $L^2$-norm. Based on the a priori estimates, we rigorously prove the convergence of the solutions of the fully discretized system to the exact solutions. Denoting the properties of the internal parameters, we find the order of convergence concerning the discretization parameters.


title: Subgroups of Genus-2 Quasi-Fuchsian groups and Cocompact Kleinian Groups

abstract: In this paper, we want to control the geometry of some surface subgroups of a cocompact Kleinian group. More precisely, provided any genus-2 quasi-Fuchsian group $\Gamma$ and cocompact Kleinian group $G$, then for any $K>1$, we will find a surface subgroup $H$ of $G$ that is $K$-quasiconformally conjugate to a finite index subgroup $F<\Gamma$.


title: Enhanced directionality of active processes in a viscoelastic bath

abstract: Active fluctuations are known to play a significant role in the intracellular transport of passive objects. However, the effect of viscoelasticity of the environment in shaping such processes is relatively less understood. Here, with a minimal experiment using a driven colloid in a viscoelastic bath, we show that viscoelasticity significantly increases the mean injected power to the passive object ($\sim 50\%$ compared to a viscous medium), for the same strength of the external driving. Additionally, we observe a notable reduction in negative work fluctuations across a wide range of driving amplitudes. These findings collectively suggest an enhanced directionality in driven processes within a viscoelastic bath, which we attribute to the emergence of interactions between the colloid and the viscoelastic medium.


title: Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analytics

abstract: In many domains, there are many examples and far fewer labels for those examples; e.g. we may have access to millions of lines of source code, but access to only a handful of warnings about that code. In those domains, semi-supervised learners (SSL) can extrapolate labels from a small number of examples to the rest of the data. Standard SSL algorithms use ``weak'' knowledge (i.e. those not based on specific SE knowledge) such as (e.g.) co-train two learners and use good labels from one to train the other. Another approach of SSL in software analytics is potentially use ``strong'' knowledge that use SE knowledge. For example, an often-used heuristic in SE is that unusually large artifacts contain undesired properties (e.g. more bugs). This paper argues that such ``strong'' algorithms perform better than those standard, weaker, SSL algorithms. We show this by learning models from labels generated using weak SSL or our ``stronger'' FRUGAL algorithm. In four domains (distinguishing security-related bug reports; mitigating bias in decision-making; predicting issue close time; and (reducing false alarms in static code warnings), FRUGAL required only 2.5% of the data to be labeled yet out-performed standard semi-supervised learners that relied on (e.g.) some domain-independent graph theory concepts. Hence, for future work, we strongly recommend the use of strong heuristics for semi-supervised learning for SE applications. To better support other researchers, our scripts and data are on-line at https://github.com/HuyTu7/FRUGAL.


title: Integrated Communication and Control Systems: A Data Significance Perspective

abstract: The interconnected smart devices and industrial internet of things devices require low-latency communication to fulfill control objectives despite limited resources. In essence, such devices have a time-critical nature but also require a highly accurate data input based on its significance. In this paper, we investigate various coordinated and distributed semantic scheduling schemes with a data significance perspective. In particular, novel algorithms are proposed to analyze the benefit of such schemes for the significance in terms of estimation accuracy. Then, we derive the bounds of the achievable estimation accuracy. Our numerical results showcase the superiority of semantic scheduling policies that adopt an integrated control and communication strategy. In essence, such policies can reduce the weighted sum of mean squared errors compared to traditional policies.


title: Online and Offline Learning of Player Objectives from Partial Observations in Dynamic Games

abstract: Robots deployed to the real world must be able to interact with other agents in their environment. Dynamic game theory provides a powerful mathematical framework for modeling scenarios in which agents have individual objectives and interactions evolve over time. However, a key limitation of such techniques is that they require a-priori knowledge of all players' objectives. In this work, we address this issue by proposing a novel method for learning players' objectives in continuous dynamic games from noise-corrupted, partial state observations. Our approach learns objectives by coupling the estimation of unknown cost parameters of each player with inference of unobserved states and inputs through Nash equilibrium constraints. By coupling past state estimates with future state predictions, our approach is amenable to simultaneous online learning and prediction in receding horizon fashion. We demonstrate our method in several simulated traffic scenarios in which we recover players' preferences for, e.g., desired travel speed and collision-avoidance behavior. Results show that our method reliably estimates game-theoretic models from noise-corrupted data that closely matches ground-truth objectives, consistently outperforming state-of-the-art approaches.


title: Cheeger-Chern-Simons classes of representations of finite subgroups of $\mathrm{SL}(2,\mathbb{C})$ and the spectrum of rational double point singularities

abstract: Let $L$ be a compact oriented $3$-manifold and $\rho\colon\pi_1(L)\to \mathrm{GL}(n,\mathbb{C})$ a representation. Evaluating the Cheeger-Chern-Simons class $\widehat{c}_{\rho,k}\in H^{2k-1}(L;\mathbb{C}/\mathbb{Z})$ of $\rho$ at $\nu\in H_{2k-1}(L;\mathbb{Z})$ we get characteristic numbers that we call the $k$-th CCS-numbers of $\rho$. We prove that if $\rho$ is a topologically trivial representation, the 2-nd CCS-number $\widehat{c}_{\rho,2}([L])$ of the fundamental class $[L]$ of $L$ is given by the invariant $\tilde{\xi}_\rho(D)$ of the Dirac operator $D$ of $L$ twisted by $\rho$ defined by Atiyah, Patodi and Singer. If $L$ is a rational homology sphere, we also give a formula for $\widehat{c}_{\rho,2}([L])$ of any representation $\rho$ in terms of $\tilde{\xi}(D)$. Given a topologically trivial representation $\rho\colon\pi_1(L)\to\mathrm{GL}(n,\mathbb{C})$ we construct an element $\langle L,\rho\rangle$ in the $3$-rd algebraic K-theory group $K_3(\mathbb{C})$ of the complex numbers. For a finite subgroup $\Gamma$ of $\mathrm{SU(2)}$ and its irreducible representations, we compute the 1-st and 2-nd CCS-numbers. With this, we recover the spectrum of all rational double point singularities. Motivated by this result, we define the topological spectrum of rational surface singularities and Gorenstein singularities. Given a normal surface singularity $(X,x)$ with link a rational homology sphere $L$, we show how to compute the invariant $\tilde{\xi}_\rho(D)$ for the Dirac operator of $L$ using either a resolution or a smoothing of $(X,x)$.


title: Spatial Network Calculus and Performance Guarantees in Wireless Networks

abstract: This work develops a novel approach toward performance guarantees for all links in arbitrarily large wireless networks. It introduces a spatial network calculus, consisting of spatial regulation properties for stationary point processes and the first steps of a calculus for this regulation, which can be seen as an extension to space of the classical network calculus. Specifically, two classes of regulations are defined: one includes ball regulation and shot-noise regulation, which are shown to be equivalent and upper constraint interference; the other one includes void regulation, which lower constraints the signal power. These regulations are defined both in the strong and weak sense: the former requires the regulations to hold everywhere in space, whereas the latter only requires the regulations to hold as observed by a jointly stationary point process. Using this approach, we derive performance guarantees in device-to-device, ad hoc, and cellular networks under proper regulations. We give universal bounds on the SINR for all links, which gives link service guarantees based on information-theoretic achievability. They are combined with classical network calculus to provide end-to-end latency guarantees for all packets in wireless queuing networks. Such guarantees do not exist in networks that are not spatially regulated, e.g., Poisson networks.


title: Flat fully augmented links are determined by their complements

abstract: In this paper, we show that two flat fully augmented links with homeomorphic complements must be equivalent as links in $\mathbb{S}^{3}$. This requires a careful analysis of how totally geodesic surfaces and cusps intersect in these link complements and behave under homeomorphism. One consequence of this analysis is a complete classification of flat fully augmented link complements that admit multiple reflection surfaces. In addition, our work classifies those symmetries of flat fully augmented link complements which are not induced by symmetries of the corresponding link.


title: QContext: Context-Aware Decomposition for Quantum Gates

abstract: In this paper we propose QContext, a new compiler structure that incorporates context-aware and topology-aware decompositions. Because of circuit equivalence rules and resynthesis, variants of a gate-decomposition template may exist. QContext exploits the circuit information and the hardware topology to select the gate variant that increases circuit optimization opportunities. We study the basis-gate-level context-aware decomposition for Toffoli gates and the native-gate-level context-aware decomposition for CNOT gates. Our experiments show that QContext reduces the number of gates as compared with the state-of-the-art approach, Orchestrated Trios.


title: Sharp Spectral Rates for Koopman Operator Learning

abstract: Nonlinear dynamical systems can be handily described by the associated Koopman operator, whose action evolves every observable of the system forward in time. Learning the Koopman operator and its spectral decomposition from data is enabled by a number of algorithms. In this work we present for the first time non-asymptotic learning bounds for the Koopman eigenvalues and eigenfunctions. We focus on time-reversal-invariant stochastic dynamical systems, including the important example of Langevin dynamics. We analyze two popular estimators: Extended Dynamic Mode Decomposition (EDMD) and Reduced Rank Regression (RRR). Our results critically hinge on novel {minimax} estimation bounds for the operator norm error, that may be of independent interest. Our spectral learning bounds are driven by the simultaneous control of the operator norm error and a novel metric distortion functional of the estimated eigenfunctions. The bounds indicates that both EDMD and RRR have similar variance, but EDMD suffers from a larger bias which might be detrimental to its learning rate. Our results shed new light on the emergence of spurious eigenvalues, an issue which is well known empirically. Numerical experiments illustrate the implications of the bounds in practice.


title: DeepAstroUDA: Semi-Supervised Universal Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection

abstract: Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features. Therefore, such methods do not generalize well across multiple datasets. We present a universal domain adaptation method, \textit{DeepAstroUDA}, as an approach to overcome this challenge. This algorithm performs semi-supervised domain adaptation and can be applied to datasets with different data distributions and class overlaps. Non-overlapping classes can be present in any of the two datasets (the labeled source domain, or the unlabeled target domain), and the method can even be used in the presence of unknown classes. We apply our method to three examples of galaxy morphology classification tasks of different complexities ($3$-class and $10$-class problems), with anomaly detection: 1) datasets created after different numbers of observing years from a single survey (LSST mock data of $1$ and $10$ years of observations); 2) data from different surveys (SDSS and DECaLS); and 3) data from observing fields with different depths within one survey (wide field and Stripe 82 deep field of SDSS). For the first time, we demonstrate the successful use of domain adaptation between very discrepant observational datasets. \textit{DeepAstroUDA} is capable of bridging the gap between two astronomical surveys, increasing classification accuracy in both domains (up to $40\%$ on the unlabeled data), and making model performance consistent across datasets. Furthermore, our method also performs well as an anomaly detection algorithm and successfully clusters unknown class samples even in the unlabeled target dataset.


title: Robust Budget Pacing with a Single Sample

abstract: Major Internet advertising platforms offer budget pacing tools as a standard service for advertisers to manage their ad campaigns. Given the inherent non-stationarity in an advertiser's value and also competing advertisers' values over time, a commonly used approach is to learn a target expenditure plan that specifies a target spend as a function of time, and then run a controller that tracks this plan. This raises the question: how many historical samples are required to learn a good expenditure plan? We study this question by considering an advertiser repeatedly participating in $T$ second-price auctions, where the tuple of her value and the highest competing bid is drawn from an unknown time-varying distribution. The advertiser seeks to maximize her total utility subject to her budget constraint. Prior work has shown the sufficiency of $T\log T$ samples per distribution to achieve the optimal $O(\sqrt{T})$-regret. We dramatically improve this state-of-the-art and show that just one sample per distribution is enough to achieve the near-optimal $\tilde O(\sqrt{T})$-regret, while still being robust to noise in the sampling distributions.


title: On the Analysis of Correlation Between Nominal Data and Numerical Data

abstract: The article investigates the possibility of measuring the strength of a linear correlation relationship between nominal data and numerical data. Correlation coefficients for variables coded with real numbers as well as for variables coded with complex numbers were studied. For variables coded with real numbers, unambiguous measures of real linear correlation were obtained. In the case of complex coding, it has been observed that the obtained complex correlation coefficients change with the permutation of the phases in the complex numbers used to code classes of elements with equal cardinalities. It was found that a necessary condition for linear correlation is the possibility of linear ordering of a set with data. Since linear order is not possible in the set of complex numbers, complex correlation coefficients cannot be used as a measure of linear correlation. In the event of such a situation, a substitute action was suggested that would prevent equal cardinality of classes of identical elements contained in the set with nominal data. This action would consist in the correction of data, analogous to the correction during preprocessing or cleaning of data containing missing or outlier values.


title: Witscript: A System for Generating Improvised Jokes in a Conversation

abstract: A chatbot is perceived as more humanlike and likeable if it includes some jokes in its output. But most existing joke generators were not designed to be integrated into chatbots. This paper presents Witscript, a novel joke generation system that can improvise original, contextually relevant jokes, such as humorous responses during a conversation. The system is based on joke writing algorithms created by an expert comedy writer. Witscript employs well-known tools of natural language processing to extract keywords from a topic sentence and, using wordplay, to link those keywords and related words to create a punch line. Then a pretrained neural network language model that has been fine-tuned on a dataset of TV show monologue jokes is used to complete the joke response by filling the gap between the topic sentence and the punch line. A method of internal scoring filters out jokes that don't meet a preset standard of quality. Human evaluators judged Witscript's responses to input sentences to be jokes more than 40% of the time. This is evidence that Witscript represents an important next step toward giving a chatbot a humanlike sense of humor.


title: Domain Adaptation via Rebalanced Sub-domain Alignment

abstract: Unsupervised domain adaptation (UDA) is a technique used to transfer knowledge from a labeled source domain to a different but related unlabeled target domain. While many UDA methods have shown success in the past, they often assume that the source and target domains must have identical class label distributions, which can limit their effectiveness in real-world scenarios. To address this limitation, we propose a novel generalization bound that reweights source classification error by aligning source and target sub-domains. We prove that our proposed generalization bound is at least as strong as existing bounds under realistic assumptions, and we empirically show that it is much stronger on real-world data. We then propose an algorithm to minimize this novel generalization bound. We demonstrate by numerical experiments that this approach improves performance in shifted class distribution scenarios compared to state-of-the-art methods.


title: Identifying f-electron symmetries of UTe2 with O-edge resonant inelastic X-ray scattering

abstract: The recent discovery of spin-triplet superconductivity emerging from a non-magnetic parent state in UTe$_2$ has stimulated great interest in the underlying mechanism of Cooper pairing. Experimental characterization of short-range electronic and magnetic correlations is vital to understanding these phenomena. Here we use resonant inelastic X-ray scattering (RIXS), X-ray absorption spectroscopy (XAS), and atomic multiplet-based modeling to shed light on the active debate between 5$f^2$6$d^1$-based models with singlet crystal field states versus 5$f^3$-based models that predict atomic Kramers doublets and much greater 5$f$ itinerancy. The XAS and RIXS data are found to agree strongly with predictions for an 5$f^2$6$d^1$-like valence electron configuration with weak intra-dimer magnetic correlations, and provide new context for interpreting recent investigations of the electronic structure and superconducting pairing mechanism.


title: Zero-Shot Robot Manipulation from Passive Human Videos

abstract: Can we learn robot manipulation for everyday tasks, only by watching videos of humans doing arbitrary tasks in different unstructured settings? Unlike widely adopted strategies of learning task-specific behaviors or direct imitation of a human video, we develop a a framework for extracting agent-agnostic action representations from human videos, and then map it to the agent's embodiment during deployment. Our framework is based on predicting plausible human hand trajectories given an initial image of a scene. After training this prediction model on a diverse set of human videos from the internet, we deploy the trained model zero-shot for physical robot manipulation tasks, after appropriate transformations to the robot's embodiment. This simple strategy lets us solve coarse manipulation tasks like opening and closing drawers, pushing, and tool use, without access to any in-domain robot manipulation trajectories. Our real-world deployment results establish a strong baseline for action prediction information that can be acquired from diverse arbitrary videos of human activities, and be useful for zero-shot robotic manipulation in unseen scenes.


title: DeTorrent: An Adversarial Padding-only Traffic Analysis Defense

abstract: While anonymity networks like Tor aim to protect the privacy of their users, they are vulnerable to traffic analysis attacks such as Website Fingerprinting (WF) and Flow Correlation (FC). Recent implementations of WF and FC attacks, such as Tik-Tok and DeepCoFFEA, have shown that the attacks can be effectively carried out, threatening user privacy. Consequently, there is a need for effective traffic analysis defense. There are a variety of existing defenses, but most are either ineffective, incur high latency and bandwidth overhead, or require additional infrastructure. As a result, we aim to design a traffic analysis defense that is efficient and highly resistant to both WF and FC attacks. We propose DeTorrent, which uses competing neural networks to generate and evaluate traffic analysis defenses that insert 'dummy' traffic into real traffic flows. DeTorrent operates with moderate overhead and without delaying traffic. In a closed-world WF setting, it reduces an attacker's accuracy by 61.5%, a reduction 10.5% better than the next-best padding-only defense. Against the state-of-the-art FC attacker, DeTorrent reduces the true positive rate for a $10^{-5}$ false positive rate to about .12, which is less than half that of the next-best defense. We also demonstrate DeTorrent's practicality by deploying it alongside the Tor network and find that it maintains its performance when applied to live traffic.


title: IoT Botnet Detection Using an Economic Deep Learning Model

abstract: The rapid progress in technology innovation usage and distribution has increased in the last decade. The rapid growth of the Internet of Things (IoT) systems worldwide has increased network security challenges created by malicious third parties. Thus, reliable intrusion detection and network forensics systems that consider security concerns and IoT systems limitations are essential to protect such systems. IoT botnet attacks are one of the significant threats to enterprises and individuals. Thus, this paper proposed an economic deep learning-based model for detecting IoT botnet attacks along with different types of attacks. The proposed model achieved higher accuracy than the state-of-the-art detection models using a smaller implementation budget and accelerating the training and detecting processes.


title: Multi-Task Learning for Screen Content Image Coding

abstract: With the rise of remote work and collaboration, compression of screen content images (SCI) is becoming increasingly important. While there are efficient codecs for natural images, as well as codecs for purely-synthetic images, those SCIs that contain both synthetic and natural content pose a particular challenge. In this paper, we propose a learning-based image coding model developed for such SCIs. By training an encoder to provide a latent representation suitable for two tasks -- input reconstruction and synthetic/natural region segmentation -- we create an effective SCI image codec whose strong performance is verified through experiments. Once trained, the second task (segmentation) need not be used; the codec still benefits from the segmentation-friendly latent representation.


title: Non-greedy Tree-based Learning for Estimating Global Optimal Dynamic Treatment Decision Rules with Continuous Treatment Dosage

abstract: Dynamic treatment regime (DTR) plays a critical role in precision medicine when assigning patient-specific treatments at multiple stages and optimizing a long term clinical outcome. However, most of existing work about DTRs have been focused on categorical treatment scenarios, instead of continuous treatment options. Also, the performances of regular black-box machine learning methods and regular tree learning methods are lack of interpretability and global optimality respectively. In this paper, we propose a non-greedy global optimization method for dose search, namely Global Optimal Dosage Tree-based learning method (GoDoTree), which combines a robust estimation of the counterfactual outcome mean with an interpretable and non-greedy decision tree for estimating the global optimal dynamic dosage treatment regime in a multiple-stage setting. GoDoTree-Learning recursively estimates how the counterfactual outcome mean depends on a continuous treatment dosage using doubly robust estimators at each stage, and optimizes the stage-specific decision tree in a non-greedy way. We conduct simulation studies to evaluate the finite sample performance of the proposed method and apply it to a real data application for optimal warfarin dose finding.


title: Improving Interpretability via Explicit Word Interaction Graph Layer

abstract: Recent NLP literature has seen growing interest in improving model interpretability. Along this direction, we propose a trainable neural network layer that learns a global interaction graph between words and then selects more informative words using the learned word interactions. Our layer, we call WIGRAPH, can plug into any neural network-based NLP text classifiers right after its word embedding layer. Across multiple SOTA NLP models and various NLP datasets, we demonstrate that adding the WIGRAPH layer substantially improves NLP models' interpretability and enhances models' prediction performance at the same time.


title: Prospects of Detecting Non-thermal Protons in Solar Flares via Lyman Line Spectroscopy: Revisiting the Orrall-Zirker Effect

abstract: Solar flares are efficient particle accelerators, with a substantial fraction of the energy released manifesting as non-thermal particles. While the role that non-thermal electrons play in transporting flare energy is well studied, the properties and importance of non-thermal protons is rather less well understood. This is in large part due to the paucity of diagnostics, particularly at the lower-energy (deka-keV) range of non-thermal proton distributions in flares. One means to identify the presence of deka-keV protons is by an effect originally described by \cite{1976ApJ...208..618O}. In the Orrall-Zirker effect, non-thermal protons interact with ambient neutral hydrogen, and via charge exchange produce a population of energetic neutral atoms (ENAs) in the chromosphere. These ENAs subsequently produce an extremely redshifted photon in the red wings of hydrogen spectral lines. We revisit predictions of the strength of this effect using modern interaction cross-sections, and numerical models capable of self-consistently simulating the flaring non-equilibrium ionization stratification, and the non-thermal proton distribution (and, crucially, their feedback on each other). We synthesize both the thermal and non-thermal emission from \lya\ and \lyb, the most promising lines that may exhibit a detectable signal. These new predictions are are weaker and more transient than prior estimates, but the effects should be detectable in fortuitous circumstances. We degrade the \lyb\ emission to the resolution of the Spectral Imaging of the Coronal Environment (SPICE) instrument on board Solar Orbiter, demonstrating that though likely difficult, it should be possible to detect the presence of non-thermal protons in flares observed by SPICE.


title: Hierarchical Model with Allee Effect, Immigration, and Holling Type II Functional Response

abstract: In this paper, we discuss a hierarchical model, based on a Ricker competition model. The species considered are competing for resources and may be subject to an Allee effect due to mate limitation, anti-predator vigilance or aggression, cooperative predation or resource defense, or social thermoregulation. The species may be classified into a more dominant species and less dominant or ``wimpy" species or just as a predator and prey. The model under consideration also has components taking into account immigration in both species and a more structured Holling type II functional response. Local and global stability analyses are discussed and simulations are provided. We also consider demographic stochasticity on the species due to environmental fluctuations in the form of Wiener processes and we show that there are conditions under which a global solution exists, stationary distributions exists, and strong persistence in mean of the species is possible. We also use Wasserstein distance to show empirically that stochasticity can acts as bifurcation parameter.


title: Tubings, chord diagrams, and Dyson--Schwinger equations

abstract: We give series solutions to single insertion place propagator-type systems of Dyson--Schwinger equations using binary tubings of rooted trees. These solutions are combinatorially transparent in the sense that each tubing has a straightforward contribution. The Dyson--Schwinger equations solved here are more general than those previously solved by chord diagram techniques, including systems and non-integer values of the insertion parameter $s$. We remark on interesting combinatorial connections and properties.


title: Galaxy rotation curves and universal scaling relations: comparison between phenomenological and fermionic dark matter profiles

abstract: Galaxies show different halo scaling relations such as the Radial Acceleration Relation, the Mass Discrepancy Acceleration Relation (MDAR) or the dark matter Surface Density Relation (SDR). At difference with traditional studies using phenomenological $\Lambda$CDM halos, we analyze the above relations assuming that dark matter (DM) halos are formed through a Maximum Entropy Principle (MEP) in which the fermionic (quantum) nature of the DM particles is dully accounted for. For the first time a competitive DM model based on first physical principles, such as (quantum) statistical-mechanics and thermodynamics, is tested against a large data-set of galactic observables. In particular, we compare the fermionic DM model with empirical DM profiles: the NFW model, a generalized NFW model accounting for baryonic feedback, the Einasto model and the Burkert model. For this task, we use a large sample of 120 galaxies taken from the Spitzer Photometry and Accurate Rotation Curves (SPARC) data-set, from which we infer the DM content to compare with the models. We find that the Radial Acceleration Relation and MDAR are well explained by all the models with comparable accuracy, while the fits to the individual rotation curves, in contrast, show that cored DM halos are statistically preferred with respect to the cuspy NFW profile. However, very different physical principles justify the flat inner halo slope in the most favored DM profiles: while generalized NFW or Einasto models rely on complex baryonic feedback processes, the MEP scenario involves a quasi-thermodynamic equilibrium of the DM particles.


title: Glycolaldehyde formation mediated by interstellar amorphous ice: a computational study

abstract: Glycolaldehyde (HOCH2CHO) is the most straightforward sugar detected in the Interstellar Medium (ISM) and participates in the formation pathways of molecules fundamental to life, red such as ribose and derivatives. Although detected in several regions of the ISM, its formation route is still debated and its abundance cannot be explained only by reactions in the gas phase. This work explores a new gas-phase formation mechanism for glycolaldehyde and compares the energy barrier reduction when the same route happens on the surface of amorphous ices. The first step of the mechanism involves the formation of a carbon-carbon bond between formaldehyde (H2CO) and the formyl radical (HCO), with an energy barrier of 27 kJ mol-1 (gas-phase). The second step consists of barrierless hydrogen addition. Density functional calculations under periodic boundary conditions were applied to study this reaction path on 10 different amorphous ice surfaces through an Eley-Rideal type mechanism. It was found that the energy barrier is reduced on average by 49 per cent, leading in some cases to a 100 per cent reduction. The calculated adsorption energy of glycolaldehyde suggests that it can be promptly desorbed to the gas phase after its formation. This work, thus contributes to explaining the detected relative abundances of glycolaldehyde and opens a new methodological framework for studying the formation routes for Complex Organic Molecules (COMs) in interstellar icy grains.


title: Topological Darkness: How to Design a Metamaterial for Optical Biosensing with Virtually Unlimited Sensitivity

abstract: Due to the absence of labels and fast analyses, optical biosensors promise major advances in biomedical diagnostics, security, environmental and food safety applications. However, sensitivity of the most advanced plasmonic biosensor implementations has a fundamental limitation caused by losses in the system and or geometry of biochips. Here, we report a scissor effect in topologically dark metamaterials which is capable of providing virtually unlimited bona fide sensitivity to biosensing thus solving the bottleneck sensitivity limitation problem. We explain how the scissor effect can be realized via a proper design of topologically dark metamaterials and describe strategies for their fabrication. To validate the applicability of this effect in biosensing, we demonstrate the detection of folic acid (vitamin important for human health) in the wide 3-log linear dynamic range with the limit of detection of 0.125 nM, which is orders of magnitude better than previously reported for all optical counterparts. Our work opens possibilities for designing and realising plasmonic, semiconductor and dielectric metamaterials with ultra-sensitivity to binding events.


title: TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classification

abstract: Adversarial attack serves as a major challenge for neural network models in NLP, which precludes the model's deployment in safety-critical applications. A recent line of work, detection-based defense, aims to distinguish adversarial sentences from benign ones. However, {the core limitation of previous detection methods is being incapable of giving correct predictions on adversarial sentences unlike defense methods from other paradigms.} To solve this issue, this paper proposes TextShield: (1) we discover a link between text attack and saliency information, and then we propose a saliency-based detector, which can effectively detect whether an input sentence is adversarial or not. (2) We design a saliency-based corrector, which converts the detected adversary sentences to benign ones. By combining the saliency-based detector and corrector, TextShield extends the detection-only paradigm to a detection-correction paradigm, thus filling the gap in the existing detection-based defense. Comprehensive experiments show that (a) TextShield consistently achieves higher or comparable performance than state-of-the-art defense methods across various attacks on different benchmarks. (b) our saliency-based detector outperforms existing detectors for detecting adversarial sentences.


title: A Simple Approach for Local and Global Variable Importance in Nonlinear Regression Models

abstract: The ability to interpret machine learning models has become increasingly important as their usage in data science continues to rise. Most current interpretability methods are optimized to work on either (\textit{i}) a global scale, where the goal is to rank features based on their contributions to overall variation in an observed population, or (\textit{ii}) the local level, which aims to detail on how important a feature is to a particular individual in the data set. In this work, a new operator is proposed called the "GlObal And Local Score" (GOALS): a simple \textit{post hoc} approach to simultaneously assess local and global feature variable importance in nonlinear models. Motivated by problems in biomedicine, the approach is demonstrated using Gaussian process regression where the task of understanding how genetic markers are associated with disease progression both within individuals and across populations is of high interest. Detailed simulations and real data analyses illustrate the flexible and efficient utility of GOALS over state-of-the-art variable importance strategies.


title: Self-Supervised Transformer Architecture for Change Detection in Radio Access Networks

abstract: Radio Access Networks (RANs) for telecommunications represent large agglomerations of interconnected hardware consisting of hundreds of thousands of transmitting devices (cells). Such networks undergo frequent and often heterogeneous changes caused by network operators, who are seeking to tune their system parameters for optimal performance. The effects of such changes are challenging to predict and will become even more so with the adoption of 5G/6G networks. Therefore, RAN monitoring is vital for network operators. We propose a self-supervised learning framework that leverages self-attention and self-distillation for this task. It works by detecting changes in Performance Measurement data, a collection of time-varying metrics which reflect a set of diverse measurements of the network performance at the cell level. Experimental results show that our approach outperforms the state of the art by 4% on a real-world based dataset consisting of about hundred thousands timeseries. It also has the merits of being scalable and generalizable. This allows it to provide deep insight into the specifics of mode of operation changes while relying minimally on expert knowledge.


title: Classification of complex algebraic curves under blow-spherical equivalence

abstract: This article is devoted to studying complex algebraic sets under (global) blow-spherical equivalence. The main results of this article are complete classifications of complex algebraic curves. Firstly, we present a complete classification of complex algebraic curves under blow-spherical homeomorphisms at infinity and, then, we present a complete classification of complex algebraic curves under (global) blow-spherical homeomorphisms. We also present several properties of the blow-spherical equivalence. For instance, we prove that the degree of curves is preserved under blow-spherical homeomorphisms at infinity. Another property presented here is a Bernstein-type result which says that a pure dimensional complex algebraic set which is blow-spherical homeomorphic at infinity to a Euclidean space must be an affine linear subspace.


title: On the special harmonic numbers $H_{\lfloor p/9 \rfloor}$ and $H_{\lfloor p/18 \rfloor}$ modulo $p$

abstract: Building on work of Zhi-Hong Sun, we establish congruences for the special harmonic numbers $H_\lfloor p/9 \rfloor$ and $H_{\lfloor p/18 \rfloor}$ modulo $p$, which contain respectively three and four distinct arithmetic components. We also obtain a complete determination modulo $p$ of the corresponding families of sums of reciprocals of the type studied by Dilcher and Skula. Applications to the first case of Fermat's Last Theorem are considered.


title: Analyzing the Large-Scale Bulk Flow using CosmicFlows4: Increasing Tension with the Standard Cosmological Model

abstract: We present an estimate of the bulk flow in a volume of radii $150-200h^{-1}$Mpc using the minimum variance (MV) method with data from the CosmicFlows-4 (CF4) catalog. The addition of new data in the CF4 has resulted in an increase in the estimate of the bulk flow in a sphere of radius $150h^{-1}$Mpc relative to the CosmicFlows-3 (CF3). This bulk flow has less than a $0.03\%$ chance of occurring in the Standard Cosmological Model ($\Lambda$CDM) with cosmic microwave background derived parameters. Given that the CF4 is deeper than the CF3, we were able to use the CF4 to accurately estimate the bulk flow on scales of $200h^{-1}$Mpc (equivalent to 266 Mpc for Hubble constant $H_o=75$ km/s/Mpc) for the first time. This bulk flow is in even greater tension with the Standard Model, having less than $0.003\%$ probability of occurring. To estimate the bulk flow accurately, we introduce a novel method to calculate distances and velocities from distance moduli that is unbiased and accurate at all distances. Our results are completely independent of the value of $H_o$.


title: Towards Few-Shot Identification of Morality Frames using In-Context Learning

abstract: Data scarcity is a common problem in NLP, especially when the annotation pertains to nuanced socio-linguistic concepts that require specialized knowledge. As a result, few-shot identification of these concepts is desirable. Few-shot in-context learning using pre-trained Large Language Models (LLMs) has been recently applied successfully in many NLP tasks. In this paper, we study few-shot identification of a psycho-linguistic concept, Morality Frames (Roy et al., 2021), using LLMs. Morality frames are a representation framework that provides a holistic view of the moral sentiment expressed in text, identifying the relevant moral foundation (Haidt and Graham, 2007) and at a finer level of granularity, the moral sentiment expressed towards the entities mentioned in the text. Previous studies relied on human annotation to identify morality frames in text which is expensive. In this paper, we propose prompting-based approaches using pretrained Large Language Models for identification of morality frames, relying only on few-shot exemplars. We compare our models' performance with few-shot RoBERTa and found promising results.


title: Learning the Night Sky with Deep Generative Priors

abstract: Recovering sharper images from blurred observations, referred to as deconvolution, is an ill-posed problem where classical approaches often produce unsatisfactory results. In ground-based astronomy, combining multiple exposures to achieve images with higher signal-to-noise ratios is complicated by the variation of point-spread functions across exposures due to atmospheric effects. We develop an unsupervised multi-frame method for denoising, deblurring, and coadding images inspired by deep generative priors. We use a carefully chosen convolutional neural network architecture that combines information from multiple observations, regularizes the joint likelihood over these observations, and allows us to impose desired constraints, such as non-negativity of pixel values in the sharp, restored image. With an eye towards the Rubin Observatory, we analyze 4K by 4K Hyper Suprime-Cam exposures and obtain preliminary results which yield promising restored images and extracted source lists.


title: Augmenting Rule-based DNS Censorship Detection at Scale with Machine Learning

abstract: The proliferation of global censorship has led to the development of a plethora of measurement platforms to monitor and expose it. Censorship of the domain name system (DNS) is a key mechanism used across different countries. It is currently detected by applying heuristics to samples of DNS queries and responses (probes) for specific destinations. These heuristics, however, are both platform-specific and have been found to be brittle when censors change their blocking behavior, necessitating a more reliable automated process for detecting censorship. In this paper, we explore how machine learning (ML) models can (1) help streamline the detection process, (2) improve the potential of using large-scale datasets for censorship detection, and (3) discover new censorship instances and blocking signatures missed by existing heuristic methods. Our study shows that supervised models, trained using expert-derived labels on instances of known anomalies and possible censorship, can learn the detection heuristics employed by different measurement platforms. More crucially, we find that unsupervised models, trained solely on uncensored instances, can identify new instances and variations of censorship missed by existing heuristics. Moreover, both methods demonstrate the capability to uncover a substantial number of new DNS blocking signatures, i.e., injected fake IP addresses overlooked by existing heuristics. These results are underpinned by an important methodological finding: comparing the outputs of models trained using the same probes but with labels arising from independent processes allows us to more reliably detect cases of censorship in the absence of ground-truth labels of censorship.


title: A Highly Correlated Topological Bubble Phase of Composite Fermions

abstract: Strong interactions and topology drive a wide variety of correlated ground states. Some of the most interesting of these ground states, such as fractional quantum Hall states and fractional Chern insulators, have fractionally charged quasiparticles. Correlations in these phases are captured by the binding of electrons and vortices into emergent particles called composite fermions. Composite fermion quasiparticles are randomly localized at high levels of disorder and may exhibit charge order when there is not too much disorder in the system. However, more complex correlations were predicted when composite fermion quasiparticles cluster into a bubble, then these bubbles order on a lattice. Such a highly correlated ground state was termed the bubble phase of composite fermions. Here we report the observation of this bubble phase of composite fermions, evidenced by the reentrance of the fractional quantum Hall effect. We associate this reentrance with a bubble phase with two composite fermion quasiparticles per bubble. Our results demonstrate the existence of a new class of strongly correlated topological phases driven by clustering and charge ordering of emergent quasiparticles.


title: An Asymptotically Optimal Algorithm for the Convex Hull Membership Problem

abstract: We study the convex hull membership (CHM) problem in the pure exploration setting where one aims to efficiently and accurately determine if a given point lies in the convex hull of means of a finite set of distributions. We give a complete characterization of the sample complexity of the CHM problem in the one-dimensional case. We present the first asymptotically optimal algorithm called Thompson-CHM, whose modular design consists of a stopping rule and a sampling rule. In addition, we extend the algorithm to settings that generalize several important problems in the multi-armed bandit literature. Furthermore, we discuss the extension of Thompson-CHM to higher dimensions. Finally, we provide numerical experiments to demonstrate the empirical behavior of the algorithm matches our theoretical results for realistic time horizons.


title: 5GLoR: 5G LAN Orchestration for enterprise IoT applications

abstract: 5G-LAN is an enterprise local area network (LAN) that leverages 5G technology for wireless connectivity instead of WiFi. 5G technology is unique: it uses network slicing to distinguish customers in the same traffic class using new QoS technologies in the RF domain. This unique ability is not supported by most enterprise LANs, which rely primarily on DiffServ-like technologies that distinguish among traffic classes rather than customers. We first show that this mismatch in QoS between the 5G network and the LAN affects the accuracy of insights from the LAN-resident analytics applications. We systematically analyze the root causes of the QoS mismatch and propose a first-of-a-kind 5G-LAN orchestrator (5GLoR). 5GLoR is a middleware that applications can use to preserve the QoS of their 5G data streams through the enterprise LAN. 5GLoR periodically analyzes the status of the queues, provides suitable DSCP identifiers to the application, and installs relevant switch re-write rules (to change DSCP identifiers between switches) to continuously preserve the QoS of the 5G data through the LAN. 5GLoR improves the RTP frame level delay and inter-frame delay by 212\% and 122\%, respectively, for the WebRTC application. Additionally, with 5GLoR, the accuracy of two example applications (face detection and recognition) improved by 33\%, while the latency was reduced by about 25\%. Our experiments show that the performance (accuracy and latency) of applications on a 5G-LAN performs well with the proposed 5GLoR compared to the same applications on MEC. This is significant because 5G-LAN offers an order of magnitude more computing, networking, and storage resources to the applications than the resource-constrained MEC, and mature enterprise technologies can be used to deploy, manage, and update IoT applications.


title: Uniqueness of monoidal adjunctions

abstract: There are two dual equivalences between the $\infty$-category of $\mathcal{O}$-monoidal $\infty$-categories with right adjoint lax $\mathcal{O}$-monoidal functors and that with left adjoint oplax $\mathcal{O}$-monoidal functors, where $\mathcal{O}$ is an $\infty$-operad. We study the space of equivalences between these two $\infty$-categories, and show that the two equivalences equipped with compatible $\mathcal{O}$-monoidal presheaf functors are canonically equivalent.


title: Nonlinear Balanced Truncation: Part 2 -- Model Reduction on Manifolds

abstract: Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and observability are solutions of high-dimensional Hamilton-Jacobi-(Bellman) equations, which have been computationally intractable and (b) the transformations to construct the reduced-order models (ROMs) are potentially ill-conditioned and the resulting ROMs are difficult to simulate on the nonlinear balanced manifolds. Part~1 of this two-part article addressed challenge (a) via a scalable tensor-based method to solve for polynomial approximations of the open- and closed-loop energy functions. This article, (Part~2), addresses challenge (b) by presenting a novel and scalable method to reduce the dimensionality of the full-order model via model reduction on polynomially-nonlinear balanced manifolds. The associated nonlinear state transformation simultaneously 'diagonalizes' relevant energy functions in the new coordinates. Since this nonlinear balancing transformation can be ill-conditioned and expensive to evaluate, inspired by the linear case we develop a computationally efficient balance-and-reduce strategy, resulting in a scalable and better conditioned truncated transformation to produce balanced nonlinear ROMs. The algorithm is demonstrated on a semi-discretized partial differential equation, namely Burgers equation, which illustrates that higher-degree transformations can improve the accuracy of ROM outputs.


title: Bounds on Binary Niederreiter-Rosenbloom-Tsfasman LCD codes

abstract: Linear complementary dual codes (LCD codes) are codes whose intersections with their dual codes are trivial. These codes were introduced by Massey in 1992. LCD codes have wide applications in data storage, communication systems, and cryptography. Niederreiter-Rosenbloom-Tsfasman LCD codes (NRT-LCD codes) were introduced by Heqian, Guangku and Wei as a generalization of LCD codes for the NRT metric space $M_{n,s}(\mathbb{F}_{q})$. In this paper, we study LCD$[n\times s,k]$, the maximum minimum NRT distance among all binary $[n\times s,k]$ NRT-LCD codes. We prove the existence (non-existence) of binary maximum distance separable NRT-LCD codes in $M_{1,s}(\mathbb{F}_{2})$. We present a linear programming bound for binary NRT-LCD codes in $M_{n,2}(\mathbb{F}_{2})$. We also give two methods to construct binary NRT-LCD codes.


title: Rating Sentiment Analysis Systems for Bias through a Causal Lens

abstract: Sentiment Analysis Systems (SASs) are data-driven Artificial Intelligence (AI) systems that, given a piece of text, assign one or more numbers conveying the polarity and emotional intensity expressed in the input. Like other automatic machine learning systems, they have also been known to exhibit model uncertainty where a (small) change in the input leads to drastic swings in the output. This can be especially problematic when inputs are related to protected features like gender or race since such behavior can be perceived as a lack of fairness, i.e., bias. We introduce a novel method to assess and rate SASs where inputs are perturbed in a controlled causal setting to test if the output sentiment is sensitive to protected variables even when other components of the textual input, e.g., chosen emotion words, are fixed. We then use the result to assign labels (ratings) at fine-grained and overall levels to convey the robustness of the SAS to input changes. The ratings serve as a principled basis to compare SASs and choose among them based on behavior. It benefits all users, especially developers who reuse off-the-shelf SASs to build larger AI systems but do not have access to their code or training data to compare.


title: Antibacterial Activity of Zinc Oxide Thin Films by Atomic Layer Deposition for Personal Protective Equipment Applications

abstract: The global pandemic has significantly increased the demand for personal protective equipment (PPE). The antimicrobial coating has been broadly applied to PPE to improve its prevention capability, especially after prolonged usage. However, antimicrobial coating by traditional methods, such as chemical vapor deposition, spraying, and slurry coating, suffers from drawbacks such as low efficiency, poor coverage, and loose adhesion to PPE. To overcome these limitations, this work adopted an atomic layer deposition (ALD) technique to deposit a zinc oxide (ZnO) thin film (~ 312.8 nm thick) as an antimicrobial coating and proved its advantage for depositing uniform ZnO coating on PPE with a fabric structure. Analysis by X-ray diffraction, Raman spectroscopy, and X-ray photoelectron spectroscopy confirmed the crystal structure and chemical composition of the ALD-ZnO. Ultraviolet-visible spectra disclosed a high absorption level of about 4.8 from 200 nm to 380 nm wavelength for ALD-ZnO, in contrast to 3.8 for commercial ZnO powders. Moreover, the ALD-ZnO exhibited strong antimicrobial properties when tested against Escherichia coli (E.Coli) in contrast to the control and bare glass samples. The colony-forming unit (CFU/ml) remained zero for all ALD-ZnO samples while varying between 2.30*109 and 4.97*109 with a median of 4.36*109 for the control and between 9.10*108 and 3.27*109 with a median of 2.04x 109 for the bare glass. Statistic analysis using null-hypothesis significance testing revealed that the calculated P value, between bare glass and control, ALD-ZnO and control, and bare glass and control, were all smaller than 0.0001 and significantly smaller than 0.05 alpha value, suggesting a high confidence level of ALD-ZnO as the main factor for preventing E.Coli growth.


title: Stellar Populations in the Central 0.5 pc of Our Galaxy III: The Dynamical Sub-structures

abstract: We measure the 3D kinematic structures of the young stars within the central 0.5 parsec of our Galactic Center using the 10 m telescopes of the W.~M.~Keck Observatory over a time span of 25 years. Using high-precision measurements of positions on the sky, and proper motions and radial velocities from new observations and the literature, we constrain the orbital parameters for each young star. Our results show two statistically significant sub-structures: a clockwise stellar disk with 18 candidate stars, as has been proposed before, but with an improved disk membership; a second, almost edge-on plane of 10 candidate stars oriented East-West on the sky that includes at least one IRS 13 star. We estimate the eccentricity distribution of each sub-structure and find that the clockwise disk has <$e$> = 0.39 and the edge-on plane has <$e$> = 0.68. We also perform simulations of each disk/plane with incompleteness and spatially-variable extinction to search for asymmetry. Our results show that the clockwise stellar disk is consistent with a uniform azimuthal distribution within the disk. The edge-on plane has an asymmetry that cannot be explained by variable extinction or incompleteness in the field. The orientation, asymmetric stellar distribution, and high eccentricity of the edge-on plane members suggest that this structure may be a stream associated with the IRS 13 group. The complex dynamical structure of the young nuclear cluster indicates that the star formation process involved complex gas structures and dynamics and is inconsistent with a single massive gaseous disk.


title: REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformers

abstract: Tabular data is a common form of organizing data. Multiple models are available to generate synthetic tabular datasets where observations are independent, but few have the ability to produce relational datasets. Modeling relational data is challenging as it requires modeling both a "parent" table and its relationships across tables. We introduce REaLTabFormer (Realistic Relational and Tabular Transformer), a tabular and relational synthetic data generation model. It first creates a parent table using an autoregressive GPT-2 model, then generates the relational dataset conditioned on the parent table using a sequence-to-sequence (Seq2Seq) model. We implement target masking to prevent data copying and propose the $Q_{\delta}$ statistic and statistical bootstrapping to detect overfitting. Experiments using real-world datasets show that REaLTabFormer captures the relational structure better than a baseline model. REaLTabFormer also achieves state-of-the-art results on prediction tasks, "out-of-the-box", for large non-relational datasets without needing fine-tuning.


title: BarrierBypass: Out-of-Sight Clean Voice Command Injection Attacks through Physical Barriers

abstract: The growing adoption of voice-enabled devices (e.g., smart speakers), particularly in smart home environments, has introduced many security vulnerabilities that pose significant threats to users' privacy and safety. When multiple devices are connected to a voice assistant, an attacker can cause serious damage if they can gain control of these devices. We ask where and how can an attacker issue clean voice commands stealthily across a physical barrier, and perform the first academic measurement study of this nature on the command injection attack. We present the BarrierBypass attack that can be launched against three different barrier-based scenarios termed across-door, across-window, and across-wall. We conduct a broad set of experiments to observe the command injection attack success rates for multiple speaker samples (TTS and live human recorded) at different command audio volumes (65, 75, 85 dB), and smart speaker locations (0.1-4.0m from barrier). Against Amazon Echo Dot 2, BarrierBypass is able to achieve 100% wake word and command injection success for the across-wall and across-window attacks, and for the across-door attack (up to 2 meters). At 4 meters for the across-door attack, BarrierBypass can achieve 90% and 80% injection accuracy for the wake word and command, respectively. Against Google Home mini BarrierBypass is able to achieve 100% wake word injection accuracy for all attack scenarios. For command injection BarrierBypass can achieve 100% accuracy for all the three barrier settings (up to 2 meters). For the across-door attack at 4 meters, BarrierBypass can achieve 80% command injection accuracy. Further, our demonstration using drones yielded high command injection success, up to 100%. Overall, our results demonstrate the potentially devastating nature of this vulnerability to control a user's device from outside of the device's physical space.


title: mixdistreg: An R Package for Fitting Mixture of Experts Distributional Regression with Adaptive First-order Methods

abstract: This paper presents a high-level description of the R software package mixdistreg to fit mixture of experts distributional regression models. The proposed framework is implemented in R using the deepregression software template, which is based on TensorFlow and follows the neural structured additive learning principle. The software comprises various approaches as special cases, including mixture density networks and mixture regression approaches. Various code examples are given to demonstrate the package's functionality.


title: Neutron capture-induced silicon nuclear recoils for dark matter and CE$\nu$NS

abstract: Following neutron capture in a material there will be prompt nuclear recoils in addition to the gamma cascade. The nuclear recoils that are left behind in materials are generally below 1\,keV and therefore in the range of interest for dark matter experiments and CE$\nu$NS studies--both as backgrounds and calibration opportunities. Here we obtain the spectrum of prompt nuclear recoils following neutron capture for silicon.


title: Radar Clutter Covariance Estimation: A Nonlinear Spectral Shrinkage Approach

abstract: In this paper, we exploit the spiked covariance structure of the clutter plus noise covariance matrix for radar signal processing. Using state-of-the-art techniques high dimensional statistics, we propose a nonlinear shrinkage-based rotation invariant spiked covariance matrix estimator. We state the convergence of the estimated spiked eigenvalues. We use a dataset generated from the high-fidelity, site-specific physics-based radar simulation software RFView to compare the proposed algorithm against the existing Rank Constrained Maximum Likelihood (RCML)-Expected Likelihood (EL) covariance estimation algorithm. We demonstrate that the computation time for the estimation by the proposed algorithm is less than the RCML-EL algorithm with identical Signal to Clutter plus Noise (SCNR) performance. We show that the proposed algorithm and the RCML-EL-based algorithm share the same optimization problem in high dimensions. We use Low-Rank Adaptive Normalized Matched Filter (LR-ANMF) detector to compute the detection probabilities for different false alarm probabilities over a range of target SNR. We present preliminary results which demonstrate the robustness of the detector against contaminating clutter discretes using the Challenge Dataset from RFView. Finally, we empirically show that the minimum variance distortionless beamformer (MVDR) error variance for the proposed algorithm is identical to the error variance resulting from the true covariance matrix.


title: Global existence and uniqueness of weak solutions of a Stokes-Magneto system with fractional diffusions

abstract: We consider a Stokes-Magneto system in $\mathbb{R}^d$ ($d\geq 2$) with fractional diffusions $\Lambda^{2\alpha}\boldsymbol{u}$ and $\Lambda^{2\beta}\boldsymbol{b}$ for the velocity $\boldsymbol{u}$ and the magnetic field $\boldsymbol{b}$, respectively. Here $\alpha,\beta$ are positive constants and $\Lambda^s = (-\Delta)^{s/2}$ is the fractional Laplacian of order $s$. We establish global existence of weak solutions of the Stokes-Magneto system for any initial data in $L_{2}$ when $\alpha$, $\beta$ satisfy $1/2<\alpha<(d+1)/2$, $\beta >0$, and $\min\{\alpha+\beta,2\alpha+\beta-1\}>d/2$. It is also shown that weak solutions are unique if $\beta \geq 1$ and $\min \{\alpha+\beta,2\alpha+\beta-1\}\geq d/2+1$, in addition.


title: Muon g-2 and Dark Matter in the NUGM + NUHM2 model

abstract: We analyze the NUGM + NUHM2 model and study the implications of recent experimental constraints on the parameter space of this model. We also explore the nature of dark matter in this model and present the parameter space characterized by various compositions of the neutralino. The region of the parameter space that satisfies the observed deviation in the anomalous magnetic moment of the muon is explored more rigorously. We also present results corresponding to the production cross section and decay widths of a light CP-even Higgs boson and observe that there is a narrow region of the parameter space corresponding to a light stau which explains the observed deviation in the muon g-2 and also leads to enhancement in the Higgs production and decay widths.


title: Energy Efficiency of MIMO Massive Unsourced Random Access with Finite Blocklength

abstract: This paper investigates the energy efficiency of massive unsourced random access~(URA) in multiple-input multiple-output quasi-static Rayleigh fading channels. Specifically, we derive achievability and converse bounds on the minimum required energy-per-bit under the per-user probability of error constraint, where the converse bounds contain two parts: one is general and the other is a weaker ensemble bound. Numerical evaluation shows that the gap between our achievability and converse bounds is less than $5$~dB in the considered regime. Some practical schemes are energy-inefficient compared with our bounds especially when there are many users. Moreover, we observe that in contrast to the sourced random access paradigm, the URA paradigm achieves higher spectral efficiency.


title: Non-trivial topology in rare-earth monopnictides from dimensionality reduction

abstract: Thin films of rare-earth monopnictide semimetals are expected to turn into semiconductors due to quantum confinement effect, which lifts the overlap between electron pockets at Brillouin zone edges and hole pockets at the zone center. Instead, taking non-magnetic LaSb as an example, we find the emergence of a quantum spin Hall insulator phase in LaSb(001) films as the thickness is reduced to 7, 5, or 3 monolayers. This is attributed to a strong quantum confinement effect on the in-plane electron pockets, and the lack of quantum confinement on the out-of-plane pocket in reciprocal space projected onto zone center, leading to a band inversion. Spin-orbit coupling opens a sizeable non-trivial gap in the band structure of the thin films. Such effect is shown to be general in rare-earth monopnictides and may lead to interesting phenomena when coupled with the 4f magnetic moments present in other members of this family of materials.


title: Location-based AR for Social Justice: Case Studies, Lessons, and Open Challenges

abstract: Dear Visitor and Charleston Reconstructed were location-based augmented reality (AR) experiences created between 2018 and 2020 dealing with two controversial monument sites in the US. The projects were motivated by the ability of AR to 1) link layers of context to physical sites in ways that are otherwise difficult or impossible and 2) to visualize changes to physical spaces, potentially inspiring changes to the spaces themselves. We discuss the projects' motivations, designs, and deployments. We reflect on how physical changes to the projects' respective sites radically altered their outcomes, and we describe lessons for future work in location-based AR, particularly for projects in contested spaces.


title: Multivariate Time Series Anomaly Detection via Dynamic Graph Forecasting

abstract: Anomalies in univariate time series often refer to abnormal values and deviations from the temporal patterns from majority of historical observations. In multivariate time series, anomalies also refer to abnormal changes in the inter-series relationship, such as correlation, over time. Existing studies have been able to model such inter-series relationships through graph neural networks. However, most works settle on learning a static graph globally or within a context window to assist a time series forecasting task or a reconstruction task, whose objective is not tailored to explicitly detect the abnormal relationship. Some other works detect anomalies based on reconstructing or forecasting a list of inter-series graphs, which inadvertently weakens their power to capture temporal patterns within the data due to the discrete nature of graphs. In this study, we propose DyGraphAD, a multivariate time series anomaly detection framework based upon a list of dynamic inter-series graphs. The core idea is to detect anomalies based on the deviation of inter-series relationships and intra-series temporal patterns from normal to anomalous states, by leveraging the evolving nature of the graphs in order to assist a graph forecasting task and a time series forecasting task simultaneously. Our numerical experiments on real-world datasets demonstrate that DyGraphAD has superior performance than baseline anomaly detection approaches.


title: Bilevel Inverse Problems in Neuromorphic Imaging

abstract: Event or Neuromorphic cameras are novel biologically inspired sensors that record data based on the change in light intensity at each pixel asynchronously. They have a temporal resolution of microseconds. This is useful for scenes with fast moving objects that can cause motion blur in traditional cameras, which record the average light intensity over an exposure time for each pixel synchronously. This paper presents a bilevel inverse problem framework for neuromorphic imaging. Existence of solution to the inverse problem is established. Second order sufficient conditions are derived under special situations for this nonconvex problem. A second order Newton type solver is derived to solve the problem. The efficacy of the approach is shown on several examples.


title: Model-based Smoothing with Integrated Wiener Processes and Overlapping Splines

abstract: In many applications that involve the inference of an unknown smooth function, the inference of its derivatives will often be just as important as that of the function itself. To make joint inferences of the function and its derivatives, a class of Gaussian processes called $p^{\text{th}}$ order Integrated Wiener's Process (IWP), is considered. Methods for constructing a finite element (FEM) approximation of an IWP exist but have focused only on the order $p = 2$ case which does not allow appropriate inference for derivatives, and their computational feasibility relies on additional approximation to the FEM itself. In this article, we propose an alternative FEM approximation, called overlapping splines (O-spline), which pursues computational feasibility directly through the choice of test functions, and mirrors the construction of an IWP as the Ospline results from the multiple integrations of these same test functions. The O-spline approximation applies for any order $p \in \mathbb{Z}^+$, is computationally efficient and provides consistent inference for all derivatives up to order $p-1$. It is shown both theoretically, and empirically through simulation, that the O-spline approximation converges to the true IWP as the number of knots increases. We further provide a unified and interpretable way to define priors for the smoothing parameter based on the notion of predictive standard deviation (PSD), which is invariant to the order $p$ and the placement of the knot. Finally, we demonstrate the practical use of the O-spline approximation through simulation studies and an analysis of COVID death rates where the inference is carried on both the function and its derivatives where the latter has an important interpretation in terms of the course of the pandemic.


title: Smooth, homogeneous, high-purity Nb3Sn superconducting RF resonant cavity by seed-free electrochemical synthesis

abstract: Workbench-size particle accelerators, enabled by Nb3Sn-based superconducting radio-frequency (SRF) cavities, hold the potential of driving scientific discovery by offering a widely accessible and affordable source of high-energy electrons and X-rays. Thin-film Nb3Sn RF superconductors with high quality factors, high operation temperatures, and high-field potentials are critical for these devices. However, surface roughness, non-stoichiometry, and impurities in Nb3Sn deposited by conventional Sn-vapor diffusion prevent them from reaching their theoretical capabilities. Here we demonstrate a seed-free electrochemical synthesis that pushes the limit of chemical and physical properties in Nb3Sn. Utilization of electrochemical Sn pre-deposits reduces the roughness of converted Nb3Sn by five times compared to typical vapor-diffused Nb3Sn. Quantitative mappings using chemical and atomic probes confirm improved stoichiometry and minimized impurity concentrations in electrochemically synthesized Nb3Sn. We have successfully applied this Nb3Sn to the large-scale 1.3 GHz SRF cavity and demonstrated ultra-low BCS surface resistances at multiple operation temperatures, notably lower than vapor-diffused cavities. Our smooth, homogeneous, high-purity Nb3Sn provides the route toward high efficiency and high fields for SRF applications under helium-free cryogenic operations.

categories: cond-mat.mtrl-sci cond-mat.supr-con physics.acc-ph physics.app-ph


title: Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction

abstract: Few-shot learning is a promising approach to molecular property prediction as supervised data is often very limited. However, many important molecular properties depend on complex molecular characteristics -- such as the various 3D geometries a molecule may adopt or the types of chemical interactions it can form -- that are not explicitly encoded in the feature space and must be approximated from low amounts of data. Learning these characteristics can be difficult, especially for few-shot learning algorithms that are designed for fast adaptation to new tasks. In this work, we develop molecular embeddings that encode complex molecular characteristics to improve the performance of few-shot molecular property prediction. Our approach leverages large amounts of synthetic data, namely the results of molecular docking calculations, and a multi-task learning paradigm to structure the embedding space. On multiple molecular property prediction benchmarks, training from the embedding space substantially improves Multi-Task, MAML, and Prototypical Network few-shot learning performance. Our code is available at https://github.com/cfifty/IGNITE.


title: Sketch-Flip-Merge: Mergeable Sketches for Private Distinct Counting

abstract: Data sketching is a critical tool for distinct counting, enabling multisets to be represented by compact summaries that admit fast cardinality estimates. Because sketches may be merged to summarize multiset unions, they are a basic building block in data warehouses. Although many practical sketches for cardinality estimation exist, none provide privacy when merging. We propose the first practical cardinality sketches that are simultaneously mergeable, differentially private (DP), and have low empirical errors. These introduce a novel randomized algorithm for performing logical operations on noisy bits, a tight privacy analysis, and provably optimal estimation. Our sketches dramatically outperform existing theoretical solutions in simulations and on real-world data.


title: Semantic Diffusion Network for Semantic Segmentation

abstract: Precise and accurate predictions over boundary areas are essential for semantic segmentation. However, the commonly-used convolutional operators tend to smooth and blur local detail cues, making it difficult for deep models to generate accurate boundary predictions. In this paper, we introduce an operator-level approach to enhance semantic boundary awareness, so as to improve the prediction of the deep semantic segmentation model. Specifically, we first formulate the boundary feature enhancement as an anisotropic diffusion process. We then propose a novel learnable approach called semantic diffusion network (SDN) to approximate the diffusion process, which contains a parameterized semantic difference convolution operator followed by a feature fusion module. Our SDN aims to construct a differentiable mapping from the original feature to the inter-class boundary-enhanced feature. The proposed SDN is an efficient and flexible module that can be easily plugged into existing encoder-decoder segmentation models. Extensive experiments show that our approach can achieve consistent improvements over several typical and state-of-the-art segmentation baseline models on challenging public benchmarks. The code will be released soon.


title: Toric orbit spaces which are manifolds

abstract: We characterize the actions of compact tori on smooth manifolds for which the orbit space is a topological manifold (either closed or with boundary). For closed manifolds the result was originally proved by Styrt in 2009. We give a new proof for closed manifolds which is also applicable to manifolds with boundary. In our arguments we use the result of Provan and Billera who characterized matroid complexes which are pseudomanifolds. We study the combinatorial structure of torus actions whose orbit spaces are manifolds. In two appendix sections we give an overview of two theories related to our work. The first one is the combinatorial theory of Leontief substitution systems from mathematical economics. The second one is the topological Kaluza--Klein model of Dirac's monopole studied by Atiyah. The aim of these sections is to draw some bridges between disciplines and motivate further studies in toric topology.


title: On the union of homogeneous symmetric Cantor set with its translations

abstract: Fix a positive integer $N$ and a real number $0< \beta < 1/(N+1)$. Let $\Gamma$ be the homogeneous symmetric Cantor set generated by the IFS $$ \Big\{ \phi_i(x)=\beta x + i \frac{1-\beta}{N}: i=0,1,\cdots, N \Big\}. $$ For $m\in\mathbb{Z}_+$ we show that there exist infinitely many translation vectors $\mathbf t=(t_0,t_1,\cdots, t_m)$ with $0=t_0<t_1<\cdots<t_m$ such that the union $\bigcup_{j=0}^m(\Gamma+t_j)$ is a self-similar set. Furthermore, for $0< \beta < 1/(2N+1)$, we give a complete characterization on which the union $\bigcup_{j=0}^m(\Gamma+t_j)$ is a self-similar set. Our characterization relies on determining whether some related directed graph has no cycles, or whether some related adjacency matrix is nilpotent.


title: Representation Deficiency in Masked Language Modeling

abstract: Masked Language Modeling (MLM) has been one of the most prominent approaches for pretraining bidirectional text encoders due to its simplicity and effectiveness. One notable concern about MLM is that the special $\texttt{[MASK]}$ symbol causes a discrepancy between pretraining data and downstream data as it is present only in pretraining but not in fine-tuning. In this work, we offer a new perspective on the consequence of such a discrepancy: We demonstrate empirically and theoretically that MLM pretraining allocates some model dimensions exclusively for representing $\texttt{[MASK]}$ tokens, resulting in a representation deficiency for real tokens and limiting the pretrained model's expressiveness when it is adapted to downstream data without $\texttt{[MASK]}$ tokens. Motivated by the identified issue, we propose MAE-LM, which pretrains the Masked Autoencoder architecture with MLM where $\texttt{[MASK]}$ tokens are excluded from the encoder. Empirically, we show that MAE-LM improves the utilization of model dimensions for real token representations, and MAE-LM consistently outperforms MLM-pretrained models across different pretraining settings and model sizes when fine-tuned on the GLUE and SQuAD benchmarks.