title: Feature Selection by a Mechanism Design

abstract: In constructing an econometric or statistical model, we pick relevant features or variables from many candidates. A coalitional game is set up to study the selection problem where the players are the candidates and the payoff function is a performance measurement in all possible modeling scenarios. Thus, in theory, an irrelevant feature is equivalent to a dummy player in the game, which contributes nothing to all modeling situations. The hypothesis test of zero mean contribution is the rule to decide a feature is irrelevant or not. In our mechanism design, the end goal perfectly matches the expected model performance with the expected sum of individual marginal effects. Within a class of noninformative likelihood among all modeling opportunities, the matching equation results in a specific valuation for each feature. After estimating the valuation and its standard deviation, we drop any candidate feature if its valuation is not significantly different from zero. In the simulation studies, our new approach significantly outperforms several popular methods used in practice, and its accuracy is robust to the choice of the payoff function.


title: Weakly non-collapsed RCD spaces are strongly non-collapsed

abstract: We prove that any weakly non-collapsed RCD space is actually non-collapsed, up to a renormalization of the measure. This confirms a conjecture raised by De Philippis and the second named author in full generality. One of the auxiliary results of independent interest that we obtain is about the link between the properties $\quad$- $\mathrm{tr}(\mathrm{Hess}f)=\Delta f$ on $U\subset\mathsf{X}$ for every $f$ sufficiently regular, $\quad$- $\mathfrak{m}=c\mathscr{H}^n$ on $U\subset\mathsf{X}$ for some $c>0$, where $U\subset \mathsf{X}$ is open and $\mathsf{X}$ is a - possibly collapsed - RCD space of essential dimension $n$.


title: Explaining Off-Policy Actor-Critic From A Bias-Variance Perspective

abstract: Off-policy Actor-Critic algorithms have demonstrated phenomenal experimental performance but still require better explanations. To this end, we show its policy evaluation error on the distribution of transitions decomposes into: a Bellman error, a bias from policy mismatch, and a variance term from sampling. By comparing the magnitude of bias and variance, we explain the success of the Emphasizing Recent Experience sampling and 1/age weighted sampling. Both sampling strategies yield smaller bias and variance and are hence preferable to uniform sampling.


title: Deploying the Conditional Randomization Test in High Multiplicity Problems

abstract: This paper introduces the sequential CRT, which is a variable selection procedure that combines the conditional randomization test (CRT) and Selective SeqStep+. Valid p-values are constructed via the flexible CRT, which are then ordered and passed through the selective SeqStep+ filter to produce a list of discoveries. We develop theory guaranteeing control on the false discovery rate (FDR) even though the p-values are not independent. We show in simulations that our novel procedure indeed controls the FDR and are competitive with -- and sometimes outperform -- state-of-the-art alternatives in terms of power. Finally, we apply our methodology to a breast cancer dataset with the goal of identifying biomarkers associated with cancer stage.


title: Geometric Transformers for Protein Interface Contact Prediction

abstract: Computational methods for predicting the interface contacts between proteins come highly sought after for drug discovery as they can significantly advance the accuracy of alternative approaches, such as protein-protein docking, protein function analysis tools, and other computational methods for protein bioinformatics. In this work, we present the Geometric Transformer, a novel geometry-evolving graph transformer for rotation and translation-invariant protein interface contact prediction, packaged within DeepInteract, an end-to-end prediction pipeline. DeepInteract predicts partner-specific protein interface contacts (i.e., inter-protein residue-residue contacts) given the 3D tertiary structures of two proteins as input. In rigorous benchmarks, DeepInteract, on challenging protein complex targets from the 13th and 14th CASP-CAPRI experiments as well as Docking Benchmark 5, achieves 14% and 1.1% top L/5 precision (L: length of a protein unit in a complex), respectively. In doing so, DeepInteract, with the Geometric Transformer as its graph-based backbone, outperforms existing methods for interface contact prediction in addition to other graph-based neural network backbones compatible with DeepInteract, thereby validating the effectiveness of the Geometric Transformer for learning rich relational-geometric features for downstream tasks on 3D protein structures.


title: Spectral Bias in Practice: The Role of Function Frequency in Generalization

abstract: Despite their ability to represent highly expressive functions, deep learning models seem to find simple solutions that generalize surprisingly well. Spectral bias -- the tendency of neural networks to prioritize learning low frequency functions -- is one possible explanation for this phenomenon, but so far spectral bias has primarily been observed in theoretical models and simplified experiments. In this work, we propose methodologies for measuring spectral bias in modern image classification networks on CIFAR-10 and ImageNet. We find that these networks indeed exhibit spectral bias, and that interventions that improve test accuracy on CIFAR-10 tend to produce learned functions that have higher frequencies overall but lower frequencies in the vicinity of examples from each class. This trend holds across variation in training time, model architecture, number of training examples, data augmentation, and self-distillation. We also explore the connections between function frequency and image frequency and find that spectral bias is sensitive to the low frequencies prevalent in natural images. On ImageNet, we find that learned function frequency also varies with internal class diversity, with higher frequencies on more diverse classes. Our work enables measuring and ultimately influencing the spectral behavior of neural networks used for image classification, and is a step towards understanding why deep models generalize well.


title: X-type vortex and its effect on beam shaping

abstract: In this article we propose a new type of optical vortex, the X-type vortex. This vortex inherits and develops the conventional noncanonical vortex, i.e., it no longer has a constant phase gradient around the center, while the intensity keeps invariant azimuthally. The strongly focusing properties of the X-type vortex and its effect on the beam shaping in three-dimensional (3D) fields are analyzed. The interesting phenomena, which cannot be seen in canonical vortices, are observed, for instance the 'switch effect' which shows that the intensity pattern can switch from one transverse axis to another in the focal plane by controlling the phase gradient parameter. It is shown that by adjusting the phase gradient of this vortex, the focal field can have marvelous patterns, from the doughnut shape to the shapes with different lobes, and the beam along propagation direction will form a twisting shape in 3D space with controllable rotation direction and location. The physical mechanisms underlying the rule of the beam shaping are also discussed, which generally say that the phase gradient of the X-type vortex, the orbital angular momentum, the polarization and the 'nongeneric' characteristic contribute differently in shaping fields. This new type of vortex may supply a new freedom for tailoring 3D optical fields, and our work will pave a way for exploration of new vortices and their applications.


title: Boundary Vorticity Estimates for Navier-Stokes and Application to the Inviscid Limit

abstract: Consider the steady solution to the incompressible Euler equation $\bar u=Ae_1$ in the periodic tunnel $\Omega=\mathbb T^{d-1}\times(0,1)$ in dimension $d=2,3$. Consider now the family of solutions $u^\nu$ to the associated Navier-Stokes equation with the no-slip condition on the flat boundaries, for small viscosities $\nu=A/\mathsf{Re}$, and initial values in $L^2$. We are interested in the weak inviscid limits up to subsequences $u^\nu\rightharpoonup u^\infty$ when both the viscosity $\nu$ converges to 0, and the initial value $u^\nu_0$ converges to $Ae_1$ in $L^2$. Under a conditional assumption on the energy dissipation close to the boundary, Kato showed in 1984 that $u^\nu$ converges to $Ae_1$ strongly in $L^2$ uniformly in time under this double limit. It is still unknown whether this inviscid limit is unconditionally true. The convex integration method produces solutions $u _E$ to the Euler equation with the same initial values $Ae_1$ which verify at time $0<T<T_0$: $\|u_E(T)-Ae_1\|_{L^2(\Omega)}^2\approx A^3T$. This predicts the possibility of a layer separation with an energy of order $A^3 T$. We show in this paper that the energy of layer separation associated with any asymptotic $u^\infty$ obtained via double limits cannot be more than $\|u^\infty(T)-Ae_1\|_{L^2 (\Omega)}^2\lesssim A^3T$. This result holds unconditionally for any weak limit of Leray-Hopf solutions of the Navier-Stokes equation. Especially, it shows that, even if the limit is not unique, the shear flow pattern is observable up to time $1/A$. This provides a notion of stability despite the possible non-uniqueness of the limit predicted by the convex integration theory. The result relies on a new boundary vorticity estimate for the Navier-Stokes equation. This new estimate, inspired by previous work on higher regularity estimates for Navier-Stokes, provides a nonlinear control scalable through the inviscid limit.


title: Impact of Motor Stator Winding Faults on Common-Mode Current

abstract: This paper investigates the influence of different motor stator failures on the common-mode (CM) current. The stator winding failures will affect the motor's CM impedance, and also increase the unbalance of the differential-mode (DM) noise path. The experimental results show that the former will increase the CM current induced by the CM noise source, while the latter will cause the DM current induced by the DM noise source to be converted into the CM current.


title: The 3D dust and opacity distribution of protoplanets in multi-fluid global simulations

abstract: The abundance and distribution of solids inside the Hill sphere are central to our understanding of the giant planet dichotomy. Here, we present a three-dimensional characterization of the dust density, mass flux, and mean opacities in the envelope of sub-thermal and super-thermal mass planets. We simulate the dynamics of multiple dust species in a global protoplanetary disk model accounting for dust feedback. We find that the meridional flows do not effectively stir dust grains at scales of the Bondi sphere. Thus the dust-settling driven by the stellar gravitational potential sets the latitudinal dust density gradient within the planet envelope. Not only does the planet's potential enhance this gradient, but also the spiral wakes serve as another source of asymmetry. These asymmetries substantially alter the inferred mean Rosseland and Planck opacities. In cases with the moderate-to-strong dust settling, the opacity gradient can range from a few percent to more than two orders of magnitude between the mid-plane and the polar regions of the Bondi sphere. Finally, we show that this strong latitudinal opacity gradient can introduce a transition between optically thick and thin regimes at the scales of the planet envelope. We suggest that this transition is likely to occur when the equilibrium scale height of hundred-micron-sized particles is smaller than the Hill radius of the forming planet. This work calls into question the adoption of a constant opacity derived from well-mixed distributions and demonstrates the need for global radiation hydrodynamics models of giant planet formation which account for dust dynamics.


title: Autonomous Aerial Delivery Vehicles, a Survey of Techniques on how Aerial Package Delivery is Achieved

abstract: Autonomous aerial delivery vehicles have gained significant interest in the last decade. This has been enabled by technological advancements in aerial manipulators and novel grippers with enhanced force to weight ratios. Furthermore, improved control schemes and vehicle dynamics are better able to model the payload and improved perception algorithms to detect key features within the unmanned aerial vehicle's (UAV) environment. In this survey, a systematic review of the technological advancements and open research problems of autonomous aerial delivery vehicles is conducted. First, various types of manipulators and grippers are discussed in detail, along with dynamic modelling and control methods. Then, landing on static and dynamic platforms is discussed. Subsequently, risks such as weather conditions, state estimation and collision avoidance to ensure safe transit is considered. Finally, delivery UAV routing is investigated which categorises the topic into two areas: drone operations and drone-truck collaborative operations.


title: Nano-imaging of the edge-dependent optical polarization anisotropy of black phosphorus

abstract: The electronic structure and functionality of 2D materials is highly sensitive to structural morphology, opening the possibility for manipulating material properties, but also making predictable and reproducible functionality challenging. Black phosphorus (BP), a corrugated orthorhombic 2D material, has in-plane optical absorption anisotropy critical for applications such as directional photonics, plasmonics, and waveguides. Here, we use polarization-dependent photoemission electron microscopy to visualize the anisotropic optical absorption of BP with 54 nm spatial resolution. We find the edges of BP flakes have a shift in their optical polarization anisotropy from the flake interior due to the 1D confinement and symmetry reduction at flake edges that alter the electronic charge distributions and transition dipole moments of edge electronic states, confirmed with first-principles calculations. These results uncover previously hidden modification of the polarization-dependent absorbance at the edges of BP, highlighting the opportunity for selective excitation of edge states of 2D materials with polarized light.


title: Presentation of the fundamental groups of complements of shadows

abstract: A shadowed polyhedron is a simple polyhedron equipped with half integers on regions, called gleams, which represents a compact, oriented, smooth 4-manifold. The polyhedron is embedded in the 4-manifold and it is called a shadow of that manifold. A subpolyhedron of a shadow represents a possibly singular subsurface in the 4-manifold. In this paper, we focus on contractible shadows obtained from the unit disk by attaching annuli along generically immersed closed curves on the disk. In this case, the 4-manifold is always a 4-ball. Milnor fibers of plane curve singularities and complexified real line arrangements can be represented in this way. We give a presentation of the fundamental group of the complement of a subpolyhedron of such a shadow in the 4-ball. The method is very similar to the Wirtinger presentation of links in knot theory.


title: KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks

abstract: We propose a new approach, Knowledge Distillation using Optimal Transport (KNOT), to distill the natural language semantic knowledge from multiple teacher networks to a student network. KNOT aims to train a (global) student model by learning to minimize the optimal transport cost of its assigned probability distribution over the labels to the weighted sum of probabilities predicted by the (local) teacher models, under the constraints, that the student model does not have access to teacher models' parameters or training data. To evaluate the quality of knowledge transfer, we introduce a new metric, Semantic Distance (SD), that measures semantic closeness between the predicted and ground truth label distributions. The proposed method shows improvements in the global model's SD performance over the baseline across three NLP tasks while performing on par with Entropy-based distillation on standard accuracy and F1 metrics. The implementation pertaining to this work is publicly available at: https://github.com/declare-lab/KNOT.


title: Turbulence-induced transport dynamo mechanism

abstract: The transport dynamo mechanism, which describes the magnetic field generation by diffusion flow is reviewed. In this mechanism, the cross-field transport caused by the random motion of fluid breaks the frozen-flux approximation, and the resulting cross-field diffusion that can generate the magnetic field. Turbulence can play an important role in inducing such random motion. Compared to the conventional dynamo mechanism, this transport mechanism has several special features that the field generation can occur on a very slow time scale because the mechanism is mediated by diffusion and that this mechanism is practically meaningful only when there is density inhomogeneity. Turbulence can significantly enhance cross-field diffusion far beyond collisional transport. The physical meanings of the diffusion-generated magnetic fields are discussed in detail.


title: Manipulating Goldstone modes via the superradiant light in a bosonic lattice gas inside a cavity

abstract: We study the low-energy excitations of a bosonic lattice gas with cavity-mediated interactions. By performing two successive Hubbard-Stratonovich transformations, we derive an effective field theory to study the strongly-coupling regime. Taking into account the quantum fluctuation, we report the unusual effect of the superradiant cavity light induced density imbalance, which has been shown to have a negligible effect on the single particle excitation in the previous studies. Instead, we show that such negligible fluctuation of density imbalance dramatically changes the behavior of the low-energy excitation and results in a free switching between two types of Goldstone modes in its single particle excitation, i.e., type I and type II with odd and even power energy-momentum dispersion, respectively. Our proposal would open a new horizon for manipulating Goldstone modes from bridging the cavity light and strongly interacting quantum matters.


title: Branched covers and matrix factorizations

abstract: Let $(S,\mathfrak n)$ be a regular local ring and $f$ a non-zero element of $\mathfrak n^2$. A theorem due to Kn\"orrer states that there are finitely many isomorphism classes of maximal Cohen-Macaulay $R=S/(f)$-modules if and only if the same is true for the double branched cover of $R$, that is, the hypersurface ring defined by $f+z^2$ in $S[[ z ]]$. We consider an analogue of this statement in the case of the hypersurface ring defined instead by $f+z^d$ for $d\ge 2$. In particular, we show that this hypersurface, which we refer to as the $d$-fold branched cover of $R$, has finite Cohen-Macaulay representation type if and only if, up to isomorphism, there are only finitely many indecomposable matrix factorizations of $f$ with $d$ factors. As a result, we give a complete list of polynomials $f$ with this property in characteristic zero. Furthermore, we show that reduced $d$-fold matrix factorizations of $f$ correspond to Ulrich modules over the $d$-fold branched cover of $R$.


title: A Deep Learning-based Audio-in-Image Watermarking Scheme

abstract: This paper presents a deep learning-based audio-in-image watermarking scheme. Audio-in-image watermarking is the process of covertly embedding and extracting audio watermarks on a cover-image. Using audio watermarks can open up possibilities for different downstream applications. For the purpose of implementing an audio-in-image watermarking that adapts to the demands of increasingly diverse situations, a neural network architecture is designed to automatically learn the watermarking process in an unsupervised manner. In addition, a similarity network is developed to recognize the audio watermarks under distortions, therefore providing robustness to the proposed method. Experimental results have shown high fidelity and robustness of the proposed blind audio-in-image watermarking scheme.


title: The antenna phase center motion effect in high-accuracy spacecraft tracking experiments

abstract: We present an improved model for the antenna phase center motion effect for high-gain mechanically steerable ground-based and spacecraft-mounted antennas that takes into account non-perfect antenna pointing. Using tracking data of the RadioAstron spacecraft we show that our model can result in a correction of the computed value of the effect of up to $2\times10^{-14}$ in terms of the fractional frequency shift, which is significant for high-accuracy spacecraft tracking experiments. The total fractional frequency shift due to the phase center motion effect can exceed $1\times10^{-11}$ both for the ground and space antennas depending on the spacecraft orbit and antenna parameters. We also analyze the error in the computed value of the effect and find that it can be as large as $4\times10^{-14}$ due to uncertainties in the spacecraft antenna axis position, ground antenna axis offset and misalignment, and others. Finally, we present a way to reduce both the ground and space antenna phase center motion effects by several orders of magnitude, e.g. for RadioAstron to below $1\times10^{-16}$, by tracking the spacecraft simultaneously in the one-way downlink and two-way phase-locked loop modes, i.e. using the Gravity Probe A configuration of the communications links.


title: Hyperspectral Neutron CT with Material Decomposition

abstract: Energy resolved neutron imaging (ERNI) is an advanced neutron radiography technique capable of non-destructively extracting spatial isotopic information within a given material. Energy-dependent radiography image sequences can be created by utilizing neutron time-of-flight techniques. In combination with uniquely characteristic isotopic neutron cross-section spectra, isotopic areal densities can be determined on a per-pixel basis, thus resulting in a set of areal density images for each isotope present in the sample. By preforming ERNI measurements over several rotational views, an isotope decomposed 3D computed tomography is possible. We demonstrate a method involving a robust and automated background estimation based on a linear programming formulation. The extremely high noise due to low count measurements is overcome using a sparse coding approach. It allows for a significant computation time improvement, from weeks to a few hours compared to existing neutron evaluation tools, enabling at the present stage a semi-quantitative, user-friendly routine application.


title: Replay-Guided Adversarial Environment Design

abstract: Deep reinforcement learning (RL) agents may successfully generalize to new settings if trained on an appropriately diverse set of environment and task configurations. Unsupervised Environment Design (UED) is a promising self-supervised RL paradigm, wherein the free parameters of an underspecified environment are automatically adapted during training to the agent's capabilities, leading to the emergence of diverse training environments. Here, we cast Prioritized Level Replay (PLR), an empirically successful but theoretically unmotivated method that selectively samples randomly-generated training levels, as UED. We argue that by curating completely random levels, PLR, too, can generate novel and complex levels for effective training. This insight reveals a natural class of UED methods we call Dual Curriculum Design (DCD). Crucially, DCD includes both PLR and a popular UED algorithm, PAIRED, as special cases and inherits similar theoretical guarantees. This connection allows us to develop novel theory for PLR, providing a version with a robustness guarantee at Nash equilibria. Furthermore, our theory suggests a highly counterintuitive improvement to PLR: by stopping the agent from updating its policy on uncurated levels (training on less data), we can improve the convergence to Nash equilibria. Indeed, our experiments confirm that our new method, PLR$^{\perp}$, obtains better results on a suite of out-of-distribution, zero-shot transfer tasks, in addition to demonstrating that PLR$^{\perp}$ improves the performance of PAIRED, from which it inherited its theoretical framework.


title: Inverse Probability Weighting-based Mediation Analysis for Microbiome Data

abstract: Mediation analysis is an important tool to study causal associations in biomedical and other scientific areas and has recently gained attention in microbiome studies. Using a microbiome study of acute myeloid leukemia (AML) patients, we investigate whether the effect of induction chemotherapy intensity levels on the infection status is mediated by the microbial taxa abundance. The unique characteristics of the microbial mediators -- high-dimensionality, zero-inflation, and dependence -- call for new methodological developments in mediation analysis. The presence of an exposure-induced mediator-outcome confounder, antibiotic use, further requires a delicate treatment in the analysis. To address these unique challenges in our motivating AML microbiome study, we propose a novel nonparametric identification formula for the interventional indirect effect (IIE), a measure recently developed for studying mediation effects. We develop the corresponding estimation algorithm using the inverse probability weighting method. We also test the presence of mediation effects via constructing the standard normal bootstrap confidence intervals. Simulation studies show that the proposed method has good finite-sample performance in terms of the IIE estimation, and type-I error rate and power of the corresponding test. In the AML microbiome study, our findings suggest that the effect of induction chemotherapy intensity levels on infection is mainly mediated by patients' gut microbiome.


title: Self-similar abelian groups and their centralizers

abstract: We extend results on transitive self-similar abelian subgroups of the group of automorphisms $\mathcal{A}_m$ of an $m$-ary tree $\mathcal{T}_m$ in \cite{BS}, to the general case where the permutation group induced on the first level of the tree has $s\geq 1$ orbits. We prove that such a group $A$ embeds in a self-similar abelian group $A^*$ which is also a maximal abelian subgroup of $\mathcal{A}_m$. The construction of $A^*$ is based on the definition of a free monoid $\Delta$ of rank $s$ of partial diagonal monomorphisms of $\mathcal{A}_m$, which is used to determine the structure of $C_{\mathcal{A}_m}(A)$, the centralizer of $A$ in $\mathcal{A}_m$. Indeed, we prove $A^*=C_{\mathcal{A}_m} (\Delta(A))=\overline{ \Delta({B(A)})}$, where $B(A)$ denotes the product of the projections of $A$ in its action on the different $s$ orbits of maximal subtrees of $\mathcal{T}_m$ and bar denotes the topological closure. When $A$ is a torsion self-similar abelian group, it is shown that it is necessarily of finite exponent. Moreover, we extend recent constructions of self-similar free abelian groups of infinite enumerable rank to examples of such groups which are also $\Delta$-invariant for $s=2$. Finally, we focus on self-similar cyclic groups of automorphisms of $\mathcal{T}_m$ and compute their centralizers when $m=4.$


title: PoNet: Pooling Network for Efficient Token Mixing in Long Sequences

abstract: Transformer-based models have achieved great success in various NLP, vision, and speech tasks. However, the core of Transformer, the self-attention mechanism, has a quadratic time and memory complexity with respect to the sequence length, which hinders applications of Transformer-based models to long sequences. Many approaches have been proposed to mitigate this problem, such as sparse attention mechanisms, low-rank matrix approximations and scalable kernels, and token mixing alternatives to self-attention. We propose a novel Pooling Network (PoNet) for token mixing in long sequences with linear complexity. We design multi-granularity pooling and pooling fusion to capture different levels of contextual information and combine their interactions with tokens. On the Long Range Arena benchmark, PoNet significantly outperforms Transformer and achieves competitive accuracy, while being only slightly slower than the fastest model, FNet, across all sequence lengths measured on GPUs. We also conduct systematic studies on the transfer learning capability of PoNet and observe that PoNet achieves 95.7% of the accuracy of BERT on the GLUE benchmark, outperforming FNet by 4.5% relative. Comprehensive ablation analysis demonstrates effectiveness of the designed multi-granularity pooling and pooling fusion for token mixing in long sequences and efficacy of the designed pre-training tasks for PoNet to learn transferable contextualized language representations.


title: Pedestrian Wind Factor Estimation in Complex Urban Environments

abstract: Urban planners and policy makers face the challenge of creating livable and enjoyable cities for larger populations in much denser urban conditions. While the urban microclimate holds a key role in defining the quality of urban spaces today and in the future, the integration of wind microclimate assessment in early urban design and planning processes remains a challenge due to the complexity and high computational expense of computational fluid dynamics (CFD) simulations. This work develops a data-driven workflow for real-time pedestrian wind comfort estimation in complex urban environments which may enable designers, policy makers and city residents to make informed decisions about mobility, health, and energy choices. We use a conditional generative adversarial network (cGAN) architecture to reduce the computational computation while maintaining high confidence levels and interpretability, adequate representation of urban complexity, and suitability for pedestrian comfort estimation. We demonstrate high quality wind field approximations while reducing computation time from days to seconds.


title: Influence-Balanced Loss for Imbalanced Visual Classification

abstract: In this paper, we propose a balancing training method to address problems in imbalanced data learning. To this end, we derive a new loss used in the balancing training phase that alleviates the influence of samples that cause an overfitted decision boundary. The proposed loss efficiently improves the performance of any type of imbalance learning methods. In experiments on multiple benchmark data sets, we demonstrate the validity of our method and reveal that the proposed loss outperforms the state-of-the-art cost-sensitive loss methods. Furthermore, since our loss is not restricted to a specific task, model, or training method, it can be easily used in combination with other recent re-sampling, meta-learning, and cost-sensitive learning methods for class-imbalance problems.


title: Characterization of smooth solutions to the Navier-Stokes equations in a pipe with two types of slip boundary conditions

abstract: Smooth solutions of the stationary Navier-Stokes equations in an infinitely long pipe, equipped with the Navier-slip or Navier-Hodge-Lions boundary condition, are considered in this paper. Three main results are presented. First, when equipped with the Navier-slip boundary condition, it is shown that, $W^{1,\infty}$ axially symmetric solutions with zero flux at one cross section, must be swirling solutions: $u=(- C x_2, C x_1,0)$, and $x_3-$periodic solutions must be helical solutions: $u=(-C_1x_2,C_1x_1,C_2)$. Second, also equipped with the Navier-slip boundary condition, if the swirl or vertical component of the axially symmetric solution is independent of the vertical variable $x_3$, solutions are also proven to be helical solutions. In the case of the vertical component being independent of $x_3$, the $W^{1,\infty}$ assumption is not needed. In the case of the swirl component being independent of $x_3$, the $W^{1,\infty}$ assumption can be relaxed extensively such that the horizontal radial component of the velocity, $u_r$, can grow exponentially with respect to the distance to the origin. Also, by constructing a counterexample, we show that the growing assumption on $u_r$ is optimal. Third, when equipped with the Navier-Hodge-Lions boundary condition, we can show that if the gradient of the velocity grows sublinearly, then the solution, enjoying the Liouville-type theorem, is a trivial shear flow: $(0,0,C)$.


title: Phenomenological developments for event-by-event fluctuations of conserved charges

abstract: A brief overview of the recent developments concerning theoretical description of event-by-event fluctuations in heavy-ion collisions is presented, with an emphasis on the role of exact conservation laws and calculations based on relativistic hydrodynamics.


title: Thermonuclear 17O(n,gamma)18O reaction rate and its astrophysical implications

abstract: A new thermonuclear $^{17}$O($n$,$\gamma$)$^{18}$O rate is derived based on a complete calculation of the direct-capture (DC) and resonant-capture contributions, for a temperature region up to 2 GK of astrophysical interest. We have firstly calculated the DC and subthreshold contributions in the energy region up to 1 MeV, and estimated the associated uncertainties by a Monte-Carlo approach. It shows that the present rate is remarkably larger than that adopted in the JINA REACLIB in the temperature region of 0.01 $\sim$ 2 GK, by up to a factor of $\sim$80. The astrophysical impacts of our rate have been examined in both $s$-process and $r$-process models. In our main $s$-process model which simulates flash-driven convective mixing in metal deficient asymptotic giant branch stars, both $^{18}$O and $^{19}$F abundances in interpulse phases are enhanced dramatically by factors of $\sim 20$--$40$ due to the new larger $^{17}$O($n$,$\gamma$)$^{18}$O rate. It shows, however, that this reaction hardly affects the weak $s$-process in massive stars since the $^{17}$O abundance never becomes significantly large in the massive stars. For the $r$-process nucleosynthesis, we have studied impacts of our rate in both the collapsar and neutron burst models, and found that the effect can be neglected, although an interesting "loophole" effect is found owing to the enhanced new rate, which significantly changes the final nuclear abundances if fission recycling is not involved in the model, however, these significant differences are almost completely washed out if the fission recycling is considered.


title: Wormhole Time Machines and Multiple Histories

abstract: In a previous paper, we showed that a class of time travel paradoxes which cannot be resolved using Novikov's self-consistency conjecture can be resolved by assuming the existence of multiple histories or parallel timelines. However, our proof was obtained using a simplistic toy model, which was formulated using contrived laws of physics. In the present paper we define and analyze a new model of time travel paradoxes, which is more compatible with known physics. This model consists of a traversable Morris-Thorne wormhole time machine in 3+1 spacetime dimensions. We define the spacetime topology and geometry of the model, calculate the geodesics of objects passing through the time machine, and prove that this model inevitably leads to paradoxes which cannot be resolved using Novikov's conjecture, but can be resolved using multiple histories. An open-source simulation of our new model using Mathematica is available for download on GitHub. We also provide additional arguments against the Novikov self-consistency conjecture by considering two new paradoxes, the switch paradox and the password paradox, for which assuming self-consistency inevitably leads to counter-intuitive consequences. Our new results provide more substantial support to our claim that if time travel is possible, then multiple histories or parallel timelines must also be possible.


title: Empirical likelihood inference for longitudinal data with covariate measurement errors: An application to the LEAN study

abstract: Measurement errors usually arise during the longitudinal data collection process. Ignoring the effects of measurement errors will lead to invalid estimates. The Lifestyle Education for Activity and Nutrition (LEAN) study was designed to assess the effectiveness of intervention for enhancing weight loss over nine months. The covariates systolic blood pressure (SBP) and diastolic blood pressure (DBP) were measured at baseline, month 4, and month 9. At each assessment time, there were two replicate measurements for SBP and DBP. The replicate measurement errors of SBP follow different distributions, as does DBP. To account for the distributional difference of replicate measurement errors, a new method for analyzing longitudinal data with replicate covariate measurement errors is developed based on the empirical likelihood method. The asymptotic properties of the proposed estimator are established under some regularity conditions. The confidence region for the parameters of interest can be constructed based on the chi-squared approximation without estimating the covariance matrix. Additionally, the proposed empirical likelihood estimator is asymptotically more efficient than the estimator of Lin et al. (2018). Extensive simulations demonstrate that the proposed method can eliminate the effects of measurement errors in the covariate and has a high estimation efficiency. The proposed method indicates the significant effect of the intervention on BMI in the LEAN study.


title: Reward-Punishment Symmetric Universal Intelligence

abstract: Can an agent's intelligence level be negative? We extend the Legg-Hutter agent-environment framework to include punishments and argue for an affirmative answer to that question. We show that if the background encodings and Universal Turing Machine (UTM) admit certain Kolmogorov complexity symmetries, then the resulting Legg-Hutter intelligence measure is symmetric about the origin. In particular, this implies reward-ignoring agents have Legg-Hutter intelligence 0 according to such UTMs.


title: On the instability of the Ruf-Sani solitons for the NLS with exponential nonlinearity

abstract: We study the two dimensional non-linear Schr\"odinger equation with two types of exponential non-linearities. It is well-known by a work of Ruf - Sani, that such models support solitary wave solutions, which are solutions of some constrained minimization problem. We show that these Ruf - Sani solitons, are spectrally unstable as well as unstable by blow-up.


title: Space-time approach to spontaneous symmetry breaking in the Abelian-gauge interaction

abstract: Spontaneous symmetry breaking is examined by regarding it as a phenomenon in the eternal intermediate state due to sequential perturbations. The concept of the relativistic many-body state is applied to this intermediate state occurring in the collision of massless Dirac fermions. Time in the relativistic many-body state should evolve while maintaining the direction of time in each particle, even if the particles are viewed from any inertial frames. This kinematical requirement leads to spontaneous symmetry breaking in the vacuum of these states, which gives a different meaning to the results of the Higgs model. In this vacuum, massless fermion-antifermion pairs and coherent collection of gauge bosons condense, which determine each other's mass. When a local excitation of the condensed gauge bosons propagates in space, a Higgs-like boson appears. The effective coupling of this Higgs-like boson to gauge bosons is calculated as a one-loop process. With this coupling, the total cross section of the pair annihilation of fermion and antifermion to gauge boson pair is calculated. Renormalizability of this model is discussed using the inductive method. Since the Higgs Lagrangian is not assumed, the divergence we must renormalize is only the logarithmic divergence, not the quadratic one.


title: Ripple Attention for Visual Perception with Sub-quadratic Complexity

abstract: Transformer architectures are now central to sequence modeling tasks. At its heart is the attention mechanism, which enables effective modeling of long-term dependencies in a sequence. Recently, transformers have been successfully applied in the computer vision domain, where 2D images are first segmented into patches and then treated as 1D sequences. Such linearization, however, impairs the notion of spatial locality in images, which bears important visual clues. To bridge the gap, we propose ripple attention, a sub-quadratic attention mechanism for vision transformers. Built upon the recent kernel-based efficient attention mechanisms, we design a novel dynamic programming algorithm that weights contributions of different tokens to a query with respect to their relative spatial distances in the 2D space in linear observed time. Extensive experiments and analyses demonstrate the effectiveness of ripple attention on various visual tasks.


title: Sum-rate Maximization in Uplink CRAN with a Massive MIMO Fronthaul

abstract: The limited fronthaul capacity is known to be one of the main problems in cloud radio access networks (CRANs), especially in the wireless fronthaul links. In this paper, we consider the uplink of a CRAN system, where massive multiple-input multiple-output (MIMO) is utilized in the fronthaul link. Considering multi-antenna user equipment (UEs) and multi-antenna remote radio heads (RRHs), we maximize the system sum-rate by jointly optimizing the precoders at the UEs and the quantization noise covariance matrices and transmit powers at the RRHs. To solve the resulting nonconvex problem, an iterative algorithm based on the majorization-minimization (MM) method is proposed. Two schemes at the central unit are considered, namely maximum ratio (MR) and zero-forcing (ZF) combining. Numerical results show that the sum-rate has an asymptotic behaviour with respect to the maximum available power at RRHs and that the MR scheme goes to its asymptote faster than the ZF scheme.


title: Capturing non-Markovian dynamics with the reaction coordinate method

abstract: The reaction coordinate (RC) technique is emerging as a significant tool in the study of quantum dissipative dynamics and quantum thermodynamics. With the objective to further establish this tool, here we explore to what extent the method can capture non-Markovian dynamics of open quantum systems. As a case study, we focus on the pure decoherence model of a spin coupled to a harmonic reservoir. We compare the spin dynamics and measures for non-Markovianity from the exact analytical solution to simulations based on the RC method at the level of a second order quantum master equation. We find that the RC method can quantitatively capture non-Markovian effects at strong system-bath coupling and for structured baths. This is rationalized by the fact that the collective RC bath mode, which is made part of the system, maintains system-bath correlations. Lastly, we apply our RC method and study the spin-boson model in the non-Markovian regime.


title: VC dimension of partially quantized neural networks in the overparametrized regime

abstract: Vapnik-Chervonenkis (VC) theory has so far been unable to explain the small generalization error of overparametrized neural networks. Indeed, existing applications of VC theory to large networks obtain upper bounds on VC dimension that are proportional to the number of weights, and for a large class of networks, these upper bound are known to be tight. In this work, we focus on a class of partially quantized networks that we refer to as hyperplane arrangement neural networks (HANNs). Using a sample compression analysis, we show that HANNs can have VC dimension significantly smaller than the number of weights, while being highly expressive. In particular, empirical risk minimization over HANNs in the overparametrized regime achieves the minimax rate for classification with Lipschitz posterior class probability. We further demonstrate the expressivity of HANNs empirically. On a panel of 121 UCI datasets, overparametrized HANNs match the performance of state-of-the-art full-precision models.


title: GDA-AM: On the effectiveness of solving minimax optimization via Anderson Acceleration

abstract: Many modern machine learning algorithms such as generative adversarial networks (GANs) and adversarial training can be formulated as minimax optimization. Gradient descent ascent (GDA) is the most commonly used algorithm due to its simplicity. However, GDA can converge to non-optimal minimax points. We propose a new minimax optimization framework, GDA-AM, that views the GDAdynamics as a fixed-point iteration and solves it using Anderson Mixing to con-verge to the local minimax. It addresses the diverging issue of simultaneous GDAand accelerates the convergence of alternating GDA. We show theoretically that the algorithm can achieve global convergence for bilinear problems under mild conditions. We also empirically show that GDA-AMsolves a variety of minimax problems and improves GAN training on several datasets


title: Magnitude homology of graphs and discrete Morse theory on Asao-Izumihara complexes

abstract: Recently, Asao and Izumihara introduced CW-complexes whose homology groups are isomorphic to direct summands of the graph magnitude homology group. In this paper, we study the homotopy type of the CW-complexes in connection with the diagonality of magnitude homology groups. We prove that the Asao-Izumihara complex is homotopy equivalent to a wedge of spheres for pawful graphs introduced by Y. Gu. The result can be considered as a homotopy type version of Gu's result. We also formulate a slight generalization of the notion of pawful graphs and find new non-pawful diagonal graphs of diameter $2$.


title: Post-hoc Models for Performance Estimation of Machine Learning Inference

abstract: Estimating how well a machine learning model performs during inference is critical in a variety of scenarios (for example, to quantify uncertainty, or to choose from a library of available models). However, the standard accuracy estimate of softmax confidence is not versatile and cannot reliably predict different performance metrics (e.g., F1-score, recall) or the performance in different application scenarios or input domains. In this work, we systematically generalize performance estimation to a diverse set of metrics and scenarios and discuss generalized notions of uncertainty calibration. We propose the use of post-hoc models to accomplish this goal and investigate design parameters, including the model type, feature engineering, and performance metric, to achieve the best estimation quality. Emphasis is given to object detection problems and, unlike prior work, our approach enables the estimation of per-image metrics such as recall and F1-score. Through extensive experiments with computer vision models and datasets in three use cases -- mobile edge offloading, model selection, and dataset shift -- we find that proposed post-hoc models consistently outperform the standard calibrated confidence baselines. To the best of our knowledge, this is the first work to develop a unified framework to address different performance estimation problems for machine learning inference.


title: Gravitational wave background from mergers of large primordial black holes

abstract: The Peters formula, which tells how the coalescence time of a binary system emitting gravitational radiation is determined by the initial size and shape of the elliptic orbit, is often used in estimating the merger rate of primordial black holes and the gravitational wave background from the mergers. Valid as it is in some interesting scenarios, such as the analysis of the LIGO-Virgo events, the Peters formula fails to describe the coalescence time if the orbital period of the binary exceeds the value given by the formula. This could underestimate the event rate of mergers that occur before the cosmic time $t\sim 10^{13}\ \text{s}$. As a result, the energy density spectrum of the gravitational wave background could develop a peak, which is from mergers occurring at either $t\sim 10^{13}\ \text{s}$ (for black holes with mass $M\gtrsim 10^8 M_\odot$) or $t\sim 10^{26}(M/M_\odot)^{-5/3}\ \text{s}$ (for $10^5 M_\odot \lesssim M\lesssim 10^8 M_\odot$). This can be used to constrain the fraction of dark matter in primordial black holes (denoted by $f$) if potential probes (such as SKA and U-DECIGO) do not discover such a background, with the result $f\lesssim 10^{-6}\text{-}10^{-4}$ for the mass range $10\text{-} 10^9M_\odot$. We then consider the effect of mass accretion onto primordial black holes at redshift $z\sim 10$, and find that the merger rate could drop significantly at low redshifts. The spectrum of the gravitational wave background thus gets suppressed at the high-frequency end. This feature might be captured by future detectors such as ET and CE for initial mass $M= \mathcal{O}(10\text{-}100) M_\odot$ with $f\gtrsim 10^{-4}$.


title: Epitaxial Growth of Ultraflat Bismuthene with Large Topological Band Inversion Enabled by Substrate-Orbital-Filtering Effect

abstract: Quantum spin Hall (QSH) systems hold promises of low-power-consuming spintronic devices, yet their practical applications are extremely impeded by the small energy gaps. Fabricating QSH materials with large gaps, especially under the guidance of design principles, is essential for both scientific research and practical applications. Here, we demonstrate that large on-site atomic spin-orbit coupling can be directly exploited via the intriguing substrate-orbital-filtering effect to generate large-gap QSH systems and experimentally realized on the epitaxially synthesized ultraflat bismuthene on Ag(111). Theoretical calculations reveal that the underlying substrate selectively filters Bi pz orbitals away from the Fermi level, leading pxy orbitals with nonzero magnetic quantum numbers, resulting in large topological gap of ~1 eV at the K point. The corresponding topological edge states are identified through scanning tunneling spectroscopy combined with density functional theory calculations. Our findings provide general strategies to design large-gap QSH systems and further explore their topology-related physics.


title: Fast Activation of Graphene with Corrugated Surface and its Role in Improved Aqueous Electrochemical Capacitors

abstract: In graphene based materials, the energy storage capacity is usually improved by rich porous structures with extremely high surface area. By utilizing surface corrugations, this work shows an alternative strategy to activate graphene materials for large capacitance. We demonstrate how to simply fabricate such activated graphene and how these surface structures helped to realize considerable specific capacitance (e.g., electrode capacitance of ~340 F g-1 at 5 mV s-1 and device capacitance of ~ 343 F g-1 at 1.7 A g-1) and power performance (e.g., power density of 50 and 2500 W kg-1 at the energy density of ~10.7 and 1.53 Wh kg-1, respectively) in aqueous system, which are comparable to and even better than those of highly activated graphene materials with ultra-high surface area. This work demonstrates a new path to enhance the capacity of carbon-based materials, which could be developed and combined with other systems for various improved energy storage applications.


title: PFH spectral invariants and $C^\infty$ closing lemmas

abstract: We develop the theory of spectral invariants in periodic Floer homology (PFH) of area-preserving surface diffeomorphisms. We use this theory to prove $C^\infty$ closing lemmas for certain Hamiltonian isotopy classes of area-preserving surface diffeomorphisms. In particular, we show that for a $C^\infty$-generic area-preserving diffeomorphism of the torus, the set of periodic points is dense. Our closing lemmas are quantitative, asserting roughly speaking that for a given Hamiltonian isotopy, within time $\delta$ a periodic orbit must appear of period $O(\delta^{-1})$. We also prove a "Weyl law" describing the asymptotic behavior of PFH spectral invariants.


title: Anomalously small superconducting gap in the strong spin-orbit coupled superconductor: $ \beta- $Tungsten

abstract: Thin films of $ \beta- $tungsten host superconductivity in the presence of strong spin-orbit coupling. This non-equilibrium crystalline phase of tungsten has attracted considerable attention in recent years due to its giant spin Hall effect and the potential promise of exotic superconductivity. However, more than 60 years after its discovery, superconductivity in this material is still not well understood. Using time-domain THz spectroscopy, we measure the frequency response of the complex optical conductivity of $ \beta- $tungsten thin film with a T$_c$ of 3.7 K in its superconducting state. At temperatures down to 1.6 K, we find that both the superconducting gap and the superfluid spectral weight are much smaller than that expected for a weakly coupled superconductor given the T$_c$. The conclusion of a small gap holds up even when accounting for possible inhomogeneities in the system, which could come from other crystalline forms of tungsten (that are not superconducting at these temperatures) or surface states on $ \beta- $tungsten grains. Using detailed X-ray diffraction measurements, we preclude the possibility of significant amount of other tungsten allotropes, strongly suggesting the topological surface states of $ \beta- $tungsten play the role of inhomogeneity in these films. Our observations pose a challenge and opportunity for a theory of strongly anisotropic normal metals with strong spin-orbit coupling to describe.


title: Revisiting consistency of a recursive estimator of mixing distributions

abstract: Estimation of the mixing distribution under a general mixture model is a very difficult problem, especially when the mixing distribution is assumed to have a density. Predictive recursion (PR) is a fast, recursive algorithm for nonparametric estimation of a mixing distribution/density in general mixture models. However, the existing PR consistency results make rather strong assumptions, some of which fail for a class of mixture models relevant for monotone density estimation, namely, scale mixtures of uniform kernels. In this paper, we develop new consistency results for PR under weaker conditions. Armed with this new theory, we prove that PR is consistent for the scale mixture of uniforms problem, and we show that the corresponding PR mixture density estimator has very good practical performance compared to several existing methods for monotone density estimation.


title: Magnetic-field-insensitive coherent-population-trapping resonances excited by bichromatic linearly polarized fields on the $D_1$ line of $^{133}$Cs

abstract: We have experimentally demonstrated that magnetic-field-insensitive coherent-population-trapping (CPT) resonances are generated between the ground hyperfine levels on the $D_1$ line of $^{133}$Cs using a two-photon $\Lambda$ scheme excited by lin || lin polarizations. The frequency shift of the CPT resonance is 0.04 Hz for the deviation of 1 $\mu$T at a "magic" magnetic field of 139 $\mu$T and is 50 times smaller than that of the conventional clock transition at a typical bias magnetic field for the clock operation. The amplitude of the CPT spectrum excited by lin || lin polarizations is enhanced as the excitation intensity increases and is well explained by the three-level model without trap levels. Thus, the CPT resonance on the $D_1$ line of $^{133}$Cs atom excited by a simple lin || lin scheme will be one of the best candidates for frequency reference of miniature atomic clocks.


title: BadPre: Task-agnostic Backdoor Attacks to Pre-trained NLP Foundation Models

abstract: Pre-trained Natural Language Processing (NLP) models can be easily adapted to a variety of downstream language tasks. This significantly accelerates the development of language models. However, NLP models have been shown to be vulnerable to backdoor attacks, where a pre-defined trigger word in the input text causes model misprediction. Previous NLP backdoor attacks mainly focus on some specific tasks. This makes those attacks less general and applicable to other kinds of NLP models and tasks. In this work, we propose \Name, the first task-agnostic backdoor attack against the pre-trained NLP models. The key feature of our attack is that the adversary does not need prior information about the downstream tasks when implanting the backdoor to the pre-trained model. When this malicious model is released, any downstream models transferred from it will also inherit the backdoor, even after the extensive transfer learning process. We further design a simple yet effective strategy to bypass a state-of-the-art defense. Experimental results indicate that our approach can compromise a wide range of downstream NLP tasks in an effective and stealthy way.


title: Inelastic Mach-Zehnder Interferometry with Free Electrons

abstract: We use a novel scanning electron Mach-Zehnder interferometer constructed in a conventional transmission electron microscope to perform inelastic interferometric imaging with free electrons. An electron wave function is prepared in two paths that pass on opposite sides of a gold nanoparticle, where plasmons are excited before the paths are recombined to produce electron interference. We show that the measured spectra are consistent with theoretical predictions, specifically that the interference signal formed by inelastically scattered electrons is pi out of phase with respect to that formed by elastically scattered electrons. This technique is sensitive to the phase of localized optical modes because the interference signal amounts to a substantial fraction of the transmitted electrons. We thus argue that inelastic interferometric imaging with our scanning electron Mach-Zehnder interferometer provides a new platform for controlling the transverse momentum of a free electron and studying coherent electron-matter interactions at the nanoscale.


title: Derived categories of Quot schemes of locally free quotients via categorified Hall products

abstract: We prove Qingyuan Jiang's conjecture on semiorthogonal decompositions of derived categories of Quot schemes of locally free quotients. The author's result on categorified Hall products for Grassmannian flips is applied to prove the conjecture.


title: SSFL: Tackling Label Deficiency in Federated Learning via Personalized Self-Supervision

abstract: Federated Learning (FL) is transforming the ML training ecosystem from a centralized over-the-cloud setting to distributed training over edge devices in order to strengthen data privacy. An essential but rarely studied challenge in FL is label deficiency at the edge. This problem is even more pronounced in FL compared to centralized training due to the fact that FL users are often reluctant to label their private data. Furthermore, due to the heterogeneous nature of the data at edge devices, it is crucial to develop personalized models. In this paper we propose self-supervised federated learning (SSFL), a unified self-supervised and personalized federated learning framework, and a series of algorithms under this framework which work towards addressing these challenges. First, under the SSFL framework, we demonstrate that the standard FedAvg algorithm is compatible with recent breakthroughs in centralized self-supervised learning such as SimSiam networks. Moreover, to deal with data heterogeneity at the edge devices in this framework, we have innovated a series of algorithms that broaden existing supervised personalization algorithms into the setting of self-supervised learning. We further propose a novel personalized federated self-supervised learning algorithm, Per-SSFL, which balances personalization and consensus by carefully regulating the distance between the local and global representations of data. To provide a comprehensive comparative analysis of all proposed algorithms, we also develop a distributed training system and related evaluation protocol for SSFL. Our findings show that the gap of evaluation accuracy between supervised learning and unsupervised learning in FL is both small and reasonable. The performance comparison indicates the representation regularization-based personalization method is able to outperform other variants.


title: Attention-Enhanced Neural Network Models for Turbulence Simulation

abstract: Deep neural network models have shown a great potential in accelerating the simulation of fluid dynamic systems. Once trained, these models can make inference within seconds, thus can be extremely efficient. However, they suffer from a generalization problem when the flow becomes chaotic and turbulent. One of the most important reasons is that, existing models lack the mechanism to handle the unique characteristic of turbulent flow: multi-scale flow structures are non-uniformly distributed and strongly nonequilibrium. In this work, we address this issue with the concept of visual attention: intuitively, we expect the attention module to capture the nonequilibrium of turbulence by automatically adjusting weights on different regions. We benchmark the performance improvement with a state of the art neural network model, the Fourier Neural Operator (FNO), on two-dimensional (2D) turbulence prediction task. Numerical experiments show that the attention-enhanced neural network model can generalize well on higher Reynolds numbers flow, and can accurately reconstruct a variety of statistics and instantaneous spatial structures of turbulence. The attention mechanism provides 40% error reduction with 1% increase of parameters, at the same level of computational cost.


title: What is A Wireless UAV? A Design Blueprint for 6G Flying Wireless Nodes

abstract: Wireless Unmanned Aerial Vehicles (UAVs) were introduced in the world of 4th generation networks (4G) as cellular users, and have attracted the interest of the wireless community ever since. In~5G, UAVs operate also as flying Base Stations providing service to ground users. They can also implement independent off-the-grid UAV networks. In~6G networks, wireless UAVs will connect ground users to in-orbit wireless infrastructure. As the design and prototyping of wireless UAVs are on the rise, the time is ripe for introducing a more precise definition of what is a wireless UAV. In doing so, we revise the major design challenges in the prototyping of wireless UAVs for future 6G spectrum research. We then introduce a new wireless UAV prototype that addresses these challenges. The design of our wireless UAV prototype will be made public and freely available to other researchers.


title: The Power of Contrast for Feature Learning: A Theoretical Analysis

abstract: Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of contrastive learning is still limited. In this paper, under linear representation settings, (i) we provably show that contrastive learning outperforms the standard autoencoders and generative adversarial networks, two classical generative unsupervised learning methods, for both feature recovery and in-domain downstream tasks; (ii) we also illustrate the impact of labeled data in supervised contrastive learning. This provides theoretical support for recent findings that contrastive learning with labels improves the performance of learned representations in the in-domain downstream task, but it can harm the performance in transfer learning. We verify our theory with numerical experiments.


title: Can an AI agent hit a moving target?

abstract: I model the belief formation and decision making processes of economic agents during a monetary policy regime change (an acceleration in the money supply) with a deep reinforcement learning algorithm in the AI literature. I show that when the money supply accelerates, the learning agents only adjust their actions, which include consumption and demand for real balance, after gathering learning experience for many periods. This delayed adjustments leads to low returns during transition periods. Once they start adjusting to the new environment, their welfare improves. Their changes in beliefs and actions lead to temporary inflation volatility. I also show that, 1. the AI agents who explores their environment more adapt to the policy regime change quicker, which leads to welfare improvements and less inflation volatility, and 2. the AI agents who have experienced a structural change adjust their beliefs and behaviours quicker than an inexperienced learning agent.


title: Differential thermopower images as a probe of many-body effects in quantum point contacts

abstract: Mesoscopic circuit elements such as quantum dots and quantum point contacts (QPCs) offer a uniquely controllable platform for engineering complex quantum devices, whose tunability makes them ideal for generating and investigating interacting quantum systems. However, the conductance measurements commonly employed in mesoscopics experiments are poorly suited to discerning correlated phenomena from those of single-particle origin. Here, we introduce non-equilibrium thermopower measurements as a novel approach to probing the local density of states (LDOS), offering an energy-resolved readout of many-body effects. We combine differential thermopower measurements with non-equilibrium density functional theory (DFT) to both confirm the presence of a localized state at the saddle point of a QPC and reveal secondary states that emerge wherever the reservoir chemical potential intersects the gate-induced potential barrier. These experiments establish differential thermopower imaging as a robust and general approach to exploring quantum many-body effects in mesoscopic circuits.


title: On the existence of Auslander-Reiten $n$-exangles in $n$-exangulated categories

abstract: Let $\mathscr{C}$ be an $n$-exangulated category. In this note, we show that if $\mathscr{C}$ is locally finite, then $\mathscr{C}$ has Auslander-Reiten $n$-exangles. This unifies and extends results of Xiao-Zhu, Zhu-Zhuang, Zhou and Xie-Lu-Wang for triangulated, extriangulated, $(n+2)$-angulated and $n$-abelian categories, respectively.


title: TSN-CA: A Two-Stage Network with Channel Attention for Low-Light Image Enhancement

abstract: Low-light image enhancement is a challenging low-level computer vision task because after we enhance the brightness of the image, we have to deal with amplified noise, color distortion, detail loss, blurred edges, shadow blocks and halo artifacts. In this paper, we propose a Two-Stage Network with Channel Attention (denoted as TSN-CA) to enhance the brightness of the low-light image and restore the enhanced images from various kinds of degradation. In the first stage, we enhance the brightness of the low-light image in HSV space and use the information of H and S channels to help the recovery of details in V channel. In the second stage, we integrate Channel Attention (CA) mechanism into the skip connection of U-Net in order to restore the brightness-enhanced image from severe kinds of degradation in RGB space. We train and evaluate the performance of our proposed model on the LOL real-world and synthetic datasets. In addition, we test our model on several other commonly used datasets without Ground-Truth. We conduct extensive experiments to demonstrate that our method achieves excellent effect on brightness enhancement as well as denoising, details preservation and halo artifacts elimination. Our method outperforms many other state-of-the-art methods qualitatively and quantitatively.


title: Blind Super-resolution via Projected Gradient Descent

abstract: Blind super-resolution can be cast as low rank matrix recovery problem by exploiting the inherent simplicity of the signal. In this paper, we develop a simple yet efficient nonconvex method for this problem based on the low rank structure of the vectorized Hankel matrix associated with the target matrix. Theoretical guarantees have been established under the similar conditions as convex approaches. Numerical experiments are also conducted to demonstrate its performance.


title: Exponentially Many Local Minima in Quantum Neural Networks

abstract: Quantum Neural Networks (QNNs), or the so-called variational quantum circuits, are important quantum applications both because of their similar promises as classical neural networks and because of the feasibility of their implementation on near-term intermediate-size noisy quantum machines (NISQ). However, the training task of QNNs is challenging and much less understood. We conduct a quantitative investigation on the landscape of loss functions of QNNs and identify a class of simple yet extremely hard QNN instances for training. Specifically, we show for typical under-parameterized QNNs, there exists a dataset that induces a loss function with the number of spurious local minima depending exponentially on the number of parameters. Moreover, we show the optimality of our construction by providing an almost matching upper bound on such dependence. While local minima in classical neural networks are due to non-linear activations, in quantum neural networks local minima appear as a result of the quantum interference phenomenon. Finally, we empirically confirm that our constructions can indeed be hard instances in practice with typical gradient-based optimizers, which demonstrates the practical value of our findings.


title: Efficient Multi-agent Epistemic Planning: Teaching Planners About Nested Belief

abstract: Many AI applications involve the interaction of multiple autonomous agents, requiring those agents to reason about their own beliefs, as well as those of other agents. However, planning involving nested beliefs is known to be computationally challenging. In this work, we address the task of synthesizing plans that necessitate reasoning about the beliefs of other agents. We plan from the perspective of a single agent with the potential for goals and actions that involve nested beliefs, non-homogeneous agents, co-present observations, and the ability for one agent to reason as if it were another. We formally characterize our notion of planning with nested belief, and subsequently demonstrate how to automatically convert such problems into problems that appeal to classical planning technology for solving efficiently. Our approach represents an important step towards applying the well-established field of automated planning to the challenging task of planning involving nested beliefs of multiple agents.


title: Massively Parallel Probabilistic Computing with Sparse Ising Machines

abstract: Inspired by the developments in quantum computing, building domain-specific classical hardware to solve computationally hard problems has received increasing attention. Here, by introducing systematic sparsification techniques, we demonstrate a massively parallel architecture: the sparse Ising Machine (sIM). Exploiting sparsity, sIM achieves ideal parallelism: its key figure of merit - flips per second - scales linearly with the number of probabilistic bits (p-bit) in the system. This makes sIM up to 6 orders of magnitude faster than a CPU implementing standard Gibbs sampling. Compared to optimized implementations in TPUs and GPUs, sIM delivers 5-18x speedup in sampling. In benchmark problems such as integer factorization, sIM can reliably factor semiprimes up to 32-bits, far larger than previous attempts from D-Wave and other probabilistic solvers. Strikingly, sIM beats competition-winning SAT solvers (by 4-700x in runtime to reach 95% accuracy) in solving 3SAT problems. Even when sampling is made inexact using faster clocks, sIM can find the correct ground state with further speedup. The problem encoding and sparsification techniques we introduce can be applied to other Ising Machines (classical and quantum) and the architecture we present can be used for scaling the demonstrated 5,000-10,000 p-bits to 1,000,000 or more through analog CMOS or nanodevices.


title: $O\left(1/T\right)$ Time-Average Convergence in a Generalization of Multiagent Zero-Sum Games

abstract: We introduce a generalization of zero-sum network multiagent matrix games and prove that alternating gradient descent converges to the set of Nash equilibria at rate $O(1/T)$ for this set of games. Alternating gradient descent obtains this convergence guarantee while using fixed learning rates that are four times larger than the optimistic variant of gradient descent. Experimentally, we show with 97.5% confidence that, on average, these larger learning rates result in time-averaged strategies that are 2.585 times closer to the set of Nash equilibria than optimistic gradient descent.


title: Detecting and Quantifying Malicious Activity with Simulation-based Inference

abstract: We propose the use of probabilistic programming techniques to tackle the malicious user identification problem in a recommendation algorithm. Probabilistic programming provides numerous advantages over other techniques, including but not limited to providing a disentangled representation of how malicious users acted under a structured model, as well as allowing for the quantification of damage caused by malicious users. We show experiments in malicious user identification using a model of regular and malicious users interacting with a simple recommendation algorithm, and provide a novel simulation-based measure for quantifying the effects of a user or group of users on its dynamics.


title: Shapley variable importance clouds for interpretable machine learning

abstract: Interpretable machine learning has been focusing on explaining final models that optimize performance. The current state-of-the-art is the Shapley additive explanations (SHAP) that locally explains variable impact on individual predictions, and it is recently extended for a global assessment across the dataset. Recently, Dong and Rudin proposed to extend the investigation to models from the same class as the final model that are "good enough", and identified a previous overclaim of variable importance based on a single model. However, this method does not directly integrate with existing Shapley-based interpretations. We close this gap by proposing a Shapley variable importance cloud that pools information across good models to avoid biased assessments in SHAP analyses of final models, and communicate the findings via novel visualizations. We demonstrate the additional insights gain compared to conventional explanations and Dong and Rudin's method using criminal justice and electronic medical records data.


title: Tensor regularization by truncated iteration: a comparison of some solution methods for large-scale linear discrete ill-posed problem with a t-product

abstract: This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented for low tubal rank tensor approximations. Regularization of linear inverse problems by truncated tensor eigenvalue decomposition (T-tEVD), truncated tSVD (T-tSVD), randomized T-tSVD (RT-tSVD), t-product Golub-Kahan bidiagonalization (tGKB) process, and t-product Lanczos (t-Lanczos) process are considered. A solution method that is based on reusing tensor Krylov subspaces generated by the tGKB process is described. The regularization parameter is the number of iterations required by each method. The discrepancy principle is used to determine this parameter. Solution methods that are based on truncated iterations are compared with solution methods that combine Tikhonov regularization with the tGKB and t-Lanczos processes. Computed examples illustrate the performance of these methods when applied to image and gray-scale video restorations. Our new RT-tSVD method is seen to require less CPU time and yields restorations of higher quality than the T-tSVD method.


title: A wavelet basis for non-Archimedean $C^n$-functions and $n$-th Lipschitz functions

abstract: A wavelet basis is a basis for the $K$-Banach space $C(R, K)$ of continuous functions from a complete discrete valuation ring $R$ whose residue field is finite to its quotient field $K$. In this paper, we prove a characterization of $n$-times continuously differentiable functions from $R$ to $K$ by the coefficients with respect to the wavelet basis and give an orthonormal basis for $K$-Banach space $C^n(R, K)$ of $n$-times continuously differentiable functions.


title: An Improved Approximation for Maximum $k$-Dependent Set on Bipartite Graphs

abstract: We present a $(1+\frac{k}{k+2})$-approximation algorithm for the Maximum $k$-dependent Set problem on bipartite graphs for any $k\ge1$. For a graph with $n$ vertices and $m$ edges, the algorithm runs in $O(k m \sqrt{n})$ time and improves upon the previously best-known approximation ratio of $1+\frac{k}{k+1}$ established by Kumar et al. [Theoretical Computer Science, 526: 90--96 (2014)]. Our proof also indicates that the algorithm retains its approximation ratio when applied to the (more general) class of K\"{o}nig-Egerv\'{a}ry graphs.


title: ABC: Attention with Bounded-memory Control

abstract: Transformer architectures have achieved state-of-the-art results on a variety of sequence modeling tasks. However, their attention mechanism comes with a quadratic complexity in sequence lengths, making the computational overhead prohibitive, especially for long sequences. Attention context can be seen as a random-access memory with each token taking a slot. Under this perspective, the memory size grows linearly with the sequence length, and so does the overhead of reading from it. One way to improve the efficiency is to bound the memory size. We show that disparate approaches can be subsumed into one abstraction, attention with bounded-memory control (ABC), and they vary in their organization of the memory. ABC reveals new, unexplored possibilities. First, it connects several efficient attention variants that would otherwise seem apart. Second, this abstraction gives new insights--an established approach (Wang et al., 2020b) previously thought to be not applicable in causal attention, actually is. Last, we present a new instance of ABC, which draws inspiration from existing ABC approaches, but replaces their heuristic memory-organizing functions with a learned, contextualized one. Our experiments on language modeling, machine translation, and masked language model finetuning show that our approach outperforms previous efficient attention models; compared to the strong transformer baselines, it significantly improves the inference time and space efficiency with no or negligible accuracy loss.


title: How the magnetic field behaves during the motion of a highly conducting fluid under its own gravity--A new theoretical, relativistic approach

abstract: Within the context of general relativity we study in a fully covariant way the so-called Euler-Maxwell system of equations. In particular, on decomposing the aforementioned system into its 1 temporal and 1 + 2 spatial components at the ideal magnetohydrodynamic limit, we bring it in a simplified form that favors physical insight to the problem of a self-gravitating, magnetized fluid. Of central interest is the decomposition of Faraday's equation which leads to a new general solution governing the evolution of the magnetic field during the motion of the highly conducting fluid. According to the latter relation, the magnetic field generally grows or decays in proportion to the inverse cube law of the scale factor--associated with the continuous contraction or expansion of the fluid's volume respectively. The magnetic field's law of variation, which has remarkable implications for the motion of the whole fluid, is subsequently applied to homogeneous (anisotropic-magnetized) cosmological models--especially to the Bianchi I case--as well as to the study of homogeneous and anisotropic gravitational collapse in a magnetized environment. Concerning the cosmological application, we derive the evolution equations of Bianchi I spacetime permeated by large-scale magnetic fields (these equations reduce to their FRW counterparts at the small/large--scale limit). Also, the compatibility of the new evolution formula for the magnetic field with the standard cosmic nucleosynthesis constraint is examined. As for the application in astrophysics, our results predict that homogeneous gravitational implosion is impeded when the electric Weyl tensor (associated with tidal forces) along the magnetic forcelines overwhelms the magnetic energy density. Lastly, our model denotes that the satisfaction of the aforementioned criterion is ultimately driven into a problem of initial conditions.


title: The Variability of Model Specification

abstract: It's regarded as an axiom that a good model is one that compromises between bias and variance. The bias is measured in training cost, while the variance of a (say, regression) model is measure by the cost associated with a validation set. If reducing bias is the goal, one will strive to fetch as complex a model as necessary, but complexity is invariably coupled with variance: greater complexity implies greater variance. In practice, driving training cost to near zero does not pose a fundamental problem; in fact, a sufficiently complex decision tree is perfectly capable of driving training cost to zero; however, the problem is often with controlling the model's variance. We investigate various regression model frameworks, including generalized linear models, Cox proportional hazard models, ARMA, and illustrate how misspecifying a model affects the variance.


title: Data-Centric AI Requires Rethinking Data Notion

abstract: The transition towards data-centric AI requires revisiting data notions from mathematical and implementational standpoints to obtain unified data-centric machine learning packages. Towards this end, this work proposes unifying principles offered by categorical and cochain notions of data, and discusses the importance of these principles in data-centric AI transition. In the categorical notion, data is viewed as a mathematical structure that we act upon via morphisms to preserve this structure. As for cochain notion, data can be viewed as a function defined in a discrete domain of interest and acted upon via operators. While these notions are almost orthogonal, they provide a unifying definition to view data, ultimately impacting the way machine learning packages are developed, implemented, and utilized by practitioners.


title: Value-at-Risk forecasting model based on normal inverse Gaussian distribution driven by dynamic conditional score

abstract: Under the framework of dynamic conditional score, we propose a parametric forecasting model for Value-at-Risk based on the normal inverse Gaussian distribution (Hereinafter NIG-DCS-VaR), which creatively incorporates intraday information into daily VaR forecast. NIG specifies an appropriate distribution to return and the semi-additivity of the NIG parameters makes it feasible to improve the estimation of daily return in light of intraday return, and thus the VaR can be explicitly obtained by calculating the quantile of the re-estimated distribution of daily return. We conducted an empirical analysis using two main indexes of the Chinese stock market, and a variety of backtesting approaches as well as the model confidence set approach prove that the VaR forecasts of NIG-DCS model generally gain an advantage over those of realized GARCH (RGARCH) models. Especially when the risk level is relatively high, NIG-DCS-VaR beats RGARCH-VaR in terms of coverage ability and independence.


title: Tight Bounds on the Optimal UL Sum-Rate of MU RIS-aided Wireless Systems

abstract: The objective of this paper is to develop simple techniques to bound the optimal uplink sum-rate of multi-user RIS-aided wireless systems. Specifically, we develop a novel technique called \textit{channel separation} which provides a new understanding as to how the RIS phases affect the sum-rate. Leveraging channel separation, we derive upper and lower bounds on the optimal sum-rate. In addition, we propose a low-complexity alternating optimization algorithm to obtain near-optimal sum-rate results. Numerical results demonstrate the tightness of the bounds and show that the alternating optimization approach delivers sum-rate values similar to the results of a full numerical optimization procedure. Furthermore, in practical scenarios where hardware limitations cause the RIS phases to be quantized, our lower bound can still be applied and shows that the sum-rate is robust to quantization, even with low resolution.


title: Quantum Crystallography N-Representability

abstract: Linus Pauling contributions span structural biology, chemistry in its broadest definition, quantum mechanical theory, valence bond theory, and even nuclear physics. A principal tool developed and used by Pauling is Xray, and electron, diffraction. One possible extension of the Pauling oeuvre could be the marriage of crystallography and quantum mechanics. Such an effort dates back to the sixties and has now flourished into an entire subfield termed quantum crystallography. Quantum crystallography could be achieved through the application of Clinton equations to yield N-representable density matrices consistent with experimental data. The implementation of the Clinton equations is qualitatively different for small and for large systems. For a small system, quantum mechanics is extracted from Xray data while for a large system, the quantum mechanics is injected into the system. In both cases, Nrepresentability is imposed by the use of the Clinton equations.


title: Deep Random Forest with Ferroelectric Analog Content Addressable Memory

abstract: Deep random forest (DRF), which incorporates the core features of deep learning and random forest (RF), exhibits comparable classification accuracy, interpretability, and low memory and computational overhead when compared with deep neural networks (DNNs) in various information processing tasks for edge intelligence. However, the development of efficient hardware to accelerate DRF is lagging behind its DNN counterparts. The key for hardware acceleration of DRF lies in efficiently realizing the branch-split operation at decision nodes when traversing a decision tree. In this work, we propose to implement DRF through simple associative searches realized with ferroelectric analog content addressable memory (ACAM). Utilizing only two ferroelectric field effect transistors (FeFETs), the ultra-compact ACAM cell can perform a branch-split operation with an energy-efficient associative search by storing the decision boundaries as the analog polarization states in an FeFET. The DRF accelerator architecture and the corresponding mapping of the DRF model to the ACAM arrays are presented. The functionality, characteristics, and scalability of the FeFET ACAM based DRF and its robustness against FeFET device non-idealities are validated both in experiments and simulations. Evaluation results show that the FeFET ACAM DRF accelerator exhibits 10^6x/16x and 10^6x/2.5x improvements in terms of energy and latency when compared with other deep random forest hardware implementations on the state-of-the-art CPU/ReRAM, respectively.


title: Genomic Data Analysis using a Two Stage Expectation Propagation Algorithm for Analysis of Sparse Bayesian High-Dimensional Instrumental Variables Regression

abstract: Simultaneous analysis of gene expression data and genetic variants is highly of interest, especially when the number of gene expressions and genetic variants are both greater than the sample size. Association of both causal genes and effective SNPs makes the use of sparse modeling of such genetic data sets, highly important. The high-dimensional sparse instrumental variables models are one of such useful association models, which models the simultaneous relation of the gene expressions and genetic variants with complex traits. From a Bayesian viewpoint, the sparsity can be favored using sparsity-enforcing priors such as spike-and-slab priors. A two-stage modification of the expectation propagation (EP) algorithm is proposed and examined for approximate inference in high-dimensional sparse instrumental variables models with spike-and-slab priors. This method is an adoption of the classical two-stage least squares method, to be used with the Bayes context. A simulation study is performed to examine the performance of the methods. The proposed method is applied to analysis of the mouse obesity data.


title: Pretraining & Reinforcement Learning: Sharpening the Axe Before Cutting the Tree

abstract: Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). However, pretraining requires a relevant dataset for training. In this work, we evaluate the effectiveness of pretraining for RL tasks, with and without distracting backgrounds, using both large, publicly available datasets with minimal relevance, as well as case-by-case generated datasets labeled via self-supervision. Results suggest filters learned during training on less relevant datasets render pretraining ineffective, while filters learned during training on the in-distribution datasets reliably reduce RL training time and improve performance after 80k RL training steps. We further investigate, given a limited number of environment steps, how to optimally divide the available steps into pretraining and RL training to maximize RL performance. Our code is available on GitHub


title: Adversarial Attacks on Machinery Fault Diagnosis

abstract: Despite the great progress of neural network-based (NN-based) machinery fault diagnosis methods, their robustness has been largely neglected, for they can be easily fooled through adding imperceptible perturbation to the input. For fault diagnosis problems, in this paper, we reformulate various adversarial attacks and intensively investigate them under untargeted and targeted conditions. Experimental results on six typical NN-based models show that accuracies of the models are greatly reduced by adding small perturbations. We further propose a simple, efficient and universal scheme to protect the victim models. This work provides an in-depth look at adversarial examples of machinery vibration signals for developing protection methods against adversarial attack and improving the robustness of NN-based models.


title: Improved inequalities for the numerical radius via Cartesian decomposition

abstract: We develop various lower bounds for the numerical radius $w(A)$ of a bounded linear operator $A$ defined on a complex Hilbert space, which improve the existing inequality $w^2(A)\geq \frac{1}{4}\|A^*A+AA^*\|$. In particular, for $r\geq 1$, we show that \begin{eqnarray*}\frac{1}{4}\|A^*A+AA^*\| \leq\frac{1}{2} \left( \frac{1}{2}\|\Re(A)+\Im(A)\|^{2r}+\frac{1}{2}\|\Re(A)-\Im(A)\|^{2r}\right)^{\frac{1}{r}} \leq w^{2}(A),\end{eqnarray*} where $\Re(A)$ and $\Im(A)$ are the real and imaginary parts of $A$, respectively. Furthermore, we obtain upper bounds for $w^2(A)$ refining the well-known upper bound $w^2(A)\leq \frac{1}{2} \left(w(A^2)+\|A\|^2\right)$. Separate complete characterizations for $w(A)=\frac{\|A\|}{2}$ and $w(A)=\frac{1}{2}\sqrt{\|A^*A+AA^*\|}$ are also given.


title: MediumVC: Any-to-any voice conversion using synthetic specific-speaker speeches as intermedium features

abstract: To realize any-to-any (A2A) voice conversion (VC), most methods are to perform symmetric self-supervised reconstruction tasks (Xi to Xi), which usually results in inefficient performances due to inadequate feature decoupling, especially for unseen speakers. We propose a two-stage reconstruction task (Xi to Yi to Xi) using synthetic specific-speaker speeches as intermedium features, where A2A VC is divided into two stages: any-to-one (A2O) and one-to-Any (O2A). In the A2O stage, we propose a new A2O method: SingleVC, by employing a noval data augment strategy(pitch-shifted and duration-remained, PSDR) to accomplish Xi to Yi. In the O2A stage, MediumVC is proposed based on pre-trained SingleVC to conduct Yi to Xi. Through such asymmetrical reconstruction tasks (Xi to Yi in SingleVC and Yi to Xi in MediumVC), the models are to capture robust disentangled features purposefully. Experiments indicate MediumVC can enhance the similarity of converted speeches while maintaining a high degree of naturalness.


title: On the Surrogate Gap between Contrastive and Supervised Losses

abstract: Contrastive representation learning encourages data representation to make semantically similar pairs closer than randomly drawn negative samples, which has been successful in various domains such as vision, language, and graphs. Recent theoretical studies have attempted to explain the benefit of the large negative sample size by upper-bounding the downstream classification loss with the contrastive loss. However, the previous surrogate bounds have two drawbacks: they are only legitimate for a limited range of negative sample sizes and prohibitively large even within that range. Due to these drawbacks, there still does not exist a consensus on how negative sample size theoretically correlates with downstream classification performance. Following the simplified setting where positive pairs are drawn from the true distribution (not generated by data augmentation; as supposed in previous studies), this study establishes surrogate upper and lower bounds for the downstream classification loss for all negative sample sizes that best explain the empirical observations on the negative sample size in the earlier studies. Our bounds suggest that the contrastive loss can be viewed as a surrogate objective of the downstream loss and larger negative sample sizes improve downstream classification because the surrogate gap between contrastive and supervised losses decays. We verify that our theory is consistent with experiments on synthetic, vision, and language datasets.


title: On the Deduction of the Carath\'eodory's Axiom of the Second Law of Thermodynamics from the Clausius and Kelvin Principles

abstract: Carath\'eodory's formalism for classical thermodynamics is a rich alternative approach to this theory, although unpopular with students and physics professors. This approach dispenses with the content of thermal machines for the presentation of the second law of thermodynamics. In this paper, we discuss Carath\'eodory's formalism historically, and show how Carath\'eodory's axiom of the second law of thermodynamics is derived, didactically, from the Clausius principle and the Kelvin principle. In addition, also providing an objective character for this paper, in the sense of seeking to popularize the teaching of Carath\'eodory's formalism in disciplines of classical thermodynamics at undergraduate level, we guide the reader to obtain the entropy and mathematical content of the second law of thermodynamics through this formalism. Finally, considering the wide reviewed literature, the proof we gave for deducing the Carath\'eodory's axiom of the second law of thermodynamics from the Clausius principle is new.


title: More on Change-Making and Related Problems

abstract: Given a set of $n$ integer-valued coin types and a target value $t$, the well-known change-making problem asks for the minimum number of coins that sum to $t$, assuming an unlimited number of coins in each type. In the more general all-targets version of the problem, we want the minimum number of coins summing to $j$, for every $j=0,\ldots,t$. For example, the textbook dynamic programming algorithms can solve the all-targets problem in $O(nt)$ time. Recently, Chan and He (SOSA'20) described a number of $O(t\,\textrm{polylog}\,t)$-time algorithms for the original (single-target) version of the change-making problem, but not the all-targets version. We obtain a number of new results on change-making and related problems, including: 1. A new algorithm for the all-targets change-making problem with running time $\tilde{O}(t^{4/3})$, improving a previous $\tilde{O}(t^{3/2})$-time algorithm. 2. A very simple $\tilde{O}(u^2+t)$-time algorithm for the all-targets change-making problem, where $u$ denotes the maximum coin value. The analysis of the algorithm uses a theorem of Erd\H{o}s and Graham (1972) on the Frobenius problem. This algorithm can be extended to solve the all-capacities version of the unbounded knapsack problem (for integer item weights bounded by $u$). 3. For the original (single-target) coin changing problem, we describe a simple modification of one of Chan and He's algorithms that runs in $\tilde{O}(u)$ time (instead of $\tilde{O}(t)$). 4. For the original (single-capacity) unbounded knapsack problem, we describe a simple algorithm that runs in $\tilde{O}(nu)$ time, improving previous near-$u^2$-time algorithms. 5. We also observe how one of our ideas implies a new result on the minimum word break problem, an optimization version of a string problem studied by Bringmann et al. (FOCS'17), generalizing change-making (which corresponds to the unary special case).