title: RankSim: Ranking Similarity Regularization for Deep Imbalanced Regression

abstract: Data imbalance, in which a plurality of the data samples come from a small proportion of labels, poses a challenge in training deep neural networks. Unlike classification, in regression the labels are continuous, potentially boundless, and form a natural ordering. These distinct features of regression call for new techniques that leverage the additional information encoded in label-space relationships. This paper presents the RankSim (ranking similarity) regularizer for deep imbalanced regression, which encodes an inductive bias that samples that are closer in label space should also be closer in feature space. In contrast to recent distribution smoothing based approaches, RankSim captures both nearby and distant relationships: for a given data sample, RankSim encourages the sorted list of its neighbors in label space to match the sorted list of its neighbors in feature space. RankSim is complementary to conventional imbalanced learning techniques, including re-weighting, two-stage training, and distribution smoothing, and lifts the state-of-the-art performance on three imbalanced regression benchmarks: IMDB-WIKI-DIR, AgeDB-DIR, and STS-B-DIR.


title: VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models

abstract: Recent advances in vision-language pre-training (VLP) have demonstrated impressive performance in a range of vision-language (VL) tasks. However, there exist several challenges for measuring the community's progress in building general multi-modal intelligence. First, most of the downstream VL datasets are annotated using raw images that are already seen during pre-training, which may result in an overestimation of current VLP models' generalization ability. Second, recent VLP work mainly focuses on absolute performance but overlooks the efficiency-performance trade-off, which is also an important indicator for measuring progress. To this end, we introduce the Vision-Language Understanding Evaluation (VLUE) benchmark, a multi-task multi-dimension benchmark for evaluating the generalization capabilities and the efficiency-performance trade-off (``Pareto SOTA'') of VLP models. We demonstrate that there is a sizable generalization gap for all VLP models when testing on out-of-distribution test sets annotated on images from a more diverse distribution that spreads across cultures. Moreover, we find that measuring the efficiency-performance trade-off of VLP models leads to complementary insights for several design choices of VLP. We release the VLUE benchmark to promote research on building vision-language models that generalize well to more diverse images and concepts unseen during pre-training, and are practical in terms of efficiency-performance trade-off.


title: Variation of stability for moduli spaces of unordered points in the plane

abstract: We study compactifications of the moduli space of unordered points in the plane via variation of GIT quotients of their corresponding Hilbert scheme. Our VGIT considers linearizations outside the ample cone and within the movable cone. For that purpose, we use the description of the Hilbert scheme as a Mori dream space, and the moduli interpretation of its birational models via Bridgeland stability. We determine the GIT walls associated with curvilinear zero-dimensional schemes, collinear points, and schemes supported on a smooth conic. For seven points, we study a compactification associated with an extremal ray of the movable cone, where stability behaves very differently from the Chow quotient. Lastly, a complete description for five points is given.


title: Conformal Credal Self-Supervised Learning

abstract: In semi-supervised learning, the paradigm of self-training refers to the idea of learning from pseudo-labels suggested by the learner itself. Across various domains, corresponding methods have proven effective and achieve state-of-the-art performance. However, pseudo-labels typically stem from ad-hoc heuristics, relying on the quality of the predictions though without guaranteeing their validity. One such method, so-called credal self-supervised learning, maintains pseudo-supervision in the form of sets of (instead of single) probability distributions over labels, thereby allowing for a flexible yet uncertainty-aware labeling. Again, however, there is no justification beyond empirical effectiveness. To address this deficiency, we make use of conformal prediction, an approach that comes with guarantees on the validity of set-valued predictions. As a result, the construction of credal sets of labels is supported by a rigorous theoretical foundation, leading to better calibrated and less error-prone supervision for unlabeled data. Along with this, we present effective algorithms for learning from credal self-supervision. An empirical study demonstrates excellent calibration properties of the pseudo-supervision, as well as the competitiveness of our method on several benchmark datasets.


title: Double Fibrations

abstract: This paper defines double fibrations (fibrations of double categories) and describes their key examples and properties. In particular, it shows how double fibrations relate to existing fibrational notions such as monoidal fibrations and discrete double fibrations, proves a representation theorem for double fibrations, and shows how double fibrations are a type of internal fibration.


title: Multi-Game Decision Transformers

abstract: A longstanding goal of the field of AI is a method for learning a highly capable, generalist agent from diverse experience. In the subfields of vision and language, this was largely achieved by scaling up transformer-based models and training them on large, diverse datasets. Motivated by this progress, we investigate whether the same strategy can be used to produce generalist reinforcement learning agents. Specifically, we show that a single transformer-based model - with a single set of weights - trained purely offline can play a suite of up to 46 Atari games simultaneously at close-to-human performance. When trained and evaluated appropriately, we find that the same trends observed in language and vision hold, including scaling of performance with model size and rapid adaptation to new games via fine-tuning. We compare several approaches in this multi-game setting, such as online and offline RL methods and behavioral cloning, and find that our Multi-Game Decision Transformer models offer the best scalability and performance. We release the pre-trained models and code to encourage further research in this direction.


title: Re-parameterizing Your Optimizers rather than Architectures

abstract: The well-designed structures in neural networks reflect the prior knowledge incorporated into the models. However, though different models have various priors, we are used to training them with model-agnostic optimizers such as SGD. In this paper, we propose to incorporate model-specific prior knowledge into optimizers by modifying the gradients according to a set of model-specific hyper-parameters. Such a methodology is referred to as Gradient Re-parameterization, and the optimizers are named RepOptimizers. For the extreme simplicity of model structure, we focus on a VGG-style plain model and showcase that such a simple model trained with a RepOptimizer, which is referred to as RepOpt-VGG, performs on par with or better than the recent well-designed models. From a practical perspective, RepOpt-VGG is a favorable base model because of its simple structure, high inference speed and training efficiency. Compared to Structural Re-parameterization, which adds priors into models via constructing extra training-time structures, RepOptimizers require no extra forward/backward computations and solve the problem of quantization. We hope to spark further research beyond the realms of model structure design. Code and models \url{https://github.com/DingXiaoH/RepOptimizers}.


title: Anyonic Chains -- $\alpha$-Induction -- CFT -- Defects -- Subfactors

abstract: Given a unitary fusion category, one can define the Hilbert space of a so-called ``anyonic spin-chain'' and nearest neighbor Hamiltonians providing a real-time evolution. There is considerable evidence that suitable scaling limits of such systems can lead to $1+1$-dimensional conformal field theories (CFTs), and in fact, can be used potentially to construct novel classes of CFTs. Besides the Hamiltonians and their densities, the spin chain is known to carry an algebra of symmetry operators commuting with the Hamiltonian, and these operators have an interesting representation as matrix-product-operators (MPOs). On the other hand, fusion categories are well-known to arise from a von Neumann algebra-subfactor pair. In this work, we investigate some interesting consequences of such structures for the corresponding anyonic spin-chain model. One of our main results is the construction of a novel algebra of MPOs acting on a bi-partite anyonic chain. We show that this algebra is precisely isomorphic to the defect algebra of $1+1$ CFTs as constructed by Fr\" ohlich et al. and Bischoff et al., even though the model is defined on a finite lattice. We thus conjecture that its central projections are associated with the irreducible vertical (transparent) defects in the scaling limit of the model. Our results partly rely on the observation that MPOs are closely related to the so-called ``double triangle algebra'' arising in subfactor theory. In our subsequent constructions, we use insights into the structure of the double triangle algebra by B\" ockenhauer et al. based on the braided structure of the categories and on $\alpha$-induction. The introductory section of this paper to subfactors and fusion categories has the character of a review.

categories: cond-mat.str-el hep-th math-ph math.MP math.OA


title: Reconstructing bulk equation of motion using CFT modular Hamiltonians

abstract: In the framework of bulk reconstruction, we elucidate the relationship between the action of CFT modular Hamiltonians on bulk operators, the possible equation of motion for the bulk operators, and the charge distribution at infinity corresponding to such bulk fields. In particular for scalar fields interacting with gravity or with gauge fields, we show how CFT considerations of the action of the modular Hamiltonian constrain the possible bulk equation of motion to be consistent with bulk gauge invariance and diffeomorphism invariance. In fact we show that requiring that the action of the modular Hamiltonian on a dressed bulk scalar operator be compatible with some unknown simple equation of motion, fixes, under reasonable assumptions, both the equation of motion and the action of the modular Hamiltonian once the first order $\frac{1}{N}$ terms are known.


title: Residual Q-Networks for Value Function Factorizing in Multi-Agent Reinforcement Learning

abstract: Multi-Agent Reinforcement Learning (MARL) is useful in many problems that require the cooperation and coordination of multiple agents. Learning optimal policies using reinforcement learning in a multi-agent setting can be very difficult as the number of agents increases. Recent solutions such as Value Decomposition Networks (VDN), QMIX, QTRAN and QPLEX adhere to the centralized training and decentralized execution scheme and perform factorization of the joint action-value functions. However, these methods still suffer from increased environmental complexity, and at times fail to converge in a stable manner. We propose a novel concept of Residual Q-Networks (RQNs) for MARL, which learns to transform the individual Q-value trajectories in a way that preserves the Individual-Global-Max criteria (IGM), but is more robust in factorizing action-value functions. The RQN acts as an auxiliary network that accelerates convergence and will become obsolete as the agents reach the training objectives. The performance of the proposed method is compared against several state-of-the-art techniques such as QPLEX, QMIX, QTRAN and VDN, in a range of multi-agent cooperative tasks. The results illustrate that the proposed method, in general, converges faster, with increased stability and shows robust performance in a wider family of environments. The improvements in results are more prominent in environments with severe punishments for non-cooperative behaviours and especially in the absence of complete state information during training time.


title: On the construction of monopoles with arbitrary symmetry breaking

abstract: We produce finite energy BPS monopoles with prescribed arbitrary symmetry breaking from a new class of solutions to Nahm's equation.


title: Constructing CFTs from AdS flows

abstract: We study the renormalization group flow equations for correlation functions of weakly coupled quantum field theories in AdS. Taking the limit where the external points approach the conformal boundary, we obtain a flow of conformally invariant correlation functions. We solve the flow for one- and two-point functions and show that the corrections to the conformal dimensions can be obtained as an integral over the Mellin amplitude of the four-point function. We also derive the flow of the Mellin amplitude for higher $n$-point functions. We then consider the flows at tree level and one loop (in AdS), and show that one obtains exactly the recursion relations for the corresponding Mellin amplitudes derived earlier by Fitzpatrick et al. [arXiv:1107.1499] at tree level and Yuan [arXiv:1710.01361,arXiv:1801.07283] at one loop. As an application, we furthermore compute one-loop corrections to the conformal dimensions for some operators in the CFT dual to an $\mathrm{O}(N)$ scalar model in AdS.


title: Direct measurement of the Wigner function of atoms in an optical trap

abstract: We present a scheme that uses Ramsey interferometry to directly probe the Wigner function of a neutral atom confined in an optical trap. The proposed scheme relies on the well-established fact that the Wigner function at a given point $(x,p)$ in phase space is proportional to the expectation value of the parity operator relative to that point. In this work, we show that parity-even and parity-odd motional states can be mapped to two distinct internal states of the atom by using state-dependent trapping potentials. The Wigner function can thus be measured point-by-point in phase space with a single, direct measurement of the internal state population. Numerical simulations show that the scheme is robust in that it applies not only to deep, harmonic potentials but also to shallower, anharmonic traps.


title: Composite pseudo Nambu Goldstone Quintessence

abstract: A pseudo-Nambu Goldstone Boson (pNGB) arising from the breaking of a global symmetry ($G\rightarrow H$) can be one of the most promising candidates for the quintessence model, to explain the late-time acceleration of our universe. Motivated from the Composite Higgs scenario, we have investigated the case where the pNGB associated with $SO(N)/ SO(N-1)$ develops a potential through its couplings with the particles that do not form the complete representations of $G$. The Coleman Weinberg (CW) potential is generated via the external particles in the loop which are linked with the strongly interacting dynamics and can be computed predicatively. The model of Dark Energy (DE) is tested against several latest cosmological observations such as supernovae data of Pantheon, Baryon Acoustic Oscillation (BAO), Redshift-space distortion (RSD) data, etc. We have found that the fit prefers the sub-Planckian value of the pNGB field decay constant. Moreover, we have found that the model predicts cosmological parameters well within the allowed range of the observation and thus gives a well-motivated model of quintessence.


title: Notes on the runtime of A* sampling

abstract: The challenge of simulating random variables is a central problem in Statistics and Machine Learning. Given a tractable proposal distribution $P$, from which we can draw exact samples, and a target distribution $Q$ which is absolutely continuous with respect to $P$, the A* sampling algorithm allows simulating exact samples from $Q$, provided we can evaluate the Radon-Nikodym derivative of $Q$ with respect to $P$. Maddison et al. originally showed that for a target distribution $Q$ and proposal distribution $P$, the runtime of A* sampling is upper bounded by $\mathcal{O}(\exp(D_{\infty}[Q||P]))$ where $D_{\infty}[Q||P]$ is the Renyi divergence from $Q$ to $P$. This runtime can be prohibitively large for many cases of practical interest. Here, we show that with additional restrictive assumptions on $Q$ and $P$, we can achieve much faster runtimes. Specifically, we show that if $Q$ and $P$ are distributions on $\mathbb{R}$ and their Radon-Nikodym derivative is unimodal, the runtime of A* sampling is $\mathcal{O}(D_{\infty}[Q||P])$, which is exponentially faster than A* sampling without assumptions.


title: Virtual excitations and quantum correlations in ultra-strongly coupled harmonic oscillators under intrinsic decoherence

abstract: We study the intrinsic decoherence of coupled harmonic oscillators. The Milburn master equation is solved exactly, and the dynamics of virtual ground state excitations are investigated. The interaction of quantum correlations and virtual excitation was then studied. The following is a summary of our major findings. (i) The damped oscillatory profile of all three quantities is the same. (ii) Ultra-strong coupling combined with huge anisotropy values results in the reemergence of entanglement and steering. (iii) To sustain entanglement and steering, virtual excitations are required. (iv) The quantum correlations are amplified in the quantum synchronous regime. (v) Ultra-strong couplings cause inherent decoherence to be avoided.


title: Link between Weyl-fermion chirality and spin texture

abstract: Topological semimetals have recently attracted great attention due to prospective applications governed by their peculiar Fermi surfaces. Weyl semimetals host chiral fermions that manifest as pairs of non-degenerate massless Weyl points in their electronic structure, giving rise to novel macroscopic quantum phenomena such as the chiral anomaly, an unusual magnetoresistance, and various kinds of Hall effects These properties enable the engineering of non-local electric transport devices, magnetic sensors and memories, and spintronics devices. Nevertheless, little is known about the underlying spin- and orbital-degrees of freedom of the electron wave functions in Weyl semimetals, that govern the electric transport. Here, we give evidence that the chirality of the Weyl points in the Type-II Weyl semimetal MoTe$_2$ is directly linked to the spin texture and orbital angular momentum of the electron wave functions. By means of state-of-the-art spin- and momentum-resolved photoemission spectroscopy the spin- and orbital texture in the Fermi surface is directly resolved. Supported by first-principles calculations, we examined the relationship between the topological chiral charge and spin texture, which significantly contributes to the understanding of the electronic structure in topological quantum materials.


title: Measurement and control of a superconducting quantum processor with a fully-integrated radio-frequency system on a chip

abstract: We describe a digital microwave platform called Presto, designed for measurement and control of multiple quantum bits (qubits) and based on the third-generation radio-frequency system on a chip. Presto uses direct digital synthesis to create signals up to 9 GHz on 16 synchronous output ports, while synchronously analyzing response on 16 input ports. Presto has 16 DC-bias outputs, 4 inputs and 4 outputs for digital triggers or markers, and two continuous-wave outputs for synthesizing frequencies up to 15 GHz. Scaling to a large number of qubits is enabled through deterministic synchronization of multiple Presto units. A Python application programming interface configures a firmware for synthesis and analysis of pulses, coordinated by an event sequencer. The analysis integrates template matching (matched filtering) and low-latency (184 - 254 ns) feedback to enable a wide range of multi-qubit experiments. We demonstrate Presto's capabilities with experiments on a sample consisting of two superconducting qubits connected via a flux-tunable coupler. We show single-shot readout and active reset of a single qubit; randomized benchmarking of single-qubit gates showing 99.972% fidelity, limited by the coherence time of the qubit; and calibration of a two-qubit iSWAP gate.


title: Pooling Revisited: Your Receptive Field is Suboptimal

abstract: The size and shape of the receptive field determine how the network aggregates local information and affect the overall performance of a model considerably. Many components in a neural network, such as kernel sizes and strides for convolution and pooling operations, influence the configuration of a receptive field. However, they still rely on hyperparameters, and the receptive fields of existing models result in suboptimal shapes and sizes. Hence, we propose a simple yet effective Dynamically Optimized Pooling operation, referred to as DynOPool, which optimizes the scale factors of feature maps end-to-end by learning the desirable size and shape of its receptive field in each layer. Any kind of resizing modules in a deep neural network can be replaced by the operations with DynOPool at a minimal cost. Also, DynOPool controls the complexity of a model by introducing an additional loss term that constrains computational cost. Our experiments show that the models equipped with the proposed learnable resizing module outperform the baseline networks on multiple datasets in image classification and semantic segmentation.


title: Superradiance and subradiance in a gas of two-level atoms

abstract: Cooperative effects describe atomic ensembles with exchange of photonic excitations, such as dipole-dipole interactions. As a particular example, superradiance arises from spontaneous emission when this exchange leads to constructive interference of the emitted photons. Here, we introduce an integrated method for studying cooperative radiation in many-body systems. This method, which allows to study extended systems with arbitrarily large number of particles can be formulated by an effective, nonlinear, two-atom master equation that describes the dynamics using a closed form which treats single- and many-body terms on an equal footing. We apply this method to a homogeneous gas of initially inverted two-level atoms, and demonstrate the appearance of both superradiance and subradiance, identifying a many-body coherence term as the source of these cooperative effects. We describe the many-body induced broadening - which is analytically found to scale with the optical depth of the system - and light shifts, and distinguish spontaneous effects from induced ones. In addition, we theoretically predict the time-dependence of subradiance, and the phase change of the radiated field during the cooperative decay.


title: Towards near-term quantum simulation of materials

abstract: Simulation of materials is one of the most promising applications of quantum computers. On near-term hardware the crucial constraint on these simulations is circuit depth. Many quantum simulation algorithms rely on a layer of unitary evolutions generated by each term in a Hamiltonian. This appears in time-dynamics as a single Trotter step, and in variational quantum eigensolvers under the Hamiltonian variational ansatz as a single ansatz layer. We present a new quantum algorithm design for materials modelling where the depth of a layer is independent of the system size. This design takes advantage of the locality of materials in the Wannier basis and employs a tailored fermionic encoding that preserves locality. We analyse the circuit costs of this approach and present a compiler that transforms density functional theory data into quantum circuit instructions -- connecting the physics of the material to the simulation circuit. The compiler automatically optimises circuits at multiple levels, from the base gate level to optimisations derived from the physics of the specific target material. We present numerical results for materials spanning a wide structural and technological range. Our results demonstrate a reduction of many orders of magnitude in circuit depth over standard prior methods that do not consider the structure of the Hamiltonian. For example our results improve resource requirements for Strontium Vanadate (SrVO$_3$) from 864 to 180 qubits for a $3\times3\times3$ lattice, and the circuit depth of a single Trotter or variational layer from $7.5\times 10^8$ to depth $884$. Although this is still beyond current hardware, our results show that materials simulation may be feasible on quantum computers without necessarily requiring scalable, fault-tolerant quantum computers, provided quantum algorithm design incorporates understanding of the materials and applications.


title: Nodal solutions for quasilinear Schr\"{o}dinger equations with asymptotically 3-linear nonlinearity

abstract: In this paper, we are concerned with the quasilinear Schr\"{o}dinger equation \begin{equation*} -\Delta u+V(x)u-u\Delta(u^2)=g(u),\ \ x\in \mathbb{R}^{N}, \end{equation*} where $N\geq3$, $V$ is radially symmetric and nonnegative, and $g$ is asymptotically 3-linear at infinity. In the case of $\inf_{\mathbb{R}^N}V>0$, we show the existence of a least energy sign-changing solution with exactly one node, and for any integer $k>0$, there are a pair of sign-changing solutions with $k$ nodes. Moreover, in the case of $\inf_{\mathbb{R}^N}V=0$, the problem above admits a least energy sign-changing solution with exactly one node. The proof is based on variational methods. In particular, some new tricks and the method of sign-changing Nehari manifold depending on a suitable restricted set are introduced to overcome the difficulty resulting from the appearance of asymptotically 3-linear nonlinearities.


title: Transparency, Governance and Regulation of Algorithmic Tools Deployed in the Criminal Justice System: a UK Case Study

abstract: We present a survey of tools used in the criminal justice system in the UK in three categories: data infrastructure, data analysis, and risk prediction. Many tools are currently in deployment, offering potential benefits, including improved efficiency and consistency. However, there are also important concerns. Transparent information about these tools, their purpose, how they are used, and by whom is difficult to obtain. Even when information is available, it is often insufficient to enable a satisfactory evaluation. More work is needed to establish governance mechanisms to ensure that tools are deployed in a transparent, safe and ethical way. We call for more engagement with stakeholders and greater documentation of the intended goal of a tool, how it will achieve this goal compared to other options, and how it will be monitored in deployment. We highlight additional points to consider when evaluating the trustworthiness of deployed tools and make concrete proposals for policy.


title: Passivity, Port-Hamiltonian Formulation and Solution Estimates for a Coupled Magneto-Quasistatic System

abstract: We study a~quasilinear coupled magneto-quasistatic model from a~systems theoretic perspective.} First, by taking the injected voltages as input and the associated currents as output, we prove that the magneto-quasistatic system is passive. Moreover, by defining suitable Dirac and resistive structures, we show that it admits a~representation as a~port-Hamiltonian system. Thereafter, we consider dependence on initial and input data. We show that the current and the magnetic vector potential can be estimated by means of the initial magnetic vector potential and the voltage. We also analyse the free dynamics of the system and study the asymptotic behavior of the solutions for $t\to\infty$.


title: Generalized Quadrangles Of Order $(s, s^2)$. IV. Translations, Moufang And Fong-Seitz

abstract: In the period 1994-1999 Thas wrote a series of three papers on generalized quadrangles of order $(s, s^2)$. In this Part IV we classify all finite translation generalized quadrangles of order $(s, s^2)$ having a kernel of size at least 3, containing a regular line not incident with the translation point. There are several applications on generalized quadrangles of order $(s, s^2)$ having at least 2 translation points, on Moufang quadrangles, and concerning the theorem of Fong and Seitz classifying all groups with a BN-pair of rank 2.


title: A Case Study of Small Field Inflationary Dynamics in the Einstein-Gauss Bonnet Framework in the Light of $GW170817$

abstract: We study two of the most theoretically promising models of inflation, namely the Natural inflation and the Mutated Hilltop inflation, in the Einstein-Gauss Bonnet(EGB) gravity framework. In this work, we try to explore these models in EGB framework, keeping the observations from $GW170817$ on the speed of gravitational wave to be equal to the speed of light. This has direct implication on the non-minimal coupling to the Gauss-Bonnet invariant in the action. Thus, the effective potential gets new features. We have not only analysed the inflationary dynamics, but also the reheating dynamics and finally the corresponding energy spectrum of the gravitational wave.


title: Geometrical frustration versus Kitaev interactions in BaCo$_2$(AsO$_4$)$_2$

abstract: Recently, Co-based honeycomb magnets have been proposed as promising candidate materials to host the Kitaev spin liquid state. One of the front-runners is BaCo$_2$(AsO$_4$)$_2$ (BCAO), where it was suggested that the exchange processes between Co$^{2+}$ ions via the surrounding edge-sharing oxygen octahedra could give rise to bond-dependent Kitaev interactions. In this work, we present and analyze comprehensive inelastic neutron scattering studies of BCAO with fields in the honeycomb plane. Combining the constraints from the magnon excitations in the high-field polarized state and the inelastic spin structure factor measured in zero magnetic field, we examine two leading theoretical models: the Kitaev-type \JKG model and the \XXZ model. We show that the existing experimental data can be consistently accounted for by the \XXZ model but not by the \JKG model, and we discuss the implications of these results for the realization of a spin liquid phase in BCAO and more generally for the realization of the Kitaev model in cobaltates.


title: bsnsing: A decision tree induction method based on recursive optimal boolean rule composition

abstract: This paper proposes a new mixed-integer programming (MIP) formulation to optimize split rule selection in the decision tree induction process, and develops an efficient search algorithm that is able to solve practical instances of the MIP model faster than commercial solvers. The formulation is novel for it directly maximizes the Gini reduction, an effective split selection criterion which has never been modeled in a mathematical program for its nonconvexity. The proposed approach differs from other optimal classification tree models in that it does not attempt to optimize the whole tree, therefore the flexibility of the recursive partitioning scheme is retained and the optimization model is more amenable. The approach is implemented in an open-source R package named bsnsing. Benchmarking experiments on 75 open data sets suggest that bsnsing trees are the most capable of discriminating new cases compared to trees trained by other decision tree codes including the rpart, C50, party and tree packages in R. Compared to other optimal decision tree packages, including DL8.5, OSDT, GOSDT and indirectly more, bsnsing stands out in its training speed, ease of use and broader applicability without losing in prediction accuracy.


title: Non-Abelian Vortices in Magnets

abstract: We show that non-Abelian vortices can exist in magnetic materials. These are singularity-free textures, are described by spin-lattice and field theory models, and we demonstrate that typical magnetic materials can be quite suitable for their realization and observation. We give a topological classification of these vortices and reveal their connection with Abelian topological structures, such as usual vortices, merons and skyrmions. We also describe how non-Abelian magnetic vortices can carry topologically protected information and present reasons for the advantage of such information carriers, as compared to Abelian entities.


title: Going Beyond One-Hot Encoding in Classification: Can Human Uncertainty Improve Model Performance?

abstract: Technological and computational advances continuously drive forward the broad field of deep learning. In recent years, the derivation of quantities describing theuncertainty in the prediction - which naturally accompanies the modeling process - has sparked general interest in the deep learning community. Often neglected in the machine learning setting is the human uncertainty that influences numerous labeling processes. As the core of this work, label uncertainty is explicitly embedded into the training process via distributional labels. We demonstrate the effectiveness of our approach on image classification with a remote sensing data set that contains multiple label votes by domain experts for each image: The incorporation of label uncertainty helps the model to generalize better to unseen data and increases model performance. Similar to existing calibration methods, the distributional labels lead to better-calibrated probabilities, which in turn yield more certain and trustworthy predictions.


title: (Spectral) Chebyshev collocation methods for solving differential equations

abstract: Recently, the efficient numerical solution of Hamiltonian problems has been tackled by defining the class of energy-conserving Runge-Kutta methods named Hamiltonian Boundary Value Methods (HBVMs). Their derivation relies on the expansion of the vector field along the Legendre orthonormal basis. Interestingly, this approach can be extended to cope with other orthonormal bases and, in particular, we here consider the case of the Chebyshev polynomial basis. The corresponding Runge-Kutta methods were previously obtained by Costabile and Napoli [33]. In this paper, the use of a different framework allows us to carry out a novel analysis of the methods also when they are used as spectral formulae in time, along with some generalizations of the methods.


title: Double Null Data and the Characteristic Problem in General Relativity

abstract: General hypersurfaces of any causal character can be studied abstractly using the hypersurface data formalism. In the null case, we write down all tangential components of the ambient Ricci tensor in terms of the abstract data. Using this formalism, we formulate and solve in a completely abstract way the characteristic Cauchy problem of the Einstein vacuum field equations. The initial data is detached from any spacetime notion, and it is fully diffeomorphism and gauge covariant. The results of this paper put the characteristic problem on a similar footing as the standard Cauchy problem in General Relativity.


title: Federated X-Armed Bandit

abstract: This work establishes the first framework of federated $\mathcal{X}$-armed bandit, where different clients face heterogeneous local objective functions defined on the same domain and are required to collaboratively figure out the global optimum. We propose the first federated algorithm for such problems, named \texttt{Fed-PNE}. By utilizing the topological structure of the global objective inside the hierarchical partitioning and the weak smoothness property, our algorithm achieves sublinear cumulative regret with respect to both the number of clients and the evaluation budget. Meanwhile, it only requires logarithmic communications between the central server and clients, protecting the client privacy. Experimental results on synthetic functions and real datasets validate the advantages of \texttt{Fed-PNE} over various centralized and federated baseline algorithms.


title: Kernel Neural Optimal Transport

abstract: We study the Neural Optimal Transport (NOT) algorithm which uses the general optimal transport formulation and learns stochastic transport plans. We show that NOT with the weak quadratic cost might learn fake plans which are not optimal. To resolve this issue, we introduce kernel weak quadratic costs. We show that they provide improved theoretical guarantees and practical performance. We test NOT with kernel costs on the unpaired image-to-image translation task.


title: SAT-Based Extraction of Behavioural Models for Java Libraries with Collections

abstract: Behavioural models are a valuable tool for software verification, testing, monitoring, publishing etc. However, they are rarely provided by the software developers and have to be extracted either from the source or from the compiled code. In the context of Java programs, a number of approaches exist for building behavioural models. Most of these approaches rely on the analysis of the compiled bytecode. Instead, we are looking to extract behavioural models in the form of Finite State Machines (FSMs) from the Java source code to ensure that the obtained FSMs can be easily understood by the software developers and, if necessary, updated or integrated into the original source code, e.g. in the form of annotations. Modern software systems are huge, rely on external libraries and interact with their environment. Hence, extracting useful behavioural models requires abstraction. In this paper, we present an initial approach to this problem by focusing on the extraction of FSMs modelling library APIs. We focus on the analysis of Java code involving the use of collections. To this end, we encode the operational semantics of collection operations using patterns of Boolean predicates. These patterns are instantiated based on the analysis of the source code of API implementation methods to form an encoding of the possible FSM transitions. A SAT solver is then used to determine the enabledness conditions (guards) of these transitions.


title: MetaSSD: Meta-Learned Self-Supervised Detection

abstract: Deep learning-based symbol detector gains increasing attention due to the simple algorithm design than the traditional model-based algorithms such as Viterbi and BCJR. The supervised learning framework is often employed to predict the input symbols, where training symbols are used to train the model. There are two major limitations in the supervised approaches: a) a model needs to be retrained from scratch when new train symbols come to adapt to a new channel status, and b) the length of the training symbols needs to be longer than a certain threshold to make the model generalize well on unseen symbols. To overcome these challenges, we propose a meta-learning-based self-supervised symbol detector named MetaSSD. Our contribution is two-fold: a) meta-learning helps the model adapt to a new channel environment based on experience with various meta-training environments, and b) self-supervised learning helps the model to use relatively less supervision than the previously suggested learning-based detectors. In experiments, MetaSSD outperforms OFDM-MMSE with noisy channel information and shows comparable results with BCJR. Further ablation studies show the necessity of each component in our framework.


title: Regularity of capillarity droplets with obstacle

abstract: In this paper we study the regularity properties of $\Lambda$-minimizers of the capillarity energy in a half space with the wet part constrained to be confined inside a given planar region. Applications to a model for nanowire growth are also provided.


title: Principal frequency, super-bandwidth, and low-order harmonics generated by super-oscillatory pulses

abstract: An alternative definition to the main frequency of an ultra-short laser pulse, named principal frequency ($\omega_P$), was recently introduced in E.G. Neyra, et al. Phys. Rev. A 103, 053124 (2021), resulting in a more transparent description of the nonlinear dynamics of a system driven by this coherent source. In this work, we extend the definition of $\omega_P$ incorporating the spectral phase of the pulse. This upgraded definition allow us to deal with super-oscillatory pulses as well as to characterize sub-cycle pulses with a complex spectral content. Simultaneously, we study the nonlinear interaction between a few-cycle super-oscillatory pulse with a gaseous system, analysing the spectral characteristics of the fundamental, third and fifth harmonics. Here, we make use of an \textit{ab-initio} quantum mechanical approach, supplemented with a wavelet analysis. We show that the spectral characteristics of the low-order harmonics are very well explained in terms of $\omega_P$, as well as the effective bandwidth of the super-oscillatory pulse. Our findings reinforce previous results that showed an increase of the effective bandwidth in the super-oscillatory region and the possibility to generate unique frequencies by a linear synthesis. We open, thus, not only new perspectives in ultrafast optics, exploring novel pathways towards the generation of fully tunable strong and short coherent sources, but also discuss possible extensions of the concepts presented here to other wave phenomena, that can be found in acoustics, signal processing or quantum mechanics.


title: Upgraded GMRT survey for pulsars in globular clusters. I: Discovery of a millisecond binary pulsar in NGC 6652

abstract: Globular clusters contain a unique pulsar population, with many exotic systems that can form only in their dense stellar environments. The leap in sensitivity of the upgraded Giant Metrewave Radio Telescope (uGMRT) in India, especially at low radio frequencies ($<$ 1 GHz) has motivated a new search for radio pulsars in a group of eight Southern globular clusters. We discovered PSR J1835$-$3259B, a 1.83-ms pulsar in NGC 6652; this is in a near-circular wide orbit of 28.7 hr with a low-mass ($ \sim 0.2 \, M_{\rm \odot}$) companion, likely a Helium white dwarf. We derived a 10-year timing solution for this system. We also present measurements of scattering, flux densities and spectral indices for some of the previously known pulsars in these GCs. A significant fraction of the pulsars in these clusters have steep spectral indices. Additionally, we detected eight radio point sources not associated with any known pulsar positions in the radio images. There are four newly identified sources, three in NGC 6652 and one in NGC 6539, and one previously identified source each in NGC 1851, NGC 6440, NGC 6544, and Terzan 5. Surprisingly, our images show that our newly discovered pulsar, PSR J1835$-$3259B, is the brightest pulsar in all GCs we have imaged; like other pulsars with broad profiles (Terzan 5 C and O), its flux density in the radio images is much larger than in its pulsations. This indicates that their pulsed emission is only a fraction of their total emission. The detection of radio sources outside the core radii but well within the tidal radii of these clusters show that future GC surveys should complement the search analysis by using the imaging capability of interferometers, and preferentially synthesize large number of search beams in order to obtain a larger field of view.


title: Relative Interlevel Set Cohomology Categorifies Extended Persistence Diagrams

abstract: The extended persistence diagram introduced by Cohen-Steiner, Edelsbrunner, and Harer is an invariant of real-valued continuous functions, which are $\mathbb{F}$-tame in the sense that all open interlevel sets have degree-wise finite-dimensional cohomology with coefficients in a fixed field $\mathbb{F}$. We show that relative interlevel set cohomology (RISC), which is based on the Mayer--Vietoris pyramid by Carlsson, de Silva, and Morozov, categorifies this invariant. More specifically, we define an abelian Frobenius category $\mathrm{pres}(\mathcal{J})$ of presheaves, which are presentable in a certain sense, such that the RISC $h(f)$ of an $\mathbb{F}$-tame function $f \colon X \rightarrow \mathbb{R}$ is an object of $\mathrm{pres}(\mathcal{J})$, and moreover the extended persistence diagram of $f$ uniquely determines - and is determined by - the corresponding element $[h(f)] \in K_0 (\mathrm{pres}(\mathcal{J}))$ in the Grothendieck group $K_0 (\mathrm{pres}(\mathcal{J}))$ of the abelian category $\mathrm{pres}(\mathcal{J})$. As an intermediate step we show that $\mathrm{pres}(\mathcal{J})$ is the abelianization of the (localized) category of complexes of $\mathbb{F}$-linear sheaves on $\mathbb{R}$, which are tame in the sense that sheaf cohomology of any open interval is finite-dimensional in each degree. This yields a close link between derived level set persistence by Curry, Kashiwara, and Schapira and the categorification of extended persistence diagrams.


title: Multi-Object Grasping -- Types and Taxonomy

abstract: This paper proposes 12 multi-object grasps (MOGs) types from a human and robot grasping data set. The grasp types are then analyzed and organized into a MOG taxonomy. This paper first presents three MOG data collection setups: a human finger tracking setup for multi-object grasping demonstrations, a real system with Barretthand, UR5e arm, and a MOG algorithm, a simulation system with the same settings as the real system. Then the paper describes a novel stochastic grasping routine designed based on a biased random walk to explore the robotic hand's configuration space for feasible MOGs. Based on observations in both the human demonstrations and robotic MOG solutions, this paper proposes 12 MOG types in two groups: shape-based types and function-based types. The new MOG types are compared using six characteristics and then compiled into a taxonomy. This paper then introduces the observed MOG type combinations and shows examples of 16 different combinations.


title: Micro-Bose/Proca dark matter stars from black hole superradiance

abstract: We study the production of heavy, $\mu \gtrsim 1$ TeV, bosonic spin $s=0,1$ dark matter (DM) via the simultaneous processes of Hawking evaporation and superradiance (SR) from an initial population of small, $\lesssim 10^6$ kg, primordial black holes (PBHs). Even for small initial PBH spins the SR process can produce extremely dense gravitationally-bound DM Bose or Proca soliton "stars" of radius $\lesssim {\rm pm}$ and mass $\sim 10^{\rm few}$ kg that can survive to today, well after PBH decay. These solitons can constitute a significant fraction of the DM density, rising to $\gtrsim 50\%$ in the vector DM case.


title: EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model

abstract: Although significant progress has been made to audio-driven talking face generation, existing methods either neglect facial emotion or cannot be applied to arbitrary subjects. In this paper, we propose the Emotion-Aware Motion Model (EAMM) to generate one-shot emotional talking faces by involving an emotion source video. Specifically, we first propose an Audio2Facial-Dynamics module, which renders talking faces from audio-driven unsupervised zero- and first-order key-points motion. Then through exploring the motion model's properties, we further propose an Implicit Emotion Displacement Learner to represent emotion-related facial dynamics as linearly additive displacements to the previously acquired motion representations. Comprehensive experiments demonstrate that by incorporating the results from both modules, our method can generate satisfactory talking face results on arbitrary subjects with realistic emotion patterns.


title: The openESEA Modelling Language for Ethical, Social and Environmental Accounting: Technical Report

abstract: Over the years ethical, social and environmental accounting (ESEA) has become a common practice among responsible organisations. ESEA entails assessing and reporting organisations" performance on environmental, social and governance topics. In this report, we present a textual grammar for specifying ESEA methods. With the grammar ESEA models can be created. Such models can be interpreted by our open-source, model-driven tool, called openESEA. The report presents the metamodel of the grammar, the grammar itself, and explanations of each grammar primitive.


title: Testing for Geometric Invariance and Equivariance

abstract: Invariant and equivariant models incorporate the symmetry of an object to be estimated (here non-parametric regression functions $f : \mathcal{X} \rightarrow \mathbb{R}$). These models perform better (with respect to $L^2$ loss) and are increasingly being used in practice, but encounter problems when the symmetry is falsely assumed. In this paper we present a framework for testing for $G$-equivariance for any semi-group $G$. This will give confidence to the use of such models when the symmetry is not known a priori. These tests are independent of the model and are computationally quick, so can be easily used before model fitting to test their validity.


title: Learning Open Domain Multi-hop Search Using Reinforcement Learning

abstract: We propose a method to teach an automated agent to learn how to search for multi-hop paths of relations between entities in an open domain. The method learns a policy for directing existing information retrieval and machine reading resources to focus on relevant regions of a corpus. The approach formulates the learning problem as a Markov decision process with a state representation that encodes the dynamics of the search process and a reward structure that minimizes the number of documents that must be processed while still finding multi-hop paths. We implement the method in an actor-critic reinforcement learning algorithm and evaluate it on a dataset of search problems derived from a subset of English Wikipedia. The algorithm finds a family of policies that succeeds in extracting the desired information while processing fewer documents compared to several baseline heuristic algorithms.


title: Axisymmetric Ridges and Circumferential Buckling of Indented Shells of Revolution

abstract: When poking a thin shell-like structure, like a plastic water bottle, experience shows that an initial axisymmetric dimple forms around the indentation point. The ridge of this dimple, with increasing indentation, eventually buckles into a polygonal shape. The polygon order generally continues to increase with further indentation. In the case of spherical shells, both the underlying axisymmetric deformation and the buckling evolution have been studied in detail. However, little is known about the behaviour of general geometries. In this work we describe the geometrical and mechanical features of the axisymmetric ridge that forms in indented general shells of revolution with non-negative Gaussian curvature and the conditions for circumferential buckling of this ridge. We show that, under the assumption of `mirror buckling' a single unified description of this ridge can be written if the problem is non-dimensionalised using the local slope of the undeformed shell mid-profile at the ridge radial location. In dimensional form the ridge properties evolve in quite different ways for different mid-profiles. Focusing on the indentation of shallow shells of revolution with constant Gaussian curvature, we use our theoretical framework to study the properties of the ridge at the circumferential buckling threshold and evaluate the validity of the mirror buckling assumption against a linear stability analysis on the shallow shell equations, showing very good agreement. Our results highlight that circumferential buckling in indented thin shells is controlled by a complex interplay between the geometry and the stress state in the ridge. The results of our study will provide greater insight into the mechanics of thin shells. This could enable indentation to be used to measure the mechanical properties of a wide range of shell geometries or used to design shells with specific mechanical behaviours.


title: Seifert surfaces in the 4-ball

abstract: We answer a question of Livingston from 1982 by producing Seifert surfaces of the same genus for a knot in $S^3$ that do not become isotopic when their interiors are pushed into $B^4$. In particular, we identify examples where the surfaces are not even topologically isotopic in $B^4$, examples that are topologically but not smoothly isotopic, and examples of infinite families of surfaces that are distinct only up to isotopy rel. boundary. Our main proofs distinguish surfaces using the cobordism maps on Khovanov homology, and our calculations demonstrate the stability and computability of these maps under certain satellite operations.


title: The Bose gas in a box with Neumann boundary conditions

abstract: We consider a gas of bosonic particles confined in a box with Neumann boundary conditions. We prove Bose-Einstein condensation in the Gross-Pitaevskii regime, with an optimal bound on the condensate depletion. Our lower bound for the ground state energy in the box implies (via Neumann bracketing) a lower bound for the ground state energy of the Bose gas in the thermodynamic limit.


title: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels

abstract: Neural radiance fields (NeRF) have shown great success in modeling 3D scenes and synthesizing novel-view images. However, most previous NeRF methods take much time to optimize one single scene. Explicit data structures, e.g. voxel features, show great potential to accelerate the training process. However, voxel features face two big challenges to be applied to dynamic scenes, i.e. modeling temporal information and capturing different scales of point motions. We propose a radiance field framework by representing scenes with time-aware voxel features, named as TiNeuVox. A tiny coordinate deformation network is introduced to model coarse motion trajectories and temporal information is further enhanced in the radiance network. A multi-distance interpolation method is proposed and applied on voxel features to model both small and large motions. Our framework significantly accelerates the optimization of dynamic radiance fields while maintaining high rendering quality. Empirical evaluation is performed on both synthetic and real scenes. Our TiNeuVox completes training with only 8 minutes and 8-MB storage cost while showing similar or even better rendering performance than previous dynamic NeRF methods.


title: Robust and accelerated single-spike spiking neural network training with applicability to challenging temporal tasks

abstract: Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to train due to their dynamic and non-differentiable nature, where current solutions are either slow or suffer from training instabilities. These networks have also been critiqued for their limited computational applicability such as being unsuitable for time-series datasets. We propose a new model for training single-spike SNNs which mitigates the aforementioned training issues and obtains competitive results across various image and neuromorphic datasets, with up to a $13.98\times$ training speedup and up to an $81\%$ reduction in spikes compared to the multi-spike SNN. Notably, our model performs on par with multi-spike SNNs in challenging tasks involving neuromorphic time-series datasets, demonstrating a broader computational role for single-spike SNNs than previously believed.


title: On the boundary at infinity for branching random walk

abstract: We prove that supercritical branching random walk on a transient graph converges almost surely under rescaling to a random measure on the Martin boundary of the graph. Several open problems and conjectures about this limiting measure are presented.


title: Self-Supervised Visual Representation Learning with Semantic Grouping

abstract: In this paper, we tackle the problem of learning visual representations from unlabeled scene-centric data. Existing works have demonstrated the potential of utilizing the underlying complex structure within scene-centric data; still, they commonly rely on hand-crafted objectness priors or specialized pretext tasks to build a learning framework, which may harm generalizability. Instead, we propose contrastive learning from data-driven semantic slots, namely SlotCon, for joint semantic grouping and representation learning. The semantic grouping is performed by assigning pixels to a set of learnable prototypes, which can adapt to each sample by attentive pooling over the feature and form new slots. Based on the learned data-dependent slots, a contrastive objective is employed for representation learning, which enhances the discriminability of features, and conversely facilitates grouping semantically coherent pixels together. Compared with previous efforts, by simultaneously optimizing the two coupled objectives of semantic grouping and contrastive learning, our approach bypasses the disadvantages of hand-crafted priors and is able to learn object/group-level representations from scene-centric images. Experiments show our approach effectively decomposes complex scenes into semantic groups for feature learning and significantly benefits downstream tasks, including object detection, instance segmentation, and semantic segmentation. Code is available at: https://github.com/CVMI-Lab/SlotCon.


title: Percolation for two-dimensional excursion clouds and the discrete Gaussian free field

abstract: We study percolative properties of excursion processes and the discrete Gaussian free field (dGFF) in the planar unit disk. We consider discrete excursion clouds, defined using random walks as a two-dimensional version of random interlacements, as well as its scaling limit, defined using Brownian motion. We prove that the critical parameters associated to vacant set percolation for the two models are the same and equal to $\pi/3.$ The value is obtained from a Schramm-Loewner evolution (SLE) computation. Via an isomorphism theorem, we use a generalization of the discrete result that also involves a loop soup (and an SLE computation) to show that the critical parameter associated to level set percolation for the dGFF is strictly positive and smaller than $\sqrt{\pi/2}.$ In particular this entails a strict inequality of the type $h_*<\sqrt{2u_*}$ between the critical percolation parameters of the dGFF and the two-dimensional excursion cloud. Similar strict inequalities are conjectured to hold in a general transient setup.


title: Zero-Shot and Few-Shot Learning for Lung Cancer Multi-Label Classification using Vision Transformer

abstract: Lung cancer is the leading cause of cancer-related death worldwide. Lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC) are the most common histologic subtypes of non-small-cell lung cancer (NSCLC). Histology is an essential tool for lung cancer diagnosis. Pathologists make classifications according to the dominant subtypes. Although morphology remains the standard for diagnosis, significant tool needs to be developed to elucidate the diagnosis. In our study, we utilize the pre-trained Vision Transformer (ViT) model to classify multiple label lung cancer on histologic slices (from dataset LC25000), in both Zero-Shot and Few-Shot settings. Then we compare the performance of Zero-Shot and Few-Shot ViT on accuracy, precision, recall, sensitivity and specificity. Our study show that the pre-trained ViT model has a good performance in Zero-Shot setting, a competitive accuracy ($99.87\%$) in Few-Shot setting ({epoch = 1}) and an optimal result ($100.00\%$ on both validation set and test set) in Few-Shot seeting ({epoch = 5}).


title: An Approach to Ordering Objectives and Pareto Efficient Solutions

abstract: Solutions to multi-objective optimization problems can generally not be compared or ordered, due to the lack of orderability of the single objectives. Furthermore, decision-makers are often made to believe that scaled objectives can be compared. This is a fallacy, as the space of solutions is in practice inhomogeneous without linear trade-offs. We present a method that uses the probability integral transform in order to map the objectives of a problem into scores that all share the same range. In the score space, we can learn which trade-offs are actually possible and develop methods for mapping the desired trade-off back into the preference space. Our results demonstrate that Pareto efficient solutions can be ordered using a low- or no-preference aggregation of the single objectives. When using scores instead of raw objectives during optimization, the process allows for obtaining trade-offs significantly closer to the expressed preference. Using a non-linear mapping for transforming a desired solution in the score space to the required preference for optimization improves this even more drastically.


title: On the solvability of weakly linear systems of fuzzy relation equations

abstract: Systems of fuzzy relation equations and inequalities in which an unknown fuzzy relation is on the one side of the equation or inequality are linear systems. They are the most studied ones, and a vast literature on linear systems focuses on finding solutions and solvability criteria for such systems. The situation is quite different with the so-called weakly linear systems, in which an unknown fuzzy relation is on both sides of the equation or inequality. Precisely, the scholars have only given the characterization of the set of exact solutions to such systems. This paper describes the set of fuzzy relations that solve weakly linear systems to a certain degree and provides ways to compute them. We pay special attention to developing the algorithms for computing fuzzy preorders and fuzzy equivalences that are solutions to some extent to weakly linear systems. We establish additional properties for the set of such approximate solutions over some particular types of complete residuated lattices. We demonstrate the advantage of this approach via many examples that arise from the problem of aggregation of fuzzy networks.


title: Chiral Higher Spin Gravity in (A)dS${}_4$ and secrets of Chern-Simons Matter Theories

abstract: Chiral Higher Spin Gravity with cosmological constant is constructed as a Free Differential Algebra, i.e. at the level of equations of motion, which is a smooth deformation of its flat space cousin arXiv:2205.07794. Chiral Higher Spin Gravity is a unique class of local higher spin theories; its very existence implies that there is a closed and, most likely, integrable sub-sector of Chern-Simons Matter Theories, which has important consequences both for the theories themselves and for three-dimensional bosonization duality.


title: Efficient Phi-Regret Minimization in Extensive-Form Games via Online Mirror Descent

abstract: A conceptually appealing approach for learning Extensive-Form Games (EFGs) is to convert them to Normal-Form Games (NFGs). This approach enables us to directly translate state-of-the-art techniques and analyses in NFGs to learning EFGs, but typically suffers from computational intractability due to the exponential blow-up of the game size introduced by the conversion. In this paper, we address this problem in natural and important setups for the \emph{$\Phi$-Hedge} algorithm -- A generic algorithm capable of learning a large class of equilibria for NFGs. We show that $\Phi$-Hedge can be directly used to learn Nash Equilibria (zero-sum settings), Normal-Form Coarse Correlated Equilibria (NFCCE), and Extensive-Form Correlated Equilibria (EFCE) in EFGs. We prove that, in those settings, the \emph{$\Phi$-Hedge} algorithms are equivalent to standard Online Mirror Descent (OMD) algorithms for EFGs with suitable dilated regularizers, and run in polynomial time. This new connection further allows us to design and analyze a new class of OMD algorithms based on modifying its log-partition function. In particular, we design an improved algorithm with balancing techniques that achieves a sharp $\widetilde{\mathcal{O}}(\sqrt{XAT})$ EFCE-regret under bandit-feedback in an EFG with $X$ information sets, $A$ actions, and $T$ episodes. To our best knowledge, this is the first such rate and matches the information-theoretic lower bound.


title: Gravitational bremsstrahlung from spinning binaries in the post-Minkowskian expansion

abstract: We present a novel calculation of the four-momentum that is radiated into gravitational waves during the scattering of two arbitrarily spinning bodies. Our result, which is accurate to leading order in $G$, to quadratic order in the spins, and to all orders in the velocity, is derived by using a Routhian-based worldline effective field theory formalism in concert with a battery of analytic techniques for evaluating loop integrals. While nonspinning binaries radiate momentum only along the direction of their relative velocity, we show that the inclusion of spins generically allows for momentum loss in all three spatial directions. We also verify that our expression for the radiated energy agrees with the overlapping terms from state-of-the-art calculations in post-Newtonian theory.


title: Tensor Network States with Low-Rank Tensors

abstract: Tensor networks are used to efficiently approximate states of strongly-correlated quantum many-body systems. More generally, tensor network approximations may allow to reduce the costs for operating on an order-$N$ tensor from exponential to polynomial in $N$, and this has become a popular approach for machine learning. We introduce the idea of imposing low-rank constraints on the tensors that compose the tensor network. With this modification, the time and space complexities for the network optimization can be substantially reduced while maintaining high accuracy. We detail this idea for tree tensor network states (TTNS) and projected entangled-pair states. Simulations of spin models on Cayley trees with low-rank TTNS exemplify the effect of rank constraints on the expressive power. We find that choosing the tensor rank $r$ to be on the order of the bond dimension $m$, is sufficient to obtain high-accuracy groundstate approximations and to substantially outperform standard TTNS computations. Thus low-rank tensor networks are a promising route for the simulation of quantum matter and machine learning on large data sets.


title: Exact subcategories, subfunctors of $\operatorname{Ext}$, and some applications

abstract: Let $(\mathcal{A},\mathcal{E})$ be an exact category. We establish basic results that allow one to identify sub(bi)functors of $\operatorname{Ext}_{\mathcal{E}}(-,-)$ using additivity of numerical functions and restriction to subcategories. We also study a small number of these new functors over commutative local rings in details, and find a range of applications from detecting regularity to understanding Ulrich modules.


title: Recognition of near-duplicate periodic patterns by continuous metrics with approximation guarantees

abstract: This paper proposes a rigorous solution to the challenging classification problem of periodic patterns under Euclidean isometry and rigid motion. The 3-dimensional case is practically important for solid crystalline materials (periodic crystals) including all medical drugs that are produced in a rigid tablet form. Many past invariants based on finite subsets fail when a unit cell of a periodic pattern discontinuously changes under almost any perturbation of atoms, which is inevitable due to noise and atomic vibrations. The major problem is not only to find complete invariants (descriptors with no false negatives and no false positives for all periodic patterns) but to design efficient algorithms for distance metrics on these invariants that should continuously behave under noise. The proposed continuous metrics solve this problem in any Euclidean dimension and are algorithmically approximated with small error factors in times that are explicitly bounded in the input size and complexity of a given crystal. The proved Lipschitz continuity allows us to confirm all near-duplicates filtered by simpler invariants in major databases of experimental and simulated crystals. This practical detection of near-duplicates will stop the artificial generation of `new' materials from slight perturbations of known crystals. Several such duplicates are under investigation by five journals for data integrity.


title: Adapting Rapid Motor Adaptation for Bipedal Robots

abstract: Recent advances in legged locomotion have enabled quadrupeds to walk on challenging terrains. However, bipedal robots are inherently more unstable and hence it's harder to design walking controllers for them. In this work, we leverage recent advances in rapid adaptation for locomotion control, and extend them to work on bipedal robots. Similar to existing works, we start with a base policy which produces actions while taking as input an estimated extrinsics vector from an adaptation module. This extrinsics vector contains information about the environment and enables the walking controller to rapidly adapt online. However, the extrinsics estimator could be imperfect, which might lead to poor performance of the base policy which expects a perfect estimator. In this paper, we propose A-RMA (Adapting RMA), which additionally adapts the base policy for the imperfect extrinsics estimator by finetuning it using model-free RL. We demonstrate that A-RMA outperforms a number of RL-based baseline controllers and model-based controllers in simulation, and show zero-shot deployment of a single A-RMA policy to enable a bipedal robot, Cassie, to walk in a variety of different scenarios in the real world beyond what it has seen during training. Videos and results at https://ashish-kmr.github.io/a-rma/


title: A Combination of Deep Neural Networks and K-Nearest Neighbors for Credit Card Fraud Detection

abstract: Detection of a Fraud transaction on credit cards became one of the major problems for financial institutions, organizations and companies. As the global financial system is highly connected to non-cash transactions and online operations fraud makers invent more effective ways to access customers' finances. The main problem in credit card fraud detection is that the number of fraud transactions is significantly lower than genuine ones. The aim of the paper is to implement new techniques, which contains of under-sampling algorithms, K-nearest Neighbor Algorithm (KNN) and Deep Neural Network (KNN) on new obtained dataset. The performance evaluation showed that DNN model gives precise high accuracy (98.12%), which shows the good ability of presented method to detect fraudulent transactions.


title: Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation

abstract: Unlike literal expressions, idioms' meanings do not directly follow from their parts, posing a challenge for neural machine translation (NMT). NMT models are often unable to translate idioms accurately and over-generate compositional, literal translations. In this work, we investigate whether the non-compositionality of idioms is reflected in the mechanics of the dominant NMT model, Transformer, by analysing the hidden states and attention patterns for models with English as source language and one of seven European languages as target language. When Transformer emits a non-literal translation - i.e. identifies the expression as idiomatic - the encoder processes idioms more strongly as single lexical units compared to literal expressions. This manifests in idioms' parts being grouped through attention and in reduced interaction between idioms and their context. In the decoder's cross-attention, figurative inputs result in reduced attention on source-side tokens. These results suggest that Transformer's tendency to process idioms as compositional expressions contributes to literal translations of idioms.


title: Unifying Kitaev magnets, kagome dimer models and ruby Rydberg spin liquids

abstract: The exploration of quantum spin liquids (QSLs) has been guided by different approaches including the resonating valence bond (RVB) picture, deconfined lattice gauge theories and the Kitaev model. More recently, a spin liquid ground state was numerically established on the ruby lattice, inspired by the Rydberg blockade mechanism. Here we unify these varied approaches in a single parent Hamiltonian, in which local fluctuations of anyons stabilize deconfinement. The parent Hamiltonian is defined on kagom\'e triangles -- each hosting four RVB-like states -- and includes only Ising interactions and single-site transverse fields. In the weak-field limit, the ruby spin liquid and exactly soluble kagom\'e dimer models are recovered, while the strong-field limit reduces to the Kitaev honeycomb model, thereby unifying three seemingly different approaches to QSLs. We similarly obtain the chiral Yao-Kivelson model, honeycomb toric code and a new spin-1 quadrupolar Kitaev model. The last is shown to be in a QSL phase by a non-local mapping to the kagom\'e Ising antiferromagnet. We demonstrate various applications of our framework, including (a) an adiabatic deformation of the ruby lattice model to the exactly soluble kagom\'e dimer model, conclusively establishing the QSL phase in the former; and (b) demystifying the dynamical protocol for measuring off-diagonal strings in the Rydberg implementation of the ruby lattice spin liquid. More generally, we find an intimate connection between Kitaev couplings and the repulsive interactions used for emergent dimer models. For instance, we show how a spin-1/2 XXZ model on the ruby lattice encodes a Kitaev honeycomb model, providing a new route toward realizing the latter in cold-atom or solid-state systems.


title: Information entropy and temperature of the binary Markov chains

abstract: We propose two different approaches for introducing the information temperature of the binary N-th order Markov chains. The first approach is based on comparing the Markov sequences with the equilibrium Ising chains at given temperatures. The second approach uses probabilities of finite-length subsequences of symbols occurring, which determine their entropies. The derivative of the entropy with respect to the energy gives the information temperature measured on the scale of introduced energy. For the case of nearest-neighbor spin/symbol interaction, both approaches provide similar results. However, the method based on the correspondence of the N-step Markov and Ising chains appears to be very cumbersome for N>3. We also introduce the information temperature for the weakly correlated one-parametric Markov chains and present results for the step-wise and power memory functions. An application of the developed method to obtain the information temperature of some literary texts is given.


title: Improvements to Supervised EM Learning of Shared Kernel Models by Feature Space Partitioning

abstract: Expectation maximisation (EM) is usually thought of as an unsupervised learning method for estimating the parameters of a mixture distribution, however it can also be used for supervised learning when class labels are available. As such, EM has been applied to train neural nets including the probabilistic radial basis function (PRBF) network or shared kernel (SK) model. This paper addresses two major shortcomings of previous work in this area: the lack of rigour in the derivation of the EM training algorithm; and the computational complexity of the technique, which has limited it to low dimensional data sets. We first present a detailed derivation of EM for the Gaussian shared kernel model PRBF classifier, making use of data association theory to obtain the complete data likelihood, Baum's auxiliary function (the E-step) and its subsequent maximisation (M-step). To reduce complexity of the resulting SKEM algorithm, we partition the feature space into $R$ non-overlapping subsets of variables. The resulting product decomposition of the joint data likelihood, which is exact when the feature partitions are independent, allows the SKEM to be implemented in parallel and at $R^2$ times lower complexity. The operation of the partitioned SKEM algorithm is demonstrated on the MNIST data set and compared with its non-partitioned counterpart. It eventuates that improved performance at reduced complexity is achievable. Comparisons with standard classification algorithms are provided on a number of other benchmark data sets.


title: A Design Space for Explainable Ranking and Ranking Models

abstract: Item ranking systems support users in multi-criteria decision-making tasks. Users need to trust rankings and ranking algorithms to reflect user preferences nicely while avoiding systematic errors and biases. However, today only few approaches help end users, model developers, and analysts to explain rankings. We report on the study of explanation approaches from the perspectives of recommender systems, explainable AI, and visualization research and propose the first cross-domain design space for explainers of item rankings. In addition, we leverage the descriptive power of the design space to characterize a) existing explainers and b) three main user groups involved in ranking explanation tasks. The generative power of the design space is a means for future designers and developers to create more target-oriented solutions in this only weakly exploited space.


title: How to Compose Shortest Paths

abstract: The composition problem for shortest paths asks the following: given shortest paths on weighted graphs M and N which share a common boundary, find the shortest paths on their union. This problem is a crucial step in any algorithm which uses the divide and conquer method to find shortest paths. This extended abstract details how this problem may be understood categorically. Finding shortest paths is represented by a functor and the composition problem asks to find the value of this functor on a pushout using the values of the functor on the components. Furthermore, we present an algorithm which solves the composition problem for shortest paths. When implemented in Python, this algorithm reduces the computation time for finding shortest paths by relying on precompilation.


title: A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks

abstract: Tensorial Convolutional Neural Networks (TCNNs) have attracted much research attention for their power in reducing model parameters or enhancing the generalization ability. However, exploration of TCNNs is hindered even from weight initialization methods. To be specific, general initialization methods, such as Xavier or Kaiming initialization, usually fail to generate appropriate weights for TCNNs. Meanwhile, although there are ad-hoc approaches for specific architectures (e.g., Tensor Ring Nets), they are not applicable to TCNNs with other tensor decomposition methods (e.g., CP or Tucker decomposition). To address this problem, we propose a universal weight initialization paradigm, which generalizes Xavier and Kaiming methods and can be widely applicable to arbitrary TCNNs. Specifically, we first present the Reproducing Transformation to convert the backward process in TCNNs to an equivalent convolution process. Then, based on the convolution operators in the forward and backward processes, we build a unified paradigm to control the variance of features and gradients in TCNNs. Thus, we can derive fan-in and fan-out initialization for various TCNNs. We demonstrate that our paradigm can stabilize the training of TCNNs, leading to faster convergence and better results.


title: Parameter-Efficient and Student-Friendly Knowledge Distillation

abstract: Knowledge distillation (KD) has been extensively employed to transfer the knowledge from a large teacher model to the smaller students, where the parameters of the teacher are fixed (or partially) during training. Recent studies show that this mode may cause difficulties in knowledge transfer due to the mismatched model capacities. To alleviate the mismatch problem, teacher-student joint training methods, e.g., online distillation, have been proposed, but it always requires expensive computational cost. In this paper, we present a parameter-efficient and student-friendly knowledge distillation method, namely PESF-KD, to achieve efficient and sufficient knowledge transfer by updating relatively few partial parameters. Technically, we first mathematically formulate the mismatch as the sharpness gap between their predictive distributions, where we show such a gap can be narrowed with the appropriate smoothness of the soft label. Then, we introduce an adapter module for the teacher and only update the adapter to obtain soft labels with appropriate smoothness. Experiments on a variety of benchmarks show that PESF-KD can significantly reduce the training cost while obtaining competitive results compared to advanced online distillation methods. Code will be released upon acceptance.


title: C\'ordoba's differentation theorem: revisited

abstract: In this paper we prove an exponential covering lemma implying the three dimensional case of a well-known conjecture formulated by A. Zygmund circa 1935 and solved by A. C\'ordoba in 1978. Our approach avoids a subtle argument involving the power series of the exponential function.


title: On the blow up of a non-local transport equation in compact manifolds

abstract: In this note we show finite time blow-up for a class of non-local active scalar equations on compact Riemannian manifolds. The strategy we follow was introduced by Silvestre and Vicol to deal with the one dimensional C\'ordoba-C\'ordoba-Fontelos equation and might be regarded as an instance of De Giorgi's method.


title: Biological Evolution and Genetic Algorithms: Exploring the Space of Abstract Tile Self-Assembly

abstract: A physically-motivated genetic algorithm (GA) and full enumeration for a tile-based model of self-assembly (JaTAM) is implemented using a graphics processing unit (GPU). We observe performance gains with respect to state-of-the-art implementations on CPU of factor 7.7 for the GA and 2.9 for JaTAM. The correctness of our GA implementation is demonstrated using a test-bed fitness function, and our JaTAM implementation is verified by classifying a well-known search space $S_{2,8}$ based on two tile types. The performance gains achieved allow for the classification of a larger search space $S^{32}_{3,8}$ based on three tile types. The prevalence of structures based on two tile types demonstrates that simple organisms emerge preferrably even in complex ecosystems. The modularity of the largest structures found motivates the assumption that to first order, $S_{2,8}$ forms the building blocks of $S_{3,8}$. We conclude that GPUs may play an important role in future studies of evolutionary dynamics.


title: Mean Field inference of CRFs based on GAT

abstract: In this paper we propose an improved mean-field inference algorithm for the fully connected paired CRFs model. The improved method Message Passing operation is changed from the original linear convolution to the present graph attention operation, while the process of the inference algorithm is turned into the forward process of the GAT model. Combined with the mean-field inferred label distribution, it is equivalent to the output of a classifier with only unary potential. To this end, we propose a graph attention network model with residual structure, and the model approach is applicable to all sequence annotation tasks, such as pixel-level image semantic segmentation tasks as well as text annotation tasks.


title: Shalika models for general linear groups

abstract: We define a generalization of Shalika models for $GL_{n+m}(F)$ and prove that they are multiplicity-free, where $F$ is either a non-Archimedean local field or a finite field and $n,m$ are any natural numbers. In particular, we give new proof for the case of $n=m$. We also show that the Bernstein-Zelevinsky product of an irreducible representation of $GL_n(F)$ and the trivial representation of $GL_m(F)$ is multiplicity-free. We relate the two results by a conjecture about twisted parabolic induction of Gelfand pairs.


title: Negative cavity photon spectral function in an optomechanical system with two parametrically-driven mechanical modes

abstract: We propose an experimentally feasible optomechanical scheme to realize a negative cavity photon spectral function (CPSF) which is equivalent to a negative absorption. The system under consideration is an optomechanical system consisting of two mechanical (phononic) modes which are linearly coupled to a common cavity mode via the radiation pressure while parametrically driven through the coherent time-modulation of their spring coefficients. Using the equations of motion for the cavity retarded Green's function obtained in the framework of the generalized linear response theory, we show that in the red-detuned and weak-coupling regimes a frequency-dependent effective cavity damping rate (ECDR) corresponding to a negative CPSF can be realized by controlling the cooperativities and modulation parameters while the system still remains in the stable regime. Nevertheless, such a negativity which acts as an optomechanical gain never occurs in a standard (an unmodulated bare) cavity optomechanical system. Besides, we find that the presence of two modulated mechanical degrees of freedom provides more controllability over the magnitude and bandwidth of the negativity of CPSF, in comparison to the setup with a single modulated mechanical oscillator. Interestingly, the introduced negativity may open a new platform to realize an extraordinary (modified) optomechanically induced transparency (in which the input signal is amplified in the output) leading to a perfect tunable optomechanical filter with switchable bandwidth which can be used as an optical transistor.


title: Thermodynamic Flux-Force Closure Relations for Systems out of the Onsager Region

abstract: The objective of this work is to determine the nonlinear flux-force relations for systems out of Onsager's region that respect the existing thermodynamic theorems for systems far from equilibrium. To this aim, a thermodynamic theory for irreversible processes [referred to as the Thermodynamical Field Theory (TFT)] has been developed. The TFT rests upon the concept of equivalence between thermodynamic systems: "The equivalent character of two alternative descriptions of a thermodynamic system is ensured if, and only if, the entropy production and the Glansdorff-Prigogine dissipative quantity remain unaltered under the thermodynamic forces transformation". The TCT leads naturally to the "Thermodynamic Covariance Principle" (TCP) stating that "The nonlinear closure equations, i.e., the flux-force relations, must be covariant under TCT". In this work, we provide the explicit expression of the nonlinear PDEs, subjected to the appropriate boundary conditions, which have to be satisfied by transport coefficients when the skew-symmetric piece is absent. The solution of these equations allows to determine the flux-force closure relations for systems out of the Onsager region. Since the proposed PDEs are obtained without neglecting any term present in the balance equations (i.e., the mass, momentum, and energy balance equations), we propose them as a good candidate for describing transport in thermodynamic systems also in turbulent regime. A preliminary test is carried out by analysing a concrete example where Onsager's relations manifestly disagree with experience: losses in magnetically confined Tokamak-plasmas in fully collisional and in turbulent regimes. We show the good agreement between the theoretical predictions and the experimental data. The aim is to apply our approach to the "Divertor Tokamak Test facility" (DTT), to be built in Italy, and to ITER.


title: Cascades of Fano Resonances in Scattering by a Mesoscale Spherical Particle in the Superresonance Mode

abstract: Broadband light illumination of a mesoscale dielectric sphere makes it possible to reveal new effects that associated with super resonance mode. These include the possibility of generating high-order Fano resonance cascades. The quality factor has the order Q=10^7. Super-resonance-enabled subdiffraction fields localization by mesoscale dielectric sphere under broadband light illuminations (e.g., at wavebands of 400 - 700 nm for refractive index of sphere n=1.5-1.9 and 1500 - 1600 nm for n=3.47) have been investigated. The conditions for the quasi-periodicity of superresonance peaks are established. The dependence of the amplitude modulation of Fano cascades on the refractive index of the sphere is shown. These results are important in deep understanding of physics of the super-resolution mechanism related to superresonance mode and will find great potential applications in many other area.


title: Chefs' Random Tables: Non-Trigonometric Random Features

abstract: We introduce chefs' random tables (CRTs), a new class of non-trigonometric random features (RFs) to approximate Gaussian and softmax kernels. CRTs are an alternative to standard random kitchen sink (RKS) methods, which inherently rely on the trigonometric maps. We present variants of CRTs where RFs are positive, a key requirement for applications in recent low-rank Transformers. Further variance reduction is possible by leveraging statistics which are simple to compute. One instantiation of CRTs, the optimal positive random features (OPRFs), is to our knowledge the first RF method for unbiased softmax kernel estimation with positive and bounded RFs, resulting in exponentially small tails and much lower variance than its counterparts. As we show, orthogonal random features applied in OPRFs provide additional variance reduction for any dimensionality $d$ (not only asymptotically for sufficiently large $d$, as for RKS). We test CRTs on many tasks ranging from non-parametric classification to training Transformers for text, speech and image data, obtaining new state-of-the-art results for low-rank text Transformers, while providing linear space and time complexity.


title: Extensions of $n$-ary prime hyperideals via an $n$-ary multiplicative subset in a Krasner $(m,n)$-hyperring

abstract: Let R be a Krasner (m,n)-hyperring and S be an n-ary multiplicative subset of R. The purpose of this paper is to introduce the notion of n-ary S-prime hyperideals as a new expansion of n-ary prime hyperideals. Several properties and characterizations concerning n-ary S-prime hyperideals are presented. The stability of this new concept with respect to various hyperring-theoretic constructions are studied. Furthermore, we extend this concept to n-ary S-primary hyperideals. We obtained some specific results explaining the structure.


title: AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoning

abstract: Due to the popularity of Graph Neural Networks (GNNs), various GNN-based methods have been designed to reason on knowledge graphs (KGs). An important design component of GNN-based KG reasoning methods is called the propagation path, which contains a set of involved entities in each propagation step. Existing methods use hand-designed propagation paths, ignoring the correlation between the entities and the query relation. In addition, the number of involved entities will explosively grow at larger propagation steps. In this work, we are motivated to learn an adaptive propagation path in order to filter out irrelevant entities while preserving promising targets. First, we design an incremental sampling mechanism where the nearby targets and layer-wise connections can be preserved with linear complexity. Second, we design a learning-based sampling distribution to identify the semantically related entities. Extensive experiments show that our method is powerful, efficient, and semantic-aware. The code is available at https://github.com/LARS-research/AdaProp.


title: Payday loans -- blessing or growth suppressor? Machine Learning Analysis

abstract: The upsurge of real estate involves a variety of factors that have got influenced by many domains. Indeed, the unrecognized sector that would affect the economy for which regulatory proposals are being drafted to keep this in control is the payday loans. This research paper revolves around the impact of payday loans in the real estate market. The research paper draws a first-hand experience of obtaining the index for the concentration of real estate in an area of reference by virtue of payday loans in Toronto, Ontario in particular, which sets out an ideology to create, evaluate and demonstrate the scenario through research analysis. The purpose of this indexing via payday loans is the basic - debt: income ratio which states that when the income of the person bound to pay the interest of payday loans increases, his debt goes down marginally which hence infers that the person invests in fixed assets like real estate which hikes up its growth.


title: WDPhotTools -- A White Dwarf Photometric Toolkit in Python

abstract: From data collection to photometric fitting and analysis of white dwarfs to generating a white dwarf luminosity function requires numerous Astrophysical, Mathematical and Computational domain knowledge. The steep learning curve makes it difficult to enter the field, and often individuals have to reinvent the wheel to perform identical data reduction and analysis tasks. We have gathered a wide range of publicly available white dwarf cooling models and synthetic photometry to provide a toolkit that allows (1) visualisation of various models, (2) photometric fitting of a white dwarf with or without distance and reddening, and (3) the computing of white dwarf luminosity functions with a choice of initial mass function, main sequence evolution model, star formation history, initial-final mass relation, and white dwarf cooling model. We have recomputed and compared the effective temperature of the white dwarfs from the Gaia EDR3 white dwarf catalogue. The two independent works show excellent agreement in the temperature solutions.


title: Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training

abstract: Recent works on sparse neural network training (sparse training) have shown that a compelling trade-off between performance and efficiency can be achieved by training intrinsically sparse neural networks from scratch. Existing sparse training methods usually strive to find the best sparse subnetwork possible in one single run, without involving any expensive dense or pre-training steps. For instance, dynamic sparse training (DST), is capable of reaching a competitive performance of dense training by iteratively evolving the sparse topology during the course of training. In this paper, we argue that it is better to allocate the limited resources to create multiple low-loss sparse subnetworks and superpose them into a stronger one, instead of allocating all resources entirely to find an individual subnetwork. To achieve this, two desiderata are required: (1) efficiently producing many low-loss subnetworks, the so-called cheap tickets, within one training process limited to the standard training time used in dense training; (2) effectively superposing these cheap tickets into one stronger subnetwork. To corroborate our conjecture, we present a novel sparse training approach, termed Sup-tickets, which can satisfy the above two desiderata concurrently in a single sparse-to-sparse training process. Across various modern architectures on CIFAR-10/100 and ImageNet, we show that Sup-tickets integrates seamlessly with the existing sparse training methods and demonstrates consistent performance improvement.


title: Generating the Electro-Weak Scale by Vector-like Quark Condensation

abstract: We show that vector-like quarks in the fundamental or higher-dimensional representations of QCD can generate the electro-weak scale in a phenomenologically viable way by chiral symmetry breaking condensates. The thereby generated scales are determined by numerically solving the Dyson-Schwinger equation and these scales are sizable, because they grow with the hard vector-like mass. Communicating such a scale to the Standard Model via a conformally invariant scalar sector can dynamically generate the electro-weak scale without a naturalness problem, because all non-dynamical mass scales are protected by chiral symmetry. We present a minimal setup which requires only a new neutral scalar with mass not too far above the electro-weak scale, as well as vector-like quarks at the (multi-)TeV scale. Both are consistent with current bounds and are attractive for future experimental searches at the LHC and future colliders. Depending on the hypercharge of the vector-like quarks, hadrons made of them are color-neutral bound states which would be interesting Dark Matter candidates.


title: $a$-Anomalous Interactions of the Holographic Dilaton

abstract: We explore higher-derivative terms in the low-energy effective action for the dilaton, the Goldstone boson of spontaneously broken scale invariance. Focusing on the simplest holographic realization of spontaneously broken scale invariance, the Randall-Sundrum (RS) scenario, we identify the nonlinear action for the RS dilaton by integrating out Kaluza-Klein graviton modes. The coefficient of a particular four-derivative dilaton self-interaction can be identified with the Weyl $a$-anomaly of the dual conformal field theory, which we use to verify anomaly matching arguments. We also find novel, $a$-dependent couplings of the dilaton to light matter fields. These anomalous interactions can have a significant effect on the collider phenomenology and the cosmology, potentially allowing us to probe the structure of the underlying conformal sector via low-energy physics. The dilaton effective theory also serves as an interesting scalar analog of gravity, and we study solutions to the equation of motion that parallel black holes and cosmologies.