title: Proton, deuteron and triton flow measurements in Au+Au collisions at $\sqrt{s_{NN}} = 2.4$ GeV

abstract: High precision measurements of flow coefficients $v_{n}$ ($n = 1 - 4$) for protons, deuterons and tritons relative to the first-order spectator plane have been performed in Au+Au collisions at $\sqrt{s_{NN}} = 2.4$ GeV with the High-Acceptance Di-Electron Spectrometer (HADES) at the SIS18/GSI. Flow coefficients are studied as a function of transverse momentum $p_{t}$ and rapidity $y_{cm}$ over a large region of phase space and for several classes of collision centrality. A clear mass hierarchy is found for the slope of $v_{1}$, $d v_{1}/d y^{\prime}|_{y^{\prime} = 0}$ where $y^{\prime}$ is the scaled rapidity, and for $v_{2}$ at mid-rapidity. Scaling with the number of nucleons is observed for the $p_{t}$ dependence of $v_{2}$ and $v_{4}$ at mid-rapidity, which is indicative for nuclear coalescence as the main process responsible for light nuclei formation. $v_{2}$ is found to scale with the initial eccentricity $\langle \epsilon_{2} \rangle$, while $v_{4}$ scales with $\langle \epsilon_{2} \rangle^{2}$ and $\langle \epsilon_{4} \rangle$. The multi-differential high-precision data on $v_{1}$, $v_{2}$, $v_{3}$, and $v_{4}$ provides important constraints on the equation-of-state of compressed baryonic matter.


title: Energy-Momentum Complex in Higher Order Curvature-Based Local Gravity

abstract: In General Relativity, there have been many proposals for defining the gravitational energy density, notably those proposed by Einstein, Tolman, Landau and Lifshitz, Papapetrou, M{\o}ller, and Weinberg. In this review, we firstly explored the energy--momentum complex in an $n^{th}$ order gravitational Lagrangian $L=L\left(g_{\mu\nu}, g_{\mu\nu,i_{1}}, g_{\mu\nu,i_{1}i_{2}},g_{\mu\nu,i_{1}i_{2}i_{3}},\cdots, g_{\mu\nu,i_{1}i_{2}i_{3}\cdots i_{n}}\right)$ and then in a gravitational Lagrangian as \mbox{$L_{g}=(\overline{R}+a_{0}R^{2}+\sum_{k=1}^{p} a_{k}R\Box^{k}R)\sqrt{-g}$}. Its gravitational part was obtained by invariance of gravitational action under infinitesimal rigid translations using Noether's theorem. We also showed that this tensor, in general, is not a covariant object but only an affine object, that is, a pseudo-tensor. Therefore, the pseudo-tensor $\tau^{\eta}_{\alpha}$ becomes the one introduced by Einstein if we limit ourselves to General Relativity and its extended corrections have been explicitly indicated. The same method was used to derive the energy--momentum complex in $ f\left (R \right) $ gravity both in Palatini and metric approaches. Moreover, in the weak field approximation the pseudo-tensor $\tau^{\eta}_{\alpha}$ to lowest order in the metric perturbation $h$ was calculated. As a practical application, the power per unit solid angle $\Omega$ emitted by a localized source carried by a gravitational wave in a direction $\hat{x}$ for a fixed wave number $\mathbf{k}$ under a suitable gauge was obtained, through the average value of the pseudo-tensor over a suitable spacetime domain and the local conservation of the pseudo-tensor. As a cosmological application, in a flat Friedmann--Lema\^itre--Robertson--Walker spacetime, the gravitational and matter energy density in $f(R)$ gravity both in Palatini and metric formalism was proposed.


title: Rare desynchronization events in power grids: On data implementation and dimensional reductions

abstract: We discuss the frequency of desynchronization events in power grids for realistic data input. We focus on the role of time correlations in the fluctuating power production and propose a new method for implementing colored noise that reproduces non-Gaussian data by means of cumulants of data increment distributions. Our desynchronization events are caused by overloads. We extend known and propose different methods of dimensional reduction to considerably reduce the high-dimensional phase space and to predict the rare desynchronization events with reasonable computational costs. The first method splits the system into two areas, connected by heavily loaded lines, and treats each area as a single node. The second method considers a separation of the timescales of power fluctuations and phase angle dynamics and completely disregards the latter. The fact that this separation turns out to be justified, albeit only to exponential accuracy in the strength of fluctuations, means that the number of rare events does not sensitively depend on inertia or damping for realistic heterogeneous parameters and long correlation times. Neither does the number of desynchronization events automatically increase with non-Gaussian fluctuations in the power production as one might have expected. On the other hand, the analytical expressions for the average time to desynchronization depend sensitively on the finite correlation time of the fluctuating power input.


title: Integrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces

abstract: Knowledge Graphs, such as Wikidata, comprise structural and textual knowledge in order to represent knowledge. For each of the two modalities dedicated approaches for graph embedding and language models learn patterns that allow for predicting novel structural knowledge. Few approaches have integrated learning and inference with both modalities and these existing ones could only partially exploit the interaction of structural and textual knowledge. In our approach, we build on existing strong representations of single modalities and we use hypercomplex algebra to represent both, (i), single-modality embedding as well as, (ii), the interaction between different modalities and their complementary means of knowledge representation. More specifically, we suggest Dihedron and Quaternion representations of 4D hypercomplex numbers to integrate four modalities namely structural knowledge graph embedding, word-level representations (e.g.\ Word2vec, Fasttext), sentence-level representations (Sentence transformer), and document-level representations (sentence transformer, Doc2vec). Our unified vector representation scores the plausibility of labelled edges via Hamilton and Dihedron products, thus modeling pairwise interactions between different modalities. Extensive experimental evaluation on standard benchmark datasets shows the superiority of our two new models using abundant textual information besides sparse structural knowledge to enhance performance in link prediction tasks.


title: Quantum Error Correction via Noise Guessing Decoding

abstract: Quantum error correction codes (QECCs) play a central role in both quantum communications and quantum computation. Practical quantum error correction codes, such as stabilizer codes, are generally structured to suit a specific use, and present rigid code lengths and code rates. This paper shows that it is possible to both construct and decode QECCs that can attain the maximum performance of the finite blocklength regime, for any chosen code length when the code rate is sufficiently high. A recently proposed strategy for decoding classical codes called GRAND (guessing random additive noise decoding) opened doors to efficiently decode classical random linear codes (RLCs) performing near the maximum rate of the finite blocklength regime. By using noise statistics, GRAND is a noise-centric efficient universal decoder for classical codes, provided that a simple code membership test exists. These conditions are particularly suitable for quantum systems, and therefore the paper extends these concepts to quantum random linear codes (QRLCs), which were known to be possible to construct but whose decoding was not yet feasible. By combining QRLCs and a newly proposed quantum-GRAND, this work shows that it is possible to decode QECCs that are easy to adapt to changing conditions. The paper starts by assessing the minimum number of gates in the coding circuit needed to reach the QRLCs' asymptotic performance, and subsequently proposes a quantum-GRAND algorithm that makes use of quantum noise statistics, not only to build an adaptive code membership test, but also to efficiently implement syndrome decoding.


title: A homotopy coherent nerve for $(\infty,n)$-categories

abstract: In the case of $(\infty,1)$-categories, the homotopy coherent nerve gives a right Quillen equivalence between the models of simplicially enriched categories and of quasi-categories. This shows that homotopy coherent diagrams of $(\infty,1)$-categories can equivalently be defined as functors of quasi-categories or as simplicially enriched functors out of the homotopy coherent categorifications. In this paper, we construct a homotopy coherent nerve for $(\infty,n)$-categories. We show that it realizes a right Quillen equivalence between the models of categories strictly enriched in $(\infty,n-1)$-categories and of Segal category objects in $(\infty,n-1)$-categories. This similarly enables us to define homotopy coherent diagrams of $(\infty,n)$-categories equivalently as functors of Segal category objects or as strictly enriched functors out of the homotopy coherent categorifications.


title: Conditional expectation operators on $C(X)$

abstract: At the COSAEF conference in 2021, several participants asked the question whether a conditional expectation operator in the sense of Kuo, Labaushagne and Watson could be constructed in vector lattices other than $\mathcal{L}_p$ spaces and in particular in $C(X)$. This work answers positively to this question and participates in an old discussion on integrals in $C(X)$ space.


title: Runner-Up Solution to ECCV 2022 Challenge on Out of Vocabulary Scene Text Understanding: Cropped Word Recognition

abstract: This report presents our 2nd place solution to ECCV 2022 challenge on Out-of-Vocabulary Scene Text Understanding (OOV-ST) : Cropped Word Recognition. This challenge is held in the context of ECCV 2022 workshop on Text in Everything (TiE), which aims to extract out-of-vocabulary words from natural scene images. In the competition, we first pre-train SCATTER on the synthetic datasets, then fine-tune the model on the training set with data augmentations. Meanwhile, two additional models are trained specifically for long and vertical texts. Finally, we combine the output from different models with different layers, different backbones, and different seeds as the final results. Our solution achieves a word accuracy of 59.45\% when considering out-of-vocabulary words only.


title: An online joint replenishment problem combined with single machine scheduling

abstract: This paper considers a combination of the joint replenishment problem with single machine scheduling. There is a single resource, which is required by all the jobs, and a job can be started at time point $t$ on the machine if and only the machine does not process another job at $t$, and the resource is replenished between its release date and $t$. Each replenishment has a cost, which is independent of the amount replenished. The objective is to minimize the total replenishment cost plus the maximum flow time of the jobs. We consider the online variant of the problem, where the jobs are released over time, and once a job is inserted into the schedule, its starting time cannot be changed. We propose a deterministic 2-competitive online algorithm for the general input. Moreover, we show that for a certain class of inputs (so-called $p$-bounded input), the competitive ratio of the algorithm tends to $\sqrt{2}$ as the number of jobs tends to infinity. We also derive several lower bounds for the best competitive ratio of any deterministic online algorithm under various assumptions.


title: On the hyperbolic Bloch transform

abstract: Motivated by recent theoretical and experimental developments in the physics of hyperbolic crystals, we study the noncommutative Bloch transform of Fuchsian groups that we call the hyperbolic Bloch transform. First, we prove that the hyperbolic Bloch transform is injective and "asymptotically unitary" already in the simplest case, that is when the Hilbert space is the regular representation of the Fuchsian group, $\Gamma$. Second, when $\Gamma \subset \mathrm{PSU} (1, 1)$ acts isometrically on the hyperbolic plane, $\mathbb{H}$, and the Hilbert space is $L^2 \left( \mathbb{H} \right)$, then we define a modified, geometric Bloch transform, that sends wave functions to sections of stable, flat bundles over $\Sigma = \mathbb{H} / \Gamma$ and transforms the hyperbolic Laplacian into the covariant Laplacian.

categories: math-ph cond-mat.mes-hall cond-mat.other math.MP quant-ph


title: From moments of the distribution function to hydrodynamics: The non-conformal case

abstract: We study the one-dimensional boost-invariant Boltzmann equation in the relaxation-time approximation using special moments of the distribution function for a system with a finite particle mass. The infinite hierarchy of moments can be truncated by keeping only the three lowest moments that correspond to the three independent components of the energy-momentum tensor. We show that such a three-moment truncation reproduces accurately the exact solution of the kinetic equation after a simple renormalization that takes into account the effects of the neglected higher moments. We derive second-order Israel-Stewart hydrodynamic equations from the three-moment equations, and show that, for most physically relevant initial conditions, these equations yield results comparable to those of the three-moment truncation, albeit less accurate. We attribute this feature to the fact that the structure of Israel-Stewart equations is similar to that of the three-moment truncation. In particular, the presence of the relaxation term in the Israel-Stewart equations, yields an early-time regime that mimics approximately the collisionless regime. A detailed comparison of the three-moment truncation with second-order non-conformal hydrodynamics reveals ambiguities in the definition of second-order transport coefficients. These ambiguities affect the ability of Israel-Stewart hydrodynamics to reproduce results of kinetic theory.


title: Measurement of the $\mathrm{t\bar{t}}$ charge asymmetry in events with highly Lorentz-boosted top quarks in pp collisions at $\sqrt{s}$ = 13 TeV

abstract: The measurement of the charge asymmetry in top quark pair events with highly Lorentz-boosted top quarks decaying to a single lepton and jets is presented. The analysis is performed using proton-proton collisions at $\sqrt{s}$ = 13 TeV with the CMS detector at the LHC and corresponding to an integrated luminosity of 138 fb$^{-1}$. The selection is optimized for top quarks produced with large Lorentz boosts, resulting in nonisolated leptons and overlapping jets. The top quark charge asymmetry is measured for events with a $\mathrm{t\bar{t}}$ invariant mass larger than 750 GeV and corrected for detector and acceptance effects using a binned maximum likelihood fit. The measured top quark charge asymmetry of (0.42 $_{-0.69}^{+0.64}$)% is in good agreement with the standard model prediction at next-to-next-to-leading order in quantum chromodynamic perturbation theory with next-to-leading-order electroweak corrections. The result is also presented for two invariant mass ranges, 750-900 and $\gt$ 900 GeV.


title: $\gamma_5$ in dimensional regularization -- a no-compromise approach using the BMHV scheme

abstract: $\gamma_5$ is notoriously difficult to define in $D$ dimensions. The traditional BMHV scheme employs a non-anticommuting $\gamma_5$. Its key advantage is mathematical consistency and the existence of all-order proofs. Its disadvantage is the spurious breaking of gauge invariance in chiral gauge theories like the electroweak standard model. Our research programme aims to determine the special finite counterterms which are necessary to restore gauge invariance, to allow more straightforward applications of the BMHV scheme and to cross-check alternative schemes. In these proceedings we present the key concepts and methods, and we outline the calculational procedure and present results for an abelian gauge theory at the 2-loop level. An important observation is the simplicity of the results -- three types of symmetry-restoring counterterms are sufficient at the 2-loop level.


title: Spectral Universality of Regularized Linear Regression with Nearly Deterministic Sensing Matrices

abstract: It has been observed that the performances of many high-dimensional estimation problems are universal with respect to underlying sensing (or design) matrices. Specifically, matrices with markedly different constructions seem to achieve identical performance if they share the same spectral distribution and have ``generic'' singular vectors. We prove this universality phenomenon for the case of convex regularized least squares (RLS) estimators under a linear regression model with additive Gaussian noise. Our main contributions are two-fold: (1) We introduce a notion of universality classes for sensing matrices, defined through a set of deterministic conditions that fix the spectrum of the sensing matrix and precisely capture the previously heuristic notion of generic singular vectors; (2) We show that for all sensing matrices that lie in the same universality class, the dynamics of the proximal gradient descent algorithm for solving the regression problem, as well as the performance of RLS estimators themselves (under additional strong convexity conditions) are asymptotically identical. In addition to including i.i.d. Gaussian and rotational invariant matrices as special cases, our universality class also contains highly structured, strongly correlated, or even (nearly) deterministic matrices. Examples of the latter include randomly signed versions of incoherent tight frames and randomly subsampled Hadamard transforms. As a consequence of this universality principle, the asymptotic performance of regularized linear regression on many structured matrices constructed with limited randomness can be characterized by using the rotationally invariant ensemble as an equivalent yet mathematically more tractable surrogate.


title: Interacting Tsallis holographic dark energy in $q$-modified DGP braneworld

abstract: We explore the cosmological aspects of interacting Tsallis holographic dark energy (THDE) in a $q$-modified DGP braneworld setup emerging from non-Gaussian statistical mechanics.To this end, three classes of superstatistics, that is, log-normal, inverse $\chi^2$ and $\chi^2$ superstatistics were incorporated into the model. We examined the implication of the three superstatistics on different cosmological parameters, namely, the dimensionless energy density and the equation-of-state (EoS) of THDE, along with the deceleration parameter and the squared speed of sound. As a result, we noted that the cosmological parameters stemming from the $\chi^2$ superstatistics, with a parameter $q > 1$, represent the highest deviation from those ascribed to the standard DGP model. While the system parameters show appropriate behavior in all three cases, the model cannot achieve stability throughout the history of the Universe. It is probably the outcome of setting the Hubble horizon as the infrared cutoff. Furthermore, the behavior of EoS was found to be governed by the value of the THDE parameter ${\delta}$. That is to say, for ${\delta} > 2$ THDE exhibits a phantom-like behavior while for ${\delta} < 2$ it displays a quintessence behavior. Constrained by the dominant energy condition, an upper bound on ${\delta}$ $({\delta} < 2)$ has been imposed.


title: Thermal Testing for Cryogenic CMB Instrument Optical Design

abstract: Observations of the Cosmic Microwave Background rely on cryogenic instrumentation with cold detectors, readout, and optics providing the low noise performance and instrumental stability required to make more sensitive measurements. It is therefore critical to optimize all aspects of the cryogenic design to achieve the necessary performance, with low temperature components and acceptable system cooling requirements. In particular, we will focus on our use of thermal filters and cold optics, which reduce the thermal load passed along to the cryogenic stages. To test their performance, we have made a series of in situ measurements while integrating the third receiver for the BICEP Array telescope. In addition to characterizing the behavior of this receiver, these measurements continue to refine the models that are being used to inform design choices being made for future instruments.


title: Finite Rank Perturbations of Heavy-Tailed Wigner Matrices

abstract: One-rank perturbations of Wigner matrices have been closely studied: let $P=\frac{1}{\sqrt{n}}A+\theta vv^T$ with $A=(a_{ij})_{1 \leq i,j \leq n} \in \mathbb{R}^{n \times n}$ symmetric, $(a_{ij})_{1 \leq i \leq j \leq n}$ i.i.d. with centered standard normal distributions, and $\theta>0, v \in \mathbb{S}^{n-1}.$ It is well known $\lambda_1(P),$ the largest eigenvalue of $P,$ has a phase transition at $\theta_0=1:$ when $\theta \leq 1,$ $\lambda_1(P) \xrightarrow[]{a.s.} 2,$ whereas for $\theta> 1,$ $\lambda_1(P) \xrightarrow[]{a.s.} \theta+\theta^{-1}.$ Under more general conditions, the limiting behavior of $\lambda_1(P),$ appropriately normalized, has also been established: it is normal if $||v||_{\infty}=o(1),$ or the convolution of the law of $a_{11}$ and a Gaussian distribution if $v$ is concentrated on one entry. These convergences require a finite fourth moment, and this paper considers situations violating this condition. For symmetric distributions $a_{11},$ heavy-tailed with index $\alpha \in (0,4),$ the fluctuations are shown to be universal and dependent on $\theta$ but not on $v,$ whereas a subfamily of the edge case $\alpha=4$ displays features of both the light- and heavy-tailed regimes: two limiting laws emerge and depend on whether $v$ is localized, each presenting a continuous phase transition at $\theta_0=1, \theta_0 \in [1,\frac{128}{89}],$ respectively. These results build on our previous which analyzes the asymptotic behavior of $\lambda_1(\frac{1}{\sqrt{n}}A)$ in the aforementioned subfamily.


title: Topological Defect Lines in Two Dimensional Fermionic CFTs

abstract: We consider topological defect lines (TDLs) in two-dimensional fermionic conformal field theories (CFTs). Besides inheriting all the properties of TDLs in bosonic CFTs, TDLs in fermionic CFTs could host fermionic defect operators at their endpoints and junctions. Furthermore, there is a new type of TDLs, called q-type TDLs, that have no analog in bosonic CFTs. Their distinguishing feature is an extra one-dimensional Majorana fermion living on the worldline of the TDLs. The properties of TDLs in fermionic CFTs are captured in the mathematical language of the super fusion category. We propose a classification of the rank-2 super fusion categories generalizing the $\mathbb Z_8$ classification for the anomalies of $\mathbb Z_2$ symmetry. We explicitly solve the F-moves for all the nontrivial categories, and derive the corresponding spin selection rules that constrain the spectrum of the defect operators. We find the full set of TDLs in the standard fermionic minimal models and a partial set of TDLs in the two exceptional models, which give CFT realizations to the rank-2 super fusion categories. Finally, we discuss a constraint on the renormalization group flow that preserves a q-type TDL.


title: Learning Interaction Variables and Kernels from Observations of Agent-Based Systems

abstract: Dynamical systems across many disciplines are modeled as interacting particles or agents, with interaction rules that depend on a very small number of variables (e.g. pairwise distances, pairwise differences of phases, etc...), functions of the state of pairs of agents. Yet, these interaction rules can generate self-organized dynamics, with complex emergent behaviors (clustering, flocking, swarming, etc.). We propose a learning technique that, given observations of states and velocities along trajectories of the agents, yields both the variables upon which the interaction kernel depends and the interaction kernel itself, in a nonparametric fashion. This yields an effective dimension reduction which avoids the curse of dimensionality from the high-dimensional observation data (states and velocities of all the agents). We demonstrate the learning capability of our method to a variety of first-order interacting systems.


title: New Differential Privacy Communication Pipeline and Design Framework

abstract: Organizations started to adopt differential privacy (DP) techniques hoping to persuade more users to share personal data with them. However, many users do not understand DP techniques, thus may not be willing to share. Previous research suggested that the design of DP mechanism communication could influence users' willingness to share data. Based on the prior work, we propose a new communication pipeline that starts by asking users about their privacy concerns and then provides a customized DP mechanism and communication. We also propose a design framework that systemically explores effective communication designs ranging from a text-based high-level description to a step-by-step interactive storyboard. Based on the framework, we created 17 designs and recruited five people to evaluate. Our user study showed that text-based descriptions have the highest clarity in all scenarios, while the step-by-step interactive storyboards have the potential to persuade users to trust central DP. Our future work will optimize the design and conduct a large-scale efficacy study.


title: OCFR 2022: Competition on Occluded Face Recognition From Synthetically Generated Structure-Aware Occlusions

abstract: This work summarizes the IJCB Occluded Face Recognition Competition 2022 (IJCB-OCFR-2022) embraced by the 2022 International Joint Conference on Biometrics (IJCB 2022). OCFR-2022 attracted a total of 3 participating teams, from academia. Eventually, six valid submissions were submitted and then evaluated by the organizers. The competition was held to address the challenge of face recognition in the presence of severe face occlusions. The participants were free to use any training data and the testing data was built by the organisers by synthetically occluding parts of the face images using a well-known dataset. The submitted solutions presented innovations and performed very competitively with the considered baseline. A major output of this competition is a challenging, realistic, and diverse, and publicly available occluded face recognition benchmark with well defined evaluation protocols.


title: Normal and Quasinormal Modes of Holographic Multiquark Star

abstract: The quadrupole normal-mode oscillation frequency $f_{n}$ of multiquark star are computed for $n=1-5$. At the transition from low to high density multiquark in the core region, the first 2 modes jump to larger values, a distinctive signature of the presence of the high-density core. When the star oscillation couples with spacetime, gravitational waves~(GW) will be generated and the star will undergo damped oscillation. The quasinormal modes~(QNMs) of the oscillation are computed using two methods, direct scan and WKB, for QNMs with small and large imaginary parts respectively. The small imaginary QNMs have frequencies $1.5-2.6$ kHz and damping times $0.19-1.7$ secs for multiquark star with mass $M=0.6-2.1 M_{\odot}$~(solar mass). The WKB QNMs with large imaginary parts have frequencies $5.98-9.81$ kHz and damping times $0.13-0.46$ ms for $M\simeq 0.3-2.1 M_{\odot}$. They are found to be the fluid $f-$modes and spacetime curvature $w-$modes respectively.


title: A general approach to the exact localized transition points of 1D mosaic disorder models

abstract: In this paper, we present a general correspondence between the mosaic and non-mosaic models, which can be used to obtain the exact solution for the mosaic ones. This relation holds not only for the quasicrystal models, but also for the Anderson models. Despite the different localization properties of the specific models, this relationship shares a unified form. Applying our method to the mosaic Anderson models, we find that there is a discrete set of extended states. At last, we also give the general analytical mobility edge for the mosaic slowly varying potential models and the mosaic Ganeshan-Pixley-Das Sarma models.


title: Magnetic thread twisting in a simulated solar atmosphere

abstract: Context. Plasma inflows accompany a variety of processes in the solar atmosphere such as heating of coronal loops and formation of prominences. Aims. We model a stratified solar atmosphere, within which a simulated prominence thread experiences density accumulation via a plasma inflow designed to mimic the formation process. We aim to investigate the interaction of such a system with torsional perturbations, and the possible consequences. Methods. The linearised equations of motion and induction are integrated to analyse the spatial and temporal evolution of torsional perturbations that are randomly driven at the photospheric footpoints. Results. Our results demonstrate that magnetic threads will experience twist amplification. Different sources and sinks of energy and the corresponding amplification mechanisms are identified. Threads reaching chromospheric heights are most susceptible to magnetic twisting with the maximum twist occurring near their footpoints. The amplifying twists are associated with a standing wave behaviour along the simulated threads. Conclusions. Our work suggests that torsional perturbations may be amplified within prominence threads, with strong magnetic twists forming at the footpoints. The amplification process is facilitated by small length scales in the background magnetic field. On the other hand, a small length scale in the background density inhibits growth. Possible consequences of the amplified twists, including their role in supporting the dense plasma within a prominence structure are discussed.


title: OpenCon: Open-world Contrastive Learning

abstract: Machine learning models deployed in the wild naturally encounter unlabeled samples from both known and novel classes. Challenges arise in learning from both the labeled and unlabeled data, in an open-world semi-supervised manner. In this paper, we introduce a new learning framework, open-world contrastive learning (OpenCon). OpenCon tackles the challenges of learning compact representations for both known and novel classes and facilitates novelty discovery along the way. We demonstrate the effectiveness of OpenCon on challenging benchmark datasets and establish competitive performance. On the ImageNet dataset, OpenCon significantly outperforms the current best method by 11.9% and 7.4% on novel and overall classification accuracy, respectively. Theoretically, OpenCon can be rigorously interpreted from an EM algorithm perspective--minimizing our contrastive loss partially maximizes the likelihood by clustering similar samples in the embedding space. The code is available at https://github.com/deeplearning-wisc/opencon.


title: Keyword Spotting System and Evaluation of Pruning and Quantization Methods on Low-power Edge Microcontrollers

abstract: Keyword spotting (KWS) is beneficial for voice-based user interactions with low-power devices at the edge. The edge devices are usually always-on, so edge computing brings bandwidth savings and privacy protection. The devices typically have limited memory spaces, computational performances, power and costs, for example, Cortex-M based microcontrollers. The challenge is to meet the high computation and low-latency requirements of deep learning on these devices. This paper firstly shows our small-footprint KWS system running on STM32F7 microcontroller with Cortex-M7 core @216MHz and 512KB static RAM. Our selected convolutional neural network (CNN) architecture has simplified number of operations for KWS to meet the constraint of edge devices. Our baseline system generates classification results for each 37ms including real-time audio feature extraction part. This paper further evaluates the actual performance for different pruning and quantization methods on microcontroller, including different granularity of sparsity, skipping zero weights, weight-prioritized loop order, and SIMD instruction. The result shows that for microcontrollers, there are considerable challenges for accelerate unstructured pruned models, and the structured pruning is more friendly than unstructured pruning. The result also verified that the performance improvement for quantization and SIMD instruction.


title: More Effort Towards Multiagent Knapsack

abstract: In this paper, we study some multiagent variants of the knapsack problem. Fluschnik et al. [AAAI 2019] considered the model in which every agent assigns some utility to every item. They studied three preference aggregation rules for finding a subset (knapsack) of items: individually best, diverse, and Nash-welfare-based. Informally, diversity is achieved by satisfying as many voters as possible. Motivated by the application of aggregation operators in multiwinner elections, we extend the study from diverse aggregation rule to Median and Best scoring functions. We study the computational and parameterized complexity of the problem with respect to some natural parameters, namely, the number of voters, the number of items, and the distance from an easy instance. We also study the complexity of the problem under domain restrictions. Furthermore, we present significantly faster parameterized algorithms with respect to the number of voters for the diverse aggregation rule.


title: Parabolic PDE-constrained optimal control under uncertainty with entropic risk measure using quasi-Monte Carlo integration

abstract: We study the application of a tailored quasi-Monte Carlo (QMC) method to a class of optimal control problems subject to parabolic partial differential equation (PDE) constraints under uncertainty: the state in our setting is the solution of a parabolic PDE with a random thermal diffusion coefficient, steered by a control function. To account for the presence of uncertainty in the optimal control problem, the objective function is composed with a risk measure. We focus on two risk measures, both involving high-dimensional integrals over the stochastic variables: the expected value and the (nonlinear) entropic risk measure. The high-dimensional integrals are computed numerically using specially designed QMC methods and, under moderate assumptions on the input random field, the error rate is shown to be essentially linear, independently of the stochastic dimension of the problem -- and thereby superior to ordinary Monte Carlo methods. Numerical results demonstrate the effectiveness of our method.


title: Chiral loop quantum supergravity and black hole entropy

abstract: Recent work has shown that local supersymmetry on a spacetime boundary in $\mathcal{N}$-extended AdS supergravity in chiral variables implies coupling to a boundary $\mathrm{OSp}(\mathcal{N}|2)_{\mathbb{C}}$ super Chern-Simons theory. We propose a way to calculate the entropy $S$ for the boundary, in the supersymmetric version of loop quantum gravity, for the minimal case $\mathcal{N}=1$. We calculate the dimensions of the quantum state spaces of $\mathrm{UOSp}(1|2)$ super Chern-Simons theory with punctures, and analytically continue, for fixed quantum super area of the surface, to $\mathrm{OSp}(1|2)_{\mathbb{C}}$. We find $S = a_H/4$ for large areas and determine the subleading correction.


title: Non-vanishing of critical $L$-values in Hida families

abstract: We study the vanishing of $L(f,\chi,j)$ as $f$ runs through all classical forms in a $p$-adic Hida family (including forms with arbitrarily high nebentype at $p$), $\chi$ runs through all characters of $p$-power conductor, and $j$ is a critical value. We show that if infinitely many of these $L$-values vanish (apart from the ones forced to vanish by the sign of their functional equation) then this infinitude of vanishing must be exceptionally regular, so regular in fact that one can typically rule out this possibility in any given example. Indeed, we systematically verified that such regular vanishing does not occur in multiple Hida families twisted by a wide range of quadratic characters by computing the corresponding two-variable $p$-adic $L$-functions via overconvergent modular symbols.


title: Scaling asymptotics for ladder sequences of spherical harmonics at caustic latitudes

abstract: We study the concentration of ladder sequences of spherical harmonics on caustic latitude circles. We prove that they have Airy scaling asymptotics. We also determine the weak* limit of certain empirical measures of $L^2$ norms of restrictions of spherical harmonics to these latitude circles.


title: Smoothness of the density for McKean-Vlasov SDEs with measurable kernel

abstract: Consider the McKean-Vlasov SDE $$ dX_t=\langle b(X_t-\cdot),\mu_t\rangle dt+dW_t,\quad \mu_t=\operatorname{Law}(X_t), $$ where $W$ is the $n$-dimensional Brownian motion and $b:\mathbb{R}^d\to\mathbb{R}^d$ is a measurable function. First assuming $b\in L^\infty$, we prove that the law $\mu_t$ of $X_t$ has a density $p_t$ with respect to the Lebesgue measure, which is continuously differentiable with gradient being $\gamma$-H\"older continuous for each $\gamma\in(0,1)$. Assume further that $b\in \mathcal{C}_b^1$, we prove that the density $p_t$ is infinitely differentiable. In the regularization by noise perspective, this shows McKean-Vlasov SDEs tend to have a smoother density function than SDEs without density dependence, under the same regularity assumption of the coefficients. We observe similar phenomenon for singular interaction kernels satisfying Krylov's integrability condition, for distributional kernels $b\in B_{\infty,\infty}^\alpha$, $\alpha\in(-1,0)$, and for processes driven by an $\alpha$-stable noise for $\alpha\in(1,2)$.


title: Decentralized Risk-Aware Tracking of Multiple Targets

abstract: We consider the setting where a team of robots is tasked with tracking multiple targets with the following property: approaching the targets enables more accurate target position estimation, but also increases the risk of sensor failures. Therefore, it is essential to address the trade-off between tracking quality maximization and risk minimization. In our previous work, a centralized controller is developed to plan motions for all the robots -- however, this is not a scalable approach. Here, we present a decentralized and risk-aware multi-target tracking framework, in which each robot plans its motion trading off tracking accuracy maximization and aversion to risk, while only relying on its own information and information exchanged with its neighbors. We use the control barrier function to guarantee network connectivity throughout the tracking process. Extensive numerical experiments demonstrate that our system can achieve similar tracking accuracy and risk-awareness to its centralized counterpart.


title: 4D supersymmetric gauge theories of spacetime translations

abstract: The paper addresses the question whether in four spacetime dimensions, besides standard supergravity theories, field theories exist whose symmetries include local spacetime translations and supersymmetries generated by transformations whose commutators contain infinitesimal local spacetime translations. It is shown that, up to local field redefinitions, there is a unique class of such supersymmetric field theories satisfying specified prerequisites which particularly concern the field content of the theories. The theories of this class have global supersymmetry and are similar to globally supersymmetric Yang-Mills theories.


title: Spherical maximal operators on Heisenberg groups: Restricted dilation sets

abstract: Consider spherical means on the Heisenberg group with a codimension two incidence relation, and associated spherical local maximal functions $M_Ef$ where the dilations are restricted to a set $E$. We prove $L^p\to L^q$ estimates for these maximal operators; the results depend on various notions of dimension of $E$.


title: Spectral Properties of Disordered Interacting Non-Hermitian Systems

abstract: Non-hermitian systems have gained a lot of interest in recent years. However, notions of chaos and localization in such systems have not reached the same level of maturity as in the Hermitian systems. Here, we consider non-hermitian interacting disordered Hamiltonians and attempt to analyze their chaotic behavior or lack of it through the lens of the recently introduced non-hermitian analog of the spectral form factor and the complex spacing ratio. We consider three widely relevant non-hermitian models which are unique in their ways and serve as excellent platforms for such investigations. Two of the models considered are short-ranged and have different symmetries. The third model is long-ranged, whose hermitian counterpart has itself become a subject of growing interest. All these models exhibit a deep connection with the non-hermitian Random Matrix Theory of corresponding symmetry classes at relatively weak disorder. At relatively strong disorder, the models show the absence of complex eigenvalue correlation, thereby, corresponding to Poisson statistics. Our thorough analysis is expected to play a crucial role in understanding disordered open quantum systems in general.


title: Parallel block preconditioners for virtual element discretizations of the time-dependent Maxwell equations

abstract: The focus of this study is the construction and numerical validation of parallel block preconditioners for low order virtual element discretizations of the three-dimensional Maxwell equations. The virtual element method (VEM) is a recent technology for the numerical approximation of partial differential equations (PDEs), that generalizes finite elements to polytopal computational grids. So far, VEM has been extended to several problems described by PDEs, and recently also to the time-dependent Maxwell equations. When the time discretization of PDEs is performed implicitly, at each time-step a large-scale and ill-conditioned linear system must be solved, that, in case of Maxwell equations, is particularly challenging, because of the presence of both H(div) and H(curl) discretization spaces. We propose here a parallel preconditioner, that exploits the Schur complement block factorization of the linear system matrix and consists of a Jacobi preconditioner for the H(div) block and an auxiliary space preconditioner for the H(curl) block. Several parallel numerical tests have been perfomed to study the robustness of the solver with respect to mesh refinement, shape of polyhedral elements, time step size and the VEM stabilization parameter.


title: QC-ODKLA: Quantized and Communication-Censored Online Decentralized Kernel Learning via Linearized ADMM

abstract: This paper focuses on online kernel learning over a decentralized network. Each agent in the network receives continuous streaming data locally and works collaboratively to learn a nonlinear prediction function that is globally optimal in the reproducing kernel Hilbert space with respect to the total instantaneous costs of all agents. In order to circumvent the curse of dimensionality issue in traditional online kernel learning, we utilize random feature (RF) mapping to convert the non-parametric kernel learning problem into a fixed-length parametric one in the RF space. We then propose a novel learning framework named Online Decentralized Kernel learning via Linearized ADMM (ODKLA) to efficiently solve the online decentralized kernel learning problem. To further improve the communication efficiency, we add the quantization and censoring strategies in the communication stage and develop the Quantized and Communication-censored ODKLA (QC-ODKLA) algorithm. We theoretically prove that both ODKLA and QC-ODKLA can achieve the optimal sublinear regret $\mathcal{O}(\sqrt{T})$ over $T$ time slots. Through numerical experiments, we evaluate the learning effectiveness, communication, and computation efficiencies of the proposed methods.


title: Attention and DCT based Global Context Modeling for Text-independent Speaker Recognition

abstract: Learning an effective speaker representation is crucial for achieving reliable performance in speaker verification tasks. Speech signals are high-dimensional, long, and variable-length sequences containing diverse information at each time-frequency (TF) location. The standard convolutional layer that operates on neighboring local regions often fails to capture the complex TF global information. Our motivation is to alleviate these challenges by increasing the modeling capacity, emphasizing significant information, and suppressing possible redundancies. We aim to design a more robust and efficient speaker recognition system by incorporating the benefits of attention mechanisms and Discrete Cosine Transform (DCT) based signal processing techniques, to effectively represent the global information in speech signals. To achieve this, we propose a general global time-frequency context modeling block for speaker modeling. First, an attention-based context model is introduced to capture the long-range and non-local relationship across different time-frequency locations. Second, a 2D-DCT based context model is proposed to improve model efficiency and examine the benefits of signal modeling. A multi-DCT attention mechanism is presented to improve modeling power with alternate DCT base forms. Finally, the global context information is used to recalibrate salient time-frequency locations by computing the similarity between the global context and local features. This effectively improves the speaker verification performance compared to the standard ResNet model and Squeeze & Excitation block by a large margin. Our experimental results show that the proposed global context modeling method can efficiently improve the learned speaker representations by achieving channel-wise and time-frequency feature recalibration.


title: Lp-asymptotic stability of 1D damped wave equations with localized and nonlinear damping

abstract: In this paper, we study the $L^p$-asymptotic stability with $p\in (1,\infty)$ of the one-dimensional nonlinear damped wave equation with a localized damping and Dirichlet boundary conditions in a bounded domain $(0,1)$. We start by addressing the well-posedness problem. We prove the existence and the uniqueness of weak solutions for $p\in [2,\infty)$ and the existence and the uniqueness of strong solutions for all $p\in [1,\infty)$. The proofs rely on the well-posedness already proved in the $L^\infty$ framework by [4] combined with a density argument. Then we prove that the energy of strong solutions decays exponentially to zero. The proof relies on the multiplier method combined with the work that has been done in the linear case in [8].


title: Non-Gaussian displacement distributions in models of heterogeneous active particle dynamics

abstract: We study the effect of randomly distributed diffusivities and speeds in two models for active particle dynamics with active and passive fluctuations. We demonstrate how non-Gaussian displacement distributions emerge in these models in the long time limit, including Cauchy-type and exponential (Laplace) shapes. Notably the resulting shapes of the displacement distributions with distributed diffusivities for the active models considered here are in striking contrast to passive diffusion models. For the active motion models our discussion points out the differences between active- and passive-noise. Specifically, we demonstrate that the case with active-noise is in nice agreement with measured data for the displacement distribution of social amoeba.


abstract: The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) dataset will dramatically alter our understanding of the Universe, from the origins of the Solar System to the nature of dark matter and dark energy. Much of this research will depend on the existence of robust, tested, and scalable algorithms, software, and services. Identifying and developing such tools ahead of time has the potential to significantly accelerate the delivery of early science from LSST. Developing these collaboratively, and making them broadly available, can enable more inclusive and equitable collaboration on LSST science. To facilitate such opportunities, a community workshop entitled "From Data to Software to Science with the Rubin Observatory LSST" was organized by the LSST Interdisciplinary Network for Collaboration and Computing (LINCC) and partners, and held at the Flatiron Institute in New York, March 28-30th 2022. The workshop included over 50 in-person attendees invited from over 300 applications. It identified seven key software areas of need: (i) scalable cross-matching and distributed joining of catalogs, (ii) robust photometric redshift determination, (iii) software for determination of selection functions, (iv) frameworks for scalable time-series analyses, (v) services for image access and reprocessing at scale, (vi) object image access (cutouts) and analysis at scale, and (vii) scalable job execution systems. This white paper summarizes the discussions of this workshop. It considers the motivating science use cases, identified cross-cutting algorithms, software, and services, their high-level technical specifications, and the principles of inclusive collaborations needed to develop them. We provide it as a useful roadmap of needs, as well as to spur action and collaboration between groups and individuals looking to develop reusable software for early LSST science.


title: Panchromatic evolution of three luminous red novae: Forbidden hugs in pandemic times -- IV

abstract: We present photometric and spectroscopic data on three extragalactic luminous red novae (LRNe): AT2018bwo, AT2021afy, and AT2021blu. AT2018bwo was discovered in NGC45 (at 6.8 Mpc) a few weeks after the outburst onset. During the monitoring period, the transient reached a peak luminosity of 10^40 erg/s. AT2021afy, hosted by UGC10043 (49.2 Mpc), showed a double-peaked light curve, with the two peaks reaching a similar luminosity of 2.1(+-0.6)x10^41 erg/s. For AT2021blu in UGC5829, (8.6 Mpc), the pre-outburst phase was well-monitored by several photometric surveys, and the object showed a slow luminosity rise before the outburst. The light curve of AT2021blu was sampled with an unprecedented cadence until the object disappeared behind the Sun, and it was then recovered at late phases. The light curve of AT2021blu shows a double peak, with a prominent early maximum reaching a luminosity of 6.5x10^40 erg/s, which is half of that of AT2021afy. The spectra of AT2021afy and AT2021blu display the expected evolution for LRNe: a blue continuum dominated by prominent Balmer lines in emission during the first peak, and a redder continuum consistent with that of a K-type star with narrow absorption metal lines during the second, broad maximum. The spectra of AT2018bwo are markedly different, with a very red continuum dominated by broad molecular features in absorption. As these spectra closely resemble those of LRNe after the second peak, AT2018bwo was probably discovered at the very late evolutionary stages. This would explain its fast evolution and the spectral properties compatible with that of an M-type star. From the analysis of deep frames of the LRN sites years before the outburst, and considerations of the light curves, the quiescent progenitor systems of the three LRNe were likely massive, with primaries ranging from 13Mo for AT2018bwo, to 13-18Mo for AT2021blu, and over 40Mo for AT2021afy.


title: Highly parallelizable electronic transport calculations in periodic Rhodium and Copper nanostructures

abstract: We extend the highly-parallelizable open-source electronic transport code TRANSEC to perform real-space atomic-scale electronic transport calculations with periodic boundary conditions in the lateral dimensions. We demonstrate the use of TRANSEC in periodic Cu and Rh bulk structures and in large periodic Rh point contacts, in preparation to perform calculations of reflection probability across Rh grain boundaries.


title: Topological Metal MoP Nanowire for Interconnect

abstract: The increasing resistance of Cu interconnects for decreasing dimensions is a major challenge in continued downscaling of integrated circuits beyond the 7-nm technology node as it leads to unacceptable signal delays and power consumption in computing. The resistivity of Cu increases due to electron scattering at surfaces and grain boundaries of the interconnects at the nanoscale. Topological semimetals, owing to their topologically protected surface states and suppressed electron backscattering, are promising material candidates to potentially replace current Cu interconnects as low-resistance interconnects. Here, we report the attractive resistivity scaling of topological metal MoP nanowires and show that the resistivity values are comparable to those of Cu interconnects below 500 nm$^2$ cross-section areas. More importantly, we demonstrate that the dimensional scaling of MoP nanowires, in terms of line resistance versus total cross-sectional area, is superior to those of effective Cu and barrier-less Ru interconnects, suggesting MoP is an attractive solution to the current scaling challenge of Cu interconnects.


title: Notions, Stability, Existence, and Robustness of Limit Cycles in Hybrid Dynamical Systems

abstract: This paper deals with existence and robust stability of hybrid limit cycles for a class of hybrid systems given by the combination of continuous dynamics on a flow set and discrete dynamics on a jump set. For this purpose, the notion of Zhukovskii stability, typically stated for continuous-time systems, is extended to the hybrid systems. Necessary conditions, particularly, a condition using a forward invariance notion, for existence of hybrid limit cycles are first presented. In addition, a sufficient condition, related to Zhukovskii stability, for the existence of (or lack of) hybrid limit cycles is established. Furthermore, under mild assumptions, we show that asymptotic stability of such hybrid limit cycles is not only equivalent to asymptotic stability of a fixed point of the associated Poincar\'{e} map but also robust to perturbations. Specifically, robustness to generic perturbations, which capture state noise and unmodeled dynamics, and to inflations of the flow and jump sets are established in terms of $\mathcal{KL}$ bounds. Furthermore, results establishing relationships between the properties of a computed Poincar\'{e} map, which is necessarily affected by computational error, and the actual asymptotic stability properties of a hybrid limit cycle are proposed. In particular, it is shown that asymptotic stability of the exact Poincar\'{e} map is preserved when computed with enough precision. Several examples, including a congestion control system and spiking neurons, are presented to illustrate the notions and results throughout the paper.


title: Developing a New Generation of Integrated Micro-Spec Far Infrared Spectrometers for the EXperiment for Cryogenic Large-Aperture Intensity Mapping (EXCLAIM)

abstract: The current state of far-infrared astronomy drives the need to develop compact, sensitive spectrometers for future space and ground-based instruments. Here we present details of the $\rm \mu$-Spec spectrometers currently in development for the far-infrared balloon mission EXCLAIM. The spectrometers are designed to cover the $\rm 555 - 714\ \mu$m range with a resolution of $\rm R\ =\ \lambda / \Delta\lambda\ =\ 512$ at the $\rm 638\ \mu$m band center. The spectrometer design incorporates a Rowland grating spectrometer implemented in a parallel plate waveguide on a low-loss single-crystal Si chip, employing Nb microstrip planar transmission lines and thin-film Al kinetic inductance detectors (KIDs). The EXCLAIM $\rm \mu$-Spec design is an advancement upon a successful $\rm R = 64\ \mu$-Spec prototype, and can be considered a sub-mm superconducting photonic integrated circuit (PIC) that combines spectral dispersion and detection. The design operates in a single $M{=}2$ grating order, allowing one spectrometer to cover the full EXCLAIM band without requiring a multi-order focal plane. The EXCLAIM instrument will fly six spectrometers, which are fabricated on a single 150 mm diameter Si wafer. Fabrication involves a flip-wafer-bonding process with patterning of the superconducting layers on both sides of the Si dielectric. The spectrometers are designed to operate at 100 mK, and will include 355 Al KID detectors targeting a goal of NEP ${\sim}8\times10^{-19}$ $\rm W/\sqrt{Hz}$. We summarize the design, fabrication, and ongoing development of these $\rm \mu$-Spec spectrometers for EXCLAIM.


title: Modular Grammatical Evolution for the Generation of Artificial Neural Networks

abstract: This paper presents a novel method, called Modular Grammatical Evolution (MGE), towards validating the hypothesis that restricting the solution space of NeuroEvolution to modular and simple neural networks enables the efficient generation of smaller and more structured neural networks while providing acceptable (and in some cases superior) accuracy on large data sets. MGE also enhances the state-of-the-art Grammatical Evolution (GE) methods in two directions. First, MGE's representation is modular in that each individual has a set of genes, and each gene is mapped to a neuron by grammatical rules. Second, the proposed representation mitigates two important drawbacks of GE, namely the low scalability and weak locality of representation, towards generating modular and multi-layer networks with a high number of neurons. We define and evaluate five different forms of structures with and without modularity using MGE and find single-layer modules with no coupling more productive. Our experiments demonstrate that modularity helps in finding better neural networks faster. We have validated the proposed method using ten well-known classification benchmarks with different sizes, feature counts, and output class count. Our experimental results indicate that MGE provides superior accuracy with respect to existing NeuroEvolution methods and returns classifiers that are significantly simpler than other machine learning generated classifiers. Finally, we empirically demonstrate that MGE outperforms other GE methods in terms of locality and scalability properties.


title: Continuous guts poker and numerical optimization of generalized recursive games

abstract: We study a type of generalized recursive game introduced by Castronova, Chen, and Zumbrun featuring increasing stakes, with an emphasis on continuous guts poker and $1$ v. $n$ coalitions. Our main results are to develop practical numerical algorithms with rigorous underlying theory for the approximation of optimal mutiplayer strategies, and to use these to obtain a number of interesting observations about guts. Outcomes are a striking 2-strategy optimum for $n$-player coalitions, with asymptotic advantage approximately $16\%$; convergence of Fictitious Play to symmetric Nash equilibrium; and a malevolent interactive $n$-player "bot" for demonstration.


title: Feature selection with gradient descent on two-layer networks in low-rotation regimes

abstract: This work establishes low test error of gradient flow (GF) and stochastic gradient descent (SGD) on two-layer ReLU networks with standard initialization, in three regimes where key sets of weights rotate little (either naturally due to GF and SGD, or due to an artificial constraint), and making use of margins as the core analytic technique. The first regime is near initialization, specifically until the weights have moved by $\mathcal{O}(\sqrt m)$, where $m$ denotes the network width, which is in sharp contrast to the $\mathcal{O}(1)$ weight motion allowed by the Neural Tangent Kernel (NTK); here it is shown that GF and SGD only need a network width and number of samples inversely proportional to the NTK margin, and moreover that GF attains at least the NTK margin itself, which suffices to establish escape from bad KKT points of the margin objective, whereas prior work could only establish nondecreasing but arbitrarily small margins. The second regime is the Neural Collapse (NC) setting, where data lies in extremely-well-separated groups, and the sample complexity scales with the number of groups; here the contribution over prior work is an analysis of the entire GF trajectory from initialization. Lastly, if the inner layer weights are constrained to change in norm only and can not rotate, then GF with large widths achieves globally maximal margins, and its sample complexity scales with their inverse; this is in contrast to prior work, which required infinite width and a tricky dual convergence assumption. As purely technical contributions, this work develops a variety of potential functions and other tools which will hopefully aid future work.


title: A Stress Induced Source of Phonon Bursts and Quasiparticle Poisoning

abstract: The performance of superconducting qubits is degraded by a poorly characterized set of energy sources breaking the Cooper pairs responsible for superconductivity, creating a condition often called "quasiparticle poisoning." Recently, a superconductor with one of the lowest average quasiparticle densities ever measured exhibited quasiparticles primarily produced in bursts which decreased in rate with time after cooldown. Similarly, several cryogenic calorimeters used to search for dark matter have also observed an unknown source of low-energy phonon bursts that decrease in rate with time after cooldown. Here, we show that a silicon crystal glued to its holder exhibits a rate of low-energy phonon events that is more than two orders of magnitude larger than in a functionally identical crystal suspended from its holder in a low-stress state. The excess phonon event rate in the glued crystal decreases with time since cooldown, consistent with a source of phonon bursts which contributes to quasiparticle poisoning in quantum circuits and the low-energy events observed in cryogenic calorimeters. We argue that relaxation of thermally induced stress between the glue and crystal is the source of these events, and conclude that stress relaxation contributes to quasiparticle poisoning in superconducting qubits and the athermal phonon background in a broad class of rare-event searches.


title: Fast computation of non-linear power spectrum in cosmologies with massive neutrinos

abstract: We compute 1-loop corrections to the redshift space galaxy power spectrum in cosmologies containing additional scales, and hence kernels different from Einstein-de Sitter (EdS). Specifically, our method is tailored for cosmologies in the presence of massive neutrinos and some modified gravity models; in this article we concentrate on the former case. The perturbative kernels have contributions that we notice appear either from the logarithmic growth factor $f(k,t)$, which is scale-dependent because of the neutrino free-streaming, or from the failure of the commonly used approximation $f^2=\Omega_m$. The latter contributions make the computation of loop corrections quite slow, precluding full-shape analyses for parameter estimation. However, we identify that the dominant pieces of the kernels come from the growth factor, allowing us to simplify the kernels but retaining the characteristic free-streaming scale introduced by the neutrinos' mass. Moreover, with this simplification one can exploit FFTLog methods to speed up the computations even more. We validate our analytical modeling and numerical method with halo catalogs extracted from the Quijote simulations finding good agreement with the, a priori, known cosmological parameters. We make public our Python code FOLPS$\nu$ to compute the redshift space power spectrum in a fraction of second. Code available at https://github.com/henoriega/FOLPS-nu.


title: A Cooperative Perception Environment for Traffic Operations and Control

abstract: Existing data collection methods for traffic operations and control usually rely on infrastructure-based loop detectors or probe vehicle trajectories. Connected and automated vehicles (CAVs) not only can report data about themselves but also can provide the status of all detected surrounding vehicles. Integration of perception data from multiple CAVs as well as infrastructure sensors (e.g., LiDAR) can provide richer information even under a very low penetration rate. This paper aims to develop a cooperative data collection system, which integrates Lidar point cloud data from both infrastructure and CAVs to create a cooperative perception environment for various transportation applications. The state-of-the-art 3D detection models are applied to detect vehicles in the merged point cloud. We test the proposed cooperative perception environment with the max pressure adaptive signal control model in a co-simulation platform with CARLA and SUMO. Results show that very low penetration rates of CAV plus an infrastructure sensor are sufficient to achieve comparable performance with 30% or higher penetration rates of connected vehicles (CV). We also show the equivalent CV penetration rate (E-CVPR) under different CAV penetration rates to demonstrate the data collection efficiency of the cooperative perception environment.


title: Simple Stochastic Modeling of Snowball Probability Throughout Earth History

abstract: Over its multibillion-year history, Earth has exhibited a wide range of climates. Its history ranges from snowball episodes where the surface was mostly or entirely covered by ice to periods much warmer than today, where the cryosphere was virtually absent. Our understanding of greenhouse gas evolution over this long history, specifically carbon dioxide, is mainly informed by deterministic models. However, the complexity of the carbon cycle and its uncertainty over time motivates the study of non-deterministic models, where key elements of the cycle are represented by inherently stochastic processes. By doing so, we can learn what models of variability are compatible with Earth's climate record instead of how exactly this variability is produced. In this study, we address why there were snowballs in the Proterozoic, but not the Phanerozoic by discussing two simple stochastic models of long-term carbon-cycle variability. The first, which is the most simple and represents CO2 concentration directly as a stochastic process, is instructive and perhaps intuitive, but is incompatible with the absence of snowballs in the Phanerozoic. The second, which separates carbon source from sink and represents CO2 outgassing as a stochastic process instead of concentration, is more flexible. When outgassing fluctuates over longer periods, as opposed to brief and rapid excursions from a mean state, this model is more compatible with the snowball record, showing only modest increases in the probability of snowball events over Earth history. The contrast between these models illustrates what kind of variability may have characterized the long-term carbon cycle.


title: Schrodinger's Galaxy Candidate: Puzzlingly Luminous at $z\approx17$, or Dusty/Quenched at $z\approx5$?

abstract: $JWST$'s first glimpse of the $z>10$ Universe has yielded a surprising abundance of luminous galaxy candidates. Here we present the most extreme of these systems: CEERS-1749. Based on $0.6-5\mu$m photometry, this strikingly luminous ($\approx$26 mag) galaxy appears to lie at $z\approx17$. This would make it an $M_{\rm{UV}}\approx-22$, $M_{\rm{\star}}\approx5\times10^{9}M_{\rm{\odot}}$ system that formed a mere $\sim220$ Myrs after the Big Bang. The implied number density of this galaxy and its analogues challenges virtually every early galaxy evolution model that assumes $\Lambda$CDM cosmology. However, there is strong environmental evidence supporting a secondary redshift solution of $z\approx5$: all three of the galaxy's nearest neighbors at $<2.5$" have photometric redshifts of $z\approx5$. Further, we show that CEERS-1749 may lie in a $z\approx5$ protocluster that is $\gtrsim5\times$ overdense compared to the field. Intense line emission at $z\approx5$ from a quiescent galaxy harboring ionized gas, or from a dusty starburst, may provide satisfactory explanations for CEERS-1749's photometry. The emission lines at $z\approx5$ conspire to boost the $>2\mu$m photometry, producing an apparent blue slope as well as a strong break in the SED. Such a perfectly disguised contaminant is possible only in a narrow redshift window ($\Delta z\lesssim0.1$), implying that the permitted volume for such interlopers may not be a major concern for $z>10$ searches, particularly when medium-bands are deployed. If CEERS-1749 is confirmed to lie at $z\approx5$, it will be the highest-redshift quiescent galaxy, or one of the lowest mass dusty galaxies of the early Universe detected to-date. Both redshift solutions of this intriguing galaxy hold the potential to challenge existing models of early galaxy evolution, making spectroscopic follow-up of this source critical.


title: Field-Induced Partial Disorder in a Shastry-Sutherland Lattice

abstract: A 2-Q antiferromagnetic order of the ferromagnetic dimers was found below TN = 2.9 K in the Shastry-Sutherland lattice BaNd2ZnS5 by single crystal neutron diffraction. The magnetic order can be understood by the orthogonal arrangement of local Ising Nd spins, identified by polarized neutrons. A field was applied along [1 -1 0] to probe the observed metamagnetic transition in the magnetization measurement. The field decouples two magnetic sublattices corresponding to the propagation vectors q1= (0.5, 0.5, 0) and q2= (-0.5, 0.5, 0), respectively. Each sublattice shows a stripe order with a Neel-type arrangement in each single layer. The stripe order with q1 remains nearly intact up to 6 T, while the other one with q2 is suppressed at a critical field Hc ~1.7 T, indicating a partial disorder. The Hc varies with temperature and is manifested in the H-T phase diagram constructed by measuring the magnetization in BaNd2ZnS5.


title: Understanding Teenage Perceptions and Configurations of Privacy on Instagram

abstract: As teenage use of social media platform continues to proliferate, so do concerns about teenage privacy and safety online. Prior work has established that privacy on networked publics, such as social media, is complex, requiring users to navigate not only the technical affordances on the platform but also interpersonal relationships and social norms. We investigate how teenagers think about privacy on the popular image-sharing platform, Instagram. We draw on an online survey (N=144) and semi-structured interviews (N=21) with teenagers, ages 13-19, to gain a better understanding how teenagers configure privacy on the popular image-sharing platform Instagram and why they make these privacy decisions. Finally, based on our findings, we provide design recommendations towards the design of better privacy controls for promoting teenage safety online.


title: Vision-Centric BEV Perception: A Survey

abstract: In recent years, vision-centric Bird's Eye View (BEV) perception has garnered significant interest from both industry and academia due to its inherent advantages, such as providing an intuitive representation of the world and being conducive to data fusion. The rapid advancements in deep learning have led to the proposal of numerous methods for addressing vision-centric BEV perception challenges. However, there has been no recent survey encompassing this novel and burgeoning research field. To catalyze future research, this paper presents a comprehensive survey of the latest developments in vision-centric BEV perception and its extensions. It compiles and organizes up-to-date knowledge, offering a systematic review and summary of prevalent algorithms. Additionally, the paper provides in-depth analyses and comparative results on various BEV perception tasks, facilitating the evaluation of future works and sparking new research directions. Furthermore, the paper discusses and shares valuable empirical implementation details to aid in the advancement of related algorithms.


title: Tropical contraction of tensor networks as a Bell inequality optimization toolset

abstract: We show that finding the classical bound of broad families of Bell inequalities can be naturally framed as the contraction of an associated tensor network, but in tropical algebra, where the sum is replaced by the minimum and the product is replaced by the arithmetic addition. We illustrate our method with paradigmatic examples both in the multipartite scenario and the bipartite scenario with multiple outcomes. We showcase how the method extends into the thermodynamic limit for some translationally invariant systems and establish a connection between the notions of tropical eigenvalue and the classical bound per particle as a fixed point of a tropical renormalization procedure.


title: Bayesian calibration of traffic flow fundamental diagrams using Gaussian processes

abstract: Modeling the relationship between vehicle speed and density on the road is a fundamental problem in traffic flow theory. Recent research found that using the least-squares (LS) method to calibrate single-regime speed-density models is biased because of the uneven distribution of samples. This paper explains the issue of the LS method from a statistical perspective: the biased calibration is caused by the correlations/dependencies in regression residuals. Based on this explanation, we propose a new calibration method for single-regime speed-density models by modeling the covariance of residuals via a zero-mean Gaussian Process (GP). Our approach can be viewed as a generalized least-squares (GLS) method with a specific covariance structure (i.e., kernel function) and is a generalization of the existing LS and the weighted least-squares (WLS) methods. Next, we use a sparse approximation to address the scalability issue of GPs and apply a Markov chain Monte Carlo (MCMC) sampling scheme to obtain the posterior distributions of the parameters for speed-density models and the hyperparameters (i.e., length scale and variance) of the GP kernel. Finally, we calibrate six well-known single-regime speed-density models with the proposed method. Results show that the proposed GP-based methods (1) significantly reduce the biases in the LS calibration, (2) achieve a similar effect as the WLS method, (3) can be used as a non-parametric speed-density model, and (4) provide a Bayesian solution to estimate posterior distributions of parameters and speed-density functions.


title: Boltzmann equations for astrophysical Stochastic Gravitational Wave Backgrounds scattering off of massive objects

abstract: This work presents a set of coupled Boltzmann equations describing the intensity and polarisation Stokes parameters of the SGWB. Collision terms, which account for gravitational Compton scattering off of massive objects, are also included. This set resembles that for the CMB Stokes parameters, but the different spin nature of the gravitational radiation and the physics involved in the scattering process determine crucial differences. In this case, due to the Rutherford angular dependence of the cross section, all the SGWB intensity multipoles of order $\ell$ are scattered out, producing outgoing intensity anisotropies of any order $\ell$ if they are present in the incoming radiation. On the other hand, SGWB linear polarisation modes can be expanded in a basis of spherical harmonics with $m=\pm 4$ and $\ell\ge 4$. This means that SGWB polarisation modes can be generated from unpolarised anisotropic radiation only with $m=\pm 4$, therefore requiring at least a hexadecapole anisotropy ($\ell\ge 4$) in the incoming intensity. Assuming a simplified toy model, we solve analytically the set of coupled Boltzmann equations to get explicit expressions for the intensity and polarisation angular power spectra. We confirm the contribution of the gravitational Compton scattering to the SGWB anisoptropies is extremely small for collisions with compact objects in the frequency range of current and upcoming surveys. The system of coupled Boltzmann equations presented here provides a way to an accurate estimate of the total amount of anisotropies generated by multiple SGWB scattering processes off of massive objects, as well as the interplay between polarisation and intensity, during the GW propagation across the LSS of the universe. These results will be useful for the full treatment of the astrophysical SWGB anisotropies in view of upcoming gravitational waves observatories.


title: Transformers as Meta-Learners for Implicit Neural Representations

abstract: Implicit Neural Representations (INRs) have emerged and shown their benefits over discrete representations in recent years. However, fitting an INR to the given observations usually requires optimization with gradient descent from scratch, which is inefficient and does not generalize well with sparse observations. To address this problem, most of the prior works train a hypernetwork that generates a single vector to modulate the INR weights, where the single vector becomes an information bottleneck that limits the reconstruction precision of the output INR. Recent work shows that the whole set of weights in INR can be precisely inferred without the single-vector bottleneck by gradient-based meta-learning. Motivated by a generalized formulation of gradient-based meta-learning, we propose a formulation that uses Transformers as hypernetworks for INRs, where it can directly build the whole set of INR weights with Transformers specialized as set-to-set mapping. We demonstrate the effectiveness of our method for building INRs in different tasks and domains, including 2D image regression and view synthesis for 3D objects. Our work draws connections between the Transformer hypernetworks and gradient-based meta-learning algorithms and we provide further analysis for understanding the generated INRs.


title: Automatic dense annotation of large-vocabulary sign language videos

abstract: Recently, sign language researchers have turned to sign language interpreted TV broadcasts, comprising (i) a video of continuous signing and (ii) subtitles corresponding to the audio content, as a readily available and large-scale source of training data. One key challenge in the usability of such data is the lack of sign annotations. Previous work exploiting such weakly-aligned data only found sparse correspondences between keywords in the subtitle and individual signs. In this work, we propose a simple, scalable framework to vastly increase the density of automatic annotations. Our contributions are the following: (1) we significantly improve previous annotation methods by making use of synonyms and subtitle-signing alignment; (2) we show the value of pseudo-labelling from a sign recognition model as a way of sign spotting; (3) we propose a novel approach for increasing our annotations of known and unknown classes based on in-domain exemplars; (4) on the BOBSL BSL sign language corpus, we increase the number of confident automatic annotations from 670K to 5M. We make these annotations publicly available to support the sign language research community.


title: Semantic Data Augmentation based Distance Metric Learning for Domain Generalization

abstract: Domain generalization (DG) aims to learn a model on one or more different but related source domains that could be generalized into an unseen target domain. Existing DG methods try to prompt the diversity of source domains for the model's generalization ability, while they may have to introduce auxiliary networks or striking computational costs. On the contrary, this work applies the implicit semantic augmentation in feature space to capture the diversity of source domains. Concretely, an additional loss function of distance metric learning (DML) is included to optimize the local geometry of data distribution. Besides, the logits from cross entropy loss with infinite augmentations is adopted as input features for the DML loss in lieu of the deep features. We also provide a theoretical analysis to show that the logits can approximate the distances defined on original features well. Further, we provide an in-depth analysis of the mechanism and rational behind our approach, which gives us a better understanding of why leverage logits in lieu of features can help domain generalization. The proposed DML loss with the implicit augmentation is incorporated into a recent DG method, that is, Fourier Augmented Co-Teacher framework (FACT). Meanwhile, our method also can be easily plugged into various DG methods. Extensive experiments on three benchmarks (Digits-DG, PACS and Office-Home) have demonstrated that the proposed method is able to achieve the state-of-the-art performance.


title: Cluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labels

abstract: Domain adaptation for semantic segmentation across datasets consisting of the same categories has seen several recent successes. However, a more general scenario is when the source and target datasets correspond to non-overlapping label spaces. For example, categories in segmentation datasets change vastly depending on the type of environment or application, yet share many valuable semantic relations. Existing approaches based on feature alignment or discrepancy minimization do not take such category shift into account. In this work, we present Cluster-to-Adapt (C2A), a computationally efficient clustering-based approach for domain adaptation across segmentation datasets with completely different, but possibly related categories. We show that such a clustering objective enforced in a transformed feature space serves to automatically select categories across source and target domains that can be aligned for improving the target performance, while preventing negative transfer for unrelated categories. We demonstrate the effectiveness of our approach through experiments on the challenging problem of outdoor to indoor adaptation for semantic segmentation in few-shot as well as zero-shot settings, with consistent improvements in performance over existing approaches and baselines in all cases.


title: Gravitational wave inference on a numerical-relativity simulation of a black hole merger beyond general relativity

abstract: We apply common gravitational wave inference procedures on binary black hole merger waveforms beyond general relativity. We consider dynamical Chern-Simons gravity, a modified theory of gravity with origins in string theory and loop quantum gravity. This theory introduces an additional parameter $\ell$, corresponding to the length-scale below which beyond-general-relativity effects become important. We simulate data based on numerical relativity waveforms produced under an approximation to this theory, which differ from those of general relativity in the strongly nonlinear merger regime. We consider a system with parameters similar to GW150914 with different values of $\ell$ and signal-to-noise ratios. We perform two analyses of the simulated data. The first is a template-based analysis that uses waveforms derived under general relativity and allows us to identify degeneracies between the two waveform morphologies. The second is a morphology-independent analysis based on BayesWave that does not assume that the signal is consistent with general relativity. The BayesWave analysis faithfully reconstructs the simulated signals. However, waveform models derived under general relativity are unable to fully mimic the simulated modified-gravity signals and such a deviation would be identifiable with existing inference tools. Depending on the magnitude of the deviation, we find that the templated analysis can under perform the morphology-independent analysis in fully recovering simulated beyond-GR waveforms even for achievable signal-to-noise ratios $\gtrsim 20{-}30$.


title: A tree perspective on stick-breaking models in covariate-dependent mixtures

abstract: Stick-breaking (SB) processes are often adopted in Bayesian mixture models for generating mixing weights. When covariates influence the sizes of clusters, SB mixtures are particularly convenient as they can leverage their connection to binary regression to ease both the specification of covariate effects and posterior computation. Existing SB models are typically constructed based on continually breaking a single remaining piece of the unit stick. We view this from a dyadic tree perspective in terms of a lopsided bifurcating tree that extends only in one side. We show that several unsavory characteristics of SB models are in fact largely due to this lopsided tree structure. We consider a generalized class of SB models with alternative bifurcating tree structures and examine the influence of the underlying tree topology on the resulting Bayesian analysis in terms of prior assumptions, posterior uncertainty, and computational effectiveness. In particular, we provide evidence that a balanced tree topology, which corresponds to continually breaking all remaining pieces of the unit stick, can resolve or mitigate several undesirable properties of SB models that rely on a lopsided tree.


title: Background Modeling for Double Higgs Boson Production: Density Ratios and Optimal Transport

abstract: We study the problem of data-driven background estimation, arising in the search of physics signals predicted by the Standard Model at the Large Hadron Collider. Our work is motivated by the search for the production of pairs of Higgs bosons decaying into four bottom quarks. A number of other physical processes, known as background, also share the same final state. The data arising in this problem is therefore a mixture of unlabeled background and signal events, and the primary aim of the analysis is to determine whether the proportion of unlabeled signal events is nonzero. A challenging but necessary first step is to estimate the distribution of background events. Past work in this area has determined regions of the space of collider events where signal is unlikely to appear, and where the background distribution is therefore identifiable. The background distribution can be estimated in these regions, and extrapolated into the region of primary interest using transfer learning with a multivariate classifier. We build upon this existing approach in two ways. First, we revisit this method by developing a customized residual neural network which is tailored to the structure and symmetries of collider data. Second, we develop a new method for background estimation, based on the optimal transport problem, which relies on modeling assumptions distinct from earlier work. These two methods can serve as cross-checks for each other in particle physics analyses, due to the complementarity of their underlying assumptions. We compare their performance on simulated double Higgs boson data.

categories: stat.AP hep-ex hep-ph physics.data-an stat.ME


title: Leveraging the HW/SW Optimizations and Ecosystems that Drive the AI Revolution

abstract: This paper presents a state-of-the-art overview on how to architect, design, and optimize Deep Neural Networks (DNNs) such that performance is improved and accuracy is preserved. The paper covers a set of optimizations that span the entire Machine Learning processing pipeline. We introduce two types of optimizations. The first alters the DNN model and requires NN re-training, while the second does not. We focus on GPU optimizations, but we believe the presented techniques can be used with other AI inference platforms. To demonstrate the DNN model optimizations, we improve one of the most advanced deep network architectures for optical flow, RAFT arXiv:2003.12039, on a popular edge AI inference platform (Nvidia Jetson AGX Xavier).


title: The Role of Morphological Variation in Evolutionary Robotics: Maximizing Performance and Robustness

abstract: Exposing an Evolutionary Algorithm that is used to evolve robot controllers to variable conditions is necessary to obtain solutions which are robust and can cross the reality gap. However, we do not yet have methods for analyzing and understanding the impact of the varying morphological conditions which impact the evolutionary process, and therefore for choosing suitable variation ranges. By morphological conditions, we refer to the starting state of the robot, and to variations in its sensor readings during operation due to noise. In this article, we introduce a method that permits us to measure the impact of these morphological variations and we analyze the relation between the amplitude of variations, the modality with which they are introduced, and the performance and robustness of evolving agents. Our results demonstrate that (i) the evolutionary algorithm can tolerate morphological variations which have a very high impact, (ii) variations affecting the actions of the agent are tolerated much better than variations affecting the initial state of the agent or of the environment, and (iii) improving the accuracy of the fitness measure through multiple evaluations is not always useful. Moreover, our results show that morphological variations permit generating solutions which perform better both in varying and non-varying conditions.


title: Analyzing Data-Centric Properties for Graph Contrastive Learning

abstract: Recent analyses of self-supervised learning (SSL) find the following data-centric properties to be critical for learning good representations: invariance to task-irrelevant semantics, separability of classes in some latent space, and recoverability of labels from augmented samples. However, given their discrete, non-Euclidean nature, graph datasets and graph SSL methods are unlikely to satisfy these properties. This raises the question: how do graph SSL methods, such as contrastive learning (CL), work well? To systematically probe this question, we perform a generalization analysis for CL when using generic graph augmentations (GGAs), with a focus on data-centric properties. Our analysis yields formal insights into the limitations of GGAs and the necessity of task-relevant augmentations. As we empirically show, GGAs do not induce task-relevant invariances on common benchmark datasets, leading to only marginal gains over naive, untrained baselines. Our theory motivates a synthetic data generation process that enables control over task-relevant information and boasts pre-defined optimal augmentations. This flexible benchmark helps us identify yet unrecognized limitations in advanced augmentation techniques (e.g., automated methods). Overall, our work rigorously contextualizes, both empirically and theoretically, the effects of data-centric properties on augmentation strategies and learning paradigms for graph SSL.


title: MAGPIE: Machine Automated General Performance Improvement via Evolution of Software

abstract: Performance is one of the most important qualities of software. Several techniques have thus been proposed to improve it, such as program transformations, optimisation of software parameters, or compiler flags. Many automated software improvement approaches use similar search strategies to explore the space of possible improvements, yet available tooling only focuses on one approach at a time. This makes comparisons and exploration of interactions of the various types of improvement impractical. We propose MAGPIE, a unified software improvement framework. It provides a common edit sequence based representation that isolates the search process from the specific improvement technique, enabling a much simplified synergistic workflow. We provide a case study using a basic local search to compare compiler optimisation, algorithm configuration, and genetic improvement. We chose running time as our efficiency measure and evaluated our approach on four real-world software, written in C, C++, and Java. Our results show that, used independently, all techniques find significant running time improvements: up to 25% for compiler optimisation, 97% for algorithm configuration, and 61% for evolving source code using genetic improvement. We also show that up to 10% further increase in performance can be obtained with partial combinations of the variants found by the different techniques. Furthermore, the common representation also enables simultaneous exploration of all techniques, providing a competitive alternative to using each technique individually.


title: P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting

abstract: Nowadays, pre-training big models on large-scale datasets has become a crucial topic in deep learning. The pre-trained models with high representation ability and transferability achieve a great success and dominate many downstream tasks in natural language processing and 2D vision. However, it is non-trivial to promote such a pretraining-tuning paradigm to the 3D vision, given the limited training data that are relatively inconvenient to collect. In this paper, we provide a new perspective of leveraging pre-trained 2D knowledge in 3D domain to tackle this problem, tuning pre-trained image models with the novel Point-to-Pixel prompting for point cloud analysis at a minor parameter cost. Following the principle of prompting engineering, we transform point clouds into colorful images with geometry-preserved projection and geometry-aware coloring to adapt to pre-trained image models, whose weights are kept frozen during the end-to-end optimization of point cloud analysis tasks. We conduct extensive experiments to demonstrate that cooperating with our proposed Point-to-Pixel Prompting, better pre-trained image model will lead to consistently better performance in 3D vision. Enjoying prosperous development from image pre-training field, our method attains 89.3% accuracy on the hardest setting of ScanObjectNN, surpassing conventional point cloud models with much fewer trainable parameters. Our framework also exhibits very competitive performance on ModelNet classification and ShapeNet Part Segmentation. Code is available at https://github.com/wangzy22/P2P.


title: Towards Understanding Mixture of Experts in Deep Learning

abstract: The Mixture-of-Experts (MoE) layer, a sparsely-activated model controlled by a router, has achieved great success in deep learning. However, the understanding of such architecture remains elusive. In this paper, we formally study how the MoE layer improves the performance of neural network learning and why the mixture model will not collapse into a single model. Our empirical results suggest that the cluster structure of the underlying problem and the non-linearity of the expert are pivotal to the success of MoE. To further understand this, we consider a challenging classification problem with intrinsic cluster structures, which is hard to learn using a single expert. Yet with the MoE layer, by choosing the experts as two-layer nonlinear convolutional neural networks (CNNs), we show that the problem can be learned successfully. Furthermore, our theory shows that the router can learn the cluster-center features, which helps divide the input complex problem into simpler linear classification sub-problems that individual experts can conquer. To our knowledge, this is the first result towards formally understanding the mechanism of the MoE layer for deep learning.


title: Conformal Risk Control

abstract: We extend conformal prediction to control the expected value of any monotone loss function. The algorithm generalizes split conformal prediction together with its coverage guarantee. Like conformal prediction, the conformal risk control procedure is tight up to an $\mathcal{O}(1/n)$ factor. We also introduce extensions of the idea to distribution shift, quantile risk control, multiple and adversarial risk control, and expectations of U-statistics. Worked examples from computer vision and natural language processing demonstrate the usage of our algorithm to bound the false negative rate, graph distance, and token-level F1-score.

categories: stat.ME cs.AI cs.LG math.ST stat.ML stat.TH


title: On-the-Fly Syntax Highlighting using Neural Networks

abstract: With the presence of online collaborative tools for software developers, source code is shared and consulted frequently, from code viewers to merge requests and code snippets. Typically, code highlighting quality in such scenarios is sacrificed in favor of system responsiveness. In these on-the-fly settings, performing a formal grammatical analysis of the source code is not only expensive, but also intractable for the many times the input is an invalid derivation of the language. Indeed, current popular highlighters heavily rely on a system of regular expressions, typically far from the specification of the language's lexer. Due to their complexity, regular expressions need to be periodically updated as more feedback is collected from the users and their design unwelcome the detection of more complex language formations. This paper delivers a deep learning-based approach suitable for on-the-fly grammatical code highlighting of correct and incorrect language derivations, such as code viewers and snippets. It focuses on alleviating the burden on the developers, who can reuse the language's parsing strategy to produce the desired highlighting specification. Moreover, this approach is compared to nowadays online syntax highlighting tools and formal methods in terms of accuracy and execution time, across different levels of grammatical coverage, for three mainstream programming languages. The results obtained show how the proposed approach can consistently achieve near-perfect accuracy in its predictions, thereby outperforming regular expression-based strategies.