title: A Note on the Stability of Monotone Markov Chains

abstract: This note studies monotone Markov chains, a subclass of Markov chains with extensive applications in operations research and economics. While the properties that ensure the global stability of these chains are well studied, their establishment often relies on the fulfillment of a certain splitting condition. We address the challenges of verifying the splitting condition by introducing simple, applicable conditions that ensure global stability. The simplicity of these conditions is demonstrated through various examples including autoregressive processes, portfolio allocation problems and resource allocation dynamics.


title: Set-Valued Koopman Theory for Control Systems

abstract: In this paper, we introduce a new definition of the Koopman operator which faithfully encodes the dynamics of controlled systems, by leveraging the grammar of set-valued analysis. We likewise propose meaningful generalisations of the Liouville and Perron-Frobenius operators, and show that they respectively coincide with proper set-valued analogues of the infinitesimal generator and dual operator of the Koopman semigroups. We also give meaning to the spectra of these set-valued operators and prove an adapted version of the spectral mapping theorem. In essence, these results provide theoretical justifications for many existing approaches that consist in bundling together the Liouville operators associated with different control parameters to produce Koopman eigenvalues and eigenfunctions for control systems.


title: The linearization of the boundary rigidity problem for MP-systems and generic local boundary rigidity

abstract: We consider an $\mathcal{MP}$-system, that is, a compact Riemannian manifold with boundary, endowed with a magnetic field and a potential. On simple $\mathcal{MP}$-systems, we study the $\mathcal{MP}$-ray transform in order to obtain new boundary rigidity results for $\mathcal{MP}$-systems. We show that there is an explicit relation between the $\mathcal{MP}$-ray transform and the magnetic one, which allow us to apply results from [DPSU07] to our case. Regarding rigidity, we show that there exists a generic set $\mathcal{G}^{m}$ of simple $\mathcal{MP}$-systems, which is open and dense, such that any two $\mathcal{MP}$-systems close to an element in it and having the same boundary action function, must be $k$-gauge equivalent.


title: On eigenvalues and eigenfunctions of the operators defining multidimensional scaling on some symmetric spaces

abstract: We study asymptotics of the eigenvalues and eigenfunctions of the operators used for constructing multidimensional scaling (MDS) on compact connected Riemannian manifolds, in particular on closed connected symmetric spaces. They are the limits of eigenvalues and eigenvectors of squared distance matrices of an increasing sequence of finite subsets covering the space densely in the limit. We show that for products of spheres and real projective spaces, the numbers of positive and negative eigenvalues of these operators are both infinite. We also find a class of spaces (namely $\mathbb{RP}^n$ with odd $n>1$) whose MDS defining operators are not trace class, and original distances cannot be reconstructed from the eigenvalues and eigenfunctions of these operators.


title: Uniform $L^\infty$ estimates: subsolutions to fully nonlinear partial differential equations

abstract: Uniform bounds are obtained using the auxiliary Monge-Amp\`ere equation method for solutions of very general classes of fully non-linear partial differential equations, assuming the existence of a ${C}$-subsolution in the sense of G. Sz\'ekelyhidi and B. Guan. The main advantage over previous estimates is in the K\"ahler case, where the new estimates remain uniform as the background metric is allowed to degenerate.


title: A Decentralized Proximal Gradient Tracking Algorithm for Composite Optimization on Riemannian Manifolds

abstract: This paper focuses on minimizing a smooth function combined with a nonsmooth regularization term on a compact Riemannian submanifold embedded in the Euclidean space under a decentralized setting. Typically, there are two types of approaches at present for tackling such composite optimization problems. The first, subgradient-based approaches, rely on subgradient information of the objective function to update variables, achieving an iteration complexity of $\mathcal{O}(\epsilon^{-4}\log^2(\epsilon^{-2}))$. The second, smoothing approaches, involve constructing a smooth approximation of the nonsmooth regularization term, resulting in an iteration complexity of $\mathcal{O}(\epsilon^{-4})$. This paper proposes a proximal gradient type algorithm that fully exploits the composite structure. The global convergence to a stationary point is established with a significantly improved iteration complexity of $\mathcal{O}(\epsilon^{-2})$. To validate the effectiveness and efficiency of our proposed method, we present numerical results in real-world applications, showcasing its superior performance.


title: Universal $p$-wave tetramers in low-dimensional fermionic systems with three-body interaction

abstract: Inspired by the narrow Feshbach resonance in systems with the two-body interaction, we propose the two-channel model of three-component fermions with the three-body interaction that takes into account the finite-range effects in low dimensions. Within this model, the $p$-wave Efimov-like effect in the four-body sector is predicted in fractional dimensions above 1D. The impact of the finite-range interaction on the formation of the four-body bound states in $d=1$ is also discussed in detail.


title: Connectivity of the diffuse interface and fine structure of minimizers in the Allen-Cahn theory of phase transitions

abstract: In the Allen-Cahn theory of phase transitions, minimizers partition the domain in subregions, the sets where a minimizer is near to one or to another of the zeros of the potential. These subregions that model the phases are separated by a tiny Diffuse Interface. Understanding the shape of this diffuse interface is an important step toward the description of the structure of minimizers. We assume Dirichlet data and present general conditions on the domain and on the boundary datum ensuring the connectivity of the diffuse interface. Then we restrict to the case of two dimensions and show that the phases can be separated, in a certain optimal way, by a connected network with a well defined structure. This network is contained in the diffuse interface and is a priori unknown. Under general assumption on the potential and on the Dirichlet datum, we show that, if we assume that the phase are connected, then we can obtain precise information on the shape of the network and in turn a detailed description of the fine structure of minimizers. In particular we can characterize the shape and the size of the various phases and also how they depend on the surface tensions.


title: Quantum Architecture Search with Unsupervised Representation Learning

abstract: Utilizing unsupervised representation learning for quantum architecture search (QAS) represents a cutting-edge approach poised to realize potential quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) devices. Most QAS algorithms combine their search space and search algorithms together and thus generally require evaluating a large number of quantum circuits during the search process. Predictor-based QAS algorithms can alleviate this problem by directly estimating the performance of circuits according to their structures. However, a high-performance predictor generally requires very time-consuming labeling to obtain a large number of labeled quantum circuits. Recently, a classical neural architecture search algorithm Arch2vec inspires us by showing that architecture search can benefit from decoupling unsupervised representation learning from the search process. Whether unsupervised representation learning can help QAS without any predictor is still an open topic. In this work, we propose a framework QAS with unsupervised representation learning and visualize how unsupervised architecture representation learning encourages quantum circuit architectures with similar connections and operators to cluster together. Specifically, our framework enables the process of QAS to be decoupled from unsupervised architecture representation learning so that the learned representation can be directly applied to different downstream applications. Furthermore, our framework is predictor-free eliminating the need for a large number of labeled quantum circuits. During the search process, we use two algorithms REINFORCE and Bayesian Optimization to directly search on the latent representation, and compare them with the method Random Search. The results show our framework can more efficiently get well-performing candidate circuits within a limited number of searches.


title: Generation of Entangled Photons via Cooper Pair Recombination in Noncentrosymmetric Quantum Wells

abstract: We theoretically explore the generation of entangled two-photon pairs through Cooper pair recombination within a noncentrosymmetric [001]-quantum well superconductor. Superconducting state is induced into the quantum well via proximity effects, and featuring an admixture of Rashba and Dresselhaus antisymmetric spin-orbit couplings. Our investigation highlights that the highest achievable purity of entangled photon pairs emerges within scenarios involving pure singlet Cooper pairs. Specifically, the conventional $s$-wave gap function within the singlet pairings achieves the highest purity levels. Furthermore, our findings underscore the significance of reducing spin-triplet pairing amplitudes to attain entangled states of superior purity. This reduction can be achieved by diminishing the amplitude of antisymmetric spin-orbit couplings. In addition to purity considerations, our study delves into the population of two-photon states. We observed that states featuring $s+p$- and $d^{}_{x^2-y^2}+p$-wave Cooper pairings exhibit the highest population values among the generated entangled two-photon states within a noncentrosymmetric superconducting quantum well.

categories: quant-ph cond-mat.mtrl-sci cond-mat.str-el cond-mat.supr-con


title: Brill-Noether Theory of stable vector bundles on ruled surfaces

abstract: Let X be a ruled surface over a nonsingular curve C of genus $g\geq0$. Let $M_H:=M_{X,H}(2;c_1,c_2)$ be the moduli space of H-stable rank 2 vector bundles E on X with fixed Chern classes $c_i:=c_i(E)$ for $i=1,2$. The main goal of this paper is to contribute to a better understanding of the geometry of the moduli space $M_H$ in terms of its Brill-Noether locus $W_H^k(2;c_1,c_2)$, whose points correspond to stable vector bundles in $M_H$ having at least k independent sections. We deal with the non-emptiness of this Brill-Noether locus, getting in most of the cases sharp bounds for the values of k such that $W_H^k(2;c_1,c_2)$ is non-empty.


title: Elliptic Curves in Continuous-Variable Quantum Systems

abstract: Elliptic curves are planar curves which can be used to define an abelian group. The efficient computation of discrete logarithms over this group is a longstanding problem relevant to cryptography. It may be possible to efficiently compute these logarithms using a quantum computer, assuming that the group addition operation can be computed efficiently on a quantum device. Currently, however, thousands of logical qubits are required for elliptic curve group addition, putting this application out of reach for near-term quantum hardware. Here we give an algorithm for computing elliptic curve group addition using a single continuous-variable mode, based on weak measurements of a system with a cubic potential energy. This result could lead to improvements in the efficiency of elliptic curve discrete logarithms using a quantum device.


title: Age of Gossip in Random and Bipartite Networks

abstract: In this paper we study gossip networks where a source observing a process sends updates to an underlying graph. Nodes in the graph communicate to their neighbors by randomly sending updates. Our interest is studying the version age of information (vAoI) metric over various classes of networks. It is known that the version age of $K_n$ is logarithmic, and the version age of $\overline{K_n}$ is linear. We study the question `how does the vAoI evolve as we interpolate between $K_n$ and $\overline{K_n}$' by studying Erd\H{o}s-Reyni random graphs, random $d$-regular graphs, and bipartite networks. Our main results are proving the existence of a threshold in $G(n,p)$ from rational to logarithmic average version age, and showing $G(n,d)$ almost surely has logarithmic version age for constant $d$. We also characterize the version age of complete bipartite graphs $K_{L,R}$, when we let $L$ vary from $O(1)$ to $O(n)$.


title: Physical Origin of the Effective Parameters at Boundaries in Finite Difference Schemes

abstract: Using the Observable form of Maxwell's equations, we reveal that effective parameters at materials boundaries emerge naturally as anisotropic transfer functions. The complexity of the boundary dictates the order of these functions. Employing the residue-pole expansion, we describe the relation between field components as a system of ODEs solvable through the auxiliary differential equation approach. Not only can be used in Finite difference methods, the approach can be also employed to model complex surface structures.


title: Thermal Image Calibration and Correction using Unpaired Cycle-Consistent Adversarial Networks

abstract: Unmanned aerial vehicles (UAVs) offer a flexible and cost-effective solution for wildfire monitoring. However, their widespread deployment during wildfires has been hindered by a lack of operational guidelines and concerns about potential interference with aircraft systems. Consequently, the progress in developing deep-learning models for wildfire detection and characterization using aerial images is constrained by the limited availability, size, and quality of existing datasets. This paper introduces a solution aimed at enhancing the quality of current aerial wildfire datasets to align with advancements in camera technology. The proposed approach offers a solution to create a comprehensive, standardized large-scale image dataset. This paper presents a pipeline based on CycleGAN to enhance wildfire datasets and a novel fusion method that integrates paired RGB images as attribute conditioning in the generators of both directions, improving the accuracy of the generated images.


title: Fuchs' problem for linear groups

abstract: Which groups can occur as the group of units in a ring? Such groups are called realizable. Though the realizable members of several classes of groups have been determined (e.g., cyclic, odd order, alternating, symmetric, finite simple, indecomposable abelian, and dihedral), the question remains open. The general linear groups are realizable by definition: they are the units in the corresponding matrix rings. In this paper, we study the realizability of two closely related linear groups, the special linear groups and the affine general linear groups. We determine which special linear groups of degree 2 over a finite field are realizable by a finite ring, and we determine which affine general linear groups of degree 1 over a cyclic group are realizable by a finite ring. We also give partial results for certain linear groups of other degrees and for rings of characteristic zero.


title: On Fast Charged Particles Scattering on a Flat Relativistic Beam of Charged Particles in Approximation of Continuous Potential

abstract: The differential scattering cross section for the problem of fast charged particles motion near a flat relativistic beam of charged particles was obtained. The problem is considered in the eikonal approximation in the representation of the beam by a continuous potential.


title: Analyzing the Impact of Financial Inclusion on Economic Growth in Bangladesh

abstract: Financial inclusion is touted one of the principal drivers for economic growth for an economy. The study aims to explore the impact of financial inclusion on economic growth in Bangladesh. In my study, I used the number of loan accounts as the proxy for financial inclusion. Using time series data from spans from 2004-2021, the study revealed that there exists a long-run relationship between GDP, financial inclusion, and other macroeconomic variables in Bangladesh. The study also found that financial inclusion had a positive impact on economic growth of Bangladesh during the study period. Therefore, the policymakers and the central bank of Bangladesh as the apex authority of financial system should promote financial inclusion activities to achieve sustainable economic growth.


title: Entangled-Beam Reflectometry and Goos-H\"anchen Shift

abstract: We introduce the technique of Entangled-Beam Reflectometry for extracting spatially correlated (magnetic or non-magnetic) information from material surfaces or thin films. Our amplitude- and phase-sensitive technique exploits the coherent nature of an incoming entangled probe beam, of matter or light waves, undergoing reflection from the surface. Such reflection encodes the surface spatial structure into the probe's geometric and phase-derived Goos-H\"anchen shifts, which can then be measured to unveil the structure. We investigate the way these shifts depend on the wave packet widths, and illustrate our technique in the case of in-plane periodic (non-)magnetic structures by utilizing spin-path mode-entangled neutron beams.

categories: physics.optics cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el quant-ph


title: Degree powers and number of stars in graphs with a forbidden broom

abstract: Given a graph $G$ with degree sequence $d_1,\dots, d_n$ and a positive integer $r$, let $e_r(G)=\sum_{i=1}^n d_i^r$. We denote by $\mathrm{ex}_r(n,F)$ the largest value of $e_r(G)$ among $n$-vertex $F$-free graphs $G$, and by $\mathrm{ex}(n,S_r,G)$ the largest number of stars $S_r$ in $n$-vertex $F$-free graphs. The \textit{broom} $B(\ell,s)$ is the graph obtained from an $\ell$-vertex path by adding $s$ new leaves connected to a penultimate vertex $v$ of the path. We determine $\mathrm{ex}_r(n,B(\ell,s))$ for $r\ge 2$, any $\ell,s$ and sufficiently large $n$, proving a conjecture of Lan, Liu, Qin and Shi. We also determine $\mathrm{ex}(n,S_r,B(\ell,s))$ for $r\ge 2$, any $\ell,s$ and sufficiently large $n$.


title: Synergistic signatures of group mechanisms in higher-order systems

abstract: The interplay between causal mechanisms and emerging collective behaviors is a central aspect of the understanding, control, and prediction of complex networked systems. Here we study this interplay in the context of higher-order mechanisms and behaviors in two representative models: a simplicial Ising model and a simplicial social contagion model. In both systems, we find that group (higher-order) interactions show emergent synergistic (higher-order) behavior. The emergent synergy appears only at the group level and depends in a complex non-linear way on the tradeoff between the strengths of the low- and higher-order mechanisms, and is invisible to low-order behavioral observables. Finally, we present a simple method to detect higher-order mechanisms by using this signature.


title: Uniform bounds for the density in Artin's conjecture on primitive roots

abstract: We consider Artin's conjecture on primitive roots over a number field $K$, reducing an algebraic number $\alpha\in K^\times$. Under the Generalised Riemann Hypothesis, there is a density ${\mathrm{dens}}(\alpha)$ counting the proportion of the primes of $K$ for which $\alpha$ is a primitive root. This density ${\mathrm{dens}}(\alpha)$ is a rational multiple of an Artin constant $A(\tau)$ that depends on the largest integer $\tau\geq 1$ such that $\alpha\in (K^\times)^\tau$. The aim of this paper is bounding the ratio ${\mathrm{dens}}(\alpha)/A(\tau)$, under the assumption that ${\mathrm{dens}}(\alpha)\neq 0$. Over $\mathbb Q$, this ratio is between $2/3$ and $2$, these bounds being optimal. For a general number field $K$ we provide upper and lower bounds that only depend on $K$.


title: Small Even Covers, Locally Decodable Codes and Restricted Subgraphs of Edge-Colored Kikuchi Graphs

abstract: Given a $k$-uniform hypergraph $H$ on $n$ vertices, an even cover in $H$ is a collection of hyperedges that touch each vertex an even number of times. Even covers are a generalization of cycles in graphs and are equivalent to linearly dependent subsets of a system of linear equations modulo $2$. As a result, they arise naturally in the context of well-studied questions in coding theory and refuting unsatisfiable $k$-SAT formulas. Analogous to the irregular Moore bound of Alon, Hoory, and Linial (2002), in 2008, Feige conjectured an extremal trade-off between the number of hyperedges and the length of the smallest even cover in a $k$-uniform hypergraph. This conjecture was recently settled up to a multiplicative logarithmic factor in the number of hyperedges (Guruswami, Kothari, and 1Manohar 2022 and Hsieh, Kothari, and Mohanty 2023). These works introduce the new technique that relates hypergraph even covers to cycles in the associated \emph{Kikuchi} graphs. Their analysis of these Kikuchi graphs, especially for odd $k$, is rather involved and relies on matrix concentration inequalities. In this work, we give a simple and purely combinatorial argument that recovers the best-known bound for Feige's conjecture for even $k$. We also introduce a novel variant of a Kikuchi graph which together with this argument improves the logarithmic factor in the best-known bounds for odd $k$. As an application of our ideas, we also give a purely combinatorial proof of the improved lower bounds (Alrabiah, Guruswami, Kothari and Manohar, 2023) on 3-query binary linear locally decodable codes.


title: Primary constraints in general teleparallel quadratic gravity

abstract: The primary constraints for general teleparallel quadratic gravity are presented. They provide a basic classification of teleparallel theories from the perspective of the full nonlinear theory and represent the first step towards a full-fledged Hamiltonian analysis. The results are consistent with the limit of metric and symmetric teleparallel quadratic gravity. In the latter case we also present novel results, since symmetric teleparallel theories have only been partially studied so far. Apart from the general results, we also present the special cases of teleparallel theories classically equivalent to general relativity, which differ by a boundary term from the formulation of Einstein and Hilbert. This affects the constraint algebra as the primary constraints involve a mix of torsion and non-metricity, implying that the symmetries of general relativity are realized in a more intricate way compared to the teleparallel case. In this context, a more detailed understanding will provide insights for energy and entropy in gravity, quantum gravity and numerical relativity of this alternative formulation of general relativity. The primary constraints are presented both in the standard formulation and in irreducible parts of torsion and non-metricity. The special role of axial torsion and its connection to the one-parameter of viable new general relativity is confirmed. Furthermore, we find that one of the irreducible parts of non-metricity affects the primary constraint for shift but not lapse.


title: Differentially-Private Hierarchical Federated Learning

abstract: While federated learning (FL) eliminates the transmission of raw data over a network, it is still vulnerable to privacy breaches from the communicated model parameters. In this work, we propose \underline{H}ierarchical \underline{F}ederated Learning with \underline{H}ierarchical \underline{D}ifferential \underline{P}rivacy ({\tt H$^2$FDP}), a DP-enhanced FL methodology for jointly optimizing privacy and performance in hierarchical networks. Building upon recent proposals for Hierarchical Differential Privacy (HDP), one of the key concepts of {\tt H$^2$FDP} is adapting DP noise injection at different layers of an established FL hierarchy -- edge devices, edge servers, and cloud servers -- according to the trust models within particular subnetworks. We conduct a comprehensive analysis of the convergence behavior of {\tt H$^2$FDP}, revealing conditions on parameter tuning under which the training process converges sublinearly to a finite stationarity gap that depends on the network hierarchy, trust model, and target privacy level. Leveraging these relationships, we develop an adaptive control algorithm for {\tt H$^2$FDP} that tunes properties of local model training to minimize communication energy, latency, and the stationarity gap while striving to maintain a sub-linear convergence rate and meet desired privacy criteria. Subsequent numerical evaluations demonstrate that {\tt H$^2$FDP} obtains substantial improvements in these metrics over baselines for different privacy budgets, and validate the impact of different system configurations.


title: On the stability of second order parametric ordinary differential equations and applications

abstract: This work deals with Lipschitz stability for a parametric version of the general second order Ordinary Differential Equation (ODE) initial-value Cauchy problem. We first establish a Lipschitz stability result for this problem under a partial variation of the data. Then, we apply our abstract result to second order differential equations governed by cocoercive operators. Furthermore, we discuss more concrete applications of the stability for two specific applied mathematical models inherent in electricity and control theory. Finally, we provide numerical tests based on the software source Scilab, which are done with respect to parametric linear control systems, illustrating henceforth the validity of our abstract theoretical result.


title: On non-stability of one-dimensional non-periodic ground states

abstract: We address the problem of stability of one-dimensional non-periodic ground-state configurations with respect to finite-range perturbations of interactions in classical lattice-gas models. We show that a relevant property of non-periodic ground-state configurations in this context is their homogeneity. The so-called strict boundary condition says that the number of finite patterns of a configuration have bounded fluctuations on any finite subsets of the lattice. We show that if the strict boundary condition is not satisfied, then in order for non-periodic ground-state configurations to be stable, interactions between particles should not decay faster than $1/r^{\alpha}$ with $\alpha>2$. In the Thue-Morse ground state, number of finite patterns may fluctuate as much as the logarithm of the lenght of a lattice subset. We show that the Thue-Morse ground state is unstable for any $\alpha >1$ with respect to arbitrarily small two-body interactions favoring the presence of molecules consisting of two spins up or down. We also investigate Sturmian systems defined by irrational rotations on the circle. They satisfy the strict boundary condition but nevertheless they are unstable for $\alpha>3$.


title: Local Harmonic Approximation to Quantum Mean Force Gibbs State

abstract: When the strength of interaction between a quantum system and bath is non-negligible, the equilibrium state can deviate from the Gibbs state. Here, we obtain an approximate expression for such a mean force Gibbs state for a particle in an arbitrary one dimensional potential, interacting with a bosonic bath. This approximate state is accurate when either the system-bath coupling or the temperature is large, or when the third and higher derivatives of the potential are small compared to certain system-bath specific parameters. We show that our result recovers the ultra strong coupling and high temperature results recently derived in literature. We then apply this method to study some systems like a quartic oscillator and a particle in a quartic double-well potential. We also use our method to analyze the proton tunneling problem in a DNA recently studied in literature [Slocombe et al., Comm. Phys., vol. 5, no. 1, p. 109, 2022], where our results suggest the equilibrium value of the probability of mutation to be orders of magnitude lower than the steady state value obtained there ($10^{-8}$ vs $10^{-4}$).


title: Learning to Maximize Gains From Trade in Small Markets

abstract: We study the problem of designing a two-sided market (double auction) to maximize the gains from trade (social welfare) under the constraints of (dominant-strategy) incentive compatibility and budget-balance. Our goal is to do so for an unknown distribution from which we are given a polynomial number of samples. Our first result is a general impossibility for the case of correlated distributions of values even between just one seller and two buyers, in contrast to the case of one seller and one buyer (bilateral trade) where this is possible. Our second result is an efficient learning algorithm for one seller and two buyers in the case of independent distributions which is based on a novel algorithm for computing optimal mechanisms for finitely supported and explicitly given independent distributions. Both results rely heavily on characterizations of (dominant-strategy) incentive compatible mechanisms that are strongly budget-balanced.


title: Realizing trees of hypergraphs in thin sets

abstract: Let $\phi(x,y)$ be a continuous function, smooth away from the diagonal, such that, for some $\alpha>0$, the associated generalized Radon transforms \begin{equation} \label{Radon} R_t^{\phi}f(x)=\int_{\phi(x,y)=t} f(y) \psi(y) d\sigma_{x,t}(y) \end{equation} map $L^2({\mathbb R}^d) \to H^{\alpha}({\mathbb R}^d)$ for all $t>0$. Let $E$ be a compact subset of ${\mathbb R}^d$ for some $d \ge 2$, and suppose that the Hausdorff dimension of $E$ is $>d-\alpha$. Then any tree graph $T$ on $k+1$ ($k \ge 1$) vertices is realizable in $E$, in the sense that there exist distinct $x^1, x^2, \dots, x^{k+1} \in E$ and $t>0$ such that the $\phi$-distance $\phi(x^i, x^j)$ is equal to $t$ for all pairs $(i,j)$ corresponding to the edges of the graph $T$. We also extend this notion to hyper-graphs where points $x^1, x^2, \dots, x^{k+1}$ are connected by a hyper-edge if $\phi(x^i,x^j)=t_{ij}$ for a set of pairs $(i,j)$ selected in accordance with a graph $H$, and $\{t_{ij}\}$ is a pre-assigned collection of positive distances. A chain of hyper-edges is a sequence $$\{(x^1_1, \dots, x^{k+1}_1), (x^1_2, \dots, x^{k+1}_2), \dots, (x^1_n,\dots, x^{k+1}_n)\},$$ where $(x^1_i, \dots, x^{k+1}_i)$ and $(x^1_{i+1}, \dots, x^{k+1}_{i+1})$, $1 \leq i \leq n$, share one and only one vertex $x^J_i$, with $J$ pre-assigned. A hyper-graph tree is defined analogously. The key estimate behind these arguments is a variant of (\ref{Radon}) where the average over the level set of $\phi(x,\cdot)$ is replaced by the average over an intersection of such surfaces. In the process, we develop a general graph theoretic paradigm that reduces a variety of point configuration questions to operator theoretic estimates.


title: TetraLoss: Improving the Robustness of Face Recognition against Morphing Attacks

abstract: Face recognition systems are widely deployed in high-security applications such as for biometric verification at border controls. Despite their high accuracy on pristine data, it is well-known that digital manipulations, such as face morphing, pose a security threat to face recognition systems. Malicious actors can exploit the facilities offered by the identity document issuance process to obtain identity documents containing morphed images. Thus, subjects who contributed to the creation of the morphed image can with high probability use the identity document to bypass automated face recognition systems. In recent years, no-reference (i.e., single image) and differential morphing attack detectors have been proposed to tackle this risk. These systems are typically evaluated in isolation from the face recognition system that they have to operate jointly with and do not consider the face recognition process. Contrary to most existing works, we present a novel method for adapting deep learning-based face recognition systems to be more robust against face morphing attacks. To this end, we introduce TetraLoss, a novel loss function that learns to separate morphed face images from its contributing subjects in the embedding space while still preserving high biometric verification performance. In a comprehensive evaluation, we show that the proposed method can significantly enhance the original system while also significantly outperforming other tested baseline methods.


title: Reducing Usefulness of Stolen Credentials in SSO Contexts

abstract: Approximately 61% of cyber attacks involve adversaries in possession of valid credentials. Attackers acquire credentials through various means, including phishing, dark web data drops, password reuse, etc. Multi-factor authentication (MFA) helps to thwart attacks that use valid credentials, but attackers still commonly breach systems by tricking users into accepting MFA step up requests through techniques, such as ``MFA Bombing'', where multiple requests are sent to a user until they accept one. Currently, there are several solutions to this problem, each with varying levels of security and increasing invasiveness on user devices. This paper proposes a token-based enrollment architecture that is less invasive to user devices than mobile device management, but still offers strong protection against use of stolen credentials and MFA attacks.


title: Understanding the Generalization Benefits of Late Learning Rate Decay

abstract: Why do neural networks trained with large learning rates for a longer time often lead to better generalization? In this paper, we delve into this question by examining the relation between training and testing loss in neural networks. Through visualization of these losses, we note that the training trajectory with a large learning rate navigates through the minima manifold of the training loss, finally nearing the neighborhood of the testing loss minimum. Motivated by these findings, we introduce a nonlinear model whose loss landscapes mirror those observed for real neural networks. Upon investigating the training process using SGD on our model, we demonstrate that an extended phase with a large learning rate steers our model towards the minimum norm solution of the training loss, which may achieve near-optimal generalization, thereby affirming the empirically observed benefits of late learning rate decay.


title: Robust Evaluation Measures for Evaluating Social Biases in Masked Language Models

abstract: Many evaluation measures are used to evaluate social biases in masked language models (MLMs). However, we find that these previously proposed evaluation measures are lacking robustness in scenarios with limited datasets. This is because these measures are obtained by comparing the pseudo-log-likelihood (PLL) scores of the stereotypical and anti-stereotypical samples using an indicator function. The disadvantage is the limited mining of the PLL score sets without capturing its distributional information. In this paper, we represent a PLL score set as a Gaussian distribution and use Kullback Leibler (KL) divergence and Jensen Shannon (JS) divergence to construct evaluation measures for the distributions of stereotypical and anti-stereotypical PLL scores. Experimental results on the publicly available datasets StereoSet (SS) and CrowS-Pairs (CP) show that our proposed measures are significantly more robust and interpretable than those proposed previously.


title: Torsion factors of commutative monoid semirings

abstract: Let $P$ be a finitely generated commutative semiring. It was shown recently that if $P$ is a parasemifield (i.e. the multiplicative reduct of $P$ is a group) then $P$ cannot contain the positive rationals $\mathbb{Q}^+$ as its subsemiring. Equivalently, a commutative parasemifield $P$ finitely generated as a semiring is additively divisible if and only if $P$ is additively idempotent. We generalize this result using weaker forms of these additive properties to a broader class of commutative semirings in the following way. Let $S$ be a semiring that is a factor of a monoid semiring $\mathbb{N}[\mathcal{C}]$ where $\mathcal{C}$ is a submonoid of a free commutative monoid of finite rank. Then the semiring $S$ is additively almost-divisible if and only if $S$ is torsion. In particular, we show that if $S$ is a ring then $S$ cannot contain any non-finitely generated subring of $\mathbb{Q}$.


title: Rotational Taylor dispersion in linear flows

abstract: The coupling between advection and diffusion in position space can often lead to enhanced mass transport compared to diffusion without flow. An important framework used to characterize the long-time diffusive transport in position space is the generalized Taylor dispersion theory. In contrast, the dynamics and transport in orientation space remains less developed. In this work, we develop a rotational Taylor dispersion theory that characterizes the long-time orientational transport of a spheroidal particle in linear flows that is constrained to rotate in the velocity-gradient plane. Similar to Taylor dispersion in position space, the orientational distribution of axisymmetric particles in linear flows at long times satisfies an effective advection-diffusion equation in orientation space. Using this framework, we then calculate the long-time average angular velocity and dispersion coefficient for both simple shear and extensional flows. Analytic expressions for the transport coefficients are derived in several asymptotic limits including nearly-spherical particles, weak flow, and strong flow. Our analysis shows that at long times the effective rotational dispersion is enhanced in simple shear and suppressed in extensional flow. The asymptotic solutions agree with full numerical solutions of the derived macrotransport equations and results from Brownian dynamics simulations. Our results show that the interplay between flow-induced rotations and Brownian diffusion can fundamentally change the long-time transport dynamics.


title: Searches for long-lived particles with the ANUBIS experiment

abstract: In recent years, there has been growing interest in the search for long-lived particles (LLPs), as predicted by various extensions of the Standard Model (SM). The AN Underground Belayed In-Shaft search experiment (ANUBIS) was proposed to search for such particles by instrumenting CERN's ATLAS underground cavern with tracking detectors. This report provides an overview of the current efforts to realize the ANUBIS project focusing on the latest optimized detector geometry and the installation of proANUBIS -- a prototype or proof-of-concept demonstrator. The latter aims to offer insights into anticipated backgrounds for the ANUBIS experiment and demonstrate the feasibility of such a project. The ongoing efforts are needed to contribute to the continuous optimization and development of the ANUBIS project.


title: Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers

abstract: We present the Hourglass Diffusion Transformer (HDiT), an image generative model that exhibits linear scaling with pixel count, supporting training at high-resolution (e.g. $1024 \times 1024$) directly in pixel-space. Building on the Transformer architecture, which is known to scale to billions of parameters, it bridges the gap between the efficiency of convolutional U-Nets and the scalability of Transformers. HDiT trains successfully without typical high-resolution training techniques such as multiscale architectures, latent autoencoders or self-conditioning. We demonstrate that HDiT performs competitively with existing models on ImageNet $256^2$, and sets a new state-of-the-art for diffusion models on FFHQ-$1024^2$.


title: Massively Parallel Modular Methods in Commutative Algebra and Algebraic Geometry

abstract: Computations over the rational numbers often encounter the problem of intermediate coefficient growth. A solution to this is provided by modular methods, which apply the algorithm under consideration modulo a number of primes and then lift the results to the rationals. We present a novel, massively parallel framework for modular computations with polynomial data, which is able to cover a broad spectrum of applications in commutative algebra and algebraic geometry. We demonstrate the framework's effectiveness in Groebner basis computations over the rationals and algorithmic methods from birational geometry. In particular, we develop algorithms to compute images and domains of rational maps, as well as determining invertibility and computing inverses. Our implementation is based on the Singular/GPI-Space framework, which uses the computer algebra system Singular as computational backend, while coordination and communication of parallel computations is handled by the workflow management system GPI-Space, which relies on Petri nets as its mathematical modeling language. Convenient installation is realized through the package manager Spack. Relying on Petri nets, our approach provides automated parallelization and balancing of the load between computation, lifting, stabilization testing, and potential verification. We use error tolerant rational reconstruction to ensure termination as long as for a fixed computation there exist only finitely many bad primes. Via stabilization testing, our approach automatically finds with high probablity a minimal set of primes required for the successful reconstruction. We present timings to illustrate the potential for a game changing improvement of performance over previous modular and non-modular methods. In particular, we illustrate that the approach scales very well with the number of processor cores used for the computation.


title: An Interacting Wasserstein Gradient Flow Strategy to Robust Bayesian Inference

abstract: Model Updating is frequently used in Structural Health Monitoring to determine structures' operating conditions and whether maintenance is required. Data collected by sensors are used to update the values of some initially unknown physics-based model's parameters. Bayesian Inference techniques for model updating require the assumption of a prior distribution. This choice of prior may affect posterior predictions and subsequent decisions on maintenance requirements, specially under the typical case in engineering applications of little informative data. Therefore, understanding how the choice of prior may affect the posterior prediction is of great interest. In this paper, a Robust Bayesian Inference technique evaluates the optimal and worst-case prior in the vicinity of a chosen nominal prior, and their corresponding posteriors. This technique employs an interacting Wasserstein gradient flow formulation. Two numerical case studies are used to showcase the proposed algorithm: a double-banana-posterior and a double beam structure. Optimal and worst-case prior are modelled by specifying an ambiguity set containing any distribution at a statistical distance to the nominal prior, less or equal to the radius. Examples show how particles flow from an initial assumed Gaussian distribution to the optimal worst-case prior distribution that lies inside the defined ambiguity set, and the resulting particles from the approximation to the posterior. The resulting posteriors may be used to yield the lower and upper bounds on subsequent calculations used for decision-making. If the metric used for decision-making is not sensitive to the resulting posteriors, it may be assumed that decisions taken are robust to prior uncertainty.


title: $\texttt{immrax}$: A Parallelizable and Differentiable Toolbox for Interval Analysis and Mixed Monotone Reachability in JAX

abstract: We present an implementation of interval analysis and mixed monotone interval reachability analysis as function transforms in Python, fully composable with the computational framework JAX. The resulting toolbox inherits several key features from JAX, including computational efficiency through Just-In-Time Compilation, GPU acceleration for quick parallelized computations, and Automatic Differentiability. We demonstrate the toolbox's performance on several case studies, including a reachability problem on a vehicle model controlled by a neural network, and a robust closed-loop optimal control problem for a swinging pendulum.


title: Graph Edits for Counterfactual Explanations: A comparative study

abstract: Counterfactuals have been established as a popular explainability technique which leverages a set of minimal edits to alter the prediction of a classifier. When considering conceptual counterfactuals on images, the edits requested should correspond to salient concepts present in the input data. At the same time, conceptual distances are defined by knowledge graphs, ensuring the optimality of conceptual edits. In this work, we extend previous endeavors on graph edits as counterfactual explanations by conducting a comparative study which encompasses both supervised and unsupervised Graph Neural Network (GNN) approaches. To this end, we pose the following significant research question: should we represent input data as graphs, which is the optimal GNN approach in terms of performance and time efficiency to generate minimal and meaningful counterfactual explanations for black-box image classifiers?


title: Note on Min-k-Planar Drawings of Graphs

abstract: The k-planar graphs, which are (usually with small values of k such as 1, 2, 3) subject to recent intense research, admit a drawing in which edges are allowed to cross, but each one edge is allowed to carry at most k crossings. In recently introduced [Binucci et al., GD 2023] min-k-planar drawings of graphs, edges may possibly carry more than k crossings, but in any two crossing edges, at least one of the two must have at most k crossings. In both concepts, one may consider general drawings or a popular restricted concept of drawings called simple. In a simple drawing, every two edges are allowed to cross at most once, and any two edges which share a vertex are forbidden to cross. While, regarding the former concept, it is for k<=3 known (but perhaps not widely known) that every general k-planar graph admits a simple k-planar drawing and this ceases to be true for any k>=4, the difference between general and simple drawings in the latter concept is more striking. We prove that there exist graphs with a min-2-planar drawing, or with a min-3-planar drawing avoiding crossings of adjacent edges, which have no simple min-k-planar drawings for arbitrarily large fixed k.


title: Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networks

abstract: Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there is a growing interest in using the deep neural network route to address the problem. This work presents a novel approach that learns a continuous representation of the physical field using implicit neural representations (INRs). Specifically, after factorizing spatiotemporal variability into spatial and temporal components using the separation of variables technique, the method learns relevant basis functions from sparsely sampled irregular data points to develop a continuous representation of the data. In experimental evaluations, the proposed model outperforms recent INR methods, offering superior reconstruction quality on simulation data from a state-of-the-art climate model and a second dataset that comprises ultra-high resolution satellite-based sea surface temperature fields.


title: JWST Reveals Powerful Feedback from Radio Jets in a Massive Galaxy at z = 4.1

abstract: We report observations of a powerful ionized gas outflow in a z = 4.1 luminous ($ L_{1.4GHz} \sim 10^{28.3} \ W \ Hz^{-1}$) radio galaxy TNJ1338-1942 hosting an obscured quasar using the Near Infrared Spectrograph (NIRSpec) on board JWST. We spatially resolve a large-scale (~15 kpc) outflow and measure resolved outflow rates. The outflowing gas shows velocities exceeding 900 $ km \ s^{-1}$ and broad line profiles with line widths exceeding 1200 $ km \ s^{-1}$ located at ~10 kpc projected distance from the central nucleus. The outflowing nebula spatially overlaps with the brightest radio lobe, indicating that the powerful radio jets are responsible for the extraordinary kinematics exhibited by the ionized gas. The ionized gas is possibly ionized by the central obscured quasar with a contribution from shocks. The spatially resolved mass outflow rate shows that the region with the broadest line profiles exhibits the strongest outflow rates, with an integrated mass outflow rate of ~500 $ M_{\odot} \ yr^{-1}$. Our hypothesis is that an over-pressured shocked jet fluid expands laterally to create an expanding ellipsoidal "cocoon" that causes the surrounding gas to accelerate outwards. The total kinetic energy injected by the radio jet is about 3 orders of magnitude larger than the total kinetic energy measured in the outflowing ionized gas. This implies that kinetic energy must be transferred inefficiently from the jets to the gas. The bulk of the deposited energy possibly lies in the form of hot (~$ 10^7$ K) X-ray-emitting gas.


title: Hot Jupiter Formation in Dense Star Clusters

abstract: Hot Jupiters (HJ) are defined as Jupiter-mass exoplanets orbiting around their host star with an orbital period < 10 days. It is assumed that HJ do not form in-situ but ex-situ. Recent discoveries show that star clusters contribute to the formation of HJ. We present direct $N$-body simulations of planetary systems in star clusters and analyze the formation of HJ in them. We combine two direct $N$-body codes: NBODY6++GPU for the dynamics of dense star clusters with 32 000 and 64 000 stellar members and LonelyPlanets used to follow 200 identical planetary systems around solar mass stars in those star clusters. We use different sets with 3, 4, or 5 planets and with the innermost planet at a semi-major axis of 5 au or 1 au and follow them for 100 Myr in our simulations. The results indicate that HJs are generated with high efficiency in dense star clusters if the innermost planet is already close to the host star at a semi-major axis of 1 au. If the innermost planet is initially beyond a semi-major axis of 5 au, the probability of a potential HJ ranges between $1.5-4.5$ percent. Very dense stellar neighborhoods tend to eject planets rather than forming HJs. A correlation between HJ formation and angular momentum deficit (AMD) is not witnessed. Young Hot Jupiters ($t_{\rm age} < 100$ Myrs) have only been found, in our simulations, in planetary systems with the innermost planet at a semi-major axis of 1 au.


title: Lightweight Self-Driven Deformable Organ Animations

abstract: The subject of simulating internal organs is a valuable and important topic of research to multiple fields from medical analysis to education and training. This paper presents a solution that utilizes a graphical technique in combination with a Stochastic method for tuning an active physics-based model. We generate responsive interactive organ animations with regional properties (i.e., areas of the model oscillating with different harmonic frequencies) to reproduce and capture real-world characteristics. Our method builds upon biological and physical discoveries to procedurally generate internally controlled rhythmic motions but also enable the solution to be interactive and adaptive. We briefly review deformation models for medical simulations and investigate the impediments to combining 'computergraphics' representations with biomechanical models. Finally, we present a lightweight solution that is scalable and able to procedurally generate large organ animations. In particular, simplified geometric representations of deformable structures that use periodic coupled forces to drive themselves.


title: Another Way to the Top: Exploit Contextual Clustering in Learned Image Coding

abstract: While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering operations and local attention for correlation characterization and compact representation of an image. As seen, CLIC expands the receptive field into the entire image for intra-cluster feature aggregation. Afterward, features are reordered to their original spatial positions to pass through the local attention units for inter-cluster embedding. Additionally, we introduce the Guided Post-Quantization Filtering (GuidedPQF) into CLIC, effectively mitigating the propagation and accumulation of quantization errors at the initial decoding stage. Extensive experiments demonstrate the superior performance of CLIC over state-of-the-art works: when optimized using MSE, it outperforms VVC by about 10% BD-Rate in three widely-used benchmark datasets; when optimized using MS-SSIM, it saves more than 50% BD-Rate over VVC. Our CLIC offers a new way to generate compact representations for image compression, which also provides a novel direction along the line of LIC development.


title: Boundary element method for the Dirichlet problem for Laplace's equation on a disk

abstract: The Boundary Element Method (BEM) is implemented using piecewise linear elements to solve the two-dimensional Dirichlet problem for Laplace's equation posed on a disk. A benefit of the BEM as opposed to many other numerical solution techniques is that discretization only occurs on the boundary, i.e., the complete domain does not need to be discretized. This provides an advantage in terms of time and cost. The algorithm's performance is illustrated through sample test problems with known solutions. A comparison between the exact solution and the BEM numerical solution is done, and error analysis is performed on the results.


title: A Survey on African Computer Vision Datasets, Topics and Researchers

abstract: Computer vision encompasses a range of tasks such as object detection, semantic segmentation, and 3D reconstruction. Despite its relevance to African communities, research in this field within Africa represents only 0.06% of top-tier publications over the past decade. This study undertakes a thorough analysis of 63,000 Scopus-indexed computer vision publications from Africa, spanning from 2012 to 2022. The aim is to provide a survey of African computer vision topics, datasets and researchers. A key aspect of our study is the identification and categorization of African Computer Vision datasets using large language models that automatically parse abstracts of these publications. We also provide a compilation of unofficial African Computer Vision datasets distributed through challenges or data hosting platforms, and provide a full taxonomy of dataset categories. Our survey also pinpoints computer vision topics trends specific to different African regions, indicating their unique focus areas. Additionally, we carried out an extensive survey to capture the views of African researchers on the current state of computer vision research in the continent and the structural barriers they believe need urgent attention. In conclusion, this study catalogs and categorizes Computer Vision datasets and topics contributed or initiated by African institutions and identifies barriers to publishing in top-tier Computer Vision venues. This survey underscores the importance of encouraging African researchers and institutions in advancing computer vision research in the continent. It also stresses on the need for research topics to be more aligned with the needs of African communities.


title: Efficient local linearity regularization to overcome catastrophic overfitting

abstract: Catastrophic overfitting (CO) in single-step adversarial training (AT) results in abrupt drops in the adversarial test accuracy (even down to 0%). For models trained with multi-step AT, it has been observed that the loss function behaves locally linearly with respect to the input, this is however lost in single-step AT. To address CO in single-step AT, several methods have been proposed to enforce local linearity of the loss via regularization. However, these regularization terms considerably slow down training due to Double Backpropagation. Instead, in this work, we introduce a regularization term, called ELLE, to mitigate CO effectively and efficiently in classical AT evaluations, as well as some more difficult regimes, e.g., large adversarial perturbations and long training schedules. Our regularization term can be theoretically linked to curvature of the loss function and is computationally cheaper than previous methods by avoiding Double Backpropagation. Our thorough experimental validation demonstrates that our work does not suffer from CO, even in challenging settings where previous works suffer from it. We also notice that adapting our regularization parameter during training (ELLE-A) greatly improves the performance, specially in large $\epsilon$ setups. Our implementation is available in https://github.com/LIONS-EPFL/ELLE .


title: The geometry of multi-curve interest rate models

abstract: We study the problems of consistency and of the existence of finite-dimensional realizations for multi-curve interest rate models of Heath-Jarrow-Morton type, generalizing the geometric approach developed by T. Bj\"ork and co-authors in the classical single-curve setting. We characterize when a multi-curve interest rate model is consistent with a given parameterized family of forward curves and spreads and when a model can be realized by a finite-dimensional state process. We illustrate the general theory in a number of model classes and examples, providing explicit constructions of finite-dimensional realizations. Based on these theoretical results, we perform the calibration of a three-curve Hull-White model to market data and analyse the stability of the estimated parameters.


title: Real-Time Systems Optimization with Black-box Constraints and Hybrid Variables

abstract: When optimizing real-time systems, designers often face a challenging problem where the schedulability constraints are non-convex, non-continuous, or lack an analytical form to understand their properties. Although the optimization framework NORTH proposed in previous work is general (it works with arbitrary schedulability analysis) and scalable, it can only handle problems with continuous variables, which limits its application. In this paper, we extend the applications of the framework NORTH to problems with a hybrid of continuous and discrete variables. This is achieved in a coordinate-descent method, where the continuous and discrete variables are optimized separately during iterations. The new framework, NORTH+, improves around 20% solution quality than NORTH in experiments.


title: A Novel Decision Ensemble Framework: Customized Attention-BiLSTM and XGBoost for Speculative Stock Price Forecasting

abstract: Forecasting speculative stock prices is essential for effective investment risk management that drives the need for the development of innovative algorithms. However, the speculative nature, volatility, and complex sequential dependencies within financial markets present inherent challenges which necessitate advanced techniques. This paper proposes a novel framework, CAB-XDE (customized attention BiLSTM-XGB decision ensemble), for predicting the daily closing price of speculative stock Bitcoin-USD (BTC-USD). CAB-XDE framework integrates a customized bi-directional long short-term memory (BiLSTM) with the attention mechanism and the XGBoost algorithm. The customized BiLSTM leverages its learning capabilities to capture the complex sequential dependencies and speculative market trends. Additionally, the new attention mechanism dynamically assigns weights to influential features, thereby enhancing interpretability, and optimizing effective cost measures and volatility forecasting. Moreover, XGBoost handles nonlinear relationships and contributes to the proposed CAB-XDE framework robustness. Additionally, the weight determination theory-error reciprocal method further refines predictions. This refinement is achieved by iteratively adjusting model weights. It is based on discrepancies between theoretical expectations and actual errors in individual customized attention BiLSTM and XGBoost models to enhance performance. Finally, the predictions from both XGBoost and customized attention BiLSTM models are concatenated to achieve diverse prediction space and are provided to the ensemble classifier to enhance the generalization capabilities of CAB-XDE. The proposed CAB-XDE framework is empirically validated on volatile Bitcoin market, sourced from Yahoo Finance and outperforms state-of-the-art models with a MAPE of 0.0037, MAE of 84.40, and RMSE of 106.14.


title: The Markov-Chain Polytope with Applications

abstract: This paper addresses the problem of finding a minimum-cost $m$-state Markov chain $(S_0,\ldots,S_{m-1})$ in a large set of chains. The chains studied have a reward associated with each state. The cost of a chain is its "gain", i.e., its average reward under its stationary distribution. Specifically, for each $k=0,\ldots,m-1$ there is a known set ${\mathbb S}_k$ of type-$k$ states. A permissible Markov chain contains exactly one state of each type; the problem is to find a minimum-cost permissible chain. The original motivation was to find a cheapest binary AIFV-$m$ lossless code on a source alphabet of size $n$. Such a code is an $m$-tuple of trees, in which each tree can be viewed as a Markov Chain state. This formulation was then used to address other problems in lossless compression. The known solution techniques for finding minimum-cost Markov chains were iterative and ran in exponential time. This paper shows how to map every possible type-$k$ state into a type-$k$ hyperplane and then define a "Markov Chain Polytope" as the lower envelope of all such hyperplanes. Finding a minimum-cost Markov chain can then be shown to be equivalent to finding a "highest" point on this polytope. The local optimization procedures used in the previous iterative algorithms are shown to be separation oracles for this polytope. Since these were often polynomial time, an application of the Ellipsoid method immediately leads to polynomial time algorithms for these problems.


title: Radiative decays of X(3872) discriminate between the molecular and compact interpretations

abstract: Radiative decays X --> psi(1S) + gamma and X --> psi(2S) + gamma might be expected to have a ratio of branching fractions following the phase space volumes ratio. However data suggest the opposite, indicating a value for R=B(X --> psi^prime + gamma) / B(X --> psi +gamma) consistently larger than one. In this paper we present a calculation of R for both a compact Born-Oppenheimer cc-bar q-qbar state and a DD^* molecule. In the former case R~1 or larger is found, a value to be confronted with forthcoming high statistics data analyses. In the molecular picture, with D and D^* mesons described by the universal wave function used by Voloshin, Braaten and Kusunoki, we find that R would be of order 10^-2. A more precise experimental measure would be extremely helpful in clarifying the true nature of the X(3872).


title: In-context Learning with Retrieved Demonstrations for Language Models: A Survey

abstract: Language models, especially pre-trained large language models, have showcased remarkable abilities as few-shot in-context learners (ICL), adept at adapting to new tasks with just a few demonstrations in the input context. However, the model's ability to perform ICL is sensitive to the choice of the few-shot demonstrations. Instead of using a fixed set of demonstrations, one recent development is to retrieve demonstrations tailored to each input query. The implementation of demonstration retrieval is relatively straightforward, leveraging existing databases and retrieval systems. This not only improves the efficiency and scalability of the learning process but also has been shown to reduce biases inherent in manual example selection. In light of the encouraging results and growing research in ICL with retrieved demonstrations, we conduct an extensive review of studies in this area. In this survey, we discuss and compare different design choices for retrieval models, retrieval training procedures, and inference algorithms.


title: Efficient PSF Modeling with ShOpt.jl: A PSF Benchmarking Study with JWST NIRCam Imaging

abstract: With their high angular resolutions of 30--100 mas, large fields of view, and complex optical systems, imagers on next-generation optical/near-infrared space observatories, such as the Near-Infrared Camera (NIRCam) on the James Webb Space Telescope (JWST), present both new opportunities for science and also new challenges for empirical point spread function (PSF) characterization. In this context, we introduce ShOpt, a new PSF fitting tool developed in Julia and designed to bridge the advanced features of PIFF (PSFs in the Full Field of View) with the computational efficiency of PSFEx (PSF Extractor). Along with ShOpt, we propose a suite of non-parametric statistics suitable for evaluating PSF fit quality in space-based imaging. Our study benchmarks ShOpt against the established PSF fitters PSFEx and PIFF using real and simulated COSMOS-Web Survey imaging. We assess their respective PSF model fidelity with our proposed diagnostic statistics and investigate their computational efficiencies, focusing on their processing speed relative to the complexity and size of the PSF models. We find that ShOpt can already achieve PSF model fidelity comparable to PSFEx and PIFF while maintaining competitive processing speeds, constructing PSF models for large NIRCam mosaics within minutes.


abstract: Freely Long-Thinking Transformer (FraiLT) is an improved transformer model designed to enhance processing capabilities without scaling up size. It utilizes a recursive approach, iterating over a subset of layers multiple times, and introduces iteration encodings to maintain awareness across these cycles. Iteration encoding allows FraiLT to achieve the interpretive depth of larger models in a compact form. When evaluated on a synthetic story dataset, FraiLT outperformed larger models, showcasing its ability to deliver high-quality performance while reducing memory demands. This model represents a step forward towards more efficient and accessible language models.


title: Tight Verification of Probabilistic Robustness in Bayesian Neural Networks

abstract: We introduce two algorithms for computing tight guarantees on the probabilistic robustness of Bayesian Neural Networks (BNNs). Computing robustness guarantees for BNNs is a significantly more challenging task than verifying the robustness of standard Neural Networks (NNs) because it requires searching the parameters' space for safe weights. Moreover, tight and complete approaches for the verification of standard NNs, such as those based on Mixed-Integer Linear Programming (MILP), cannot be directly used for the verification of BNNs because of the polynomial terms resulting from the consecutive multiplication of variables encoding the weights. Our algorithms efficiently and effectively search the parameters' space for safe weights by using iterative expansion and the network's gradient and can be used with any verification algorithm of choice for BNNs. In addition to proving that our algorithms compute tighter bounds than the SoA, we also evaluate our algorithms against the SoA on standard benchmarks, such as MNIST and CIFAR10, showing that our algorithms compute bounds up to 40% tighter than the SoA.


title: Older Adults Imagining Future Technologies in Participatory Design Workshops: Supporting Continuity in the Pursuit of Meaningful Activities

abstract: Recent innovations in digital technology offer significant opportunities for older adults to engage in meaningful activities. To investigate older adults' perceptions of using existing and emerging technologies for meaningful activities, we conducted three participatory design workshops and follow-up interviews with adults aged over 65. The workshops encompassed discussions on existing technologies for meaningful activities, demonstrations of emerging technologies such as VR, AR, and AI, and design activities including prototyping and storyboarding. Our findings show that while participants had diverse interpretations of meaningful activities, they sought to use technologies to support continuity in the pursuit of these activities. Specifically, participants highlighted the importance of safe aging at home, which provides a pathway for meaningful activities in later life. We further discuss participants' discerning attitudes when assessing the use of different technologies for meaningful activities and several values and attributes they desire when envisioning future technologies, including simplicity, positivity, proactivity, and integration.


title: Jump off the Bandwagon? Characterizing Bandwagon Fans' Future Loyalty in Online NBA Fan Communities

abstract: Online user dynamics has been actively studied in recent years and bandwagon behavior is one of the most representative topics which can provide valuable insights for user identity change. Many previous studies have characterized bandwagon users and leveraged such characteristics to tackle practical problems such as community loyalty prediction. However, very few of them have investigated bandwagon dynamics from a long-term perspective. In this work, we focus on characterizing and predicting long-term bandwagon user behaviors in the context of online fan loyalty. Using a dataset collected from NBA-related discussion forums on Reddit, we trace the long-term loyalty status of bandwagon fans to capture their latent behavioral characteristics and then propose a computational model to predict their next sport season loyalty status with their home teams. Our analyses reveal that bandwagoning for most fans is a temporary switch and most of them will be back in the long term. In addition, online fans with different loyalty levels to their home teams have demonstrated different behaviors in various aspects, such as activity level, language usage and reply network properties. We then propose a model based on such behavioral characteristics to predict their next-season loyalty status. Its promising performance demonstrates the effectiveness of our behavior characterization.


title: Reframing Offline Reinforcement Learning as a Regression Problem

abstract: The study proposes the reformulation of offline reinforcement learning as a regression problem that can be solved with decision trees. Aiming to predict actions based on input states, return-to-go (RTG), and timestep information, we observe that with gradient-boosted trees, the agent training and inference are very fast, the former taking less than a minute. Despite the simplification inherent in this reformulated problem, our agent demonstrates performance that is at least on par with established methods. This assertion is validated by testing it across standard datasets associated with D4RL Gym-MuJoCo tasks. We further discuss the agent's ability to generalize by testing it on two extreme cases, how it learns to model the return distributions effectively even with highly skewed expert datasets, and how it exhibits robust performance in scenarios with sparse/delayed rewards.


title: Text-to-Image Cross-Modal Generation: A Systematic Review

abstract: We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output, without limiting the analysis to narrow sub-areas. It also results in the identification of common templates in the field, which are then compared and contrasted both within pools of similar methods and across lines of research. We provide a breakdown of text-to-image generation into various flavors of image-from-text methods, video-from-text methods, image editing, self-supervised and graph-based approaches. In this discussion, we focus on research papers published at 8 leading machine learning conferences in the years 2016-2022, also incorporating a number of relevant papers not matching the outlined search criteria. The conducted review suggests a significant increase in the number of papers published in the area and highlights research gaps and potential lines of investigation. To our knowledge, this is the first review to systematically look at text-to-image generation from the perspective of "cross-modal generation."


title: What Are We Optimizing For? A Human-centric Evaluation of Deep Learning-based Movie Recommenders

abstract: In the past decade, deep learning (DL) models have gained prominence for their exceptional accuracy on benchmark datasets in recommender systems (RecSys). However, their evaluation has primarily relied on offline metrics, overlooking direct user perception and experience. To address this gap, we conduct a human-centric evaluation case study of four leading DL-RecSys models in the movie domain. We test how different DL-RecSys models perform in personalized recommendation generation by conducting survey study with 445 real active users. We find some DL-RecSys models to be superior in recommending novel and unexpected items and weaker in diversity, trustworthiness, transparency, accuracy, and overall user satisfaction compared to classic collaborative filtering (CF) methods. To further explain the reasons behind the underperformance, we apply a comprehensive path analysis. We discover that the lack of diversity and too much serendipity from DL models can negatively impact the consequent perceived transparency and personalization of recommendations. Such a path ultimately leads to lower summative user satisfaction. Qualitatively, we confirm with real user quotes that accuracy plus at least one other attribute is necessary to ensure a good user experience, while their demands for transparency and trust can not be neglected. Based on our findings, we discuss future human-centric DL-RecSys design and optimization strategies.


title: Zoom-shot: Fast and Efficient Unsupervised Zero-Shot Transfer of CLIP to Vision Encoders with Multimodal Loss

abstract: The fusion of vision and language has brought about a transformative shift in computer vision through the emergence of Vision-Language Models (VLMs). However, the resource-intensive nature of existing VLMs poses a significant challenge. We need an accessible method for developing the next generation of VLMs. To address this issue, we propose Zoom-shot, a novel method for transferring the zero-shot capabilities of CLIP to any pre-trained vision encoder. We do this by exploiting the multimodal information (i.e. text and image) present in the CLIP latent space through the use of specifically designed multimodal loss functions. These loss functions are (1) cycle-consistency loss and (2) our novel prompt-guided knowledge distillation loss (PG-KD). PG-KD combines the concept of knowledge distillation with CLIP's zero-shot classification, to capture the interactions between text and image features. With our multimodal losses, we train a $\textbf{linear mapping}$ between the CLIP latent space and the latent space of a pre-trained vision encoder, for only a $\textbf{single epoch}$. Furthermore, Zoom-shot is entirely unsupervised and is trained using $\textbf{unpaired}$ data. We test the zero-shot capabilities of a range of vision encoders augmented as new VLMs, on coarse and fine-grained classification datasets, outperforming the previous state-of-the-art in this problem domain. In our ablations, we find Zoom-shot allows for a trade-off between data and compute during training; and our state-of-the-art results can be obtained by reducing training from 20% to 1% of the ImageNet training data with 20 epochs. All code and models are available on GitHub.


title: MR.CAP: Multi-Robot Joint Control and Planning for Object Transport

abstract: With the recent influx in demand for multi-robot systems throughout industry and academia, there is an increasing need for faster, robust, and generalizable path planning algorithms. Similarly, given the inherent connection between control algorithms and multi-robot path planners, there is in turn an increased demand for fast, efficient, and robust controllers. We propose a scalable joint path planning and control algorithm for multi-robot systems with constrained behaviours based on factor graph optimization. We demonstrate our algorithm on a series of hardware and simulated experiments. Our algorithm is consistently able to recover from disturbances and avoid obstacles while outperforming state-of-the-art methods in optimization time, path deviation, and inter-robot errors. See the code and supplementary video for experiments.


title: Gravitational Waves from Neutrino-Driven Core Collapse Supernovae: Predictions, Detection, and Parameter Estimation

abstract: Three-dimensional modeling has reached a level of maturity to provide detailed predictions of the gravitational wave emission in neutrino-driven core collapse supernovae. We review the status of these modeling efforts, current predictions for core collapse supernova gravitational wave emission, and the status of algorithms for the detection of core collapse supernova gravitational waves and the estimation of physical parameters associated with these events, which we hope to use to cull information about the central engine.


title: New physics search via angular distribution of $B \rightarrow D^* \ell {\nu}_{\ell}$ decay in the light of the new lattice data

abstract: In this article, we investigate the potential of the angular distribution of the $B \rightarrow D^* \ell {\nu}_{\ell}$ process to search for new physics signals. The Belle collaboration has analysed it to constraint $V_{cb}$ and the $B\to D^*$ form factors, under the assumption of the Standard Model. With the newly released lattice QCD data, we can perform a simultaneous fit of the form factors, $V_{cb}$ as well as new physics parameters. We use the Belle data and the lattice data to constrain right-handed new physics. In addition, we also generate unbinned pseudo-dataset and perform a sensitivity study on more general new physics models, using the lattice data.


title: A survey of recent developments in GLSMs

abstract: In this article we briefly survey some developments in gauged linear sigma models (GLSMs). Specifically, we give an overview of progress on constructions of GLSMs for various geometries, GLSM-based computations of quantum cohomology, quantum sheaf cohomology, and quantum K theory rings, as well as two-dimensional abelian and non-abelian mirror constructions. (Contribution to the proceedings of Gauged Linear Sigma Models@30 (Simons Center, Stony Brook, May 2023).)


title: Chiral perturbation theory with vector mesons and the pion form factors

abstract: The chiral perturbation theory (ChPT) of pions is extended to include vector mesons as well as pertinent degrees of freedom. By counting the typical momentum scale of vector mesons as order of $Q$ and vector meson masses as of the order of $\Lambda_\chi$, a consistent theory could be obtained. The explicit renormalization procedure of the theory is presented for the form factors of the pion up to one-loop accuracy. The resulting theory prediction for the form factors is in good agreement with the experimental data for a wide range of momentum transfers. The vector-meson dominance mechanism is also discussed in the systematic framework of ChPT.


title: Long time stability for KAM tori of the derivative nonlinear Schr\"odinger equation

abstract: This paper is concerned with the long time stability of KAM tori for a class of derivative nonlinear Schr\"odinger equations subjected to periodic boundary condition.


title: Optimizing performance in elastic optical networks using advanced reconfigurable optical add-drop multiplexers: A novel design approach and comprehensive analysis

abstract: Network operators diversify service offerings and enhance network efficiency by leveraging bandwidth-variable transceivers and colorless flexible-grid reconfigurable optical add-drop multiplexers (ROADMs). Nonetheless, the paradigm shift from rigid to elastic optical networks (EONs) has affected several key parameters, including bit rate, center frequency spacing, modulation format, and optical reach. This study investigated the transformative impact of emerging technologies on the design and structure of optical network architectures, including spectrally efficient multicarrier systems and bandwidth-variable wavelength-selective switches. A cost-effective ROADM architecture applying an order-based connecting approach was introduced, which presented a high connectivity level and a blockage probability of less than 10-4. When this architecture was implemented in the EON, the data transportation rate was 1 Tb/s. This outcome successfully accommodated a 20 % surge in traffic demand, while the optimized network architecture significantly improved fiber utilization by 3.4 %. Consequently, this study contributed a practical and efficient solution for implementing flexible optical networks, effectively addressing current concerns and propelling the optical communication system sector forward.


title: Revolutionizing Finance with LLMs: An Overview of Applications and Insights

abstract: In recent years, Large Language Models (LLMs) like ChatGPT have seen considerable advancements and have been applied in diverse fields. Built on the Transformer architecture, these models are trained on extensive datasets, enabling them to understand and generate human language effectively. In the financial domain, the deployment of LLMs is gaining momentum. These models are being utilized for automating financial report generation, forecasting market trends, analyzing investor sentiment, and offering personalized financial advice. Leveraging their natural language processing capabilities, LLMs can distill key insights from vast financial data, aiding institutions in making informed investment choices and enhancing both operational efficiency and customer satisfaction. In this study, we provide a comprehensive overview of the emerging integration of LLMs into various financial tasks. Additionally, we conducted holistic tests on multiple financial tasks through the combination of natural language instructions. Our findings show that GPT-4 effectively follow prompt instructions across various financial tasks. This survey and evaluation of LLMs in the financial domain aim to deepen the understanding of LLMs' current role in finance for both financial practitioners and LLM researchers, identify new research and application prospects, and highlight how these technologies can be leveraged to solve practical challenges in the finance industry.


title: SyzRetrospector: A Large-Scale Retrospective Study of Syzbot

abstract: Over the past 6 years, Syzbot has fuzzed the Linux kernel day and night to report over 5570 bugs, of which 4604 have been patched [11]. While this is impressive, we have found the average time to find a bug is over 405 days. Moreover, we have found that current metrics commonly used, such as time-to-find and number of bugs found, are inaccurate in evaluating Syzbot since bugs often spend the majority of their lives hidden from the fuzzer. In this paper, we set out to better understand and quantify Syzbot's performance and improvement in finding bugs. Our tool, SyzRetrospector, takes a different approach to evaluating Syzbot by finding the earliest that Syzbot was capable of finding a bug, and why that bug was revealed. We use SyzRetrospector on a large scale to analyze 559 bugs and find that bugs are hidden for an average of 331.17 days before Syzbot is even able to find them. We further present findings on the behaviors of revealing factors, how some bugs are harder to reveal than others, the trends in delays over the past 6 years, and how bug location relates to delays. We also provide key takeaways for improving Syzbot's delays.


title: Coronal Heating and Solar Wind Generation by Flux Cancellation Reconnection

abstract: In this paper we propose that flux cancellation on small granular scales ($\lesssim 1000$ km) ubiquitously drives reconnection at a multitude of sites in the low solar atmosphere, contributing to chromospheric/coronal heating and the generation of the solar wind. We analyse the energy conversion in these small-scale flux cancellation events using both analytical models and three-dimensional, resistive magnetohydrodynamic (MHD) simulations. The analytical models -- in combination with the latest estimates of flux cancellation rates -- allow us to estimate the energy release rates due to cancellation events, which are found to be of the order $10^6-10^7$ erg cm$^{-2}$sec$^{-1}$, sufficient to heat the chromosphere and corona of the Quiet Sun and active regions, and to power the solar wind. The MHD simulations confirm the conversion of energy in reconnecting current sheets, in a geometry representing a small-scale bipole being advected towards an intergranular lane. A ribbon-like jet of heated plasma is accelerated upwards, that could also escape the Sun as the solar wind in an open-field configuration. We conclude that through two phases of atmospheric energy release -- pre-cancellation and cancellation -- the cancellation of photospheric magnetic flux fragments and the associated magnetic reconnection may provide a substantial energy and mass flux contribution to coronal heating and solar wind generation.


title: Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition

abstract: Automatic surgical phase recognition is a core technology for modern operating rooms and online surgical video assessment platforms. Current state-of-the-art methods use both spatial and temporal information to tackle the surgical phase recognition task. Building on this idea, we propose the Multi-Scale Action Segmentation Transformer (MS-AST) for offline surgical phase recognition and the Multi-Scale Action Segmentation Causal Transformer (MS-ASCT) for online surgical phase recognition. We use ResNet50 or EfficientNetV2-M for spatial feature extraction. Our MS-AST and MS-ASCT can model temporal information at different scales with multi-scale temporal self-attention and multi-scale temporal cross-attention, which enhances the capture of temporal relationships between frames and segments. We demonstrate that our method can achieve 95.26% and 96.15% accuracy on the Cholec80 dataset for online and offline surgical phase recognition, respectively, which achieves new state-of-the-art results. Our method can also achieve state-of-the-art results on non-medical datasets in the video action segmentation domain.


title: Streaming Bilingual End-to-End ASR model using Attention over Multiple Softmax

abstract: Even with several advancements in multilingual modeling, it is challenging to recognize multiple languages using a single neural model, without knowing the input language and most multilingual models assume the availability of the input language. In this work, we propose a novel bilingual end-to-end (E2E) modeling approach, where a single neural model can recognize both languages and also support switching between the languages, without any language input from the user. The proposed model has shared encoder and prediction networks, with language-specific joint networks that are combined via a self-attention mechanism. As the language-specific posteriors are combined, it produces a single posterior probability over all the output symbols, enabling a single beam search decoding and also allowing dynamic switching between the languages. The proposed approach outperforms the conventional bilingual baseline with 13.3%, 8.23% and 1.3% word error rate relative reduction on Hindi, English and code-mixed test sets, respectively.


title: Nonparametric Estimation via Variance-Reduced Sketching

abstract: Nonparametric models are of great interest in various scientific and engineering disciplines. Classical kernel methods, while numerically robust and statistically sound in low-dimensional settings, become inadequate in higher-dimensional settings due to the curse of dimensionality. In this paper, we introduce a new framework called Variance-Reduced Sketching (VRS), specifically designed to estimate density functions and nonparametric regression functions in higher dimensions with a reduced curse of dimensionality. Our framework conceptualizes multivariable functions as infinite-size matrices, and facilitates a new sketching technique motivated by numerical linear algebra literature to reduce the variance in estimation problems. We demonstrate the robust numerical performance of VRS through a series of simulated experiments and real-world data applications. Notably, VRS shows remarkable improvement over existing neural network estimators and classical kernel methods in numerous density estimation and nonparametric regression models. Additionally, we offer theoretical justifications for VRS to support its ability to deliver nonparametric estimation with a reduced curse of dimensionality.


title: LW-FedSSL: Resource-efficient Layer-wise Federated Self-supervised Learning

abstract: Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw training data distributed across edge devices. However, edge devices often struggle with high computation and communication costs imposed by SSL and FL algorithms. To tackle this hindrance, we propose LW-FedSSL, a layer-wise federated self-supervised learning approach that allows edge devices to incrementally train a single layer of the model at a time. Our LW-FedSSL comprises server-side calibration and representation alignment mechanisms to maintain comparable performance with end-to-end federated self-supervised learning (FedSSL) while significantly lowering clients' resource requirements. In a pure layer-wise training scheme, training one layer at a time may limit effective interaction between different layers of the model. The server-side calibration mechanism takes advantage of the resource-rich server in an FL environment to ensure smooth collaboration between different layers of the global model. During the local training process, the representation alignment mechanism encourages closeness between representations of FL local models and those of the global model, thereby preserving the layer cohesion established by server-side calibration. Our experiments show that LW-FedSSL has a $3.3 \times$ lower memory requirement and a $3.2 \times$ cheaper communication cost than its end-to-end counterpart. We also explore a progressive training strategy called Prog-FedSSL that outperforms end-to-end training with a similar memory requirement and a $1.8 \times$ cheaper communication cost.


title: Next Visit Diagnosis Prediction via Medical Code-Centric Multimodal Contrastive EHR Modelling with Hierarchical Regularisation

abstract: Predicting next visit diagnosis using Electronic Health Records (EHR) is an essential task in healthcare, critical for devising proactive future plans for both healthcare providers and patients. Nonetheless, many preceding studies have not sufficiently addressed the heterogeneous and hierarchical characteristics inherent in EHR data, inevitably leading to sub-optimal performance. To this end, we propose NECHO, a novel medical code-centric multimodal contrastive EHR learning framework with hierarchical regularisation. First, we integrate multifaceted information encompassing medical codes, demographics, and clinical notes using a tailored network design and a pair of bimodal contrastive losses, all of which pivot around a medical codes representation. We also regularise modality-specific encoders using a parental level information in medical ontology to learn hierarchical structure of EHR data. A series of experiments on MIMIC-III data demonstrates effectiveness of our approach.


title: M2-CLIP: A Multimodal, Multi-task Adapting Framework for Video Action Recognition

abstract: Recently, the rise of large-scale vision-language pretrained models like CLIP, coupled with the technology of Parameter-Efficient FineTuning (PEFT), has captured substantial attraction in video action recognition. Nevertheless, prevailing approaches tend to prioritize strong supervised performance at the expense of compromising the models' generalization capabilities during transfer. In this paper, we introduce a novel Multimodal, Multi-task CLIP adapting framework named \name to address these challenges, preserving both high supervised performance and robust transferability. Firstly, to enhance the individual modality architectures, we introduce multimodal adapters to both the visual and text branches. Specifically, we design a novel visual TED-Adapter, that performs global Temporal Enhancement and local temporal Difference modeling to improve the temporal representation capabilities of the visual encoder. Moreover, we adopt text encoder adapters to strengthen the learning of semantic label information. Secondly, we design a multi-task decoder with a rich set of supervisory signals to adeptly satisfy the need for strong supervised performance and generalization within a multimodal framework. Experimental results validate the efficacy of our approach, demonstrating exceptional performance in supervised learning while maintaining strong generalization in zero-shot scenarios.


title: PointGL: A Simple Global-Local Framework for Efficient Point Cloud Analysis

abstract: Efficient analysis of point clouds holds paramount significance in real-world 3D applications. Currently, prevailing point-based models adhere to the PointNet++ methodology, which involves embedding and abstracting point features within a sequence of spatially overlapping local point sets, resulting in noticeable computational redundancy. Drawing inspiration from the streamlined paradigm of pixel embedding followed by regional pooling in Convolutional Neural Networks (CNNs), we introduce a novel, uncomplicated yet potent architecture known as PointGL, crafted to facilitate efficient point cloud analysis. PointGL employs a hierarchical process of feature acquisition through two recursive steps. First, the Global Point Embedding leverages straightforward residual Multilayer Perceptrons (MLPs) to effectuate feature embedding for each individual point. Second, the novel Local Graph Pooling technique characterizes point-to-point relationships and abstracts regional representations through succinct local graphs. The harmonious fusion of one-time point embedding and parameter-free graph pooling contributes to PointGL's defining attributes of minimized model complexity and heightened efficiency. Our PointGL attains state-of-the-art accuracy on the ScanObjectNN dataset while exhibiting a runtime that is more than 5 times faster and utilizing only approximately 4% of the FLOPs and 30% of the parameters compared to the recent PointMLP model. The code for PointGL is available at https://github.com/Roywangj/PointGL.


title: Improved model of large-field inflation with primordial black hole production in Starobinsky-like supergravity

abstract: A viable model of large-field (chaotic) inflation with efficient production of primordial black holes is proposed in Starobinsky-like (modified) supergravity leading to the "no-scale-type" K\"ahler potential and the Wess-Zumino-type ("renormalizable") superpotential. The cosmological tilts are in good (within $1\sigma$) agreement with Planck measurements of the cosmic microwave background radiation. In addition, the power spectrum of scalar perturbations has a large peak at smaller scales, which leads to a production of primordial black holes from gravitational collapse of large perturbations with the masses about $10^{17}$ g. The masses are beyond the Hawking (black hole) evaporation limit of $10^{15}$ g, so that those primordial black holes may be viewed as viable candidates for part or the whole of the current dark matter. The parameters of the superpotential were fine-tuned for those purposes, while the cubic term in the superpotential is essential whereas the quadratic term should vanish. The vacuum after inflation (relevant to reheating) is Minkowskian. The energy density fraction of the gravitational waves induced by the production of primordial black holes and their frequency were also calculated in the second order with respect to perturbations.


title: OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning

abstract: Federated learning (FL) has emerged as a promising approach to collaboratively train machine learning models across multiple edge devices while preserving privacy. The success of FL hinges on the efficiency of participating models and their ability to handle the unique challenges of distributed learning. While several variants of Vision Transformer (ViT) have shown great potential as alternatives to modern convolutional neural networks (CNNs) for centralized training, the unprecedented size and higher computational demands hinder their deployment on resource-constrained edge devices, challenging their widespread application in FL. Since client devices in FL typically have limited computing resources and communication bandwidth, models intended for such devices must strike a balance between model size, computational efficiency, and the ability to adapt to the diverse and non-IID data distributions encountered in FL. To address these challenges, we propose OnDev-LCT: Lightweight Convolutional Transformers for On-Device vision tasks with limited training data and resources. Our models incorporate image-specific inductive biases through the LCT tokenizer by leveraging efficient depthwise separable convolutions in residual linear bottleneck blocks to extract local features, while the multi-head self-attention (MHSA) mechanism in the LCT encoder implicitly facilitates capturing global representations of images. Extensive experiments on benchmark image datasets indicate that our models outperform existing lightweight vision models while having fewer parameters and lower computational demands, making them suitable for FL scenarios with data heterogeneity and communication bottlenecks.