title: X-ray analysis of JWST's first galaxy cluster lens SMACS J0723.3-7327

abstract: SMACS~J0723.3-7327 is the first galaxy cluster lens observed by JWST. Based on the ERO data from JWST, several groups have reported the results on strong lensing analysis and mass distribution of this cluster. However, limited by the angular coverage of the JWST data, the strong lensing models only cover the central region. X-ray analysis on the hot ICM is necessary to obtain a more complete constraint on the mass distribution in this very massive cluster. In this work, we aim to perform a comprehensive X-ray analysis of J0723 to obtain accurate ICM hydrostatic mass measurements, using the X-ray data from SRG/eROSITA and Chandra X-ray observatories. By comparing the hydrostatic mass profile with the strong lensing model, we aim to provide the most reliable constraint on the distribution of mass up to R500. Thanks to the eROSITA all-sky survey and Chandra data, which provide high S/N and high angular resolution respectively, we are able to constrain the ICM gas density profile and temperature profile with good accuracy both in the core and to the outskirts. With the density and temperature profiles, we compute the hydrostatic mass profile, which is then projected along the line of sight to compare with the mass distribution obtained from the recent strong lensing analysis based on JWST data. We also deproject the strong lensing mass distribution using the hydrostatic mass profile we obtained in this work. The X-ray results obtained from eROSITA and Chandra agree very well with each other. The hydrostatic mass profiles we measured in this work, both projected and deprojected, are in good agreement with recent strong lensing results based on JWST data, at all radii. We also find that the radial acceleration relation in J0723 is inconsistent with the RAR for spiral galaxies, implying that the latter is not a universal property of gravity across all mass scales.


title: A Kernel Measure of Dissimilarity between $M$ Distributions

abstract: Given $M \geq 2$ distributions defined on a general measurable space, we introduce a nonparametric (kernel) measure of multi-sample dissimilarity (KMD) -- a parameter that quantifies the difference between the $M$ distributions. The population KMD, which takes values between 0 and 1, is 0 if and only if all the $M$ distributions are the same, and 1 if and only if all the distributions are mutually singular. Moreover, KMD possesses many properties commonly associated with $f$-divergences such as the data processing inequality and invariance under bijective transformations. The sample estimate of KMD, based on independent observations from the $M$ distributions, can be computed in near linear time (up to logarithmic factors) using $k$-nearest neighbor graphs (for $k \ge 1$ fixed). We develop an easily implementable test for the equality of $M$ distributions based on the sample KMD that is consistent against all alternatives where at least two distributions are not equal. We prove central limit theorems for the sample KMD, and provide a complete characterization of the asymptotic power of the test, as well as its detection threshold. The usefulness of our measure is demonstrated via real and synthetic data examples; our method is also implemented in an R package.


title: Robust Empirical Risk Minimization with Tolerance

abstract: Developing simple, sample-efficient learning algorithms for robust classification is a pressing issue in today's tech-dominated world, and current theoretical techniques requiring exponential sample complexity and complicated improper learning rules fall far from answering the need. In this work we study the fundamental paradigm of (robust) $\textit{empirical risk minimization}$ (RERM), a simple process in which the learner outputs any hypothesis minimizing its training error. RERM famously fails to robustly learn VC classes (Montasser et al., 2019a), a bound we show extends even to `nice' settings such as (bounded) halfspaces. As such, we study a recent relaxation of the robust model called $\textit{tolerant}$ robust learning (Ashtiani et al., 2022) where the output classifier is compared to the best achievable error over slightly larger perturbation sets. We show that under geometric niceness conditions, a natural tolerant variant of RERM is indeed sufficient for $\gamma$-tolerant robust learning VC classes over $\mathbb{R}^d$, and requires only $\tilde{O}\left( \frac{VC(H)d\log \frac{D}{\gamma\delta}}{\epsilon^2}\right)$ samples for robustness regions of (maximum) diameter $D$.


title: Stability of Sobolev inequalities on Riemannian manifolds with Ricci curvature lower bounds

abstract: We study the qualitative stability of two classes of Sobolev inequalities on Riemannian manifolds. In the case of positive Ricci curvature, we prove that an almost extremal function for the sharp Sobolev inequality is close to an extremal function of the round sphere. In the setting of non-negative Ricci curvature and Euclidean volume growth, we show an analogous result in comparison with the extremal functions in the Euclidean Sobolev inequality. As an application, we deduce a stability result for minimizing Yamabe metrics. The arguments rely on a generalized Lions' concentration compactness on varying spaces and on rigidity results of Sobolev inequalities on singular spaces.


title: Benign Autoencoders

abstract: Recent progress in Generative Artificial Intelligence (AI) relies on efficient data representations, often featuring encoder-decoder architectures. We formalize the mathematical problem of finding the optimal encoder-decoder pair and characterize its solution, which we name the "benign autoencoder" (BAE). We prove that BAE projects data onto a manifold whose dimension is the optimal compressibility dimension of the generative problem. We highlight surprising connections between BAE and several recent developments in AI, such as conditional GANs, context encoders, stable diffusion, stacked autoencoders, and the learning capabilities of generative models. As an illustration, we show how BAE can find optimal, low-dimensional latent representations that improve the performance of a discriminator under a distribution shift. By compressing "malignant" data dimensions, BAE leads to smoother and more stable gradients.


title: What shapes the loss landscape of self-supervised learning?

abstract: Prevention of complete and dimensional collapse of representations has recently become a design principle for self-supervised learning (SSL). However, questions remain in our theoretical understanding: When do those collapses occur? What are the mechanisms and causes? We answer these questions by deriving and thoroughly analyzing an analytically tractable theory of SSL loss landscapes. In this theory, we identify the causes of the dimensional collapse and study the effect of normalization and bias. Finally, we leverage the interpretability afforded by the analytical theory to understand how dimensional collapse can be beneficial and what affects the robustness of SSL against data imbalance.


title: Exact first moments of the RV coefficient by invariant orthogonal integration

abstract: The RV coefficient measures the similarity between two multivariate configurations, and its significance testing has attracted various proposals in the last decades. We present a new approach, the invariant orthogonal integration, permitting to obtain the exact first four moments of the RV coefficient under the null hypothesis. It consists in averaging along the Haar measure the respective orientations of the two configurations, and can be applied to any multivariate setting endowed with Euclidean distances between the observations. Our proposal also covers the weighted setting of observations of unequal importance, where the exchangeability assumption, justifying the usual permutation tests, breaks down. The proposed RV moments express as simple functions of the kernel eigenvalues occurring in the weighted multidimensional scaling of the two configurations. The expressions for the third and fourth moments seem original. The first three moments can be obtained by elementary means, but computing the fourth moment requires a more sophisticated apparatus, the Weingarten calculus for orthogonal groups. The central role of standard kernels and their spectral moments is emphasized.


title: Wide Attention Is The Way Forward For Transformers?

abstract: The Transformer is an extremely powerful and prominent deep learning architecture. In this work, we challenge the commonly held belief in deep learning that going deeper is better, and show an alternative design approach that is building wider attention Transformers. We demonstrate that wide single layer Transformer models can compete with or outperform deeper ones in a variety of Natural Language Processing (NLP) tasks when both are trained from scratch. The impact of changing the model aspect ratio on Transformers is then studied systematically. This ratio balances the number of layers and the number of attention heads per layer while keeping the total number of attention heads and all other hyperparameters constant. On average, across 4 NLP tasks and 10 attention types, single layer wide models perform 0.3% better than their deep counterparts. We show an in-depth evaluation and demonstrate how wide models require a far smaller memory footprint and can run faster on commodity hardware, in addition, these wider models are also more interpretable. For example, a single layer Transformer on the IMDb byte level text classification has 3.1x faster inference latency on a CPU than its equally accurate deeper counterpart, and is half the size. We therefore put forward wider and shallower models as a viable and desirable alternative for small models on NLP tasks, and as an important area of research for domains beyond this.


title: DARTFormer: Finding The Best Type Of Attention

abstract: Given the wide and ever growing range of different efficient Transformer attention mechanisms, it is important to identify which attention is most effective when given a task. In this work, we are also interested in combining different attention types to build heterogeneous Transformers. We first propose a DARTS-like Neural Architecture Search (NAS) method to find the best attention for a given task, in this setup, all heads use the same attention (homogeneous models). Our results suggest that NAS is highly effective on this task, and it identifies the best attention mechanisms for IMDb byte level text classification and Listops. We then extend our framework to search for and build Transformers with multiple different attention types, and call them heterogeneous Transformers. We show that whilst these heterogeneous Transformers are better than the average homogeneous models, they cannot outperform the best. We explore the reasons why heterogeneous attention makes sense, and why it ultimately fails.


title: From 2G to 4G Mobile Network: Architecture and Key Performance Indicators

abstract: The second-generation (2G) mobile systems were developed in response to the growing demand for a system that met mobile communication demands while also providing greater interoperability with other systems. International organizations were crucial in the development of a system that would offer better services, be more transparent, and be more interoperable with other networks. The aim of having a single set of standards for networks worldwide was sadly not realized by the 2G network standards. The third generation (3G) was born. It was called the universal terrestrial mobile system (UMTS), which is European telecommunications standards institute (ETSI) driven. IMT-2000 is the international telecommunication union-telecommunication standardization sector (ITU-T) name for the 3G network. Wide-band code division multiple access (WCDMA) is the air interface technology for the UMTS. This platform offers many services that are based on the Internet, along with video calling, imaging, etc. Further advancements to mobile network technology led to long term evolution (LTE), a technology referred to as 4G. The primary goal of LTE was to improve the speed and capacity of mobile networks while lowering latency. As we move to an ALL-IP system, mobile networks' design becomes much simpler. LTE uses orthogonal frequency division multiplexing (OFDM) in its air interface. This paper details all mentioned mobile generations, as well as all the differences between them in terms of hardware and software architectures.


title: Spectral Augmentation for Self-Supervised Learning on Graphs

abstract: Graph contrastive learning (GCL), as an emerging self-supervised learning technique on graphs, aims to learn representations via instance discrimination. Its performance heavily relies on graph augmentation to reflect invariant patterns that are robust to small perturbations; yet it still remains unclear about what graph invariance GCL should capture. Recent studies mainly perform topology augmentations in a uniformly random manner in the spatial domain, ignoring its influence on the intrinsic structural properties embedded in the spectral domain. In this work, we aim to find a principled way for topology augmentations by exploring the invariance of graphs from the spectral perspective. We develop spectral augmentation which guides topology augmentations by maximizing the spectral change. Extensive experiments on both graph and node classification tasks demonstrate the effectiveness of our method in self-supervised representation learning. The proposed method also brings promising generalization capability in transfer learning, and is equipped with intriguing robustness property under adversarial attacks. Our study sheds light on a general principle for graph topology augmentation.


title: Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints

abstract: The framework of Integral Quadratic Constraints (IQCs) is used to present a performance analysis for gradient descent with varying step sizes. Two performance metrics are considered: convergence rate and noise amplification. We assume that the step size is produced from a line search and varies in a known interval. We model the algorithm as a linear, parameter-varying (LPV) system and construct a parameterized linear matrix inequality (LMI) condition that certifies algorithm performance. This condition is a generalization of prior results for gradient descent with constant step sizes. The parameterized LMI condition is solved using a gridding approach on the step size interval. Our results provide convergence rate guarantees when the step size lies within a restricted interval. Moreover, we recover existing rate bounds when this interval reduces to a single point, i.e. a constant step size. Finally, we note that the convergence rate depends only on the condition number of the problem. In contrast, the noise amplification performance depends on the individual values of the convexity and smoothness parameters, and varies inversely with them for a fixed condition number.


title: Economic-Driven Adaptive Traffic Signal Control

abstract: With the emerging connected-vehicle technologies and smart roads, the need for intelligent adaptive traffic signal controls is more than ever before. This paper proposes a novel Economic-driven Adaptive Traffic Signal Control (eATSC) model with a hyper control variable - interest rate defined in economics for traffic signal control at signalized intersections. The eATSC uses a continuous compounding function that captures both the total number of vehicles and the accumulated waiting time of each vehicle to compute penalties for different directions. The computed penalties grow with waiting time and is used for signal control decisions. Each intersection is assigned two intelligent agents adjusting interest rate and signal length for different directions according to the traffic patterns, respectively. The problem is formulated as a Markov Decision Process (MDP) problem to reduce congestions, and a two-agent Double Dueling Deep Q Network (DDDQN) is utilized to solve the problem. Under the optimal policy, the agents can select the optimal interest rates and signal time to minimize the likelihood of traffic congestion. To evaluate the superiority of our method, a VISSIM simulation model with classic four-leg signalized intersections is developed. The results indicate that the proposed model is adequately able to maintain healthy traffic flow at the intersection.


title: Pixel-global Self-supervised Learning with Uncertainty-aware Context Stabilizer

abstract: We developed a novel SSL approach to capture global consistency and pixel-level local consistencies between differently augmented views of the same images to accommodate downstream discriminative and dense predictive tasks. We adopted the teacher-student architecture used in previous contrastive SSL methods. In our method, the global consistency is enforced by aggregating the compressed representations of augmented views of the same image. The pixel-level consistency is enforced by pursuing similar representations for the same pixel in differently augmented views. Importantly, we introduced an uncertainty-aware context stabilizer to adaptively preserve the context gap created by the two views from different augmentations. Moreover, we used Monte Carlo dropout in the stabilizer to measure uncertainty and adaptively balance the discrepancy between the representations of the same pixels in different views.


title: IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

abstract: Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic decomposition into the NeRF-based neural rendering method and can extend its application to room-scale scenes. Since intrinsic decomposition is a fundamentally under-constrained inverse problem, we propose a novel distance-aware point sampling and adaptive reflectance iterative clustering optimization method, which enables IntrinsicNeRF with traditional intrinsic decomposition constraints to be trained in an unsupervised manner, resulting in multi-view consistent intrinsic decomposition results. To cope with the problem that different adjacent instances of similar reflectance in a scene are incorrectly clustered together, we further propose a hierarchical clustering method with coarse-to-fine optimization to obtain a fast hierarchical indexing representation. It supports compelling real-time augmented applications such as recoloring and illumination variation. Extensive experiments and editing samples on both object-specific/room-scale scenes and synthetic/real-word data demonstrate that we can obtain consistent intrinsic decomposition results and high-fidelity novel view synthesis even for challenging sequences.


title: Elliptic Modular Graphs, Eigenvalue Equations and Algebraic Identities

abstract: We obtain eigenvalue equations satisfied by various elliptic modular graphs with five links where two of the vertices are unintegrated. Solving them leads to several non--trivial algebraic identities between these graphs.


title: Automated Security Analysis of Exposure Notification Systems

abstract: We present the first formal analysis and comparison of the security of the two most widely deployed exposure notification systems, ROBERT and the Google and Apple Exposure Notification (GAEN) framework. ROBERT is the most popular instalment of the centralised approach to exposure notification, in which the risk score is computed by a central server. GAEN, in contrast, follows the decentralised approach, where the user's phone calculates the risk. The relative merits of centralised and decentralised systems have proven to be a controversial question. The majority of the previous analyses have focused on the privacy implications of these systems, ours is the first formal analysis to evaluate the security of the deployed systems -- the absence of false risk alerts. We model the French deployment of ROBERT and the most widely deployed GAEN variant, Germany's Corona-Warn-App. We isolate the precise conditions under which these systems prevent false alerts. We determine exactly how an adversary can subvert the system via network and Bluetooth sniffing, database leakage or the compromise of phones, back-end systems and health authorities. We also investigate the security of the original specification of the DP3T protocol, in order to identify gaps between the proposed scheme and its ultimate deployment. We find a total of 27 attack patterns, including many that distinguish the centralised from the decentralised approach, as well as attacks on the authorisation procedure that differentiate all three protocols. Our results suggest that ROBERT's centralised design is more vulnerable against both opportunistic and highly resourced attackers trying to perform mass-notification attacks.


title: Time-Reversible Thermodynamic Irreversibility : One-Dimensional Heat-Conducting Oscillators and Two-Dimensional Newtonian Shockwaves

abstract: We analyze the time-reversible mechanics of two irreversible simulation types. The first is a dissipative one-dimensional heat-conducting oscillator exposed to a temperature gradient in a three-dimensional phase space with coordinate $q$, momentum $p$, and thermostat control variable $\zeta$. The second type simulates a conservative two-dimensional $N$-body fluid with $4N$ phase variables $\{q,p\}$ undergoing shock compression. Despite the time-reversibility of each of the three oscillator equations and all of the $4N$ manybody motion equations both types of simulation are irreversible, obeying the Second Law of Thermodynamics. But for different reasons. The irreversible oscillator seeks out an attractive dissipative limit cycle. The likewise irreversible, but thoroughly conservative, Newtonian shockwave eventually generates a reversible near-equilibrium pair of rarefaction fans. Both problem types illustrate interesting features of Lyapunov instability.


title: Orbits and action changes during star-clump encounters responsible for the origin of exponential discs in dwarf galaxies

abstract: Previous studies found that stellar scattering by massive clumps can lead to the formation of exponential profiles in galaxy discs, but details on how a star is moved around have not been fully explained. We use a GADGET-2 simulation where an exponential profile forms from an initially Gaussian disc in about 4 Gyr for a low-mass galaxy like a dwarf irregular. We find that nearly all large angular momentum changes of stars are caused by star-clump encounters with the closest approach less than 0.5 kpc. During star-clump encounters, stars may increase their random motions, resulting in an increase in the average radial and vertical actions of the whole stellar population. The angular momentum change and the radial action change of an individual star are influenced by the direction from which the star approaches a clump. A star initially at a higher galactic radius relative to the scattering clump usually gets pulled inwards and loses its angular momentum during the encounter, and one at a lower radius tends to shift outwards and gains angular momentum. The increase in the radial action is the largest if a star encounters a clump from the azimuthal direction, and is the smallest from a radial approach. The angular momentum change due to encounters has an inward bias when the clump profile has a steep radial decline, and a shallow decline can make the bias outwards. The stellar profile evolution towards an exponential seems to occur regardless of the direction of the bias.


title: The cost of nonconvexity in deterministic nonsmooth optimization

abstract: We study the impact of nonconvexity on the complexity of nonsmooth optimization, emphasizing objectives such as piecewise linear functions, which may not be weakly convex. We focus on a dimension-independent analysis, slightly modifying a black-box algorithm of Zhang et al. (2020) that approximates an $\epsilon$-stationary point of any directionally differentiable Lipschitz objective using $O(\epsilon^{-4})$ calls to a specialized subgradient oracle and a randomized line search. Our simple black-box deterministic version, achieves $O(\epsilon^{-5})$ for any difference-of-convex objective, and $O(\epsilon^{-4})$ for the weakly convex case. Our complexity bound depends on a natural nonconvexity modulus, related, intriguingly, to the negative part of directional second derivatives of the objective, understood in the distributional sense.


title: Greedy capped nonlinear Kaczmarz methods

abstract: To solve nonlinear problems, we construct two kinds of greedy capped nonlinear Kaczmarz methods by setting a capped threshold and introducing an effective probability criterion for selecting a row of the Jacobian matrix. The capped threshold and probability criterion are mainly determined by the maximum residual and maximum distance rules. The block versions of the new methods are also presented. We provide the convergence analysis of these methods and their numerical results behave quite well.


title: Relational Models for the Lambek Calculus with Intersection and Constants

abstract: We consider relational semantics (R-models) for the Lambek calculus extended with intersection and explicit constants for zero and unit. For its variant without constants and a restriction which disallows empty antecedents, Andreka and Mikulas (1994) prove strong completeness. We show that it fails without this restriction, but, on the other hand, prove weak completeness for non-standard interpretation of constants. For the standard interpretation, even weak completeness fails. The weak completeness result extends to an infinitary setting, for so-called iterative divisions (Kleene star under division). We also prove strong completeness results for product-free fragments.


title: Online Pen Testing

abstract: We study a "pen testing" problem, in which we are given $n$ pens with unknown amounts of ink $X_1, X_2, \ldots, X_n$, and we want to choose a pen with the maximum amount of remaining ink in it. The challenge is that we cannot access each $X_i$ directly; we only get to write with the $i$-th pen until either a certain amount of ink is used, or the pen runs out of ink. In both cases, this testing reduces the remaining ink in the pen and thus the utility of selecting it. Despite this significant lack of information, we show that it is possible to approximately maximize our utility up to an $O(\log n)$ factor. Formally, we consider two different setups: the "prophet" setting, in which each $X_i$ is independently drawn from some distribution $\mathcal{D}_i$, and the "secretary" setting, in which $(X_i)_{i=1}^n$ is a random permutation of arbitrary $a_1, a_2, \ldots, a_n$. We derive the optimal competitive ratios in both settings up to constant factors. Our algorithms are surprisingly robust: (1) In the prophet setting, we only require one sample from each $\mathcal{D}_i$, rather than a full description of the distribution; (2) In the secretary setting, the algorithm also succeeds under an arbitrary permutation, if an estimate of the maximum $a_i$ is given. Our techniques include a non-trivial online sampling scheme from a sequence with an unknown length, as well as the construction of a hard, non-uniform distribution over permutations. Both might be of independent interest. We also highlight some immediate open problems and discuss several directions for future research.


title: Perfect partitions of a random set of integers

abstract: Let $X_1,\dots, X_n$ be independent integers distributed uniformly on $\{1,\dots, M\}$, $M=M(n)\to\infty$ however slow. A partition $S$ of $[n]$ into $\nu$ non-empty subsets $S_1,\dots, S_{\nu}$ is called perfect, if all $\nu$ values $\sum_{j\in S_{\a}}X_j$ are equal. For a perfect partition to exist, $\sum_j X_j$ has to be divisible by $\nu$. For $\nu=2$, Borgs et al. proved, among other results, that, conditioned on $\sum_j X_j$ being even, with high probability a perfect partition exists if $\kappa:=\lim \tfrac{n}{\log M}>\tfrac{1}{\log 2}$, and that w.h.p. no perfect partition exists if $\kappa<\tfrac{1}{\log 2}$. We prove that w.h.p. no perfect partition exists if $\nu\ge 3$ and $\kappa<\tfrac{2}{\log \nu}$. We identify the range of $\kappa$ in which the expected number of perfect partitions is exponentially high. We show that for $\kappa> \tfrac{2(\nu-1)}{\log[(1-2\nu^{-2})^{-1}]}$ the total number of perfect partitions is exponentially high with probability $\gtrsim (1+\nu^2)^{-1}$.


title: Q2Graph: a modelling tool for measurement-based quantum computing

abstract: The quantum circuit model is the default for encoding an algorithm intended for a NISQ computer or a quantum computing simulator. A simple graph and through it, a graph state - quantum state physically manifesting an abstract graph structure - is syntactically expressive and tractable. A graph representation is well-suited for algorithms intended for a quantum computing facility founded on measurement-based quantum computing (MBQC) principles. Indeed, the process of creating an algorithm-specific graph can be efficiently realised through classical computing hardware. A graph state is a stabiliser state, which means a graph is a (quantum) intermediate representation at all points of the algorithm-specific graph process. We submit Q2Graph, a software package for designing and testing of simple graphs as algorithms for quantum computing facilities based on MQBC design principles. Q2Graph is a suitable modelling tool for NISQ computing facilities: the user is free to reason about structure or characteristics of its graph-as-algorithm without also having to account for (quantum) errors and their impact upon state.


title: Far-from-equilibrium attractors for massive kinetic theory in the relaxation time approximation

abstract: We investigate whether early and late time attractors for non-conformal kinetic theories exist by computing the time-evolution of a large set of moments of the one-particle distribution function. For this purpose we make use of a previously obtained exact solution of the 0+1D boost-invariant massive Boltzmann equation in relaxation time approximation. We extend prior attractor studies of non-conformal systems by using a realistic mass- and temperature-dependent relaxation time and explicitly computing the effect of varying both the initial momentum-space anisotropy and initialization time on the time evolution of a large set of integral moments. Our findings are consistent with prior studies, which found that there is an attractor for the scaled longitudinal pressure, but not for the shear and bulk viscous corrections separately. We further present evidence that both late- and early-time attractors exist for all moments of the one-particle distribution function that contain greater than one power of the longitudinal momentum squared.


title: Periodic points of algebraic functions related to a continued fraction of Ramanujan

abstract: A continued fraction $v(\tau)$ of Ramanujan is evaluated at certain arguments in the field $K = \mathbb{Q}(\sqrt{-d})$, with $-d \equiv 1$ (mod $8$), in which the ideal $(2) = \wp_2 \wp_2'$ is a product of two prime ideals. These values of $v(\tau)$ are shown to generate the inertia field of $\wp_2$ or $\wp_2'$ in an extended ring class field over the field $K$. The conjugates over $\mathbb{Q}$ of these same values, together with $0, -1 \pm \sqrt{2}$, are shown to form the exact set of periodic points of a fixed algebraic function $\hat F(x)$, independent of $d$. These are analogues of similar results for the Rogers-Ramanujan continued fraction.


title: A Non-monotonic Self-terminating Language Model

abstract: Recent large-scale neural autoregressive sequence models have shown impressive performances on a variety of natural language generation tasks. However, their generated sequences often exhibit degenerate properties such as non-termination, undesirable repetition, and premature termination, when generated with decoding algorithms such as greedy search, beam search, top-$k$ sampling, and nucleus sampling. In this paper, we focus on the problem of non-terminating sequences resulting from an incomplete decoding algorithm. We first define an incomplete probable decoding algorithm which includes greedy search, top-$k$ sampling, and nucleus sampling, beyond the incomplete decoding algorithm originally put forward by Welleck et al. (2020). We then propose a non-monotonic self-terminating language model, which significantly relaxes the constraint of monotonically increasing termination probability in the originally proposed self-terminating language model by Welleck et al. (2020), to address the issue of non-terminating sequences when using incomplete probable decoding algorithms. We prove that our proposed model prevents non-terminating sequences when using not only incomplete probable decoding algorithms but also beam search. We empirically validate our model on sequence completion tasks with various architectures.


title: Braids, entropies and fibered 2-fold branched covers of 3-manifolds

abstract: It is proved by Sakuma and Brooks that any closed orientable $3$-manifold with a Heegaard splitting of genus $g$ admits a $2$-fold branched cover that is a hyperbolic $3$-manifold and a genus $g$ surface bundle over the circle. This paper concerns entropy of pseudo-Anosov monodromies for hyperbolic fibered $3$-manifolds. We prove that there exist infinitely many closed orientable $3$-manifolds $M$ such that the minimal entropy over all hyperbolic, genus $g$ surface bundles over the circle as $2$-fold branched covers of the $3$-manifold $M$ is comparable to $1/g$.


title: Under the Cover Infant Pose Estimation using Multimodal Data

abstract: Infant pose monitoring during sleep has multiple applications in both healthcare and home settings. In a healthcare setting, pose detection can be used for region of interest detection and movement detection for noncontact based monitoring systems. In a home setting, pose detection can be used to detect sleep positions which has shown to have a strong influence on multiple health factors. However, pose monitoring during sleep is challenging due to heavy occlusions from blanket coverings and low lighting. To address this, we present a novel dataset, Simultaneously-collected multimodal Mannequin Lying pose (SMaL) dataset, for under the cover infant pose estimation. We collect depth and pressure imagery of an infant mannequin in different poses under various cover conditions. We successfully infer full body pose under the cover by training state-of-art pose estimation methods and leveraging existing multimodal adult pose datasets for transfer learning. We demonstrate a hierarchical pretraining strategy for transformer-based models to significantly improve performance on our dataset. Our best performing model was able to detect joints under the cover within 25mm 86% of the time with an overall mean error of 16.9mm. Data, code and models publicly available at https://github.com/DanielKyr/SMaL


title: Topological adiabatic dynamics in classical mass-spring chains with clamps

abstract: The path dependence of adiabatic evolution in classical harmonic chains with clamps is examined. It is shown that cutting and joining a chain may braid adiabatic normal mode frequencies. Accordingly, different adiabatic paths with the same endpoints may transport a normal mode to a different one, and an adiabatic cycle pumps action variables, i.e., the adiabatic invariants of integrable classical systems. Another adiabatic pump for artificial edge modes induced by clamps is shown as an application. Extensions to completely integrable systems and quantum systems are outlined.


title: FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environment

abstract: Painting is an artistic process of rendering visual content that achieves the high-level communication goals of an artist that may change dynamically throughout the creative process. In this paper, we present a Framework and Robotics Initiative for Developing Arts (FRIDA) that enables humans to produce paintings on canvases by collaborating with a painter robot using simple inputs such as language descriptions or images. FRIDA introduces several technical innovations for computationally modeling a creative painting process. First, we develop a fully differentiable simulation environment for painting, adopting the idea of real to simulation to real (real2sim2real). We show that our proposed simulated painting environment is higher fidelity to reality than existing simulation environments used for robot painting. Second, to model the evolving dynamics of a creative process, we develop a planning approach that can continuously optimize the painting plan based on the evolving canvas with respect to the high-level goals. In contrast to existing approaches where the content generation process and action planning are performed independently and sequentially, FRIDA adapts to the stochastic nature of using paint and a brush by continually re-planning and re-assessing its semantic goals based on its visual perception of the painting progress. We describe the details on the technical approach as well as the system integration.


title: Distributed Non-Convex Optimization with One-Bit Compressors on Heterogeneous Data: Efficient and Resilient Algorithms

abstract: Federated Learning (FL) is a nascent decentralized learning framework under which a massive collection of heterogeneous clients collaboratively train a model without revealing their local data. Scarce communication, privacy leakage, and Byzantine attacks are the key bottlenecks of system scalability. In this paper, we focus on communication-efficient distributed (stochastic) gradient descent for non-convex optimization, a driving force of FL. We propose two algorithms, named {\em Adaptive Stochastic Sign SGD (Ada-StoSign)} and {\em $\beta$-Stochastic Sign SGD ($\beta$-StoSign)}, each of which compresses the local gradients into bit vectors. To handle unbounded gradients, Ada-StoSign uses a novel norm tracking function that adaptively adjusts a coarse estimation on the $\ell_{\infty}$ of the local gradients - a key parameter used in gradient compression. We show that Ada-StoSign converges in expectation with a rate $O(\log T/\sqrt{T} + 1/\sqrt{M})$, where $M$ is the number of clients. To the best of our knowledge, when $M$ is sufficiently large, Ada-StoSign outperforms the state-of-the-art sign-based method whose convergence rate is $O(T^{-1/4})$. Under bounded gradient assumption, $\beta$-StoSign achieves quantifiable Byzantine resilience and privacy assurances, and works with partial client participation and mini-batch gradients which could be unbounded. We corroborate and complement our theories by experiments on MNIST and CIFAR-10 datasets.


title: On the extremal graphs in generalized Tur\'an problems

abstract: Given two graphs $H$ and $F$, the generalized Tur\'an number $\mathrm{ex}(n,H,F)$ is the largest number of copies of $H$ in an $n$-vertex $F$-free graph. For every $F$ and sufficiently large $n$, we present an extremal graph for a generalized Tur\'an problem, i.e., an $F$-free $n$ vertex graph $G$ that for some $H$ contains exactly $\mathrm{ex}(n,H,F)$ copies of $H$.


title: Probing of Quantitative Values in Abstractive Summarization Models

abstract: Abstractive text summarization has recently become a popular approach, but data hallucination remains a serious problem, including with quantitative data. We propose a set of probing tests to evaluate the efficacy of abstract summarization models' modeling of quantitative values found in the input text. Our results show that in most cases, the encoders of recent SOTA-performing models struggle to provide embeddings that adequately represent quantitative values in the input compared to baselines, and in particular, they outperform random representations in some, but surprisingly not all, cases. Under our assumptions, this suggests that the encoder's performance contributes to the quantity hallucination problem. One model type in particular, DistilBART-CDM, was observed to underperform randomly initialized representations for several experiments, and performance versus BERT suggests that standard pretraining and fine-tuning approaches for the summarization task may play a role in underperformance for some encoders.


title: Multiple Scale Asymptotics of Map Enumeration

abstract: We introduce a systematic approach to express generating functions for the enumeration of maps on surfaces of high genus in terms of a single generating function relevant to planar surfaces. Central to this work is the comparison of two asymptotic expansions obtained from two different fields of mathematics: the Riemann-Hilbert analysis of orthogonal polynomials and the theory of discrete dynamical systems. By equating the coefficients of these expansions in a common region of uniform validity in their parameters, we recover known results and provide new expressions for generating functions associated with graphical enumeration on surfaces of genera 0 through 7. Although the body of the article focuses on 4-valent maps, the methodology presented here extends to regular maps of arbitrary even valence and to some cases of odd valence, as detailed in the appendices.


title: Sum and Difference Sets in Generalized Dihedral Groups

abstract: Given a group $G$, we say that a set $A \subseteq G$ has more sums than differences (MSTD) if $|A+A| > |A-A|$, has more differences than sums (MDTS) if $|A+A| < |A-A|$, or is sum-difference balanced if $|A+A| = |A-A|$. A problem of recent interest has been to understand the frequencies of these type of subsets. The seventh author and Vissuet studied the problem for arbitrary finite groups $G$ and proved that almost all subsets $A\subseteq G$ are sum-difference balanced as $|G|\to\infty$. For the dihedral group $D_{2n}$, they conjectured that of the remaining sets, most are MSTD, i.e., there are more MSTD sets than MDTS sets. Some progress on this conjecture was made by Haviland et al. in 2020, when they introduced the idea of partitioning the subsets by size: if, for each $m$, there are more MSTD subsets of $D_{2n}$ of size $m$ than MDTS subsets of size $m$, then the conjecture follows. We extend the conjecture to generalized dihedral groups $D=\mathbb{Z}_2\ltimes G$, where $G$ is an abelian group of size $n$ and the nonidentity element of $\mathbb{Z}_2$ acts by inversion. We make further progress on the conjecture by considering subsets with a fixed number of rotations and reflections. By bounding the expected number of overlapping sums, we show that the collection $\mathcal S_{D,m}$ of subsets of the generalized dihedral group $D$ of size $m$ has more MSTD sets than MDTS sets when $6\le m\le c_j\sqrt{n}$ for $c_j=1.3229/\sqrt{111+5j}$, where $j$ is the number of elements in $G$ with order at most $2$. We also analyze the expectation for $|A+A|$ and $|A-A|$ for $A\subseteq D_{2n}$, proving an explicit formula for $|A-A|$ when $n$ is prime.


title: Polynomial progressions in topological fields

abstract: Let $P_1, \ldots, P_m \in K[y]$ be polynomials with distinct degrees, no constant terms and coefficients in a general locally compact topological field $K$. We give a quantitative count of the number of polynomial progressions $x, x+P_1(y), \ldots, x + P_m(y)$ lying in a set $S\subseteq K$ of positive density. The proof relies on a general $L^{\infty}$ inverse theorem which is of independent interest. This inverse theorem implies a Sobolev improving estimate for multilinear polynomial averaging operators which in turn implies our quantitative estimate for polynomial progressions. This general Sobolev inequality has the potential to be applied in a number of problems in real, complex and $p$-adic analysis.


title: Non-recursive Counts of Graphs on Surfaces

abstract: The problem of map enumeration concerns counting connected spatial graphs, with a specified number $j$ of vertices, that can be embedded in a compact surface of genus $g$ in such a way that its complement yields a cellular decomposition of the surface. As such this problem lies at the cross-roads of combinatorial studies in low dimensional topology and graph theory. The determination of explicit formulae for map counts, in terms of closed classical combinatorial functions of $g$ and $j$ as opposed to a recursive prescription, has been a long-standing problem with explicit results known only for very low values of $g$. In this paper we derive closed-form expressions for counts of maps with an arbitrary number of even-valent vertices, embedded in surfaces of arbitrary genus. In particular, we exhibit a number of higher genus examples for 4-valent maps that have not appeared prior in the literature.


title: Evolution is Still Good: Theoretical Analysis of Evolutionary Algorithms on General Cover Problems

abstract: Theoretical studies on evolutionary algorithms have developed vigorously in recent years. Many such algorithms have theoretical guarantees in both running time and approximation ratio. Some approximation mechanism seems to be inherently embedded in many evolutionary algorithms. In this paper, we identify such a relation by proposing a unified analysis framework for a generalized simple multi-objective evolutionary algorithm (GSEMO), and apply it on a minimum weight general cover problem. For a wide range of problems (including the the minimum submodular cover problem in which the submodular function is real-valued, and the minimum connected dominating set problem for which the potential function is non-submodular), GSEMO yields asymptotically tight approximation ratios in expected polynomial time.


title: Deep Learning for Wireless Networked Systems: a joint Estimation-Control-Scheduling Approach

abstract: Wireless networked control system (WNCS) connecting sensors, controllers, and actuators via wireless communications is a key enabling technology for highly scalable and low-cost deployment of control systems in the Industry 4.0 era. Despite the tight interaction of control and communications in WNCSs, most existing works adopt separative design approaches. This is mainly because the co-design of control-communication policies requires large and hybrid state and action spaces, making the optimal problem mathematically intractable and difficult to be solved effectively by classic algorithms. In this paper, we systematically investigate deep learning (DL)-based estimator-control-scheduler co-design for a model-unknown nonlinear WNCS over wireless fading channels. In particular, we propose a co-design framework with the awareness of the sensor's age-of-information (AoI) states and dynamic channel states. We propose a novel deep reinforcement learning (DRL)-based algorithm for controller and scheduler optimization utilizing both model-free and model-based data. An AoI-based importance sampling algorithm that takes into account the data accuracy is proposed for enhancing learning efficiency. We also develop novel schemes for enhancing the stability of joint training. Extensive experiments demonstrate that the proposed joint training algorithm can effectively solve the estimation-control-scheduling co-design problem in various scenarios and provide significant performance gain compared to separative design and some benchmark policies.

categories: eess.SY cs.AI cs.IT cs.LG cs.SY eess.SP math.IT


title: Multi-view information fusion using multi-view variational autoencoders to predict proximal femoral strength

abstract: The aim of this paper is to design a deep learning-based model to predict proximal femoral strength using multi-view information fusion. Method: We developed new models using multi-view variational autoencoder (MVAE) for feature representation learning and a product of expert (PoE) model for multi-view information fusion. We applied the proposed models to an in-house Louisiana Osteoporosis Study (LOS) cohort with 931 male subjects, including 345 African Americans and 586 Caucasians. With an analytical solution of the product of Gaussian distribution, we adopted variational inference to train the designed MVAE-PoE model to perform common latent feature extraction. We performed genome-wide association studies (GWAS) to select 256 genetic variants with the lowest p-values for each proximal femoral strength and integrated whole genome sequence (WGS) features and DXA-derived imaging features to predict proximal femoral strength. Results: The best prediction model for fall fracture load was acquired by integrating WGS features and DXA-derived imaging features. The designed models achieved the mean absolute percentage error of 18.04%, 6.84% and 7.95% for predicting proximal femoral fracture loads using linear models of fall loading, nonlinear models of fall loading, and nonlinear models of stance loading, respectively. Compared to existing multi-view information fusion methods, the proposed MVAE-PoE achieved the best performance. Conclusion: The proposed models are capable of predicting proximal femoral strength using WGS features and DXA-derived imaging features. Though this tool is not a substitute for FEA using QCT images, it would make improved assessment of hip fracture risk more widely available while avoiding the increased radiation dosage and clinical costs from QCT.


title: A pinned Mattila-Sj\"{o}lin type theorem for product sets

abstract: We generalize a result of McDonald and Taylor which concerns the size of the tuples of edge lengths in the set $C_1 \times C_2$ utilizing the notion of thickness. Specifically, we show that $C_1, C_2 \subset \mathbb{R}^d$ compact sets with thickness satisfying $\tau(C_1) \tau(C_2) >1$, then the edge lengths in $C_1 \times C_2$ corresponding to any pinned finite tree configuration has non-empty interior. Originally proven for Cantor sets on the real line by McDonald and Taylor, we use the notion of thickness introduced by Falconer and Yavicoli which allows us to generalize the result of McDonald and Taylor to compact sets in $\mathbb{R}^d$.


title: Some pointwise and decidable properties of non-uniform cellular automata

abstract: For non-uniform cellular automata (NUCA) with finite memory over an arbitrary universe with multiple local transition rules, we show that pointwise nilpotency, pointwise periodicity, and pointwise eventual periodicity properties are respectively equivalent to nilpotency, periodicity, and eventual periodicity. Moreover, we prove that every linear NUCA which satisfies pointwise a polynomial equation (which may depend on the configuration) must be an eventually periodic linear NUCA. Generalizing results for higher dimensional group and linear CA, we also establish the decidability results of the above dynamical properties as well as the injectivity for arbitrary NUCA with finite memory which are local perturbations of higher dimensional linear and group CA. Some generalizations to the case of sparse global perturbations of higher dimensional linear and group CA are also obtained.


title: Nonlinear asymptotic stability of inhomogeneous steady solutions to boundary problems of Vlasov-Poisson equation

abstract: We consider an ensemble of mass collisionless particles, which interact mutually either by an attraction of Newton's law of gravitation or by an electrostatic repulsion of Coulomb's law, under a background downward gravity in a horizontally-periodic 3D half-space, whose inflow distribution at the boundary is prescribed. We investigate a nonlinear asymptotic stability of its generic steady states in the dynamical kinetic PDE theory of the Vlasov-Poisson equations. We construct Lipschitz continuous space-inhomogeneous steady states and establish exponentially fast asymptotic stability of these steady states with respect to small perturbation in a weighted Sobolev topology. In this proof, we crucially use the Lipschitz continuity in the velocity of the steady states. Moreover, we establish well-posedness and regularity estimates for both steady and dynamic problems.


title: Inference from gated first-passage times

abstract: First-passage times provide invaluable insight into fundamental properties of stochastic processes. Yet, various forms of gating mask first-passage times and differentiate them from actual detection times. For instance, imperfect conditions may intermittently gate our ability to observe a system of interest, such that exact first-passage instances might be missed. In other cases, e.g., certain chemical reactions, direct observation of the molecules involved is virtually impossible, but the reaction event itself can be detected. However, this instance need not coincide with the first collision time since some molecular encounters are infertile and hence gated. Motivated by the challenge posed by such real-life situations we develop a universal -- model-free -- framework for the inference of first-passage times from the detection times of gated first-passage processes. In addition, when the underlying laws of motions are known, our framework also provides a way to infer physically meaningful parameters, e.g. diffusion coefficients. Finally, we show how to infer the gating rates themselves via the hitherto overlooked short-time regime of the measured detection times. The robustness of our approach and its insensitivity to underlying details are illustrated in several settings of physical relevance.

categories: cond-mat.stat-mech math.PR physics.bio-ph physics.chem-ph physics.data-an


title: High Probability Convergence for Accelerated Stochastic Mirror Descent

abstract: In this work, we describe a generic approach to show convergence with high probability for stochastic convex optimization. In previous works, either the convergence is only in expectation or the bound depends on the diameter of the domain. Instead, we show high probability convergence with bounds depending on the initial distance to the optimal solution as opposed to the domain diameter. The algorithms use step sizes analogous to the standard settings and are universal to Lipschitz functions, smooth functions, and their linear combinations.


title: On the Brezis-Nirenberg problem for the $(p,q)$-Laplacian

abstract: We prove some existence and nonexistence results for a class of critical $(p,q)$-Laplacian problems in a bounded domain. Our results extend and complement those in the literature for model cases.


title: On discriminants of minimal polynomials of the Ramanujan $t_n$ class invariants

abstract: We study the discriminants of the minimal polynomials $\mathcal{P}_n$ of the Ramanujan $t_n$ class invariants, which are defined for positive integers $n\equiv11\pmod{24}$. The historical precedent for doing so comes from Gross and Zagier, which is known for computing the prime factorizations of certain resultants and discriminants of the Hilbert class polynomials $H_n$. We show that $\Delta\left(\mathcal{P}_n\right)$ divides $\Delta\left(H_n\right)$ with quotient a perfect square, and as a consequence, we explicitly determine the sign of $\Delta\left(\mathcal{P}_n\right)$ based on the class group structure of the order of discriminant $-n$. We also show that the discriminant of the number field generated by $j\left(\frac{-1+\sqrt{-n}}{2}\right)$, where $j$ is the $j$-invariant, divides $\Delta\left(\mathcal{P}_n\right)$. Moreover, we show that 3 never divides $\Delta\left(\mathcal{P}_n\right)$ for all squarefree positive integers $n\equiv11\pmod{24}$.


title: A K-theory spectrum for cobordism cut and paste groups

abstract: Cobordism groups and cut-and-paste groups of manifolds arise from imposing two different relations on the monoid of manifolds under disjoint union. By imposing both relations simultaneously, a cobordism cut and paste group $\overline{\mathrm{SK}}_n$ is defined. In this paper, we extend this definition to manifolds with boundary obtaining $\overline{\mathrm{SK}}^{\partial}_n$ and study the relationship of this group to an appropriately defined cobordism group of manifolds with boundary. The main results are the construction of a spectrum that recovers on $\pi_0$ the cobordism cut and paste groups of manifolds with boundary, $\overline{\mathrm{SK}}^{\partial}_n$, and a map of spectra that lifts the canonical quotient map $\mathrm{SK}^{\partial}_n \rightarrow \overline{\mathrm{SK}}^{\partial}_n$.


title: A new prospect for jet origin and spectral state transitions with three hybrid accretion flows around black holes

abstract: There is a very popular two-zone accretion disk model that the inner part of the non-advective Keplerian disk (Shakura-Sunyaev disk) can produce hot advection-dominated accretion flow, which can generate high energy power-law radiation and outflows/jets. However, we find that this simple model is inadequate to automatically explain many properties of the sources (such as hysteresis effect, counter-clockwise traversal in a hardness-intensity diagram, peculiar variabilities, and association/non-association of jets in a black hole $X-$ray binary) without considering additional assumptions. We also find some theoretical issues in this model, such as understanding of variation of transition region and formation of an outer disk, which has only Keplerian distribution. Based on the recent theoretical studies on advective disk structures, as well as, many observational behaviors of the accreting black holes, we conclude that there should be a third component (TC) of accretion flow parallel to the two-zone disk model, which can naturally explain all above mentioned issues. Interestingly, this modified model also provides a new scenario for the jet generation and evolution with the TC flow during high energy states, which can make the jet close to the axis. We also find out an expression of jet kinetic power.


title: The Relation between the Optical \feii Emission and the Dimensionless Accretion Rate for Active Galactic Nuclei

abstract: It was suggested that the prominent feature of the optical Fe II emission has a connection with the accretion process in active galactic nuclei (AGN). For a large sample of 4037 quasars ($z < 0.8$) with measured $\rm H\beta$ line dispersion ($\sigma_{\rm H\beta}$) selected from the Sloan Digital Sky Survey (SDSS) and 120 compiled reverberation-mapped (RM) AGN, we use $\sigma_{\rm H\beta}$ and the extended $R_{\rm BLR}-L_{\rm 5100}$ relation to calculate supermassive black holes masses ($M_{\rm BH}$) from the single-epoch spectra for the SDSS subsample, and $\sigma_{\rm H\beta}$ from the mean spectra for the RM subsample. We find a strong correlation between the relative optical Fe II strength $R_{\rm Fe}$ and $\dot{\mathscr{M}}$ for the SDSS subsample with the Spearman correlation coefficient $r_s$ of $0.727$, which is consistent with that derived from the mean spectra for the RM subsample. The magnitude of velocity shift of the optical Fe II emission has a strong anticorrelation with $\dot{\mathscr{M}}$, whenever there is inflow or outflow. These strong correlations show that the optical Fe II emission has an intimate connection with the accretion process. Assuming that the difference of $M_{\rm BH}$ is due to the variable virial factor $f$ for adopting $ \rm FWHM_{H\beta}$ as the velocity tracer, we find that there is a relation between $f$ and $\rm FWHM_{H\beta}$, $\log f=-(0.41\pm 0.002) \rm \log FWHM_{\rm H\beta}+(1.719\pm 0.009)$ for the single-epoch spectrum. The relation between $\log f$ and $\sigma_{\rm H\beta}$ is not too strong, suggesting that $\sigma_{\rm H\beta}$ does not seem to depend much on the broad-line region inclination and a constant $\sigma$-based $f$ is suitable for $\sigma_{\rm H\beta}$ as the velocity tracer.


title: Two new classes of exponential Runge-Kutta integrators for efficiently solving stiff systems or highly oscillatory problems

abstract: We note a fact that stiff systems or differential equations that have highly oscillatory solutions cannot be solved efficiently using conventional methods. In this paper, we study two new classes of exponential Runge-Kutta (ERK) integrators for efficiently solving stiff systems or highly oscillatory problems. We first present a novel class of explicit modified version of exponential Runge-Kutta (MVERK) methods based on the order conditions. Furthermore, we consider a class of explicit simplified version of exponential Runge-Kutta (SVERK) methods. Numerical results demonstrate the high efficiency of the explicit MVERK integrators and SVERK methods derived in this paper compared with the well-known explicit ERK integrators for stiff systems or highly oscillatory problems in the literature.


title: 3D Photon Conserving Code for Time-dependent General Relativistic Radiative Transfer : CARTOON

abstract: We develop the 3-dimensional general relativistic radiative transfer code: CARTOON (Calculation code of Authentic Radiative Transfer based On phOton Number conservation in curved space-time) which is improved from the 2-dimensional code: ARTIST developed by Takahashi & Umemura (2017). In CARTOON, the frequency-integrated general relativistic radiative transfer equation is solved in a photon number-conserving manner, and the isotropic and coherent scattering in the zero angular momentum observers (ZAMO) frame and the fluid rest frame is incorporated. By calculating the average energy of photons, energy conservation of the radiation is also guaranteed. With the test calculations in 2-dimensional and 3-dimensional space, we have demonstrated that the wavefront propagation in black hole space-time can be correctly solved in CARTOON conserving photon numbers. The position of the wavefront coincides with the analytical solution and the number of photons remains constant until the wavefront reaches the event horizon. We also solve the radiative transfer equation on the geodesic reaching the observer's screen. The time variation of the intensity map on the observer's screen can be simultaneously and consistently calculated with the time variation of the radiation field around the black hole. In addition, the black hole shadow can be reproduced in moderately optically thin situations.


title: Boundedness of measured Gromov-Hausdorff precompact sets of metric measure spaces in pyramids

abstract: We prove that any measured Gromov-Hausdorff precompact set of metric measure spaces which is contained in a certain set, called a pyramid, is bounded by some metric measure space with respect to the Lipschitz order inside the pyramid. This is proved as a step towards a possible extension of the statement of Gromov, for which we gave a detailed proof in our previous work. Several related results are also obtained.


title: On the infinite-depth limit of finite-width neural networks

abstract: In this paper, we study the infinite-depth limit of finite-width residual neural networks with random Gaussian weights. With proper scaling, we show that by fixing the width and taking the depth to infinity, the pre-activations converge in distribution to a zero-drift diffusion process. Unlike the infinite-width limit where the pre-activation converge weakly to a Gaussian random variable, we show that the infinite-depth limit yields different distributions depending on the choice of the activation function. We document two cases where these distributions have closed-form (different) expressions. We further show an intriguing change of regime phenomenon of the post-activation norms when the width increases from 3 to 4. Lastly, we study the sequential limit infinite-depth-then-infinite-width and compare it with the more commonly studied infinite-width-then-infinite-depth limit.


title: Multipod Convolutional Network

abstract: In this paper, we introduce a convolutional network which we call MultiPodNet consisting of a combination of two or more convolutional networks which process the input image in parallel to achieve the same goal. Output feature maps of parallel convolutional networks are fused at the fully connected layer of the network. We experimentally observed that three parallel pod networks (TripodNet) produce the best results in commonly used object recognition datasets. Baseline pod networks can be of any type. In this paper, we use ResNets as baseline networks and their inputs are augmented image patches. The number of parameters of the TripodNet is about three times that of a single ResNet. We train the TripodNet using the standard backpropagation type algorithms. In each individual ResNet, parameters are initialized with different random numbers during training. The TripodNet achieved state-of-the-art performance on CIFAR-10 and ImageNet datasets. For example, it improved the accuracy of a single ResNet from 91.66% to 92.47% under the same training process on the CIFAR-10 dataset.


title: Taming Fat-Tailed ("Heavier-Tailed'' with Potentially Infinite Variance) Noise in Federated Learning

abstract: A key assumption in most existing works on FL algorithms' convergence analysis is that the noise in stochastic first-order information has a finite variance. Although this assumption covers all light-tailed (i.e., sub-exponential) and some heavy-tailed noise distributions (e.g., log-normal, Weibull, and some Pareto distributions), it fails for many fat-tailed noise distributions (i.e., ``heavier-tailed'' with potentially infinite variance) that have been empirically observed in the FL literature. To date, it remains unclear whether one can design convergent algorithms for FL systems that experience fat-tailed noise. This motivates us to fill this gap in this paper by proposing an algorithmic framework called FAT-Clipping (\ul{f}ederated \ul{a}veraging with \ul{t}wo-sided learning rates and \ul{clipping}), which contains two variants: FAT-Clipping per-round (FAT-Clipping-PR) and FAT-Clipping per-iteration (FAT-Clipping-PI). Specifically, for the largest $\alpha \in (1,2]$ such that the fat-tailed noise in FL still has a bounded $\alpha$-moment, we show that both variants achieve $\mathcal{O}((mT)^{\frac{2-\alpha}{\alpha}})$ and $\mathcal{O}((mT)^{\frac{1-\alpha}{3\alpha-2}})$ convergence rates in the strongly-convex and general non-convex settings, respectively, where $m$ and $T$ are the numbers of clients and communication rounds. Moreover, at the expense of more clipping operations compared to FAT-Clipping-PR, FAT-Clipping-PI further enjoys a linear speedup effect with respect to the number of local updates at each client and being lower-bound-matching (i.e., order-optimal). Collectively, our results advance the understanding of designing efficient algorithms for FL systems that exhibit fat-tailed first-order oracle information.


title: Electromagnetic response in an expanding quark-gluon plasma

abstract: The validity of conventional Ohm's law is tested in the context of a rapidly evolving quark-gluon plasma produced in heavy-ion collisions. Here we discuss the electromagnetic response using an analytical solution in kinetic theory. As conjectured previously, after switching on an electric field in a nonexpanding plasma, the time-dependent current is given by $\mathbf{J}(t)=(1-e^{-t/\tau_0}) \sigma_{0} \mathbf{E}$, where $\tau_0$ is the transport relaxation time and $\sigma_{0}$ is the steady-state electrical conductivity. Such an incomplete electromagnetic response reduces the efficiency of the magnetic flux trapping in the quark-gluon plasma and may prevent the observation of the chiral magnetic effect. Here we extend the study to the case of a rapidly expanding plasma. We find that the decreasing temperature and the increasing transport relaxation time have opposite effects on the electromagnetic response. While the former suppresses the time-dependent conductivity, the latter enhances it.


title: Interpreting convolutional neural networks' low dimensional approximation to quantum spin systems

abstract: Convolutional neural networks (CNNs) have been employed along with Variational Monte Carlo methods for finding the ground state of quantum many-body spin systems with great success. In order to do so, however, a CNN with only linearly many variational parameters has to circumvent the ``curse of dimensionality'' and successfully approximate a wavefunction on an exponentially large Hilbert space. In our work, we provide a theoretical and experimental analysis of how the CNN optimizes learning for spin systems, and investigate the CNN's low dimensional approximation. We first quantify the role played by physical symmetries of the underlying spin system during training. We incorporate our insights into a new training algorithm and demonstrate its improved efficiency, accuracy and robustness. We then further investigate the CNN's ability to approximate wavefunctions by looking at the entanglement spectrum captured by the size of the convolutional filter. Our insights reveal the CNN to be an ansatz fundamentally centered around the occurrence statistics of $K$-motifs of the input strings. We use this motivation to provide the shallow CNN ansatz with a unifying theoretical interpretation in terms of other well-known statistical and physical ansatzes such as the maximum entropy (MaxEnt) and entangled plaquette correlator product states (EP-CPS). Using regression analysis, we find further relationships between the CNN's approximations of the different motifs' expectation values. Our results allow us to gain a comprehensive, improved understanding of how CNNs successfully approximate quantum spin Hamiltonians and to use that understanding to improve CNN performance.

categories: quant-ph cond-mat.dis-nn cond-mat.str-el physics.comp-ph


title: Liouville's formulae and Hadamard variation with respect to general domain perturbations

abstract: We study Hadamard variations with respect to general domain perturbations, particularly for the Neumann boundary condition. They are derived from new Liouville's formulae concerning the transformation of volume and area integrals. Then, relations to several geometric quantities are discussed; differential forms and the second fundamental form on the boundary.


title: Irreducibility of stochastic complex Ginzburg-Landau equations driven by pure jump noise and its applications

abstract: Considering irreducibility is fundamental for studying the ergodicity of stochastic dynamical systems. In this paper, we establish the irreducibility of stochastic complex Ginzburg-Laudau equations driven by pure jump noise. Our results are dimension free and the conditions placed on the driving noises are very mild. A crucial role is played by criteria developed by the authors of this paper and T. Zhang for the irreducibility of stochastic equations driven by pure jump noise. As an application, we obtain the ergodicity of stochastic complex Ginzburg-Laudau equations. We remark that our ergodicity result covers the weakly dissipative case with pure jump degenerate noise.


title: Automated Performance Estimation for Decentralized Optimization via Network Size Independent Problems

abstract: We develop a novel formulation of the Performance Estimation Problem (PEP) for decentralized optimization whose size is independent of the number of agents in the network. The PEP approach allows computing automatically the worst-case performance and worst-case instance of first-order optimization methods by solving an SDP. Unlike previous work, the size of our new PEP formulation is independent of the network size. For this purpose, we take a global view of the decentralized problem and we also decouple the consensus subspace and its orthogonal complement. We apply our methodology to different decentralized methods such as DGD, DIGing and EXTRA and obtain numerically tight performance guarantees that are valid for any network size.


title: Polymer-bonded magnets produced by laser powder bed fusion: Influence of powder morphology, filler fraction and energy input on the magnetic and mechanical properties

abstract: Bonded permanent magnets are key components in many energy conversion, sensor and actuator devices. These applications require high magnetic performance and freedom of shape. With additive manufacturing processes, for example laser powder bed fusion (LPBF), it is possible to produce bonded magnets with customized stray field distribution. Up to now, most studies use spherical powders as magnetic fillers due to their good flowability. Here, the behavior of large SmFeN platelets with a high aspect ratio as filler material and its influence on the arrangement and the resulting magnetic properties are examined in comparison to a spherical magnetic filler. The 3D distribution and orientation of the magnetic filler was studied by computed tomography and digital image analysis. The platelet-shaped particles align themselves perpendicular to the buildup direction during the process, which offers a new and cost-effective way of producing composites by LPBF with anisotropic structural and functional properties. The influence of LPBF parameters on the properties of the composites is investigated. Highest filling fractions are required for high magnetic remanence, however the powder itself limits this maximum due to particle shape and required minimal polymer fraction to form mechanically stable magnets. The coercivity decreases for higher filling fractions, which is attributed to increased rotation of insufficiently embedded magnetic particles in the matrix. It is discussed how filler morphology influences the observed change in coercivity since the rotation of spherical particles in comparison to platelet-shaped particles requires less energy. Our work shows the challenges and opportunities of large platelet shaped fillers used in LPBF for the production of anisotropic functional and structural composites.


title: A flexible model for correlated count data, with application to multi-condition differential expression analyses of single-cell RNA sequencing data

abstract: Detecting differences in gene expression is an important part of single-cell RNA sequencing experiments, and many statistical methods have been developed for this aim. Most differential expression analyses focus on comparing expression between two groups (e.g., treatment vs. control). But there is increasing interest in multi-condition differential expression analyses in which expression is measured in many conditions, and the aim is to accurately detect and estimate expression differences in all conditions. We show that directly modeling single-cell RNA-seq counts in all conditions simultaneously, while also inferring how expression differences are shared across conditions, leads to greatly improved performance for detecting and estimating expression differences compared to existing methods. We illustrate the potential of this new approach by analyzing data from a single-cell experiment studying the effects of cytokine stimulation on gene expression. We call our new method "Poisson multivariate adaptive shrinkage", and it is implemented in an R package available online at https://github.com/stephenslab/poisson.mash.alpha.


title: NAS-based Recursive Stage Partial Network (RSPNet) for Light-Weight Semantic Segmentation

abstract: Current NAS-based semantic segmentation methods focus on accuracy improvements rather than light-weight design. In this paper, we proposed a two-stage framework to design our NAS-based RSPNet model for light-weight semantic segmentation. The first architecture search determines the inner cell structure, and the second architecture search considers exponentially growing paths to finalize the outer structure of the network. It was shown in the literature that the fusion of high- and low-resolution feature maps produces stronger representations. To find the expected macro structure without manual design, we adopt a new path-attention mechanism to efficiently search for suitable paths to fuse useful information for better segmentation. Our search for repeatable micro-structures from cells leads to a superior network architecture in semantic segmentation. In addition, we propose an RSP (recursive Stage Partial) architecture to search a light-weight design for NAS-based semantic segmentation. The proposed architecture is very efficient, simple, and effective that both the macro- and micro- structure searches can be completed in five days of computation on two V100 GPUs. The light-weight NAS architecture with only 1/4 parameter size of SoTA architectures can achieve SoTA performance on semantic segmentation on the Cityscapes dataset without using any backbones.


title: Regular Cayley Maps of Elementary abelian $p$-groups: Classification and Enumeration

abstract: Recently, regular Cayley maps of cyclic groups and dihedral groups have been classified. A nature question is to classify regular Cayley maps of elementary abelian $p$-groups $Z_p^n$. In this paper, a complete classification of regular Cayley maps of $Z_p^n$ is given and moreover, the number of these maps and their genera are enumerated.


title: Optimal Weight Adaptation of Model Predictive Control for Connected and Automated Vehicles in Mixed Traffic with Bayesian Optimization

abstract: In this paper, we develop an optimal weight adaptation strategy of model predictive control (MPC) for connected and automated vehicles (CAVs) in mixed traffic. We model the interaction between a CAV and a human-driven vehicle (HDV) as a simultaneous game and formulate a game-theoretic MPC problem to find a Nash equilibrium of the game. In the MPC problem, the weights in the HDV's objective function can be learned online using moving horizon inverse reinforcement learning. Using Bayesian optimization, we propose a strategy to optimally adapt the weights in the CAV's objective function so that the expected true cost when using MPC in simulations can be minimized. We validate the effectiveness of the optimal strategy by numerical simulations of a vehicle crossing example at an unsignalized intersection.


title: Near-Optimal Deployment Efficiency in Reward-Free Reinforcement Learning with Linear Function Approximation

abstract: We study the problem of deployment efficient reinforcement learning (RL) with linear function approximation under the \emph{reward-free} exploration setting. This is a well-motivated problem because deploying new policies is costly in real-life RL applications. Under the linear MDP setting with feature dimension $d$ and planning horizon $H$, we propose a new algorithm that collects at most $\widetilde{O}(\frac{d^2H^5}{\epsilon^2})$ trajectories within $H$ deployments to identify $\epsilon$-optimal policy for any (possibly data-dependent) choice of reward functions. To the best of our knowledge, our approach is the first to achieve optimal deployment complexity and optimal $d$ dependence in sample complexity at the same time, even if the reward is known ahead of time. Our novel techniques include an exploration-preserving policy discretization and a generalized G-optimal experiment design, which could be of independent interest. Lastly, we analyze the related problem of regret minimization in low-adaptive RL and provide information-theoretic lower bounds for switching cost and batch complexity.


title: Concurrent infall of satellites: Collective effects changing the overall picture

abstract: A variety of new physical processes have proven to play an important role in orbital decay of a satellite galaxy embedded inside a dark matter halo but this is not fully understood. Our goal is to assess if the orbital history of a satellite remains unchanged during a concurrent sinking. For this purpose we analyze the impact that the internal structure of the satellites and their spatial distribution inside the host halo may have on the concurrent sinking process due to both mass loss and the combined effect of self-friction, which have not been studied before for concurrent sinking. We set up a set of N-body simulations that include multiple satellites, sinking simultaneously in a host halo and we compare them with models including a single satellite. The main result of our work is that the satellite's accretion history differs from the classical isolated view when we consider the collective effects. The accretion history of each satellite strongly depends on the initial configuration, the number of satellites in the halo at the time of infall and the internal properties of each satellite. We observe that compact satellites in a flat configuration fall slower than extended satellites that have lost mass, showing a non-reported behavior of self-friction. We find that such effects are maximized when satellites are located in a flat configuration. We show that in a flat configuration similar to the Vast Polar Structure, deviations in the apocenters can be of about 30% with respect to the isolated case, and up to 50% on the eccentricities. We conclude that ignoring the collective effects produced by the concurrent sinking of satellite galaxies may lead to large errors in the determination of the merger progenitors properties, making it considerably more challenging to trace back the accretion event. Timing constrains on host density profile may be modified by the effects discussed here.


title: Contact geometric approach to Glauber dynamics near a cusp and its limitation

abstract: We study a nonequilibrium mean field Ising model in the low temperature phase regime, where metastable equilibrium states develop a cuspidal (spinodal) singularity. We focus on celebrated Glauber dynamics, and design a contact Hamiltonian flow which captures some of its rough features in this regime. We prove, however, that there is an inevitable discrepancy between the scaling laws for the relaxation time in the Glauber and the contact Hamiltonian dynamical systems.


title: Combined Dynamic Virtual Spatiotemporal Graph Mapping for Traffic Prediction

abstract: The continuous expansion of the urban construction scale has recently contributed to the demand for the dynamics of traffic intersections that are managed, making adaptive modellings become a hot topic. Existing deep learning methods are powerful to fit complex heterogeneous graphs. However, they still have drawbacks, which can be roughly classified into two categories, 1) spatiotemporal async-modelling approaches separately consider temporal and spatial dependencies, resulting in weak generalization and large instability while aggregating; 2) spatiotemporal sync-modelling is hard to capture long-term temporal dependencies because of the local receptive field. In order to overcome above challenges, a \textbf{C}ombined \textbf{D}ynamic \textbf{V}irtual spatiotemporal \textbf{G}raph \textbf{M}apping \textbf{(CDVGM)} is proposed in this work. The contributions are the following: 1) a dynamic virtual graph Laplacian ($DVGL$) is designed, which considers both the spatial signal passing and the temporal features simultaneously; 2) the Long-term Temporal Strengthen model ($LT^2S$) for improving the stability of time series forecasting; Extensive experiments demonstrate that CDVGM has excellent performances of fast convergence speed and low resource consumption and achieves the current SOTA effect in terms of both accuracy and generalization. The code is available at \hyperlink{https://github.com/Dandelionym/CDVGM.}{https://github.com/Dandelionym/CDVGM.}


title: SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model

abstract: Data-driven speech processing models usually perform well with a large amount of text supervision, but collecting transcribed speech data is costly. Therefore, we propose SpeechCLIP, a novel framework bridging speech and text through images to enhance speech models without transcriptions. We leverage state-of-the-art pre-trained HuBERT and CLIP, aligning them via paired images and spoken captions with minimal fine-tuning. SpeechCLIP outperforms prior state-of-the-art on image-speech retrieval and performs zero-shot speech-text retrieval without direct supervision from transcriptions. Moreover, SpeechCLIP can directly retrieve semantically related keywords from speech.


title: Information-Theoretic Analysis of Unsupervised Domain Adaptation

abstract: This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generalization errors. The first notion measures the gap between the population risk in the target domain and that in the source domain, and the second measures the gap between the population risk in the target domain and the empirical risk in the source domain. While our bounds for the first kind of error are in line with the traditional analysis and give similar insights, our bounds on the second kind of error are algorithm-dependent, which also provide insights into algorithm designs. Specifically, we present two simple techniques for improving generalization in UDA and validate them experimentally.


title: Theme and Topic: How Qualitative Research and Topic Modeling Can Be Brought Together

abstract: Qualitative research is an approach to understanding social phenomenon based around human interpretation of data, particularly text. Probabilistic topic modelling is a machine learning approach that is also based around the analysis of text and often is used to in order to understand social phenomena. Both of these approaches aim to extract important themes or topics in a textual corpus and therefore we may see them as analogous to each other. However there are also considerable differences in how the two approaches function. One is a highly human interpretive process, the other is automated and statistical. In this paper we use this analogy as the basis for our Theme and Topic system, a tool for qualitative researchers to conduct textual research that integrates topic modelling into an accessible interface. This is an example of a more general approach to the design of interactive machine learning systems in which existing human professional processes can be used as the model for processes involving machine learning. This has the particular benefit of providing a familiar approach to existing professionals, that may can make machine learning seem less alien and easier to learn. Our design approach has two elements. We first investigate the steps professionals go through when performing tasks and design a workflow for Theme and Topic that integrates machine learning. We then designed interfaces for topic modelling in which familiar concepts from qualitative research are mapped onto machine learning concepts. This makes these the machine learning concepts more familiar and easier to learn for qualitative researchers.


title: EraseNet: A Recurrent Residual Network for Supervised Document Cleaning

abstract: Document denoising is considered one of the most challenging tasks in computer vision. There exist millions of documents that are still to be digitized, but problems like document degradation due to natural and man-made factors make this task very difficult. This paper introduces a supervised approach for cleaning dirty documents using a new fully convolutional auto-encoder architecture. This paper focuses on restoring documents with discrepancies like deformities caused due to aging of a document, creases left on the pages that were xeroxed, random black patches, lightly visible text, etc., and also improving the quality of the image for better optical character recognition system (OCR) performance. Removing noise from scanned documents is a very important step before the documents as this noise can severely affect the performance of an OCR system. The experiments in this paper have shown promising results as the model is able to learn a variety of ordinary as well as unusual noises and rectify them efficiently.


title: On the $A_{\alpha}$ and $RD_{\alpha}$ matrices over certain groups

abstract: The power graph $G = P(\Omega)$ of a finite group $\Omega$ is a graph with the vertex set $\Omega$ and two vertices $u, v \in \Omega$ form an edge if and only if one is an integral power of the other. Let $D(G)$, $A(G)$, $RT(G)$, and $RD(G)$ denote the degree diagonal matrix, adjacency matrix, the diagonal matrix of the vertex reciprocal transmission, and Harary matrix of the power graph $G$ respectively. Then the $A_{\alpha}$ and $RD_{\alpha}$ matrices of $G$ are defined as $A_{\alpha}(G) = \alpha D(G) + (1-\alpha)A(G)$ and $RD_{\alpha}(G) = \alpha RT(G) + (1-\alpha)RD(G)$. In this article, we determine the eigenvalues of $A_{\alpha}$ and $RD_{\alpha}$ matrices of the power graph of group $ \mathcal{G} = \langle s,r \, : r^{2^kp} = s^2 = e,~ srs^{-1} = r^{2^{k-1}p-1}\rangle$. In addition, we calculate its distant and detotar distance degree sequences, metric dimension, and strong metric dimension.


title: Chirality-induced one-way quantum steering between two waveguide-mediated ferrimagnetic microspheres

abstract: One-way quantum steering is of importance for quantum technologies, such as secure quantum teleportation. In this paper, we study the generation of one-way quantum steering between two distant yttrium iron garnet (YIG) microspheres in chiral waveguide electromagonics. We consider that the magnon mode with the Kerr nonlinearity in each YIG sphere is chirally coupled to left- and right-propagating guided photons in the waveguide. We find that quantum steering between the magnon modes is absent with non-chirality but is present merely in the form of one way (i.e., one-way steering) when the chirality occurs. The maximal achievable steering is obviously improved as the chirality degree increases. We further find that when the waveguide's outputs are subjected to continuous homodyne detection, the steering can be considerably enhanced and asymmetric steering with strong entanglement can also be achieved by tuning the chirality. Our study shows that chirality can be explored to effectively realize one-way quantum steering. Compared to other studies on achieving asymmetric steering via controlling intrinsic dissipation, e.g. cavity loss rates, our scheme merely depends on the chirality enabled via positioning the micromagnets in the waveguide and is continuously adjustable and experimentally more feasible.


title: Some properties of $n$-semidualizing modules

abstract: Let $R$ be a commutative noetherian ring. The $n$-semidualizing modules of $R$ are generalizations of its semidualizing modules. We will prove some basic properties of $n$-semidualizing modules. Our main result and example shows that the divisor class group of a Gorenstein determinantal ring over a field is the set of isomorphism classes of its 1-semidualizing modules. Finally, we pose some questions about $n$-semidualizing modules.


title: PSENet: Progressive Self-Enhancement Network for Unsupervised Extreme-Light Image Enhancement

abstract: The extremes of lighting (e.g. too much or too little light) usually cause many troubles for machine and human vision. Many recent works have mainly focused on under-exposure cases where images are often captured in low-light conditions (e.g. nighttime) and achieved promising results for enhancing the quality of images. However, they are inferior to handling images under over-exposure. To mitigate this limitation, we propose a novel unsupervised enhancement framework which is robust against various lighting conditions while does not require any well-exposed images to serve as the ground-truths. Our main concept is to construct pseudo-ground-truth images synthesized from multiple source images that simulate all potential exposure scenarios to train the enhancement network. Our extensive experiments show that the proposed approach consistently outperforms the current state-of-the-art unsupervised counterparts in several public datasets in terms of both quantitative metrics and qualitative results. Our code is available at https://github.com/VinAIResearch/PSENet-Image-Enhancement.


title: Efficient Meta-Learning for Continual Learning with Taylor Expansion Approximation

abstract: Continual learning aims to alleviate catastrophic forgetting when handling consecutive tasks under non-stationary distributions. Gradient-based meta-learning algorithms have shown the capability to implicitly solve the transfer-interference trade-off problem between different examples. However, they still suffer from the catastrophic forgetting problem in the setting of continual learning, since the past data of previous tasks are no longer available. In this work, we propose a novel efficient meta-learning algorithm for solving the online continual learning problem, where the regularization terms and learning rates are adapted to the Taylor approximation of the parameter's importance to mitigate forgetting. The proposed method expresses the gradient of the meta-loss in closed-form and thus avoid computing second-order derivative which is computationally inhibitable. We also use Proximal Gradient Descent to further improve computational efficiency and accuracy. Experiments on diverse benchmarks show that our method achieves better or on-par performance and much higher efficiency compared to the state-of-the-art approaches.


title: It's Time to Replace TCP in the Datacenter

abstract: In spite of its long and successful history, TCP is a poor transport protocol for modern datacenters. Every significant element of TCP, from its stream orientation to its expectation of in-order packet delivery, is wrong for the datacenter. It is time to recognize that TCP's problems are too fundamental and interrelated to be fixed; the only way to harness the full performance potential of modern networks is to introduce a new transport protocol into the datacenter. Homa demonstrates that it is possible to create a transport protocol that avoids all of TCP's problems. Although Homa is not API-compatible with TCP, it should be possible to bring it into widespread usage by integrating it with RPC frameworks.


title: WorldGen: A Large Scale Generative Simulator

abstract: In the era of deep learning, data is the critical determining factor in the performance of neural network models. Generating large datasets suffers from various difficulties such as scalability, cost efficiency and photorealism. To avoid expensive and strenuous dataset collection and annotations, researchers have inclined towards computer-generated datasets. Although, a lack of photorealism and a limited amount of computer-aided data, has bounded the accuracy of network predictions. To this end, we present WorldGen -- an open source framework to autonomously generate countless structured and unstructured 3D photorealistic scenes such as city view, object collection, and object fragmentation along with its rich ground truth annotation data. WorldGen being a generative model gives the user full access and control to features such as texture, object structure, motion, camera and lens properties for better generalizability by diminishing the data bias in the network. We demonstrate the effectiveness of WorldGen by presenting an evaluation on deep optical flow. We hope such a tool can open doors for future research in a myriad of domains related to robotics and computer vision by reducing manual labor and the cost of acquiring rich and high-quality data.


title: rPPG-Toolbox: Deep Remote PPG Toolbox

abstract: Camera-based physiological measurement is a fast growing field of computer vision. Remote photoplethysmography (rPPG) utilizes imaging devices (e.g., cameras) to measure the peripheral blood volume pulse (BVP) via photoplethysmography, and enables cardiac measurement via webcams and smartphones. However, the task is non-trivial with important pre-processing, modeling, and post-processing steps required to obtain state-of-the-art results. Replication of results and benchmarking of new models is critical for scientific progress; however, as with many other applications of deep learning, reliable codebases are not easy to find or use. We present a comprehensive toolbox, rPPG-Toolbox, that contains unsupervised and supervised rPPG models with support for public benchmark datasets, data augmentation, and systematic evaluation: \url{https://github.com/ubicomplab/rPPG-Toolbox}


title: Future of industrial assembly: Intelligent Reconfigurable & Repurposable Adaptive Assembly (IRRAA)

abstract: Assembly, the process of integrating parts and components into usable products, is a key industrial process to achieve finished goods. Driven by market demographics and technological advancements, industrial assembly has evolved through several phases i.e. craftmanship, bench assembly, assembly lines and flexible assembly cells. Due to the complexity and variety of assembly tasks, besides significant advancement of automation technologies in other manufacturing activities, humans are still considered vital for assembly operations. The rationalization of manufacturing automation has considerably remained away from assembly systems. The advancement in assembly has only been in terms of better scheduling of work tasks and avoiding of wastes. With smart manufacturing technologies such as collaborative robots, additive manufacturing, and digital twins, the opportunities have arisen for the next reshaping of assembly systems. The new paradigm promises a higher degree of automation yet remaining flexible. This may result into a new manufacturing paradigm driven by the advancement of new technologies, new customer expectations and by establishing new kinds of manufacturing systems. This study explores the future collaborative assembly cells, presents a generic framework to develop them and the basic building blocks.