title: Strong convergence rates of a fully discrete scheme for the Cahn-Hilliard-Cook equation

abstract: The first aim of this paper is to examine existence, uniqueness and regularity for the Cahn-Hilliard-Cook (CHC) equation in space dimension $d\leq 3$. By applying a spectral Galerkin method to the infinite dimensional equation, we elaborate the well-posedness and regularity of the finite dimensional approximate problem. The key idea lies in transforming the stochastic problem {\color{black}{with additive noise}} into an equivalent random equation. The regularity of the solution to the equivalent random equation is obtained, in one dimension, with the aid of the Gagliardo-Nirenberg inequality and done in two and three dimensions, by the energy argument. Further, the approximate solution is shown to be strongly convergent to the unique mild solution of the original CHC equation, whose spatio-temporal regularity can be attained by similar arguments. In addition, a fully discrete approximation of such problem is investigated, performed by the spectral Galerkin method in space and the backward Euler method in time. The previously obtained regularity results of the problem help us to identify strong convergence rates of the fully discrete scheme.


title: Ion specificity of confined ion-water structuring and nanoscale surface forces in clays

abstract: Ion specificity and related Hofmeister effects, ubiquitous in aqueous systems, can have spectacular consequences in hydrated clays, where ion-specific nanoscale surface forces can determine large scale cohesive, swelling and shrinkage behaviors of soil and sediments. We have used a semi-atomistic computational approach and examined sodium, calcium and aluminum counterions confined with water between charged surfaces representative of clay materials, to show that ion-water structuring in nanoscale confinement is at the origin of surface forces between clay particles which are intrinsically ion-specific. When charged surfaces strongly confine ions and water, the amplitude and oscillations of the net pressure naturally emerge from the interplay of electrostatics and steric effects, which can not be captured by existing theories. Increasing confinement and surface charge densities promote ion-water structures that increasingly deviate from the ions' bulk hydration shells, being strongly anisotropic and persistent, and self-organizing into optimized, nearly solid-like assemblies where hardly any free water is left. In these conditions, strongly attractive interactions can prevail between charged surfaces, due to the dramatically reduced dielectric screening of water and the highly organized water-ion structures. By unravelling the ion-specific nature of these nanoscale interactions, we provide evidence that ion-specific solvation structures determined by confinement are at the origin of ion specificity in clays and potentially a broader range of confined aqueous systems.


title: Semantic Similarity Metrics for Evaluating Source Code Summarization

abstract: Source code summarization involves creating brief descriptions of source code in natural language. These descriptions are a key component of software documentation such as JavaDocs. Automatic code summarization is a prized target of software engineering research, due to the high value summaries have to programmers and the simultaneously high cost of writing and maintaining documentation by hand. Current work is almost all based on machine models trained via big data input. Large datasets of examples of code and summaries of that code are used to train an e.g. encoder-decoder neural model. Then the output predictions of the model are evaluated against a set of reference summaries. The input is code not seen by the model, and the prediction is compared to a reference. The means by which a prediction is compared to a reference is essentially word overlap, calculated via a metric such as BLEU or ROUGE. The problem with using word overlap is that not all words in a sentence have the same importance, and many words have synonyms. The result is that calculated similarity may not match the perceived similarity by human readers. In this paper, we conduct an experiment to measure the degree to which various word overlap metrics correlate to human-rated similarity of predicted and reference summaries. We evaluate alternatives based on current work in semantic similarity metrics and propose recommendations for evaluation of source code summarization.


title: Estimating Social Influence from Observational Data

abstract: We consider the problem of estimating social influence, the effect that a person's behavior has on the future behavior of their peers. The key challenge is that shared behavior between friends could be equally explained by influence or by two other confounding factors: 1) latent traits that caused people to both become friends and engage in the behavior, and 2) latent preferences for the behavior. This paper addresses the challenges of estimating social influence with three contributions. First, we formalize social influence as a causal effect, one which requires inferences about hypothetical interventions. Second, we develop Poisson Influence Factorization (PIF), a method for estimating social influence from observational data. PIF fits probabilistic factor models to networks and behavior data to infer variables that serve as substitutes for the confounding latent traits. Third, we develop assumptions under which PIF recovers estimates of social influence. We empirically study PIF with semi-synthetic and real data from Last.fm, and conduct a sensitivity analysis. We find that PIF estimates social influence most accurately compared to related methods and remains robust under some violations of its assumptions.


title: Commutative graded monads

abstract: It is well-known that the category of Kleisli algebras for a monoidal monad carries a canonical monoidal structure. We define the notion of a commutative graded monad and present a strictly two-categorical proof that Kleisli algebras for such monads equally carry a canonical monoidal structure which reduce to the monoidal monad case when the commutative graded monad in question is graded over the trivial monoidal category.


title: Exceptional fracture toughness of CrCoNi-based medium- and high-entropy alloys close to liquid helium temperatures

abstract: Medium- and high-entropy alloys based on the CrCoNi-system have been shown to display outstanding strength, tensile ductility and fracture toughness (damage-tolerance properties), especially at cryogenic temperatures. Here we examine the JIc and (back-calculated) KJIc fracture toughness values of the face-centered cubic, equiatomic CrCoNi and CrMnFeCoNi alloys at 20 K. At flow stress values of ~1.5 GPa, crack-initiation KJIc toughnesses were found to be exceptionally high, respectively 235 and 415 MPa(square-root)m for CrMnFeCoNi and CrCoNi, with the latter displaying a crack-growth toughness Kss exceeding 540 MPa(square-root)m after 2.25 mm of stable cracking, which to our knowledge is the highest such value ever reported. Characterization of the crack-tip regions in CrCoNi by scanning electron and transmission electron microscopy reveal deformation structures at 20 K that are quite distinct from those at higher temperatures and involve heterogeneous nucleation, but restricted growth, of stacking faults and fine nano-twins, together with transformation to the hexagonal closed-packed phase. The coherent interfaces of these features can promote both the arrest and transmission of dislocations to generate respectively strength and ductility which strongly contributes to sustained strain hardening. Indeed, we believe that these nominally single-phase, concentrated solid-solution alloys develop their fracture resistance through a progressive synergy of deformation mechanisms, including dislocation glide, stacking-fault formation, nano-twinning and eventually in situ phase transformation, all of which serve to extend continuous strain hardening which simultaneously elevates strength and ductility (by delaying plastic instability), leading to truly exceptional resistance to fracture.


title: Evidence of Noncollinear Spin Texture in Magnetic Moir\'e Superlattices

abstract: Moir\'e magnetism, parallel with moir\'e electronics that has led to novel correlated and topological electronic states, emerges as a new venue to design and control exotic magnetic phases in twisted magnetic two-dimensional(2D) crystals. Here, we report direct evidence of noncollinear spin texture in 2D twisted double bilayer (tDB) magnet chromium triiodide (CrI$_3$). Using magneto-optical spectroscopy in tDB CrI$_3$, we revealed the presence of a net magnetization, unexpected from the composing antiferromagnetic bilayers with compensated magnetizations, and the emergence of noncollinear spins, originated from the moir\'e exchange coupling-induced spin frustrations. Exploring the twist angle dependence, we demonstrated that both features are present in tDB CrI$_3$ with twist angles from 0.5$^o$ to 5$^o$, but are most prominent in the 1.1$^o$ tDB CrI$_3$. Focusing on the temperature dependence of the 1.1$^o$ tDB CrI$_3$, we resolved the dramatic suppression in the net magnetization onset temperature and the significant softening of noncollinear spins, as a result of the moir\'e induced frustration. Our results demonstrate the power of moir\'e superlattices in introducing novel magnetic phenomena that are absent in natural 2D magnets.


title: Do Deep Neural Networks Contribute to Multivariate Time Series Anomaly Detection?

abstract: Anomaly detection in time series is a complex task that has been widely studied. In recent years, the ability of unsupervised anomaly detection algorithms has received much attention. This trend has led researchers to compare only learning-based methods in their articles, abandoning some more conventional approaches. As a result, the community in this field has been encouraged to propose increasingly complex learning-based models mainly based on deep neural networks. To our knowledge, there are no comparative studies between conventional, machine learning-based and, deep neural network methods for the detection of anomalies in multivariate time series. In this work, we study the anomaly detection performance of sixteen conventional, machine learning-based and, deep neural network approaches on five real-world open datasets. By analyzing and comparing the performance of each of the sixteen methods, we show that no family of methods outperforms the others. Therefore, we encourage the community to reincorporate the three categories of methods in the anomaly detection in multivariate time series benchmarks.


title: Reliable Editions from Unreliable Components: Estimating Ebooks from Print Editions Using Profile Hidden Markov Models

abstract: A profile hidden Markov model, a popular model in biological sequence analysis, can be used to model related sequences of characters transcribed from books, magazines, and other printed materials. This paper documents one application of a profile HMM: automatically producing an ebook edition from distinct print editions. The resulting ebook has virtually all the desired properties found in a publisher-prepared ebook, including accurate transcription and an absence of print artifacts such as end-of-line hyphenation and running headers. The technique, which has particular benefits for readers and libraries that require books in an accessible format, is demonstrated using seven copies of a nineteenth-century novel.


title: Shear Viscosity of hadronic matter at finite temperature and magnetic field

abstract: We calculate the transport coefficient of hadronic matter in the presence of temperature and magnetic field using the linear sigma model. In the relaxation time approximation, we estimate the shear viscosity over entropy density $\eta/s$. The point-like interaction rates of hadrons are evaluated through the $S$-matrix approach in the presence of a magnetic field to obtain the temperature and magnetic field-dependent relaxation time. We observe that the transport coefficients are anisotropic in the presence of the magnetic field. We calculate the temperature and magnetic field-dependent anisotropic shear viscosity coefficients by incorporating the estimated relaxation time. The value of viscosity over entropy density is lower in the presence of a magnetic field than the value of it in a thermal medium. The behavior of the perpendicular components of the shear-viscous coefficient is also discussed. We consider the temperature-dependent hadron masses from mean-field effects in this work.


title: APP: Anytime Progressive Pruning

abstract: With the latest advances in deep learning, there has been a lot of focus on the online learning paradigm due to its relevance in practical settings. Although many methods have been investigated for optimal learning settings in scenarios where the data stream is continuous over time, sparse networks training in such settings have often been overlooked. In this paper, we explore the problem of training a neural network with a target sparsity in a particular case of online learning: the anytime learning at macroscale paradigm (ALMA). We propose a novel way of progressive pruning, referred to as \textit{Anytime Progressive Pruning} (APP); the proposed approach significantly outperforms the baseline dense and Anytime OSP models across multiple architectures and datasets under short, moderate, and long-sequence training. Our method, for example, shows an improvement in accuracy of $\approx 7\%$ and a reduction in the generalization gap by $\approx 22\%$, while being $\approx 1/3$ rd the size of the dense baseline model in few-shot restricted imagenet training. We further observe interesting nonmonotonic transitions in the generalization gap in the high number of megabatches-based ALMA. The code and experiment dashboards can be accessed at \url{https://github.com/landskape-ai/Progressive-Pruning} and \url{https://wandb.ai/landskape/APP}, respectively.


title: Biohybrid membrane formation by directed insertion of Aquaporin into a solid-state nanopore

abstract: Technical challenges in molecule sensing and chemical detection have created an increasing demand for transformative materials with high sensitivity and specificity. Biohybrid nanopores have attracted growing interest as they can ideally combine the durability of solid-state nanopores with the precise structure of biological nanopores. Particular care must be taken to control how biological nanopores adapt to their surroundings once in contact with the solid-state nanopore. Two major challenges are to precisely control this adaptability under dynamic conditions and provide predesigned functionalities that can be manipulated for engineering applications. Here, we report on the computational design of a distinctive class of biohybrid active membrane layer, built from the directed insertion of an aquaporin-incorporated lipid shell into a silica nanopore. First, we describe in detail the mechanisms at play in the insertion of the biological membrane into the solid-state nanopore. Then we analyze the structural stability of the system and demonstrate that its water permeability is comparable to the one measured in the biological environment. Finally, we discuss how the technology implemented could be applicable to environmental and biomedical applications, such as water desalination and drug discovery, where targeting and controlled permeation of small molecules must be efficiently addressed.


title: Highlights of pion and kaon structure from continuum analyses

abstract: One of the biggest challenges in contemporary physics is understanding the origin and dynamics of the internal structure of hadrons which, at a fundamental level, is described by quantum chromodynamics (QCD). Taking great prominence amongst hadrons are pions and kaons which, despite being the lightest hadrons in nature, their very existence is intimately connected to those mechanisms responsible for almost all of the mass of the visible matter. In this manuscript we discuss many aspects of the pion and kaon structure via light front wave functions and generalized parton distributions, and a collection of other distributions and structural properties that are inferred therefrom.


title: On Convergence Lemma and Convergence Stability for Piecewise Analytic Functions

abstract: In this work, a convergence lemma for function $f$ being finite compositions of analytic mappings and the maximum operator is proved. The lemma shows that the set of $\delta$-stationary points near an isolated local minimum point $x^*$ is shrinking to $x^*$ as $\delta\to 0$. It is a natural extension of the version for strongly convex $C^1$ functions. However, the correctness of the lemma is subtle. Analytic mappings are necessary for the lemma in the sense that replacing it with differentiable or $C^\infty$ mappings makes the lemma false. The proof is based on stratification theorems of semi-analytic sets by {\L}ojasiewicz. An extension of this proof presents a geometric characterization of the set of stationary points of $f$. Finally, a notion of stability on stationary points, called convergence stability, is proposed. It asks, under small numerical errors, whether a reasonable convergent optimization method started near a stationary point should eventually converge to the same stationary point. The concept of convergence stability becomes nontrivial qualitatively only when the objective function is both nonsmooth and nonconvex. Via the convergence lemma, an intuitive equivalent condition for convergence stability of $f$ is proved. These results together provide a new geometric perspective to study the problem of "where-to-converge" in nonsmooth nonconvex optimization.


title: Mutual information in changing environments: non-linear interactions, out-of-equilibrium systems, and continuously-varying diffusivities

abstract: Biochemistry, ecology, and neuroscience are examples of prominent fields aiming at describing interacting systems that exhibit non-trivial couplings to complex, ever-changing environments. We have recently shown that linear interactions and a switching environment are encoded separately in the mutual information of the overall system. Here, we first generalize these findings to a broad class of non-linear interacting models. We find that a new term in the mutual information appears, quantifying the interplay between non-linear interactions and environmental changes, and leading to either constructive or destructive information interference. Furthermore, we show that a higher mutual information emerges in out-of-equilibrium environments with respect to an equilibrium scenario. Finally, we generalize our framework to the case of continuously varying environments. We find that environmental changes can be mapped exactly into an effective spatially-varying diffusion coefficient, shedding light on modeling and information structure of biophysical systems in inhomogeneous media.


title: Three-dimensional Microstructural Image Synthesis from 2D Backscattered Electron Image of Cement Paste

abstract: The microstructure is significant for exploring the physical properties of hardened cement paste. In general, the microstructures of hardened cement paste are obtained by microscopy. As a popular method, scanning electron microscopy (SEM) can acquire high-quality 2D images but fails to obtain 3D microstructures.Although several methods, such as microtomography (Micro-CT) and Focused Ion Beam Scanning Electron Microscopy (FIB-SEM), can acquire 3D microstructures, these fail to obtain high-quality 3D images or consume considerable cost. To address these issues, a method based on solid texture synthesis is proposed, synthesizing high-quality 3D microstructural image of hardened cement paste. This method includes 2D backscattered electron (BSE) image acquisition and 3D microstructure synthesis phases. In the approach, the synthesis model is based on solid texture synthesis, capturing microstructure information of the acquired 2D BSE image and generating high-quality 3D microstructures. In experiments, the method is verified on actual 3D Micro-CT images and 2D BSE images. Finally, qualitative experiments demonstrate that the 3D microstructures generated by our method have similar visual characteristics to the given 2D example. Furthermore, quantitative experiments prove that the synthetic 3D results are consistent with the actual instance in terms of porosity, particle size distribution, and grey scale co-occurrence matrix.


title: A PRticle filter algorithm for nonparametric estimation of multivariate mixing distributions

abstract: Predictive recursion (PR) is a fast, recursive algorithm that gives a smooth estimate of the mixing distribution under the general mixture model. However, the PR algorithm requires evaluation of a normalizing constant at each iteration. When the support of the mixing distribution is of relatively low dimension, this is not a problem since quadrature methods can be used and are very efficient. But when the support is of higher dimension, quadrature methods are inefficient and there is no obvious Monte Carlo-based alternative. In this paper, we propose a new strategy, which we refer to as a PRticle filter, wherein we augment the basic PR algorithm with a filtering mechanism that adaptively reweights an initial set of particles along the updating sequence which are used to obtain Monte Carlo approximations of the normalizing constants. Convergence properties of the PRticle filter approximation are established and its empirical accuracy is demonstrated with simulation studies and a marked spatial point process data analysis.


title: Discovery of cyclotron and narrow Fe K$_{\alpha}$ lines in HMXB GRO J1750-27

abstract: We report on timing and spectral analysis of transient Be X-ray pulsar GRO J1750-27 by using the Nuclear Spectroscopic Telescope Array (NuSTAR) observation from September 2021. This is the fourth outburst of the system since 1995. The NuSTAR observation was performed during the rising phase of the outburst. Pulsations at a period of 4.450710(1) s were observed in the 3-60 keV energy range. The average pulse profile comprised of a broad peak with a weak secondary peak which evolved with energy. We did not find any appreciable variation in the X-ray emission during this observation. The broad-band phase-averaged spectrum is described by a blackbody, a powerlaw or Comptonization component. We report discovery of Fe K$_{\alpha}$ line at 6.4 keV along with presence of two cyclotron resonant scattering features around 36 and 42 keV. These lines indicate a magnetic field strength of $3.7_{-0.3}^{+0.1} \times 10^{12}$ and $4.4 \pm 0.1 \times 10^{12}$ G for the neutron star. We have estimated a source distance of $\sim$ 13.6-16.4 kpc based on the accretion-disc torque models.


title: Ground state and nodal solutions for fractional Orlicz problems with lack of regularity and without the Ambrosetti-Rabinowitz condition

abstract: We consider a non-local Shr\"odinger problem driven by the fractional Orlicz g-Laplace operator as follows \begin{equation}\label{PP} (-\triangle_{g})^{\alpha}u+g(u)=K(x)f(x,u),\ \ \text{in}\ \mathbb{R}^{d},\tag{P} \end{equation} where $d\geq 3,\ (-\triangle_{g})^{\alpha}$ is the fractional Orlicz g-Laplace operator, $f:\mathbb{R}^d\times\mathbb{R}\rightarrow \mathbb{R}$ is a measurable function and $K$ is a positive continuous function. Employing the Nehari manifold method and without assuming the well-known Ambrosetti-Rabinowitz and differentiability conditions on the non-linear term $f$, we prove that the problem \eqref{PP} has a ground state of fixed sign and a nodal (or sign-changing) solutions.


title: Cosmic star formation history with tomographic cosmic infrared background-galaxy cross-correlation

abstract: In this work, we probe the star formation history of the Universe using tomographic cross-correlation between the cosmic infrared background (CIB) and galaxy samples. The galaxy samples are from the Kilo-Degree Survey (KiDS), while the CIB maps are made from \planck\, sky maps. We measure the cross-correlation in harmonic space with a significance of 43$\sigma$. We model the cross-correlation with a halo model, which links CIB anisotropies to star formation rates (SFR) and galaxy abundance. We assume that SFR has a lognormal dependence on halo mass, while galaxy abundance follows the halo occupation distribution (HOD) model. The cross-correlations give a best-fit maximum star formation efficiency of $\eta_{\mathrm{max}}= 0.41^{+0.09}_{-0.14}$ at a halo mass $\log_{10}(M_{\mathrm{peak}}/M_{\odot})= {12.14\pm 0.36}$. The derived star formation rate density (SFRD) is well constrained up to $z\sim 1.5$. The constraining power at high redshift is mainly limited by the KiDS survey depth. A combination with external SFRD measurements from previous studies gives $\log_{10}(M_{\mathrm{peak}}/M_{\odot})=12.42^{+0.35}_{-0.19}$. This tightens the SFRD constraint up to $z=4$, yielding a peak SFRD of $0.09_{-0.004}^{+0.003}\,M_{\odot} \mathrm { year }^{-1} \mathrm{Mpc}^{-3}$ at $z=1.74^{+0.06}_{-0.02}$, corresponding to a lookback time of $10.05^{+0.12}_{-0.03}$ Gyr. Both constraints are consistent, and the derived SFRD agrees with previous studies and simulations. Additionally, we estimate the galaxy bias $b$ of KiDS galaxies from the constrained HOD parameters and yield an increasing bias from $b=1.1_{-0.31}^{+0.17}$ at $z=0$ to $b=1.96_{-0.64}^{+0.18}$ at $z=1.5$. Finally, we provide a forecast for future galaxy surveys and conclude that, due to their considerable depth, future surveys will yield a much tighter constraint on the evolution of the SFRD.


title: Yoneda algebras of the triplet vertex operator algebra

abstract: Given a vertex operator algebra $V$, one can construct two associative algebras, the Zhu algebra $A(V)$ and the $C_2$-algebra $R(V)$. This gives rise to two abelian categories $A(V)-\text{Mod}$ and $R(V)-\text{Mod}$, in addition to the category of admissible modules of $V$. In case $V$ is rational and $C_2$-cofinite, the category of admissible $V$-modules and the category of all $A(V)$-modules are equivalent. However, when $V$ is not rational, the connection between these two categories is unclear. The goal of this paper is to study the triplet vertex operator algebra $\mathcal{W}(p)$, as an example to compare these three categories, in terms of abelian categories. For each of these three abelian categories, we will determine the associated Ext quiver, the Morita equivalent basic algebra, i.e., the algebra $ \text{End} (\oplus_{L\in \text{Irr}} P_L)^{op}$, and the Yoneda algebra $\text{Ext}^{*}(\oplus_{L\in \text{Irr}}L, \oplus_{L\in \text{Irr}}L)$. As a consequence, the category of admissible log-modules for the triplet VOA $ \mathcal W(p)$ has infinite global dimension, as do the Zhu algebra $A(\mathcal W(p))$, and the associated graded algebra $\text{gr} \ A(\mathcal W(p))$ which is isomorphic to $R(\mathcal W(p))$. We also describe the Koszul properties of the module categories of $ \mathcal W(p)$, $A(\mathcal W(p))$ and $\text{gr} \ A(\mathcal W(p))$.


title: Improved bounds on number fields of small degree

abstract: We study the number of degree $n$ number fields with discriminant bounded by $X$. In this article, we improve an upper bound due to Schmidt on the number of such fields that was previously the best known upper bound for $6 \leq n \leq 94$.


title: Dyson-Schwinger equations and the muon g-2

abstract: We present a brief introduction to the Dyson-Schwinger equations (DSEs) approach to hadron and high-energy physics. In particular, how this formalism is applied to calculate the electromagnetic form factors $\gamma^* \gamma^* \to \textbf{P}^0$ and $\gamma^* \textbf{P}^\pm \to \textbf{P}^\pm$ (with $\textbf{P}^\pm$ and $\textbf{P}^0$ charged and neutral ground-state pseudoscalar mesons, respectively) is discussed. Subsequently, the corresponding contributions of those form factors to the muon anomalous magnetic moment ($g-2$) are estimated. We look forward to promoting the DSE approach to address theoretical aspects of the muon $g-2$, highlighting some calculations that could be carried out in the future.


title: Randomized Block Adaptive Linear System Solvers

abstract: Randomized linear solvers randomly compress and solve a linear system with compelling theoretical convergence rates and computational complexities. However, such solvers suffer a substantial disconnect between their theoretical rates and actual efficiency in practice. Fortunately, these solvers are quite flexible and can be adapted to specific problems and computing environments to ensure high efficiency in practice, even at the cost of lower effectiveness (i.e., having a slower theoretical rate of convergence). While highly efficient adapted solvers can be readily designed by application experts, will such solvers still converge and at what rate? To answer this, we distill three general criteria for randomized adaptive solvers, which, as we show, will guarantee a worst-case exponential rate of convergence of the solver applied to consistent and inconsistent linear systems irrespective of whether such systems are over-determined, under-determined or rank-deficient. As a result, we enable application experts to design randomized adaptive solvers that achieve efficiency and can be verified for effectiveness using our theory. We demonstrate our theory on twenty-six solvers, nine of which are novel or novel block extensions of existing methods to the best of our knowledge.


title: Distributed MPC with ALADIN -- A Tutorial

abstract: This paper consists of a tutorial on the Augmented Lagrangian based Alternating Direction Inexact Newton method (ALADIN) and its application to distributed model predictive control (MPC). The focus is - for simplicity of presentation - on convex quadratic programming (QP) formulations of MPC. It is explained how ALADIN can be used to synthesize sparse QP solvers for large-scale linear-quadratic optimal control by combining ideas from augmented Lagrangian methods, sequential quadratic programming, as well as barrier or interior point methods. The highlight of this tutorial is a real-time ALADIN variant that can be implemented with a few lines of code yet arriving at a sparse QP solver that can compete with mature open-source and commercial QP solvers in terms of both run-time as well as numerical accuracy. It is discussed why this observation could have far reaching consequences on the future of algorithm and software development in the field of large-scale optimization and MPC.


title: Classical Yang Mills equations with sources: consequences of specific scalar potentials

abstract: Some well known gauge scalar potential very often considered or used in the literature are investigated by means of the classical Yang Mills equations for the $SU(2)$ subgroups of $N_c=3$. By fixing a particular shape for the scalar potential, the resulting vector potentials and the corresponding color-charges sources are found. By adopting the spherical coordinate system, it is shown that spherically symmetric solutions, only dependent on the radial coordinate, are only possible for the Abelian limit, otherwise, there must have angle-dependent component(s). The following solutions for the scalar potential are investigated: the Coulomb potential and a non-spherically symmetric generalization, a linear potential $A_0 (\vec{r}) \sim (\kappa r)$, a Yukawa-type potential $A_0 (\vec{r}) \sim (C e^{-r/r_0}/r)$ and finite spatial regions in which the scalar potential assumes constant values. The corresponding chromo-electric and chromo-magnetic fields, as well as the color-charge densities, are found to have strong deviations from the spherical symmetric configurations. We speculate these types of non-spherically symmetric configurations may contribute (or favor) for the (anisotropic) confinement mechanism since they should favor color charge-anti-charge (or three-color-charge) bound states that are intrinsically non spherically symmetric with (asymmetric) confinement of fluxes. Specific conditions and relations between the parameters of the solutions are also presented.


title: An English translation of A. Wiman's "On the algebraic curves of genus $p=4$, $5$ and $6$, which posses unambiguous transformations into themselves"

abstract: This is an English translation of the paper "Ueber die algebraischen Curven von den Geschlechtern $p = 4$, $5$ und $6$, welche eindeutigen Transformationen in sich besitzen" by Anders Wiman, Bihang till Kongl. Svenska vetenskaps-akademiens handlingar 21 (1895): 1-41. The article, originally written in German, classifies non-hyperelliptic curves which have non-trivial automorphism groups via classical methods in algebraic geometry.


title: Coherent interaction-free detection of microwave pulses with a superconducting circuit

abstract: The interaction-free measurement is a fundamental quantum effect whereby the presence of a photosensitive object is determined without irreversible photon absorption. Here we propose the concept of coherent interaction-free detection and demonstrate it experimentally using a three-level superconducting transmon circuit. In contrast to standard interaction-free measurement setups, where the dynamics involves a series of projection operations, our protocol employs a fully coherent evolution that results, surprisingly, in a higher probability of success. We show that it is possible to ascertain the presence of a microwave pulse resonant with the second transition of the transmon, while at the same time avoid exciting the device onto the third level. Experimentally, this is done by using a series of Ramsey microwave pulses coupled into the first transition and monitoring the ground-state population.


title: Kaon, Nucleon and $\Delta^*$ Resonances with Hidden Charm

abstract: In this presentation we discuss the generation of hadrons with an exotic quark content and hidden charm emerging from three-body interactions. To be more specific, we have studied the $KD\bar{D}^*/K\bar D D^*$ and $ND\bar{D}^*/N\bar{D}D^*$ systems and predicted states generated from the respective three-body dynamics. In the case of the $KD\bar{D}^*/K\bar D D^*$ system we predict the formation of a meson state with mass around $4307$ MeV and quantum numbers $I(J^P) = 1/2(1^-)$, $K^*(4307)$, and from the study of the $ND\bar{D}^*/N\bar{D}D^*$ system we found $N^*$ states with masses in the range $4400\sim 4600$ MeV, width of $2\sim 20$ MeV and positive parity.


title: Notes on $n$-point Witten diagrams in AdS${}_2$

abstract: Witten diagrams provide a perturbative framework for calculations in Anti-de-Sitter space, and play an essential role in a variety of holographic computations. In the case of this study in AdS$_2$, the one-dimensional boundary allows for a simple setup, in which we obtain perturbative analytic results for correlators with the residue theorem. This elementary method is used to find all scalar $n$-point contact Witten diagrams for external operators of conformal dimension $\Delta=1$ and $\Delta=2$, and to determine topological correlators of Yang-Mills in AdS$_2$. Another established method is applied to explicitly compute exchange diagrams and give an example of a Polyakov block in $d=1$. We also check perturbatively a recently proposed multipoint Ward identity with the strong coupling expansion of the six-point function of operators inserted on the 1/2 BPS Wilson line in $\mathcal{N}$=4 SYM.


title: NICER monitoring of supersoft X-ray sources

abstract: We monitored four supersoft sources - two persistent ones, CAL 83 and MR Vel, and the recent novae YZ Ret (Nova Ret 2020) and V1674 Her (Nova Her 2021) - with NICER. The two persistent SSS were observed with unvaried X-ray flux level and spectrum, respectively, 13 and 20 years after the last observations. Short period modulations of the supersoft X-ray source (SSS) appear where the spectrum of the luminous central source was fully visibl (in CAL 83 and V1674 Her) and were absent in YZ Ret and MR Vel, in which the flux originated in photoionized or shocked plasma, while the white dwarf (WD) was not observable. We thus suggest that the pulsations occur on, or very close to, the WD surface. The pulsations of CAL 83 were almost unvaried after 15 years, including an irregular drift of the $\simeq$67 s period by 2.1 s. Simulations, including previous XMM-Newton data, indicate actual variations in period length within hours, rather than an artifact of the variable amplitude of the pulsations. Large amplitude pulsations with a period of 501.53$\pm$0.30 s were always detected in V1674 Her, as long as the SSS was observable. This period seems to be due to rotation of a highly magnetized WD.We cannot confirm the maximum effective temperature of ($\simeq$145,000 K) previously inferred for this nova, and discuss the difficulty in interpreting its spectrum. The WD appears to present two surface zones, one of which does not emit SSS flux.


title: Towards black hole entropy in chiral loop quantum supergravity

abstract: Recently, many geometric aspects of $\mathcal{N}$-extended AdS supergravity in chiral variables have been encountered and clarified. In particular, if the theory is supposed to be invariant under SUSY transformations also on boundaries, the boundary term has to be the action of a $\mathrm{OSp}(\mathcal{N}|2)_{\mathbb{C}}$ super Chern-Simons theory, and particular boundary conditions must be met. Based on this, we propose a way to calculate an entropy $S$ for surfaces, presumably including black hole horizons, in the supersymmetric version of loop quantum gravity for the minimal case $\mathcal{N}=1$. It proceeds in analogy to the non-supersymmetric theory, by calculating dimensions of quantum state spaces of the super Chern-Simons theory with punctures, for fixed quantum (super) area of the surface. We find $S = a_H/4$ for large areas and determine the subleading correction. Due to the non-compactness of $\mathrm{OSp}(1|2)_{\mathbb{C}}$ and the corresponding difficulties with the Chern-Simons quantum theory, we use analytic continuation from the Verlinde formula for a compact real form, $\mathrm{UOSp}(1|2)$, in analogy to work by Noui et al. This also entails studying some properties of $\mathrm{OSp}(1|2)_{\mathbb{C}}$ representations that we have not found elsewhere in the literature.


title: Evolving Neural Selection with Adaptive Regularization

abstract: Over-parameterization is one of the inherent characteristics of modern deep neural networks, which can often be overcome by leveraging regularization methods, such as Dropout. Usually, these methods are applied globally and all the input cases are treated equally. However, given the natural variation of the input space for real-world tasks such as image recognition and natural language understanding, it is unlikely that a fixed regularization pattern will have the same effectiveness for all the input cases. In this work, we demonstrate a method in which the selection of neurons in deep neural networks evolves, adapting to the difficulty of prediction. We propose the Adaptive Neural Selection (ANS) framework, which evolves to weigh neurons in a layer to form network variants that are suitable to handle different input cases. Experimental results show that the proposed method can significantly improve the performance of commonly-used neural network architectures on standard image recognition benchmarks. Ablation studies also validate the effectiveness and contribution of each component in the proposed framework.


title: The fundamental Lepage form in two independent variables: a generalization using order-reducibility

abstract: A second-order generalization of the fundamental Lepage form of geometric calculus of variations over fibered manifolds with 2-dimensional base is described by means of insisting on (i) equivalence relation "Lepage differential 2-form is closed if and only if the associated Lagrangian is trivial" and, (ii) the principal component of Lepage form, extending the well-known Poincar\'{e}-Cartan form, preserves order prescribed by a given Lagrangian. This approach completes several attempts of finding a Lepage equivalent of a second-order Lagrangian possessing condition (i), which is well-known for first-order Lagrangians in field theory due to Krupka and Betounes.


title: Entanglement dynamics of a hard-core quantum gas during a Joule expansion

abstract: We study the entanglement dynamics of a one-dimensional hard-core quantum gas initially confined in a box of size $L$ with saturated density $\rho=1$. The gas is suddenly released into a region of size $2L$ by moving one of the box edges. We show that the analytic prediction for the entanglement entropy obtained from quantum fluctuating hydrodynamics holds quantitatively true even after several reflections of the gas against the box edges. We further investigate the long time limit $t/L\gg 1$ where a Floquet picture of the non-equilibrium dynamics emerges and hydrodynamics eventually breaks down.


title: Linear Hashing with $\ell_\infty$ guarantees and two-sided Kakeya bounds

abstract: We show that a randomly chosen linear map over a finite field gives a good hash function in the $\ell_\infty$ sense. More concretely, consider a set $S \subset \mathbb{F}_q^n$ and a randomly chosen linear map $L : \mathbb{F}_q^n \to \mathbb{F}_q^t$ with $q^t$ taken to be sufficiently smaller than $ |S|$. Let $U_S$ denote a random variable distributed uniformly on $S$. Our main theorem shows that, with high probability over the choice of $L$, the random variable $L(U_S)$ is close to uniform in the $\ell_\infty$ norm. In other words, {\em every} element in the range $\mathbb{F}_q^t$ has about the same number of elements in $S$ mapped to it. This complements the widely-used Leftover Hash Lemma (LHL) which proves the analog statement under the statistical, or $\ell_1$, distance (for a richer class of functions) as well as prior work on the expected largest 'bucket size' in linear hash functions [ADMPT99]. By known bounds from the load balancing literature [RS98], our results are tight and show that linear functions hash as well as trully random function up to a constant factor in the entropy loss. Our proof leverages a connection between linear hashing and the finite field Kakeya problem and extends some of the tools developed in this area, in particular the polynomial method.


title: A Novel Capsule Neural Network Based Model for Drowsiness Detection Using Electroencephalography Signals

abstract: The early detection of drowsiness has become vital to ensure the correct and safe development of several industries' tasks. Due to the transient mental state of a human subject between alertness and drowsiness, automated drowsiness detection is a complex problem to tackle. The electroencephalography signals allow us to record variations in an individual's brain's electrical potential, where each of them gives specific information about a subject's mental state. However, due to this type of signal's nature, its acquisition, in general, is complex, so it is hard to have a large volume of data to apply techniques of Deep Learning for processing and classification optimally. Nevertheless, Capsule Neural Networks are a brand-new Deep Learning algorithm proposed for work with reduced amounts of data. It is a robust algorithm to handle the data's hierarchical relationships, which is an essential characteristic for work with biomedical signals. Therefore, this paper presents a Deep Learning-based method for drowsiness detection with CapsNet by using a concatenation of spectrogram images of the electroencephalography signals channels. The proposed CapsNet model is compared with a Convolutional Neural Network, which is outperformed by the proposed model, which obtains an average accuracy of 86,44% and 87,57% of sensitivity against an average accuracy of 75,86% and 79,47% sensitivity for the CNN, showing that CapsNet is more suitable for this kind of datasets and tasks.


title: Adaptive Merging on Phase Change Memory

abstract: Indexing is a well-known database technique used to facilitate data access and speed up query processing. Nevertheless, the construction and modification of indexes are very expensive. In traditional approaches, all records in the database table are equally covered by the index. It is not effective, since some records may be queried very often and some never. To avoid this problem, adaptive merging has been introduced. The key idea is to create index adaptively and incrementally as a side-product of query processing. As a result, the database table is indexed partially depending on the query workload. This paper faces a problem of adaptive merging for phase change memory (PCM). The most important features of this memory type are: limited write endurance and high write latency. As a consequence, adaptive merging should be investigated from the scratch. We solve this problem in two steps. First, we apply several PCM optimization techniques to the traditional adaptive merging approach. We prove that the proposed method (eAM) outperforms a traditional approach by 60%. After that, we invent the framework for adaptive merging (PAM) and a new PCM-optimized index. It further improves the system performance by 20% for databases where search queries interleave with data modifications.


title: Scalable Spike-and-Slab

abstract: Spike-and-slab priors are commonly used for Bayesian variable selection, due to their interpretability and favorable statistical properties. However, existing samplers for spike-and-slab posteriors incur prohibitive computational costs when the number of variables is large. In this article, we propose Scalable Spike-and-Slab ($S^3$), a scalable Gibbs sampling implementation for high-dimensional Bayesian regression with the continuous spike-and-slab prior of George and McCulloch (1993). For a dataset with $n$ observations and $p$ covariates, $S^3$ has order $\max\{ n^2 p_t, np \}$ computational cost at iteration $t$ where $p_t$ never exceeds the number of covariates switching spike-and-slab states between iterations $t$ and $t-1$ of the Markov chain. This improves upon the order $n^2 p$ per-iteration cost of state-of-the-art implementations as, typically, $p_t$ is substantially smaller than $p$. We apply $S^3$ on synthetic and real-world datasets, demonstrating orders of magnitude speed-ups over existing exact samplers and significant gains in inferential quality over approximate samplers with comparable cost.


title: Enumerative geometry of the mirror quintic

abstract: We evaluate the enumerative invariants of low degree on the mirror quintic threefold.


title: Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition

abstract: State-of-the-art automatic speech recognition (ASR) systems perform well on healthy speech. However, the performance on impaired speech still remains an issue. The current study explores the usefulness of using Wav2Vec self-supervised speech representations as features for training an ASR system for dysarthric speech. Dysarthric speech recognition is particularly difficult as several aspects of speech such as articulation, prosody and phonation can be impaired. Specifically, we train an acoustic model with features extracted from Wav2Vec, Hubert, and the cross-lingual XLSR model. Results suggest that speech representations pretrained on large unlabelled data can improve word error rate (WER) performance. In particular, features from the multilingual model led to lower WERs than filterbanks (Fbank) or models trained on a single language. Improvements were observed in English speakers with cerebral palsy caused dysarthria (UASpeech corpus), Spanish speakers with Parkinsonian dysarthria (PC-GITA corpus) and Italian speakers with paralysis-based dysarthria (EasyCall corpus). Compared to using Fbank features, XLSR-based features reduced WERs by 6.8%, 22.0%, and 7.0% for the UASpeech, PC-GITA, and EasyCall corpus, respectively.


title: Exemplar-based Pattern Synthesis with Implicit Periodic Field Network

abstract: Synthesis of ergodic, stationary visual patterns is widely applicable in texturing, shape modeling, and digital content creation. The wide applicability of this technique thus requires the pattern synthesis approaches to be scalable, diverse, and authentic. In this paper, we propose an exemplar-based visual pattern synthesis framework that aims to model the inner statistics of visual patterns and generate new, versatile patterns that meet the aforementioned requirements. To this end, we propose an implicit network based on generative adversarial network (GAN) and periodic encoding, thus calling our network the Implicit Periodic Field Network (IPFN). The design of IPFN ensures scalability: the implicit formulation directly maps the input coordinates to features, which enables synthesis of arbitrary size and is computationally efficient for 3D shape synthesis. Learning with a periodic encoding scheme encourages diversity: the network is constrained to model the inner statistics of the exemplar based on spatial latent codes in a periodic field. Coupled with continuously designed GAN training procedures, IPFN is shown to synthesize tileable patterns with smooth transitions and local variations. Last but not least, thanks to both the adversarial training technique and the encoded Fourier features, IPFN learns high-frequency functions that produce authentic, high-quality results. To validate our approach, we present novel experimental results on various applications in 2D texture synthesis and 3D shape synthesis.


title: Residual-guided Personalized Speech Synthesis based on Face Image

abstract: Previous works derive personalized speech features by training the model on a large dataset composed of his/her audio sounds. It was reported that face information has a strong link with the speech sound. Thus in this work, we innovatively extract personalized speech features from human faces to synthesize personalized speech using neural vocoder. A Face-based Residual Personalized Speech Synthesis Model (FR-PSS) containing a speech encoder, a speech synthesizer and a face encoder is designed for PSS. In this model, by designing two speech priors, a residual-guided strategy is introduced to guide the face feature to approach the true speech feature in the training. Moreover, considering the error of feature's absolute values and their directional bias, we formulate a novel tri-item loss function for face encoder. Experimental results show that the speech synthesized by our model is comparable to the personalized speech synthesized by training a large amount of audio data in previous works.


title: T*$\varepsilon$ -- Bounded-Suboptimal Efficient Motion Planning for Minimum-Time Planar Curvature-Constrained Systems

abstract: We consider the problem of finding collision-free paths for curvature-constrained systems in the presence of obstacles while minimizing execution time. Specifically, we focus on the setting where a planar system can travel at some range of speeds with unbounded acceleration. This setting can model many systems, such as fixed-wing drones. Unfortunately, planning for such systems might require evaluating many (local) time-optimal transitions connecting two close-by configurations, which is computationally expensive. Existing methods either pre-compute all such transitions in a preprocessing stage or use heuristics to speed up the search, thus foregoing any guarantees on solution quality. Our key insight is that computing all the time-optimal transitions is both~(i)~computationally expensive and~(ii)~unnecessary for many problem instances. We show that by finding bounded-suboptimal solutions (solutions whose cost is bounded by $1+\varepsilon$ times the cost of the optimal solution for any user-provided $\varepsilon$) and not time-optimal solutions, one can dramatically reduce the number of time-optimal transitions used. We demonstrate using empirical evaluation that our planning framework can reduce the runtime by several orders of magnitude compared to the state-of-the-art while still providing guarantees on the quality of the solution.


title: Fractal geometry of the space-time difference profile in the directed landscape via construction of geodesic local times

abstract: The Directed Landscape, a random directed metric on the plane (where the first and the second coordinates are termed spatial and temporal respectively), was constructed in the breakthrough work of Dauvergne, Ortmann, and Vir\'ag, and has since been shown to be the scaling limit of various integrable models of Last Passage percolation, a central member of the Kardar-Parisi-Zhang universality class. It exhibits several scale invariance properties making it a natural source of rich fractal behavior. Such a study was initiated in Basu-Ganguly-Hammond, where the difference profile i.e., the difference of passage times from two fixed points (say $(\pm 1,0)$), was considered. Owing to geodesic geometry, it turns out that this difference process is almost surely locally constant. The set of non-constancy is connected to disjointness of geodesics and inherits remarkable fractal properties. In particular, it has been established that when only the spatial coordinate is varied, the set of non-constancy of the difference profile has Hausdorff dimension $1/2$, and bears a rather strong resemblance to the zero set of Brownian motion. The arguments crucially rely on a monotonicity property, which is absent when the temporal structure of the process is probed, necessitating the development of new methods. In this paper, we put forth several new ideas, and show that the set of non-constancy of the 2D difference profile and the 1D temporal process (when the spatial coordinate is fixed and the temporal coordinate is varied) have Hausdorff dimensions $5/3$ and $2/3$ respectively. A particularly crucial ingredient in our analysis is the novel construction of a local time process for the geodesic akin to Brownian local time, supported on the "zero set" of the geodesic. Further, we show that the latter has Hausdorff dimension $1/3$ in contrast to the zero set of Brownian motion which has dimension $1/2.$


title: Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

abstract: Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity pattern is hippocampal replay, which is critical for memory consolidation. The switchings between replay events and a low-activity state in neural recordings suggests metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to spike noise and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesosocpic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie ("chemical Langevin equation"), which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down states dynamics) by means of phase-plane analysis. This stochastic neural mass model is the basic component of our mesoscopic model for replay. We show that our model faithfully captures the stochastic nature of individual replayed trajectories. Moreover, compared to the deterministic Romani-Tsodyks model of place cell dynamics, it exhibits a higher level of variability in terms of content, direction and timing of replay events, compatible with biological evidence and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.


title: Hybrid codes (massless electron fluid)

abstract: Hybrid codes are widely used to model ion-scale phenomena in space plasmas. Hybrid codes differ from full particle (PIC) codes in that the electrons are modeled as a fluid that is usually assumed to be massless, while the electric field is not advanced in time, but instead calculated at the new time level from the advanced ion quantities and the magnetic field. In this chapter we concentrate on such hybrid models with massless electrons, beginning with a discussion of the basics of a simple hybrid code algorithm. We then show examples of recent use of hybrid codes for large-scale space plasma simulations of structures formed at planetary bow shock--foreshock systems, magnetic reconnection at the magnetopause, and complex phenomena in the magnetosheath due to the interaction of kinetic processes associated with the bow shock, magnetic reconnection, and turbulence. A discussion then follows of a number of other hybrid codes based on different algorithms that are presently in active use to investigate a variety of plasma processes in space as well as some recent work on the development of new models. We conclude with a few brief comments concerning the future development and use of hybrid codes.


title: Self-Supervised Speech Representations Preserve Speech Characteristics while Anonymizing Voices

abstract: Collecting speech data is an important step in training speech recognition systems and other speech-based machine learning models. However, the issue of privacy protection is an increasing concern that must be addressed. The current study investigates the use of voice conversion as a method for anonymizing voices. In particular, we train several voice conversion models using self-supervised speech representations including Wav2Vec2.0, Hubert and UniSpeech. Converted voices retain a low word error rate within 1% of the original voice. Equal error rate increases from 1.52% to 46.24% on the LibriSpeech test set and from 3.75% to 45.84% on speakers from the VCTK corpus which signifies degraded performance on speaker verification. Lastly, we conduct experiments on dysarthric speech data to show that speech features relevant to articulation, prosody, phonation and phonology can be extracted from anonymized voices for discriminating between healthy and pathological speech.


title: MultiMAE: Multi-modal Multi-task Masked Autoencoders

abstract: We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB image (hence "multi-modal"), and II) its training objective accordingly includes predicting multiple outputs besides the RGB image (hence "multi-task"). We make use of masking (across image patches and input modalities) to make training MultiMAE tractable as well as to ensure cross-modality predictive coding is indeed learned by the network. We show this pre-training strategy leads to a flexible, simple, and efficient framework with improved transfer results to downstream tasks. In particular, the same exact pre-trained network can be flexibly used when additional information besides RGB images is available or when no information other than RGB is available - in all configurations yielding competitive to or significantly better results than the baselines. To avoid needing training datasets with multiple modalities and tasks, we train MultiMAE entirely using pseudo labeling, which makes the framework widely applicable to any RGB dataset. The experiments are performed on multiple transfer tasks (image classification, semantic segmentation, depth estimation) and datasets (ImageNet, ADE20K, Taskonomy, Hypersim, NYUv2). The results show an intriguingly impressive capability by the model in cross-modal/task predictive coding and transfer.


title: Predictable Sharing of Last-level Cache Partitions for Multi-core Safety-critical Systems

abstract: Last-level cache (LLC) partitioning is a technique to provide temporal isolation and low worst-case latency (WCL) bounds when cores access the shared LLC in multicore safety-critical systems. A typical approach to cache partitioning involves allocating a separate partition to a distinct core. A central criticism of this approach is its poor utilization of cache storage. Today's trend of integrating a larger number of cores exacerbates this issue such that we are forced to consider shared LLC partitions for effective deployments. This work presents an approach to share LLC partitions among multiple cores while being able to provide low WCL bounds.


title: TALLFormer: Temporal Action Localization with a Long-memory Transformer

abstract: Most modern approaches in temporal action localization divide this problem into two parts: (i) short-term feature extraction and (ii) long-range temporal boundary localization. Due to the high GPU memory cost caused by processing long untrimmed videos, many methods sacrifice the representational power of the short-term feature extractor by either freezing the backbone or using a small spatial video resolution. This issue becomes even worse with the recent video transformer models, many of which have quadratic memory complexity. To address these issues, we propose TALLFormer, a memory-efficient and end-to-end trainable Temporal Action Localization Transformer with Long-term memory. Our long-term memory mechanism eliminates the need for processing hundreds of redundant video frames during each training iteration, thus, significantly reducing the GPU memory consumption and training time. These efficiency savings allow us (i) to use a powerful video transformer feature extractor without freezing the backbone or reducing the spatial video resolution, while (ii) also maintaining long-range temporal boundary localization capability. With only RGB frames as input and no external action recognition classifier, TALLFormer outperforms previous state-of-the-arts by a large margin, achieving an average mAP of 59.1% on THUMOS14 and 35.6% on ActivityNet-1.3. The code is public available: https://github.com/klauscc/TALLFormer.


title: End-to-end multi-particle reconstruction in high occupancy imaging calorimeters with graph neural networks

abstract: We present an end-to-end reconstruction algorithm to build particle candidates from detector hits in next-generation granular calorimeters similar to that foreseen for the high-luminosity upgrade of the CMS detector. The algorithm exploits a distance-weighted graph neural network, trained with object condensation, a graph segmentation technique. Through a single-shot approach, the reconstruction task is paired with energy regression. We describe the reconstruction performance in terms of efficiency as well as in terms of energy resolution. In addition, we show the jet reconstruction performance of our method and discuss its inference computational cost. To our knowledge, this work is the first-ever example of single-shot calorimetric reconstruction of ${\cal O}(1000)$ particles in high-luminosity conditions with 200 pileup.


title: Deep Feature Screening: Feature Selection for Ultra High-Dimensional Data via Deep Neural Networks

abstract: The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and strong model assumption. In this paper, we propose a novel two-step nonparametric approach called Deep Feature Screening (DeepFS) that can overcome these problems and identify significant features with high precision for ultra high-dimensional, low-sample-size data. This approach first extracts a low-dimensional representation of input data and then applies feature screening based on multivariate rank distance correlation recently developed by Deb and Sen (2021). This approach combines the strengths of both deep neural networks and feature screening, and thereby has the following appealing features in addition to its ability of handling ultra high-dimensional data with small number of samples: (1) it is model free and distribution free; (2) it can be used for both supervised and unsupervised feature selection; and (3) it is capable of recovering the original input data. The superiority of DeepFS is demonstrated via extensive simulation studies and real data analyses.


title: Kernel-weighted specification testing under general distributions

abstract: Kernel-weighted test statistics have been widely used in a variety of settings including non-stationary regression, inference on propensity score and panel data models. We develop the limit theory for a kernel-based specification test of a parametric conditional mean when the law of the regressors may not be absolutely continuous to the Lebesgue measure and is contaminated with singular components. This result is of independent interest and may be useful in other applications that utilize kernel smoothed U-statistics. Simulations illustrate the non-trivial impact of the distribution of the conditioning variables on the power properties of the test statistic.


title: Stable spontaneously-scalarized black holes in generalized scalar-tensor theories

abstract: It has been shown that the synergy of a scalar field coupling with both the Ricci scalar and the Gauss-Bonnet invariant significantly affects the properties of scalarized black holes and neutron stars, including their domain of existence and the amount of scalar hair they carry. Here we study the radial stability of scalarized black-hole solutions. We demonstrate that they are stable against radial perturbations for Ricci couplings consistent with both a late-time cosmological attractor and the evasion of binary pulsar constraints. In addition, we investigate the effect of the Ricci coupling on the hyperbolicity of the equation governing linear, radial perturbations and show that it significantly reduces the region over which hyperbolicity is lost.


title: Bi-PPT channels are entanglement breaking

abstract: In a recent paper, Hirche and Leditzky introduced the notion of bi-PPT channels which are quantum channels that stay completely positive under composition with a transposition and such that the same property holds for one of their complementary channels. They asked whether there are examples of such channels that are not antidegradable. We show that this is not the case, since bi-PPT channels are always entanglement breaking. We also show that degradable quantum channels staying completely positive under composition with a transposition are entanglement breaking.


title: Bayesian Semiparametric Covariate Informed Multivariate Density Deconvolution

abstract: Estimating the marginal and joint densities of the long-term average intakes of different dietary components is an important problem in nutritional epidemiology. Since these variables cannot be directly measured, data are usually collected in the form of 24-hour recalls of the intakes. The problem of estimating the density of the latent long-term average intakes from their observed but error contaminated recalls then becomes a problem of multivariate deconvolution of densities. The underlying densities could potentially vary with the subjects' demographic characteristics such as sex, ethnicity, age, etc. The problem of density deconvolution in the presence of associated precisely measured covariates has, however, never been considered before, not even in the univariate setting. We present a flexible Bayesian semiparametric approach to covariate informed multivariate deconvolution. Building on recent advances in copula deconvolution and conditional tensor factorization techniques, our proposed method not only allows the joint and the marginal densities to vary flexibly with the associated predictors but also allows automatic selection of the most influential predictors. Importantly, the method also allows the density of interest and the density of the measurement errors to vary with potentially different sets of predictors. We design Markov chain Monte Carlo algorithms that enable efficient posterior inference, appropriately accommodating uncertainty in all aspects of our analysis. The empirical efficacy of the proposed method is illustrated through simulation experiments. Its practical utility is demonstrated in the afore-described nutritional epidemiology applications in estimating covariate-adjusted long term intakes of different dietary components. Supplementary materials include substantive additional details and R codes are also available online.


title: A concentration inequality for the maximum vertex degree in random dissections

abstract: We obtain a concentration inequality for the maximum degree of a vertex in a uniformly random dissection of a polygon. This resolves a conjecture posed by Curien and Kortchemski in 2012. Our approach is based on a bijection with dual trees and the tools of analytic combinatorics.


title: Electronic structure, magnetic properties and pairing tendencies of the copper-based honeycomb lattice Na$_2$Cu$_2$TeO$_6$

abstract: Spin-$1/2$ chains with alternating antiferromagnetic and ferromagnetic couplings have attracted considerable interest due to the topological character of their spin excitations. Here, using density functional theory and density matrix renormalization group methods, we have systematically studied the dimerized chain system Na$_2$Cu$_2$TeO$_6$. Near the Fermi level, the dominant states are mainly contributed by the Cu $3d_{x^2-y^2}$ orbitals highly hybridized with the O $2p$ orbitals in the nonmagnetic phase, leading to an "effective" single-orbital low-energy model. Furthermore, the bandwidth of the Cu $3d_{x^2-y^2}$ states is small ($\sim 0.8$ eV), suggesting that electronic correlations will strongly affect this system. By introducing such electronic correlations, we found this system is a Mott insulator. Moreover, by calculating the magnetic exchange interactions ($J_1$, $J_2$ and $J_3$), we explained the size and sign of the exchange interactions in Na$_2$Cu$_2$TeO$_6$, in agreement with neutron experiments. In addition, we constructed a single-orbital Hubbard model for this dimerized chain system, where the quantum fluctuations are taken into account. Both AFM and FM coupling ($\uparrow$-$\downarrow$-$\downarrow$-$\uparrow$) along the chain were found in our DMRG and Lanczos calculations, in agreement with DFT and neutron results. We also calculated the hole pairing binding energy $\Delta E$ which becomes negative at Hubbard $U \sim 11$ eV, indicating incipient pairing tendencies. Finally, we also looked at various cases of hole doping that always exhibit tight pairs. Thus, we believe our results for Na$_2$Cu$_2$TeO$_6$ could provide guidance to experimentalists and theorists working on this dimerized chain system, such as short-range magnetic coupling, doping effects, and possible pairing tendencies.


title: Using Explainable Boosting Machine to Compare Idiographic and Nomothetic Approaches for Ecological Momentary Assessment Data

abstract: Previous research on EMA data of mental disorders was mainly focused on multivariate regression-based approaches modeling each individual separately. This paper goes a step further towards exploring the use of non-linear interpretable machine learning (ML) models in classification problems. ML models can enhance the ability to accurately predict the occurrence of different behaviors by recognizing complicated patterns between variables in data. To evaluate this, the performance of various ensembles of trees are compared to linear models using imbalanced synthetic and real-world datasets. After examining the distributions of AUC scores in all cases, non-linear models appear to be superior to baseline linear models. Moreover, apart from personalized approaches, group-level prediction models are also likely to offer an enhanced performance. According to this, two different nomothetic approaches to integrate data of more than one individuals are examined, one using directly all data during training and one based on knowledge distillation. Interestingly, it is observed that in one of the two real-world datasets, knowledge distillation method achieves improved AUC scores (mean relative change of +17\% compared to personalized) showing how it can benefit EMA data classification and performance.


title: Deep Image: A precious image based deep learning method for online malware detection in IoT Environment

abstract: The volume of malware and the number of attacks in IoT devices are rising everyday, which encourages security professionals to continually enhance their malware analysis tools. Researchers in the field of cyber security have extensively explored the usage of sophisticated analytics and the efficiency of malware detection. With the introduction of new malware kinds and attack routes, security experts confront considerable challenges in developing efficient malware detection and analysis solutions. In this paper, a different view of malware analysis is considered and the risk level of each sample feature is computed, and based on that the risk level of that sample is calculated. In this way, a criterion is introduced that is used together with accuracy and FPR criteria for malware analysis in IoT environment. In this paper, three malware detection methods based on visualization techniques called the clustering approach, the probabilistic approach, and the deep learning approach are proposed. Then, in addition to the usual machine learning criteria namely accuracy and FPR, a proposed criterion based on the risk of samples has also been used for comparison, with the results showing that the deep learning approach performed better in detecting malware


title: Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

abstract: Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack real-world experience, which makes it difficult to leverage them for decision making within a given embodiment. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment. We propose to provide real-world grounding by means of pretrained skills, which are used to constrain the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model's "hands and eyes," while the language model supplies high-level semantic knowledge about the task. We show how low-level skills can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally-extended instructions, while value functions associated with these skills provide the grounding necessary to connect this knowledge to a particular physical environment. We evaluate our method on a number of real-world robotic tasks, where we show the need for real-world grounding and that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator. The project's website and the video can be found at https://say-can.github.io/.


title: Long Movie Clip Classification with State-Space Video Models

abstract: Most modern video recognition models are designed to operate on short video clips (e.g., 5-10s in length). Thus, it is challenging to apply such models to long movie understanding tasks, which typically require sophisticated long-range temporal reasoning. The recently introduced video transformers partially address this issue by using long-range temporal self-attention. However, due to the quadratic cost of self-attention, such models are often costly and impractical to use. Instead, we propose ViS4mer, an efficient long-range video model that combines the strengths of self-attention and the recently introduced structured state-space sequence (S4) layer. Our model uses a standard Transformer encoder for short-range spatiotemporal feature extraction, and a multi-scale temporal S4 decoder for subsequent long-range temporal reasoning. By progressively reducing the spatiotemporal feature resolution and channel dimension at each decoder layer, ViS4mer learns complex long-range spatiotemporal dependencies in a video. Furthermore, ViS4mer is $2.63\times$ faster and requires $8\times$ less GPU memory than the corresponding pure self-attention-based model. Additionally, ViS4mer achieves state-of-the-art results in $6$ out of $9$ long-form movie video classification tasks on the Long Video Understanding (LVU) benchmark. Furthermore, we show that our approach successfully generalizes to other domains, achieving competitive results on the Breakfast and the COIN procedural activity datasets. The code is publicly available at: https://github.com/md-mohaiminul/ViS4mer.


title: Monitoring social distancing with single image depth estimation

abstract: The recent pandemic emergency raised many challenges regarding the countermeasures aimed at containing the virus spread, and constraining the minimum distance between people resulted in one of the most effective strategies. Thus, the implementation of autonomous systems capable of monitoring the so-called social distance gained much interest. In this paper, we aim to address this task leveraging a single RGB frame without additional depth sensors. In contrast to existing single-image alternatives failing when ground localization is not available, we rely on single image depth estimation to perceive the 3D structure of the observed scene and estimate the distance between people. During the setup phase, a straightforward calibration procedure, leveraging a scale-aware SLAM algorithm available even on consumer smartphones, allows us to address the scale ambiguity affecting single image depth estimation. We validate our approach through indoor and outdoor images employing a calibrated LiDAR + RGB camera asset. Experimental results highlight that our proposal enables sufficiently reliable estimation of the inter-personal distance to monitor social distancing effectively. This fact confirms that despite its intrinsic ambiguity, if appropriately driven single image depth estimation can be a viable alternative to other depth perception techniques, more expensive and not always feasible in practical applications. Our evaluation also highlights that our framework can run reasonably fast and comparably to competitors, even on pure CPU systems. Moreover, its practical deployment on low-power systems is around the corner.


title: "This is my unicorn, Fluffy": Personalizing frozen vision-language representations

abstract: Large Vision & Language models pretrained on web-scale data provide representations that are invaluable for numerous V&L problems. However, it is unclear how they can be used for reasoning about user-specific visual concepts in unstructured language. This problem arises in multiple domains, from personalized image retrieval to personalized interaction with smart devices. We introduce a new learning setup called Personalized Vision & Language (PerVL) with two new benchmark datasets for retrieving and segmenting user-specific "personalized" concepts "in the wild". In PerVL, one should learn personalized concepts (1) independently of the downstream task (2) allowing a pretrained model to reason about them with free language, and (3) does not require personalized negative examples. We propose an architecture for solving PerVL that operates by extending the input vocabulary of a pretrained model with new word embeddings for the new personalized concepts. The model can then reason about them by simply using them in a sentence. We demonstrate that our approach learns personalized visual concepts from a few examples and can effectively apply them in image retrieval and semantic segmentation using rich textual queries.


title: LISA: Learning Implicit Shape and Appearance of Hands

abstract: This paper proposes a do-it-all neural model of human hands, named LISA. The model can capture accurate hand shape and appearance, generalize to arbitrary hand subjects, provide dense surface correspondences, be reconstructed from images in the wild and easily animated. We train LISA by minimizing the shape and appearance losses on a large set of multi-view RGB image sequences annotated with coarse 3D poses of the hand skeleton. For a 3D point in the hand local coordinate, our model predicts the color and the signed distance with respect to each hand bone independently, and then combines the per-bone predictions using predicted skinning weights. The shape, color and pose representations are disentangled by design, allowing to estimate or animate only selected parameters. We experimentally demonstrate that LISA can accurately reconstruct a dynamic hand from monocular or multi-view sequences, achieving a noticeably higher quality of reconstructed hand shapes compared to baseline approaches. Project page: https://www.iri.upc.edu/people/ecorona/lisa/.


title: Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos

abstract: We propose to forecast future hand-object interactions given an egocentric video. Instead of predicting action labels or pixels, we directly predict the hand motion trajectory and the future contact points on the next active object (i.e., interaction hotspots). This relatively low-dimensional representation provides a concrete description of future interactions. To tackle this task, we first provide an automatic way to collect trajectory and hotspots labels on large-scale data. We then use this data to train an Object-Centric Transformer (OCT) model for prediction. Our model performs hand and object interaction reasoning via the self-attention mechanism in Transformers. OCT also provides a probabilistic framework to sample the future trajectory and hotspots to handle uncertainty in prediction. We perform experiments on the Epic-Kitchens-55, Epic-Kitchens-100, and EGTEA Gaze+ datasets, and show that OCT significantly outperforms state-of-the-art approaches by a large margin. Project page is available at https://stevenlsw.github.io/hoi-forecast .


title: MaxViT: Multi-Axis Vision Transformer

abstract: Transformers have recently gained significant attention in the computer vision community. However, the lack of scalability of self-attention mechanisms with respect to image size has limited their wide adoption in state-of-the-art vision backbones. In this paper we introduce an efficient and scalable attention model we call multi-axis attention, which consists of two aspects: blocked local and dilated global attention. These design choices allow global-local spatial interactions on arbitrary input resolutions with only linear complexity. We also present a new architectural element by effectively blending our proposed attention model with convolutions, and accordingly propose a simple hierarchical vision backbone, dubbed MaxViT, by simply repeating the basic building block over multiple stages. Notably, MaxViT is able to ''see'' globally throughout the entire network, even in earlier, high-resolution stages. We demonstrate the effectiveness of our model on a broad spectrum of vision tasks. On image classification, MaxViT achieves state-of-the-art performance under various settings: without extra data, MaxViT attains 86.5% ImageNet-1K top-1 accuracy; with ImageNet-21K pre-training, our model achieves 88.7% top-1 accuracy. For downstream tasks, MaxViT as a backbone delivers favorable performance on object detection as well as visual aesthetic assessment. We also show that our proposed model expresses strong generative modeling capability on ImageNet, demonstrating the superior potential of MaxViT blocks as a universal vision module. The source code and trained models will be available at https://github.com/google-research/maxvit.


title: The miniJPAS survey: Identification and characterization of the emission line galaxies down to $z < 0.35$ in the AEGIS field

abstract: The Javalambre-Physics of the Accelerating Universe Astrophysical Survey (J-PAS) is expected to map thousands of square degrees of the northern sky with 56 narrowband filters in the upcoming years. This will make J-PAS a very competitive and unbiased emission line survey compared to spectroscopic or narrowband surveys with fewer filters. The miniJPAS survey covered 1 deg$^2$, and it used the same photometric system as J-PAS, but the observations were carried out with the pathfinder J-PAS camera. In this work, we identify and characterize the sample of emission line galaxies (ELGs) from miniJPAS with a redshift lower than $0.35$. Using a method based on artificial neural networks, we detect the ELG population and measure the equivalent width and flux of the $H\alpha$, $H\beta$, [OIII], and [NII] emission lines. We explore the ionization mechanism using the diagrams [OIII]/H$\beta$ versus [NII]/H$\alpha$ (BPT) and EW(H$\alpha$) versus [NII]/H$\alpha$ (WHAN). We identify 1787 ELGs ($83$%) from the parent sample (2154 galaxies) in the AEGIS field. For the galaxies with reliable EW values that can be placed in the WHAN diagram (2000 galaxies in total), we obtained that $72.8 \pm 0.4$%, $17.7 \pm 0.4$% , and $9.4 \pm 0.2$% are star-forming (SF), active galactic nucleus (Seyfert), and quiescent galaxies, respectively. Based on the flux of $H\alpha$ we find that the star formation main sequence is described as $\log$ SFR $[M_\mathrm{\odot} \mathrm{yr}^{-1}] = 0.90^{+ 0.02}_{-0.02} \log M_{\star} [M_\mathrm{\odot}] -8.85^{+ 0.19}_{-0.20}$ and has an intrinsic scatter of $0.20^{+ 0.01}_{-0.01}$. The cosmic evolution of the SFR density ($\rho_{\text{SFR}}$) is derived at three redshift bins: $0 < z \leq 0.15$, $0.15 < z \leq 0.25$, and $0.25 < z \leq 0.35$, which agrees with previous results that were based on measurements of the $H\alpha$ emission line.


title: Surface tension effects on flow dynamics and alveolar mechanics in the acinar region of human lung

abstract: Computational fluid dynamics (CFD) simulations, in-vitro setups, and experimental ex-vivo approaches have been applied to numerous alveolar geometries over the past years. They aimed to study and examine airflow patterns, particle transport, and particle-alveolar wall deposition fractions. These studies are imperative to both pharmaceutical and toxicological studies, especially nowadays with the escalation of the menacing COVID-19 virus. However, most of these studies ignored the surfactant layer that covers the alveoli and the effect of the air-surfactant surface tension on flow dynamics and air-alveolar surface mechanics. The present study employs a realistic human breathing profile of 4.75 to emphasize the importance of the surfactant layer by numerically comparing airflow phenomena between a surfactant-enriched and surfactant-deficient model. The acinar model exhibits physiologically accurate alveolar and duct dimensions extending from lung generations 18 to 23. Proximal lung generations experience dominant recirculating flow while farther generations in the distal alveolar region exhibit dominant radial flows. In the surfactant-enriched model, surface tension values alternate during inhalation and exhalation. In the surfactant-deficient model, only water coats the alveolar walls. Results showed that surfactant deficiency in the alveoli adversely alters airflow behavior and generates unsteady chaotic breathing through the production of vorticities, accompanied by higher vorticity and velocity magnitudes. In addition, high air-water surface tension in the surfactant-deficient case was found to induce higher shear stress values on the alveolar walls than that of the surfactant-enriched case. Overall, it was concluded that the presence of the surfactant improves respiratory mechanics and allows for smooth breathing and normal respiration.


title: Modeling COVID-19 vaccine-induced immunological memory development and its links to antibody level and infectiousness

abstract: COVID-19 vaccines have proven to be effective against SARS-CoV-2 infection. However, the dynamics of vaccine-induced immunological memory development and neutralizing antibodies generation are not fully understood, limiting vaccine development and vaccination regimen determination. Herein, we constructed a mathematical model to characterize the vaccine-induced immune response based on fitting the viral infection and vaccination datasets. With the example of CoronaVac, we revealed the association between vaccine-induced immunological memory development and neutralizing antibody levels. The establishment of the intact immunological memory requires more than 6 months after the first and second doses, after that a booster shot can induce high levels neutralizing antibodies. By introducing the maximum viral load and recovery time after viral infection, we quantitatively studied the protective effect of vaccines against viral infection. Accordingly, we optimized the vaccination regimen, including dose and vaccination timing, and predicted the effect of the fourth dose. Last, by combining the viral transmission model, we showed the suppression of virus transmission by vaccination, which may be instructive for the development of public health policies.


title: QuadraLib: A Performant Quadratic Neural Network Library for Architecture Optimization and Design Exploration

abstract: The significant success of Deep Neural Networks (DNNs) is highly promoted by the multiple sophisticated DNN libraries. On the contrary, although some work have proved that Quadratic Deep Neuron Networks (QDNNs) show better non-linearity and learning capability than the first-order DNNs, their neuron design suffers certain drawbacks from theoretical performance to practical deployment. In this paper, we first proposed a new QDNN neuron architecture design, and further developed QuadraLib, a QDNN library to provide architecture optimization and design exploration for QDNNs. Extensive experiments show that our design has good performance regarding prediction accuracy and computation consumption on multiple learning tasks.


title: Personalized Prediction of Future Lesion Activity and Treatment Effect in Multiple Sclerosis from Baseline MRI

abstract: Precision medicine for chronic diseases such as multiple sclerosis (MS) involves choosing a treatment which best balances efficacy and side effects/preferences for individual patients. Making this choice as early as possible is important, as delays in finding an effective therapy can lead to irreversible disability accrual. To this end, we present the first deep neural network model for individualized treatment decisions from baseline magnetic resonance imaging (MRI) (with clinical information if available) for MS patients. Our model (a) predicts future new and enlarging T2 weighted (NE-T2) lesion counts on follow-up MRI on multiple treatments and (b) estimates the conditional average treatment effect (CATE), as defined by the predicted future suppression of NE-T2 lesions, between different treatment options relative to placebo. Our model is validated on a proprietary federated dataset of 1817 multi-sequence MRIs acquired from MS patients during four multi-centre randomized clinical trials. Our framework achieves high average precision in the binarized regression of future NE-T2 lesions on five different treatments, identifies heterogeneous treatment effects, and provides a personalized treatment recommendation that accounts for treatment-associated risk (e.g. side effects, patient preference, administration difficulties).


title: Symplectic forms on Banach spaces

abstract: We extend and generalize the result of Kalton and Swanson ($Z_2$ is a symplectic Banach space with no Lagrangian subspace) by showing that all higher order Rochgberg spaces $\mathfrak R^{(n)}$ are symplectic Banach spaces with no Lagrangian subspaces. The nontrivial symplectic structure on even spaces is the one induced by the natural duality; while the nontrivial symplectic structure on odd spaces requires perturbation with a complex structure. We will also study symplectic structures on general Banach spaces and, motivated by the unexpected appearance of complex structures, we introduce and study almost symplectic structures.


title: Twisted sums of $c_0(I)$

abstract: The paper studies properties of twisted sums of a Banach space $X$ with $c_0(\kappa)$. We first prove a representation theorem for such twisted sums from which we will obtain, among others, the following: (a) twisted sums of $c_0(I)$ and $c_0(\kappa)$ are either subspaces of $\ell_\infty(\kappa)$ or trivial on a copy of $c_0(\kappa^+)$; (b) under the hypothesis $[\mathfrak p = \mathfrak c]$, when $K$ is either a suitable Corson compact, a separable Rosenthal compact or a scattered compact of finite height, there is a twisted sum of $C(K)$ with $c_0(\kappa)$ that is not isomorphic to a space of continuous functions; (c) all such twisted sums are Lindenstrauss spaces when $X$ is a Lindenstrauss space and $G$-spaces when $X=C(K)$ with $K$ convex, which shows tat a result of Benyamini is optimal; (d) they are isomorphically polyhedral when $X$ is a polyhedral space with property ($\star$), which solves a problem of Castillo and Papini.


title: Learning to Accelerate by the Methods of Step-size Planning

abstract: Gradient descent is slow to converge for ill-conditioned problems and non-convex problems. An important technique for acceleration is step-size adaptation. The first part of this paper contains a detailed review of step-size adaptation methods, including Polyak step-size, L4, LossGrad, Adam, IDBD, and Hypergradient descent, and the relation of step-size adaptation to meta-gradient methods. In the second part of this paper, we propose a new class of methods of accelerating gradient descent that have some distinctiveness from existing techniques. The new methods, which we call {\em step-size planning}, use the {\em update experience} to learn an improved way of updating the parameters. The methods organize the experience into $K$ steps away from each other to facilitate planning. From the past experience, our planning algorithm, Csawg, learns a step-size model which is a form of multi-step machine that predicts future updates. We extends Csawg to applying step-size planning multiple steps, which leads to further speedup. We discuss and highlight the projection power of the diagonal-matrix step-size for future large scale applications. We show for a convex problem, our methods can surpass the convergence rate of Nesterov's accelerated gradient, $1 - \sqrt{\mu/L}$, where $\mu, L$ are the strongly convex factor of the loss function $F$ and the Lipschitz constant of $F'$, which is the theoretical limit for the convergence rate of first-order methods. On the well-known non-convex Rosenbrock function, our planning methods achieve zero error below 500 gradient evaluations, while gradient descent takes about 10000 gradient evaluations to reach a $10^{-3}$ accuracy. We discuss the connection of step-size planing to planning in reinforcement learning, in particular, Dyna architectures. (This is a shorter abstract than in the paper because of length requirement)


title: Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers

abstract: Research studies have shown no qualms about using data driven deep learning models for downstream tasks in medical image analysis, e.g., anatomy segmentation and lesion detection, disease diagnosis and prognosis, and treatment planning. However, deep learning models are not the sovereign remedy for medical image analysis when the upstream imaging is not being conducted properly (with artefacts). This has been manifested in MRI studies, where the scanning is typically slow, prone to motion artefacts, with a relatively low signal to noise ratio, and poor spatial and/or temporal resolution. Recent studies have witnessed substantial growth in the development of deep learning techniques for propelling fast MRI. This article aims to (1) introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods, (2) survey the attention and transformer based models for speeding up MRI reconstruction, and (3) detail the research in coupling physics and data driven models for MRI acceleration. Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies, and discuss common pitfalls in current research and recommendations for future research directions.


title: Quadratic Neuron-empowered Heterogeneous Autoencoder for Unsupervised Anomaly Detection

abstract: Inspired by the complexity and diversity of biological neurons, a quadratic neuron is proposed to replace the inner product in the current neuron with a simplified quadratic function. Employing such a novel type of neurons offers a new perspective on developing deep learning. When analyzing quadratic neurons, we find that there exists a function such that a heterogeneous network can approximate it well with a polynomial number of neurons but a purely conventional or quadratic network needs an exponential number of neurons to achieve the same level of error. Encouraged by this inspiring theoretical result on heterogeneous networks, we directly integrate conventional and quadratic neurons in an autoencoder to make a new type of heterogeneous autoencoders. To our best knowledge, it is the first heterogeneous autoencoder that is made of different types of neurons. Next, we apply the proposed heterogeneous autoencoder to unsupervised anomaly detection for tabular data and bearing fault signals. The anomaly detection faces difficulties such as data unknownness, anomaly feature heterogeneity, and feature unnoticeability, which is suitable for the proposed heterogeneous autoencoder. Its high feature representation ability can characterize a variety of anomaly data (heterogeneity), discriminate the anomaly from the normal (unnoticeability), and accurately learn the distribution of normal samples (unknownness). Experiments show that heterogeneous autoencoders perform competitively compared to other state-of-the-art models.