title: Isoparametric hypersurfaces of Riemannian manifolds as initial data for the mean curvature flow

abstract: We show that the evolution of isoparametric hypersurfaces of Riemannian manifolds by the mean curvature flow is given by a reparametrization of the parallel family in short time, as long as the uniqueness of the mean curvature flow holds for the initial data and the corresponding ambient space. As an application, we provide a class of Riemannian manifolds that admit hypersurfaces with constant principal curvatures, which are not isoparametric hypersurfaces. Furthermore, for a class of ambient spaces, we show that the singularities developed by the mean curvature flow with isoparametric hypersurfaces as the initial data are Type I singularities. We apply our results to describe the evolution of isoparametric hypersurfaces by the mean curvature flow in ambient spaces with nonconstant sectional curvature, such as homogenous 3-manifolds $\mathbb{E}(\kappa, \tau)$ with 4-dimensional isometry groups, and Riemannian products $\mathbb{Q}^2_{c_1} \times \mathbb{Q}^2_{c_2}$ of space forms.


title: The Mysterious Affair of the H$_2$ in AU Mic

abstract: Molecular hydrogen is the most abundant molecule in the Galaxy and plays important roles for planets, their circumstellar environments, and many of their host stars. We have confirmed the presence of molecular hydrogen in the AU Mic system using high-resolution FUV spectra from HST-STIS during both quiescence and a flare. AU Mic is a $\sim$23 Myr M dwarf which hosts a debris disk and at least two planets. We estimate the temperature of the gas at 1000 to 2000 K, consistent with previous detections. Based on the radial velocities and widths of the H$_2$ line profiles and the response of the H$_2$ lines to a stellar flare, the H$_2$ line emission is likely produced in the star, rather than in the disk or the planet. However, the temperature of this gas is significantly below the temperature of the photosphere ($\sim$3650 K) and the predicted temperature of its star spots ($\gtrsim$2650 K). We discuss the possibility of colder star spots or a cold layer in the photosphere of a pre-main sequence M dwarf.


title: Improving the performance of quantum approximate optimization for preparing non-trivial quantum states without translational symmetry

abstract: The variational preparation of complex quantum states using the quantum approximate optimization algorithm (QAOA) is of fundamental interest, and becomes a promising application of quantum computers. Here, we systematically study the performance of QAOA for preparing ground states of target Hamiltonians near the critical points of their quantum phase transitions, and generating Greenberger-Horne-Zeilinger (GHZ) states. We reveal that the performance of QAOA is related to the translational invariance of the target Hamiltonian: Without the translational symmetry, for instance due to the open boundary condition (OBC) or randomness in the system, the QAOA becomes less efficient. We then propose a generalized QAOA assisted by the parameterized resource Hamiltonian (PRH-QAOA), to achieve a better performance. In addition, based on the PRH-QAOA, we design a low-depth quantum circuit beyond one-dimensional geometry, to generate GHZ states with perfect fidelity. The experimental realization of the proposed scheme for generating GHZ states on Rydberg-dressed atoms is discussed. Our work paves the way for performing QAOA on programmable quantum processors without translational symmetry, especially for recently developed two-dimensional quantum processors with OBC.


title: Momentum Gauge Fields and Non-Commutative Space-Time

abstract: In this work we present a gauge principle that starts with the momentum space representation of the position operator (${\hat x}_i = i \hbar \frac{\partial}{\partial p_i}$) rather than starting with the position space representation of the momentum operator (${\hat p}_i = -i \hbar \frac{\partial}{\partial x_i}$). We discuss some simple examples with this new type of gauge theory: (i) analog solutions from ordinary gauge theory in this momentum gauge theory, (ii) Landau levels using momentum gauge fields, (iii) the emergence of non-commutative space-times from the momentum gauge fields. We find that the non-commutative space-time parameter can be momentum dependent, and one can construct a model where space-time is commutative at low momentum but becomes non-commutative at high momentum.


title: Continuous-Time Analog Filters for Audio Edge Intelligence: Review on Circuit Designs

abstract: Edge audio devices can reduce data bandwidth requirements by pre-processing input speech on the device before transmission to the cloud. As edge devices are required to ensure always-on operation, their stringent power constraints pose several design challenges and force IC designers to look for solutions that use low standby power. One promising bio-inspired approach is to combine the continuous-time analog filter channels with a small memory footprint deep neural network that is trained on edge tasks such as keyword spotting, thereby allowing all blocks to be embedded in an IC. This paper reviews the historical background of the continuous-time analog filter circuits that have been used as feature extractors for current edge audio devices. Starting from the interpretation of a basic biquad filter as a two-integrator-loop topology, we introduce the progression in the design of second-order low-pass and band-pass filters ranging from OTA-based to source-follower-based architectures. We also derive and analyze the small-signal transfer function and discuss their usage in edge audio applications.


title: Policy Optimization for Markov Games: Unified Framework and Faster Convergence

abstract: This paper studies policy optimization algorithms for multi-agent reinforcement learning. We begin by proposing an algorithm framework for two-player zero-sum Markov Games in the full-information setting, where each iteration consists of a policy update step at each state using a certain matrix game algorithm, and a value update step with a certain learning rate. This framework unifies many existing and new policy optimization algorithms. We show that the state-wise average policy of this algorithm converges to an approximate Nash equilibrium (NE) of the game, as long as the matrix game algorithms achieve low weighted regret at each state, with respect to weights determined by the speed of the value updates. Next, we show that this framework instantiated with the Optimistic Follow-The-Regularized-Leader (OFTRL) algorithm at each state (and smooth value updates) can find an $\mathcal{\widetilde{O}}(T^{-5/6})$ approximate NE in $T$ iterations, and a similar algorithm with slightly modified value update rule achieves a faster $\mathcal{\widetilde{O}}(T^{-1})$ convergence rate. These improve over the current best $\mathcal{\widetilde{O}}(T^{-1/2})$ rate of symmetric policy optimization type algorithms. We also extend this algorithm to multi-player general-sum Markov Games and show an $\mathcal{\widetilde{O}}(T^{-3/4})$ convergence rate to Coarse Correlated Equilibria (CCE). Finally, we provide a numerical example to verify our theory and investigate the importance of smooth value updates, and find that using "eager" value updates instead (equivalent to the independent natural policy gradient algorithm) may significantly slow down the convergence, even on a simple game with $H=2$ layers.


title: Necessary and sufficient conditions to solve parabolic Anderson model with rough noise

abstract: We obtain necessary and sufficient condition for the existence of $n$-th chaos of the solution to the parabolic Anderson model $\frac{\partial}{\partial t}u(t,x)=\frac{1}{2}\Delta u(t,x)+u(t,x)\dot{W}(t,x)$, where $\dot{W}(t,x)$ is a fractional Brownian field with temporal Hurst parameter $H_0\ge 1/2$ and spatial parameters $H$ $ =(H_1, \cdots, H_d)$ $ \in (0, 1)^d$. When $d=1$, we extend the condition on the parameters under which the chaos expansion of the solution is convergent in the mean square sense, which is both sufficient and necessary under some circumstances.


title: The Kuramoto model on dynamic random graphs

abstract: We propose a Kuramoto model of coupled oscillators on a time-varying graph, whose dynamics is dictated by a Markov process in the space of graphs. The simplest representative is considering a base graph and then the subgraph determined by $N$ independent random walks on the underlying graph. We prove a synchronization result for solutions starting from a phase-cohesive set independent of the speed of the random walkers, an averaging principle and a global synchronization result with high probability for sufficiently fast processes. We also consider Kuramoto oscillators in a dynamical version of the Random Conductance Model.


title: A symbolic algorithm for exact polynomial optimization strengthened with Fritz John conditions

abstract: Consider a polynomial optimization problem. Adding polynomial equations generated by the Fritz John conditions to the constraint set does not change the optimal value. As proved in [arXiv:2205.04254 (2022)], the objective polynomial has finitely many values on the new constraint set under some genericity assumption. Based on this, we provide an algorithm that allows us to compute exactly this optimal value. Our method depends on the computations of real radical generators and Gr\"obner basis. Finally, we apply our method to solve some instances of mathematical program with complementarity constraints.


title: Accelerating inference for stochastic kinetic models

abstract: Stochastic kinetic models (SKMs) are increasingly used to account for the inherent stochasticity exhibited by interacting populations of species in areas such as epidemiology, population ecology and systems biology. Species numbers are modelled using a continuous-time stochastic process, and, depending on the application area of interest, this will typically take the form of a Markov jump process or an It\^o diffusion process. Widespread use of these models is typically precluded by their computational complexity. In particular, performing exact fully Bayesian inference in either modelling framework is challenging due to the intractability of the observed data likelihood, necessitating the use of computationally intensive techniques such as particle Markov chain Monte Carlo (particle MCMC). It is proposed to increase the computational and statistical efficiency of this approach by leveraging the tractability of an inexpensive surrogate derived directly from either the jump or diffusion process. The surrogate is used in three ways: in the design of a gradient-based parameter proposal, to construct an appropriate bridge and in the first stage of a delayed-acceptance step. The resulting approach, which exactly targets the posterior of interest, offers substantial gains in efficiency over a standard particle MCMC implementation.


title: Strouhal number universality in high-speed cylinder wake flows

abstract: Flow oscillations in the near-wake region of a 2D circular cylinder are experimentally investigated at Mach 6 over the Reynolds number range $2.3\times10^5$ to $5\times10^5$. The oscillation frequency is obtained by spectral proper orthogonal decomposition of high-speed schlieren data. The Strouhal number based on the length of the near-wake shear layers is found to exhibit universal behavior. This corroborates experimental findings at Mach 4 from recent literature, and further, the universal behavior is also seen to hold with respect to Mach number. Time-resolved pressure measurements at the flow separation points on the cylinder aft surface show that coherent oscillatory activity occurs with a phase difference of $\pi$ radians between the two statistically-symmetric halves of the flow. This aspect of the flow dynamics at high speeds is in common with its low-speed counterpart, i.e. the canonical problem of cylinder wake in an incompressible flow.


title: Manifolds with trivial Chern classes I: Hyperelliptic Manifolds and a question by Severi

abstract: We give a negative answer to a question posed by Severi in 1951, whether the Abelian Varieties are the only projective manifolds with trivial Chern classes. By Yau' s celebrated result, compact K\"ahler manifolds with trivial Chern classes must be flat, that is, they belong to the class of Hyperelliptic Manifolds (quotients $T/G$ of a complex torus $T$ by the free action of a finite group $G$). We exhibit simple examples of projective Hyperelliptic Manifolds which are not Abelian varieties and whose Chern classes are zero not only in integral cohomology, but also in the Chow ring. We prove moreover that the Bagnera-de Franchis manifolds (quotients $T/G$ as above but where the group $ G$ is cyclic) have topologically trivial tangent bundle. Our results naturally lead to the question of classifying all compact K\"ahler manifolds with topologically trivial tangent bundle, and all the counterexamples to Severi's question.


title: Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

abstract: Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384384). For gigapixel whole-slide imaging (WSI) in computational pathology, WSIs can be as large as 150000x150000 pixels at 20X magnification and exhibit a hierarchical structure of visual tokens across varying resolutions: from 16x16 images capture spatial patterns among cells, to 4096x4096 images characterizing interactions within the tissue microenvironment. We introduce a new ViT architecture called the Hierarchical Image Pyramid Transformer (HIPT), which leverages the natural hierarchical structure inherent in WSIs using two levels of self-supervised learning to learn high-resolution image representations. HIPT is pretrained across 33 cancer types using 10,678 gigapixel WSIs, 408,218 4096x4096 images, and 104M 256x256 images. We benchmark HIPT representations on 9 slide-level tasks, and demonstrate that: 1) HIPT with hierarchical pretraining outperforms current state-of-the-art methods for cancer subtyping and survival prediction, 2) self-supervised ViTs are able to model important inductive biases about the hierarchical structure of phenotypes in the tumor microenvironment.


title: A Level-Set Immersed Boundary Method for Incompressible Flows at Subcritical Reynolds Numbers

abstract: In this work, a numerical scheme based on a level-set immersed boundary method is employed for the numerical simulation of the flow around two tandem circular cylinders in the subcritical flow regimes. Three different spacing ratios $\ell/\mathcal{D}$ (where $\ell$ is the center-to-center distance between the two cylinders with $\mathcal{D}$ being the diameter of the cylinders) from $2$ to $4$ is considered. The instantaneous flow structures, pressure distributions and hydrodynamic forces on two tandem cylinders are analyzed at a Reynolds number of $\mathcal{R}\mathfrak{e}=2.2\times 10^4$. The strategy is based on a combination of a narrow-band accurate conservative level set method and ghost-fluid framework. In this strategy, the interface is defined as the isocontour of a hyperbolic tangent function, which is advected by the fluid, and then periodically reshaped to enforce the degraded level set function being a signed distance function using a reinitialization equation based on an improved form. The latter approach takes advantage of a mapping onto a classical distance level set while much better preserving the interface shape.


title: Measurement of the Proton Maximum Acceleration Energy in Galactic Cosmic Rays

abstract: Cosmic rays represent one of the most important energy transformation processes of the universe. They bring information about the surrounding universe, our galaxy, and very probably also the extragalactic space, at least at the highest observed energies. More than one century after their discovery, we have no definitive models yet about the origin, acceleration and propagation processes of the radiation. The main reason is that there are still significant discrepancies among the results obtained by different experiments, probably due to some still unknown systematic uncertainties affecting the measurements. In this paper, we will focus on the detection of galactic cosmic rays in the 10$^{15}$ eV energy range, where the so-called \emph{`knee'} in the all-particle energy spectrum is observed. The measurement of the (p+He) energy spectrum is presented and discussed.


title: Turaev-Viro TQFT and the Rank versus Genus Conjecture

abstract: This paper presents a way to estimate the Heegaard genus of a $3$-manifold using the Turaev-Viro state sum TQFT. The Turaev-Viro state sum TQFT is derived from the modular category associated to the quantum group $U_q(\mathfrak{sl}_2)$, which is unitary for some $q$ by Wenzl. Hence by Turaev and Virelizier the corresponding TQFT is unitary. We modify a proof by Garoufalidis to give a lower bound of the Heegaard genus using a unitary TQFT, and then use the software Regina to provide some known counterexamples to the rank versus genus conjecture.


title: The open Haldane-Shastry chain: thermodynamics and criticality

abstract: We study the thermodynamics and criticality of the su($m|n$) Haldane-Shastry chain of $BC_N$ type with a general chemical potential term. We first derive a complete description of the spectrum of this model in terms of $BC_N$-type motifs, from which we deduce a representation for the partition function as the trace of a product of site-dependent transfer matrices. In the thermodynamic limit, this formula yields a simple expression for the free energy per spin in terms of the Perron-Frobenius eigenvalue of the continuum limit of the transfer matrix. Evaluating this eigenvalue we obtain closed-form expressions for the thermodynamic functions of the chains with $m,n\le2$. Using the motif-based description of the spectrum derived here, we study in detail the ground state of these models and their low energy excitations. In this way we identify the critical intervals in chemical potential space and compute their corresponding Fermi velocities. By contrast with previously studied models of this type, we find in some cases two types of low energy excitations with linear energy-quasimomentum relation. Finally, we determine the central charge of all the critical phases by analyzing the low-temperature behavior of the expression for the free energy per spin.

categories: cond-mat.stat-mech math-ph math.MP nlin.SI quant-ph


title: Crust Macrofracturing as the Evidence of the Last Deglaciation

abstract: Machine learning methods were applied to reconsider the results of several passive seismic experiments in Finland. We created datasets from different stages of the receiver function technique and processed them with one of basic machine learning algorithms. All the results were obtained uniformly with the $k$-nearest neighbors algorithm. The first result is the Moho depth map of the region. Another result is the delineation of the near-surface low $S$-wave velocity layer. There are three such areas in the Northern, Southern, and central parts of the region. The low $S$-wave velocity in the Northern and Southern areas can be linked to the geological structure. However, we attribute the central low $S$-wave velocity area to a large number of water-saturated cracks in the upper 1-5 km. Analysis of the structure of this area leads us to the conclusion that macrofracturing was caused by the last deglaciation.


title: Abstraction-Refinement for Hierarchical Probabilistic Models

abstract: Markov decision processes are a ubiquitous formalism for modelling systems with non-deterministic and probabilistic behavior. Verification of these models is subject to the famous state space explosion problem. We alleviate this problem by exploiting a hierarchical structure with repetitive parts. This structure not only occurs naturally in robotics, but also in probabilistic programs describing, e.g., network protocols. Such programs often repeatedly call a subroutine with similar behavior. In this paper, we focus on a local case, in which the subroutines have a limited effect on the overall system state. The key ideas to accelerate analysis of such programs are (1) to treat the behavior of the subroutine as uncertain and only remove this uncertainty by a detailed analysis if needed, and (2) to abstract similar subroutines into a parametric template, and then analyse this template. These two ideas are embedded into an abstraction-refinement loop that analyses hierarchical MDPs. A prototypical implementation shows the efficacy of the approach.


title: Zero-free regions of the Riemann zeta function and approximation in weighted Dirichlet spaces

abstract: We study zero-free regions of the Riemann zeta function $\zeta$ related to an approximation problem in the weighted Dirichlet space $D_{-2}$ which is known to be equivalent to the Riemann Hypothesis since the work of B\'aez-Duarte. We prove, indeed, that analogous approximation problems for the standard weighted Dirichlet spaces $D_{\alpha}$ when $\alpha \in (-3,-2)$ give conditions so that the half-plane $\{s \in \mathbb{C}: \Re (s) > -\frac{\alpha+1}{2}\}$ is also zero-free for $\zeta$. Moreover, we extend such results to a large family of weighted spaces of analytic functions $\ell^p_{\alpha}$. As a particular instance, in the limit case $p=1$ and $\alpha=-2$, we provide a new equivalent formulation of the Prime Number Theorem.


title: Comprehensive simulation of heavy-ion collisions at non-zero baryon chemical potential

abstract: We present results of hydrodynamic modelling of Au-Au collisions from $\sqrt{s_{NN}}$ = 7.7 to 200 GeV. Our simulations have three novel components. Firstly, we use a Linear EXtrapolation of Ultrarelativistic nucleon-nucleon Scattering to nucleus-nucleus collisions (LEXUS) inspired Monte-Carlo initial state model. Secondly, we use a crossover equation of state at finite baryon densities without a critical point. Finally, we use departure functions derived from the quasiparticle theory of transport coefficients for hadronic matter at non-zero baryon densities.


title: A Regret-Variance Trade-Off in Online Learning

abstract: We consider prediction with expert advice for strongly convex and bounded losses, and investigate trade-offs between regret and "variance" (i.e., squared difference of learner's predictions and best expert predictions). With $K$ experts, the Exponentially Weighted Average (EWA) algorithm is known to achieve $O(\log K)$ regret. We prove that a variant of EWA either achieves a negative regret (i.e., the algorithm outperforms the best expert), or guarantees a $O(\log K)$ bound on both variance and regret. Building on this result, we show several examples of how variance of predictions can be exploited in learning. In the online to batch analysis, we show that a large empirical variance allows to stop the online to batch conversion early and outperform the risk of the best predictor in the class. We also recover the optimal rate of model selection aggregation when we do not consider early stopping. In online prediction with corrupted losses, we show that the effect of corruption on the regret can be compensated by a large variance. In online selective sampling, we design an algorithm that samples less when the variance is large, while guaranteeing the optimal regret bound in expectation. In online learning with abstention, we use a similar term as the variance to derive the first high-probability $O(\log K)$ regret bound in this setting. Finally, we extend our results to the setting of online linear regression.


title: Inducing intermittency in the inverse cascade of two dimensional turbulence by a fractal forcing

abstract: We demonstrate that like in the forward cascade of three dimensional turbulence that displays intermittency (lack of self-similarity) due to the concentration of energy dissipation in a small set of fractal dimension less than three, the inverse cascade of two-dimensional turbulence can also display lack of self-similarity and intermittency if the energy injection is constrained in a fractal set of dimension less than two. A series of numerical simulations of two dimensional turbulence are examined, using different forcing functions of the same forcing length-scale but different fractal dimension $D$ that varies from the classical $D=2$ case to the point vortex case $D=0$. It is shown that as the fractal dimension of the forcing is decreased from $D=2$, the self-similarity is lost and intermittency appears, with the scaling of the different structure functions $\langle |\delta u_\|^p| \rangle\propto r^{\zeta_p}$ differs from the dimensional analysis prediction $\zeta_p=p/3$. The present model thus provides a unique example that intermittency is controlled and can thus shed light and provide test beds for multi-fractal models of turbulence.


title: Longitudinal Analysis of Privacy Labels in the Apple App Store

abstract: In December of 2020, Apple started to require app developers to self-report privacy label annotations on their apps indicating what data is collected and how it is used.To understand the adoption and shifts in privacy labels in the App Store, we collected nearly weekly snapshots of over 1.6 million apps for over a year (July 15, 2021 -- October 25, 2022) to understand the dynamics of privacy label ecosystem. Nearly two years after privacy labels launched, only 70.1% of apps have privacy labels, but we observed an increase of 28% during the measurement period. Privacy label adoption rates are mostly driven by new apps rather than older apps coming into compliance. Of apps with labels, 18.1% collect data used to track users, 38.1% collect data that is linked to a user identity, and 42.0% collect data that is not linked. A surprisingly large share (41.8%) of apps with labels indicate that they do not collect any data, and while we do not perform direct analysis of the apps to verify this claim, we observe that it is likely that many of these apps are choosing a Does Not Collect label due to being forced to select a label, rather than this being the true behavior of the app. Moreover, for apps that have assigned labels during the measurement period nearly all do not change their labels, and when they do, the new labels indicate more data collection than less. This suggests that privacy labels may be a ``set once'' mechanism for developers that may not actually provide users with the clarity needed to make informed privacy decisions.


title: Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees

abstract: We consider fine-tuning a pretrained deep neural network on a target task. We study the generalization properties of fine-tuning to understand the problem of overfitting, which has often been observed (e.g., when the target dataset is small or when the training labels are noisy). Existing generalization measures for deep networks depend on notions such as distance from the initialization (i.e., the pretrained network) of the fine-tuned model and noise stability properties of deep networks. This paper identifies a Hessian-based distance measure through PAC-Bayesian analysis, which is shown to correlate well with observed generalization gaps of fine-tuned models. Theoretically, we prove Hessian distance-based generalization bounds for fine-tuned models. We also describe an extended study of fine-tuning against label noise, where overfitting remains a critical problem. We present an algorithm and a generalization error guarantee for this algorithm under a class conditional independent noise model. Empirically, we observe that the Hessian-based distance measure can match the scale of the observed generalization gap of fine-tuned models in practice. We also test our algorithm on several image classification tasks with noisy training labels, showing gains over prior methods and decreases in the Hessian distance measure of the fine-tuned model.


title: Pseudo-Hamiltonian Neural Networks with State-Dependent External Forces

abstract: Hybrid machine learning based on Hamiltonian formulations has recently been successfully demonstrated for simple mechanical systems, both energy conserving and not energy conserving. We introduce a pseudo-Hamiltonian formulation that is a generalization of the Hamiltonian formulation via the port-Hamiltonian formulation, and show that pseudo-Hamiltonian neural network models can be used to learn external forces acting on a system. We argue that this property is particularly useful when the external forces are state dependent, in which case it is the pseudo-Hamiltonian structure that facilitates the separation of internal and external forces. Numerical results are provided for a forced and damped mass-spring system and a tank system of higher complexity, and a symmetric fourth-order integration scheme is introduced for improved training on sparse and noisy data.


title: Evaluating Deep Taylor Decomposition for Reliability Assessment in the Wild

abstract: We argue that we need to evaluate model interpretability methods 'in the wild', i.e., in situations where professionals make critical decisions, and models can potentially assist them. We present an in-the-wild evaluation of token attribution based on Deep Taylor Decomposition, with professional journalists performing reliability assessments. We find that using this method in conjunction with RoBERTa-Large, fine-tuned on the Gossip Corpus, led to faster and better human decision-making, as well as a more critical attitude toward news sources among the journalists. We present a comparison of human and model rationales, as well as a qualitative analysis of the journalists' experiences with machine-in-the-loop decision making.


title: Medical Coding with Biomedical Transformer Ensembles and Zero/Few-shot Learning

abstract: Medical coding (MC) is an essential pre-requisite for reliable data retrieval and reporting. Given a free-text reported term (RT) such as "pain of right thigh to the knee", the task is to identify the matching lowest-level term (LLT) - in this case "unilateral leg pain" - from a very large and continuously growing repository of standardized medical terms. However, automating this task is challenging due to a large number of LLT codes (as of writing over 80,000), limited availability of training data for long tail/emerging classes, and the general high accuracy demands of the medical domain. With this paper, we introduce the MC task, discuss its challenges, and present a novel approach called xTARS that combines traditional BERT-based classification with a recent zero/few-shot learning approach (TARS). We present extensive experiments that show that our combined approach outperforms strong baselines, especially in the few-shot regime. The approach is developed and deployed at Bayer, live since November 2021. As we believe our approach potentially promising beyond MC, and to ensure reproducibility, we release the code to the research community.


title: TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning

abstract: With the extensive applications of machine learning models, automatic hyperparameter optimization (HPO) has become increasingly important. Motivated by the tuning behaviors of human experts, it is intuitive to leverage auxiliary knowledge from past HPO tasks to accelerate the current HPO task. In this paper, we propose TransBO, a novel two-phase transfer learning framework for HPO, which can deal with the complementary nature among source tasks and dynamics during knowledge aggregation issues simultaneously. This framework extracts and aggregates source and target knowledge jointly and adaptively, where the weights can be learned in a principled manner. The extensive experiments, including static and dynamic transfer learning settings and neural architecture search, demonstrate the superiority of TransBO over the state-of-the-arts.


title: Learning with Capsules: A Survey

abstract: Capsule networks were proposed as an alternative approach to Convolutional Neural Networks (CNNs) for learning object-centric representations, which can be leveraged for improved generalization and sample complexity. Unlike CNNs, capsule networks are designed to explicitly model part-whole hierarchical relationships by using groups of neurons to encode visual entities, and learn the relationships between those entities. Promising early results achieved by capsule networks have motivated the deep learning community to continue trying to improve their performance and scalability across several application areas. However, a major hurdle for capsule network research has been the lack of a reliable point of reference for understanding their foundational ideas and motivations. The aim of this survey is to provide a comprehensive overview of the capsule network research landscape, which will serve as a valuable resource for the community going forward. To that end, we start with an introduction to the fundamental concepts and motivations behind capsule networks, such as equivariant inference in computer vision. We then cover the technical advances in the capsule routing mechanisms and the various formulations of capsule networks, e.g. generative and geometric. Additionally, we provide a detailed explanation of how capsule networks relate to the popular attention mechanism in Transformers, and highlight non-trivial conceptual similarities between them in the context of representation learning. Afterwards, we explore the extensive applications of capsule networks in computer vision, video and motion, graph representation learning, natural language processing, medical imaging and many others. To conclude, we provide an in-depth discussion regarding the main hurdles in capsule network research, and highlight promising research directions for future work.


title: Absence of a COVID-induced academic drop in high-school physics learning

abstract: At the start of the COVID 19 pandemic, the majority of secondary instruction in the United States transitioned to an online environment. In many parts of the country, online schooling continued for upwards of two years. Many experts have hypothesized an "academic slide" (a reduction in student learning) following this period of online instruction. We investigated the change in student preparation for introductory college physics in incoming Stanford university students between the Fall term of 2019 to the Fall term of 2021. We did this by looking at the performance on a validated physics diagnostic exam that all Stanford students intending to take a physics course took before enrolling in an introductory physics course. We found no statistically or educationally significant change in scores. Despite many anecdotal faculty reports, at least for this population, the level of student preparation in physics and related math appears to be unchanged.


title: Robust Pareto Set Identification with Contaminated Bandit Feedback

abstract: We consider the Pareto set identification (PSI) problem in multi-objective multi-armed bandits (MO-MAB) with contaminated reward observations. At each arm pull, with some probability, the true reward samples are replaced with the samples from an arbitrary contamination distribution chosen by the adversary. We propose a median-based MO-MAB algorithm for robust PSI that abides by the accuracy requirements set by the user via an accuracy parameter. We prove that the sample complexity of this algorithm depends on the accuracy parameter inverse squarely. We compare the proposed algorithm with a mean-based method from MO-MAB literature on Gaussian reward distributions. Our numerical results verify our theoretical expectations and show the necessity for robust algorithm design in the adversarial setting.


title: Emergent specialization from participation dynamics and multi-learner retraining

abstract: Numerous online services are data-driven: the behavior of users affects the system's parameters, and the system's parameters affect the users' experience of the service, which in turn affects the way users may interact with the system. For example, people may choose to use a service only for tasks that already works well, or they may choose to switch to a different service. These adaptations influence the ability of a system to learn about a population of users and tasks in order to improve its performance broadly. In this work, we analyze a class of such dynamics -- where users allocate their participation amongst services to reduce the individual risk they experience, and services update their model parameters to reduce the service's risk on their current user population. We refer to these dynamics as \emph{risk-reducing}, which cover a broad class of common model updates including gradient descent and multiplicative weights. For this general class of dynamics, we show that asymptotically stable equilibria are always segmented, with sub-populations allocated to a single learner. Under mild assumptions, the utilitarian social optimum is a stable equilibrium. In contrast to previous work, which shows that repeated risk minimization can result in (Hashimoto et al., 2018; Miller et al., 2021), we find that repeated myopic updates with multiple learners lead to better outcomes. We illustrate the phenomena via a simulated example initialized from real data.


title: Ill-posedness issue on a multidimensional chemotaxis equations in the critical Besov spaces

abstract: In this paper, we aim to solving the open question left in [Nie, Yuan: Nonlinear Anal 196 (2020); J. Math. Anal. Appl 505 (2022)) and Xiao, Fei: J. Math. Anal. Appl 514 (2022)]. We prove that a multidimensional chemotaxis system is ill-posedness in $\dot{B}_{2d, r}^{-\frac{3}{2}} \times\big(\dot{B}_{2d, r}^{-\frac{1}{2}}\big)^{d}$ when $1\leq r<d$ due to the lack of continuity of the solution.


title: A survey of HDCO and D$_{2}$CO towards Class 0/I proto-brown dwarfs

abstract: Deuterium fractionation can constrain the physical and chemical conditions at the early stage of brown dwarf formation. We present IRAM 30m observations over a wide frequency range of 213-279 GHz of singly and doubly deuterated species of formaldehyde (HDCO and D$_{2}$CO) towards Class 0/I proto-brown dwarfs (proto-BDs). Multiple low-excitation HDCO and D$_{2}$CO transition lines with upper energy level $\leq$ 40 K are detected. The D$_{2}$CO/HDCO, HDCO/H$_{2}$CO, D$_{2}$CO/H$_{2}$CO abundance ratios range between 0.01 and 2.5 for the proto-BDs, similar to the range seen in low-mass protostars. The highest ratios of D$_{2}$CO/HDCO $\sim$1.3-2.5 are measured for two Stage 0 proto-BDs. These objects could possess a warm corino, similar to the few hot corino cases reported among Class 0 protostars. The mean D$_{2}$CO/HDCO, D$_{2}$CO/H$_{2}$CO, and HDCO/H$_{2}$CO ratios for the proto-BDs are comparatively higher than the range predicted by the current gas-grain chemical models, indicating that HDCO and D$_{2}$CO are formed via grain surface reactions in the dense and cold interiors of the proto-BDs at an early formation stage.


title: Robust Adversarial Attacks Detection based on Explainable Deep Reinforcement Learning For UAV Guidance and Planning

abstract: The dangers of adversarial attacks on Uncrewed Aerial Vehicle (UAV) agents operating in public are increasing. Adopting AI-based techniques and, more specifically, Deep Learning (DL) approaches to control and guide these UAVs can be beneficial in terms of performance but can add concerns regarding the safety of those techniques and their vulnerability against adversarial attacks. Confusion in the agent's decision-making process caused by these attacks can seriously affect the safety of the UAV. This paper proposes an innovative approach based on the explainability of DL methods to build an efficient detector that will protect these DL schemes and the UAVs adopting them from attacks. The agent adopts a Deep Reinforcement Learning (DRL) scheme for guidance and planning. The agent is trained with a Deep Deterministic Policy Gradient (DDPG) with Prioritised Experience Replay (PER) DRL scheme that utilises Artificial Potential Field (APF) to improve training times and obstacle avoidance performance. A simulated environment for UAV explainable DRL-based planning and guidance, including obstacles and adversarial attacks, is built. The adversarial attacks are generated by the Basic Iterative Method (BIM) algorithm and reduced obstacle course completion rates from 97\% to 35\%. Two adversarial attack detectors are proposed to counter this reduction. The first one is a Convolutional Neural Network Adversarial Detector (CNN-AD), which achieves accuracy in the detection of 80\%. The second detector utilises a Long Short Term Memory (LSTM) network. It achieves an accuracy of 91\% with faster computing times compared to the CNN-AD, allowing for real-time adversarial detection.


title: Canonical Cortical Graph Neural Networks and its Application for Speech Enhancement in Audio-Visual Hearing Aids

abstract: Despite the recent success of machine learning algorithms, most models face drawbacks when considering more complex tasks requiring interaction between different sources, such as multimodal input data and logical time sequences. On the other hand, the biological brain is highly sharpened in this sense, empowered to automatically manage and integrate such streams of information. In this context, this work draws inspiration from recent discoveries in brain cortical circuits to propose a more biologically plausible self-supervised machine learning approach. This combines multimodal information using intra-layer modulations together with Canonical Correlation Analysis, and a memory mechanism to keep track of temporal data, the overall approach termed Canonical Cortical Graph Neural networks. This is shown to outperform recent state-of-the-art models in terms of clean audio reconstruction and energy efficiency for a benchmark audio-visual speech dataset. The enhanced performance is demonstrated through a reduced and smother neuron firing rate distribution. suggesting that the proposed model is amenable for speech enhancement in future audio-visual hearing aid devices.


title: Primordial black hole constraints with Hawking radiation -- a review

abstract: Primordial black holes are under intense scrutiny since the detection of gravitational waves from mergers of solar-mass black holes in 2015. More recently, the development of numerical tools and the precision observational data have rekindled the effort to constrain the black hole abundance in the lower mass range, that is $M < 10^{23}$g. In particular, primordial black holes of asteroid mass $M \sim 10^{17}-10^{23}\,$g may represent 100\% of dark matter. While the microlensing and stellar disruption constraints on their abundance have been relieved, Hawking radiation of these black holes seems to be the only detection (and constraining) mean. Hawking radiation constraints on primordial black holes date back to the first papers by Hawking. Black holes evaporating in the early universe may have generated the baryon asymmetry, modified big bang nucleosynthesis, distorted the cosmic microwave background, or produced cosmological backgrounds of stable particles such as photons and neutrinos. At the end of their lifetime, exploding primordial black holes would produce high energy cosmic rays that would provide invaluable access to the physics at energies up to the Planck scale. In this review, we describe the main principles of Hawking radiation, which lie at the border of general relativity, quantum mechanics and statistical physics. We then present an up-to-date status of the different constraints on primordial black holes that rely on the evaporation phenomenon, and give, where relevant, prospects for future work. In particular, non-standard black holes and emission of beyond the Standard Model degrees of freedom is currently a hot subject.

categories: astro-ph.CO astro-ph.HE gr-qc hep-ph hep-th


title: No contextual advantage in non-paradoxical scenarios of two state vector formalism

abstract: The two state vector formalism (TSVF) was proposed by Aharonov, Bergmann, and Lebowitz (ABL) to provide a way for the counterfactual assignment of the probabilities of outcomes of contemplated but unperformed measurements on quantum systems. This formalism underlies various aspects of foundations of quantum theory and has been used significantly in the development of weak values and several proofs of quantum contextuality. We consider the application of TSVF, with pre- and post-selection (PPS) and the corresponding ABL rule, as a means to unearth quantum contextuality. We use the principle of exclusivity to classify the resultant pre- and post-selection scenarios as either paradoxical or non-paradoxical. In light of this, we find that several previous proofs of the emergence of contextuality in PPS scenarios are only possible if the principle of exclusivity is violated and are therefore classified as paradoxical. We argue that these do not constitute a proper test of contextuality. Furthermore, we provide a numerical analysis for the KCBS scenario as applied in the paradigm of TSVF and find that non-paradoxical scenarios do not offer any contextual advantage. Our approach can be easily generalized for other contextual scenarios as well.


title: Families of stable 3-folds in positive characteristic

abstract: We show that flat families of stable 3-folds do not lead to proper moduli spaces in any characteristic $p>0$. As a byproduct, we obtain log canonical 4-fold pairs, whose log canonical centers are not weakly normal.


title: Effects of Safety State Augmentation on Safe Exploration

abstract: Safe exploration is a challenging and important problem in model-free reinforcement learning (RL). Often the safety cost is sparse and unknown, which unavoidably leads to constraint violations -- a phenomenon ideally to be avoided in safety-critical applications. We tackle this problem by augmenting the state-space with a safety state, which is nonnegative if and only if the constraint is satisfied. The value of this state also serves as a distance toward constraint violation, while its initial value indicates the available safety budget. This idea allows us to derive policies for scheduling the safety budget during training. We call our approach Simmer (Safe policy IMproveMEnt for RL) to reflect the careful nature of these schedules. We apply this idea to two safe RL problems: RL with constraints imposed on an average cost, and RL with constraints imposed on a cost with probability one. Our experiments suggest that "simmering, a safe algorithm can improve safety during training for both settings. We further show that Simmer can stabilize training and improve the performance of safe RL with average constraints.


title: The structured distance to singularity of a symmetric tridiagonal Toeplitz matrix

abstract: This paper is concerned with the distance of a symmetric tridiagonal Toeplitz matrix $T$ to the variety of similarly structured singular matrices, and with determining the closest matrix to $T$ in this variety. Explicit formulas are presented, that exploit the analysis of the sensitivity of the spectrum of $T$ with respect to structure-preserving perturbations of its entries.


title: Grad-Caflisch type decay estimates of pseudo-inverse of linearized Boltzmann operator and application to Hilbert expansion of compressible Euler scaling

abstract: In this paper, we prove some Grad-Caflisch type decay estimates of the pseudo-inverse of linearized Boltzmann collision operator, including both the hard potential ($0 \leq \gamma \leq 1$) and part of soft ($- \frac{3}{2} < \gamma < 0$) potential cutoff interaction kernels. The key idea is that the weighted $L^\infty$-norms of $( \L - \nu ) f$ are first dominated by the weighted $L^2$-norms of $f$, and then the $L^2$-norms are bounded by the $L^\infty$-norms of $\L f$ via the hypocoercivity of the weighted operator $\L$. The proof of the weighted hypocoercivity employs the high-low velocities estimates argument. Finally, these decay estimates are further applied to derive some new point-wise estimates for the Hilbert expansion terms of the Boltzmann equation in the compressible Euler scaling.


title: Provably Efficient Risk-Sensitive Reinforcement Learning: Iterated CVaR and Worst Path

abstract: In this paper, we study a novel episodic risk-sensitive Reinforcement Learning (RL) problem, named Iterated CVaR RL, which aims to maximize the tail of the reward-to-go at each step, and focuses on tightly controlling the risk of getting into catastrophic situations at each stage. This formulation is applicable to real-world tasks that demand strong risk avoidance throughout the decision process, such as autonomous driving, clinical treatment planning and robotics. We investigate two performance metrics under Iterated CVaR RL, i.e., Regret Minimization and Best Policy Identification. For both metrics, we design efficient algorithms ICVaR-RM and ICVaR-BPI, respectively, and provide nearly matching upper and lower bounds with respect to the number of episodes $K$. We also investigate an interesting limiting case of Iterated CVaR RL, called Worst Path RL, where the objective becomes to maximize the minimum possible cumulative reward. For Worst Path RL, we propose an efficient algorithm with constant upper and lower bounds. Finally, our techniques for bounding the change of CVaR due to the value function shift and decomposing the regret via a distorted visitation distribution are novel, and can find applications in other risk-sensitive RL problems.


title: Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptation

abstract: Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in the sim2real strategies, but most of those methods rely on heavy image rendering, domain randomization training, or tuning. In this work, we solve the insertion task using a pure visual reinforcement learning solution with minimum infrastructure requirement. We also propose a novel sim2real strategy, Real2Sim, which provides a novel and easier solution in policy adaptation. We discuss the advantage of Real2Sim compared with Sim2Real.


title: Separable Self-attention for Mobile Vision Transformers

abstract: Mobile vision transformers (MobileViT) can achieve state-of-the-art performance across several mobile vision tasks, including classification and detection. Though these models have fewer parameters, they have high latency as compared to convolutional neural network-based models. The main efficiency bottleneck in MobileViT is the multi-headed self-attention (MHA) in transformers, which requires $O(k^2)$ time complexity with respect to the number of tokens (or patches) $k$. Moreover, MHA requires costly operations (e.g., batch-wise matrix multiplication) for computing self-attention, impacting latency on resource-constrained devices. This paper introduces a separable self-attention method with linear complexity, i.e. $O(k)$. A simple yet effective characteristic of the proposed method is that it uses element-wise operations for computing self-attention, making it a good choice for resource-constrained devices. The improved model, MobileViTv2, is state-of-the-art on several mobile vision tasks, including ImageNet object classification and MS-COCO object detection. With about three million parameters, MobileViTv2 achieves a top-1 accuracy of 75.6% on the ImageNet dataset, outperforming MobileViT by about 1% while running $3.2\times$ faster on a mobile device. Our source code is available at: \url{https://github.com/apple/ml-cvnets}


title: Observation of same-sign WW production from double parton scattering in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The first observation of the production of W$^\pm$W$^\pm$ bosons from double parton scattering processes using same-sign electron-muon and dimuon events in proton-proton collisions is reported. The data sample corresponds to an integrated luminosity of 138 fb$^{-1}$ recorded at a center-of-mass energy of 13 TeV using the CMS detector at the CERN LHC. Multivariate discriminants are used to distinguish the signal process from the main backgrounds. A binned maximum likelihood fit is performed to extract the signal cross section. The measured cross section for production of same-sign W bosons decaying leptonically is 80.7 $\pm$ 11.2 (stat) $^{+9.5}_{-8.6}$ (syst) $\pm$ 12.1 (model) fb, whereas the measured fiducial cross section is 6.28 $\pm$ 0.81 (stat) $\pm$ 0.69 (syst) $\pm$ 0.37 (model) fb. The observed significance of the signal is 6.2 standard deviations above the background-only hypothesis.


title: The nonabelian product modulo sum

abstract: It is shown that if $\{H_n\}_{n \in \omega}$ is a sequence of groups without involutions, with $1 < |H_n| \leq 2^{\aleph_0}$, then the topologist's product modulo the finite words is (up to isomorphism) independent of the choice of sequence. This contrasts with the abelian setting: if $\{A_n\}_{n \in \omega}$ is a sequence of countably infinite torsion-free abelian groups, then the isomorphism class of the product modulo sum $\prod_{n \in \omega} A_n/\bigoplus_{n \in \omega} A_n$ is dependent on the sequence.


title: Mapping out the glassy landscape of a mesoscopic elastoplastic model

abstract: We develop a mesoscopic model to study the plastic behavior of an amorphous material under cyclic loading. The model is depinning-like and driven by a disordered thresholds dynamics which are coupled by long-range elastic interactions. We propose a simple protocol of "glass preparation" which allows us to mimic thermalisation at high temperature, as well as aging at vanishing temperature. Various levels of glass stabilities (from brittle to ductile) can be achieved by tuning the aging duration. The aged glasses are then immersed into a quenched disorder landscape and serve as initial configurations for various protocols of mechanical loading by shearing. The dependence of the plastic behavior upon monotonous loading is recovered. The behavior under cyclic loading is studied for different ages and system sizes. The size and age dependence of the irreversibility transition is discussed. A thorough characterization of the disorder-landscape is achieved through the analysis of the transition graphs, which describe the plastic deformation pathways under athermal quasi-static shear. In particular, the analysis of the stability ranges of the strongly connected components of the transition graphs reveals the emergence of a phase-separation like process associated with the aging of the glass. Increasing the age and hence stability of the initial glass, results in a gradual break-up of the landscape of dynamically accessible stable states into three distinct regions: one region centered around the initially prepared glass phase, and two additional regions, characterized by well-separated ranges of positive and negative plastic strains, each of which is accessible only from the initial glass phase by passing through the stress peak in the forward, respectively, backward shearing directions.


title: Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits

abstract: Thermodynamics serves as a universal means for studying physical systems from an energy perspective. In recent years, with the establishment of the field of stochastic and quantum thermodynamics, the ideas of thermodynamics have been generalized to small fluctuating systems. Independently developed in mathematics and statistics, the optimal transport theory concerns the means by which one can optimally transport a source distribution to a target distribution, deriving a useful metric between probability distributions, called the Wasserstein distance. Despite their seemingly unrelated nature, an intimate connection between these fields has been unveiled in the context of continuous-state Langevin dynamics, providing several important implications for nonequilibrium systems. In this study, we elucidate an analogous connection for discrete cases by developing a thermodynamic framework for discrete optimal transport. We first introduce a novel quantity called dynamical state mobility, which significantly improves the thermodynamic uncertainty relation and provides insights into the precision of currents in nonequilibrium Markov jump processes. We then derive variational formulas that connect the discrete Wasserstein distances to stochastic and quantum thermodynamics of discrete Markovian dynamics described by master equations. Specifically, we rigorously prove that the Wasserstein distance equals the minimum product of irreversible entropy production and dynamical state mobility over all admissible Markovian dynamics. These formulas not only unify the relationship between thermodynamics and the optimal transport theory for discrete and continuous cases but also generalize it to the quantum case. In addition, we demonstrate that the obtained variational formulas lead to remarkable applications in stochastic and quantum thermodynamics.


title: Relative cluster entropy for power-law correlated sequences

abstract: We propose an information-theoretical measure, the \textit{relative cluster entropy} $\mathcal{D_{C}}[P \| Q] $, to discriminate among cluster partitions characterised by probability distribution functions $P$ and $Q$. The measure is illustrated with the clusters generated by pairs of fractional Brownian motions with Hurst exponents $H_1$ and $H_2$ respectively. For subdiffusive, normal and superdiffusive sequences, the relative entropy sensibly depends on the difference between $H_1$ and $H_2$. By using the \textit{minimum relative entropy} principle, cluster sequences characterized by different correlation degrees are distinguished and the optimal Hurst exponent is selected. As a case study, real-world cluster partitions of market price series are compared to those obtained from fully uncorrelated sequences (simple Browniam motions) assumed as a model. The \textit{minimum relative cluster entropy} yields optimal Hurst exponents $H_1=0.55$, $H_1=0.57$, and $H_1=0.63$ respectively for the prices of DJIA, S\&P500, NASDAQ: a clear indication of non-markovianity. Finally, we derive the analytical expression of the relative cluster entropy and the outcomes are discussed for arbitrary pairs of power-laws probability distribution functions of continuous random variables.


title: Asymptotic safety and gauged baryon number

abstract: We consider a model with gauged baryon number that may be rendered asymptotically safe when gravitational effects above the Planck scale are taken into account. We study the ultraviolet fixed points in this theory and determine the restrictions on the parameter space of the model at the TeV scale following from the requirement that the asymptotic fixed points are reached. Assuming that the new gauge symmetry is broken at the TeV scale, we comment on the phenomenological implications of these restrictions.


title: Multi-Behavior Sequential Recommendation with Temporal Graph Transformer

abstract: Modeling time-evolving preferences of users with their sequential item interactions, has attracted increasing attention in many online applications. Hence, sequential recommender systems have been developed to learn the dynamic user interests from the historical interactions for suggesting items. However, the interaction pattern encoding functions in most existing sequential recommender systems have focused on single type of user-item interactions. In many real-life online platforms, user-item interactive behaviors are often multi-typed (e.g., click, add-to-favorite, purchase) with complex cross-type behavior inter-dependencies. Learning from informative representations of users and items based on their multi-typed interaction data, is of great importance to accurately characterize the time-evolving user preference. In this work, we tackle the dynamic user-item relation learning with the awareness of multi-behavior interactive patterns. Towards this end, we propose a new Temporal Graph Transformer (TGT) recommendation framework to jointly capture dynamic short-term and long-range user-item interactive patterns, by exploring the evolving correlations across different types of behaviors. The new TGT method endows the sequential recommendation architecture to distill dedicated knowledge for type-specific behavior relational context and the implicit behavior dependencies. Experiments on the real-world datasets indicate that our method TGT consistently outperforms various state-of-the-art recommendation methods. Our model implementation codes are available at https://github.com/akaxlh/TGT.


title: Three-dimensional contrast transfer function in phase-contrast tomography

abstract: A new method is developed for three-dimensional (3D) reconstruction of multi-material objects using propagation-based X-ray phase-contrast tomography (PB-CT) with phase retrieval via the contrast transfer function (CTF) formalism. The approach differs from conventional PB-CT algorithms that apply phase retrieval on individual two-dimensional (2D) projections. Instead, this method involves performing phase retrieval to the CT-reconstructed volume in 3D. The CTF formalism is further extended to the cases of partially-coherent illumination and strongly absorbing samples. Simulated results demonstrate that the proposed post-reconstruction CTF method provides fast and stable phase retrieval, producing results equivalent to conventional pre-reconstruction 2D CTF phase retrieval. Moreover, it is shown that application can be highly localised to isolated objects of interest, without a significant loss of quality, thus leading to increased computational efficiency. Combined with the extended validity of the CTF to greater propagation distances, this method provides additional advantages over approaches based on the transport-of-intensity equation.


title: A Quillen adjunction between globular and complicial approaches to $(\infty,n)$-categories

abstract: We prove the compatibility between the suspension construction and the complicial nerve of $\omega$-categories. As a motivating application, we produce a Quillen pair between the models of $(\infty,n)$-categories given by Rezk's complete Segal $\Theta_n$-spaces and Verity's $n$-complicial sets.


title: A Survey on Sentence Embedding Models Performance for Patent Analysis

abstract: Patent data is an important source of knowledge for innovation research, while the technological similarity between pairs of patents is a key enabling indicator for patent analysis. Recently researchers have been using patent vector space models based on different NLP embeddings models to calculate the technological similarity between pairs of patents to help better understand innovations, patent landscaping, technology mapping, and patent quality evaluation. More often than not, Text Embedding is a vital precursor to patent analysis tasks. A pertinent question then arises: How should we measure and evaluate the accuracy of these embeddings? To the best of our knowledge, there is no comprehensive survey that builds a clear delineation of embedding models' performance for calculating patent similarity indicators. Therefore, in this study, we provide an overview of the accuracy of these algorithms based on patent classification performance and propose a standard library and dataset for assessing the accuracy of embeddings models based on PatentSBERTa approach. In a detailed discussion, we report the performance of the top 3 algorithms at section, class, and subclass levels. The results based on the first claim of patents show that PatentSBERTa, Bert-for-patents, and TF-IDF Weighted Word Embeddings have the best accuracy for computing sentence embeddings at the subclass level. According to the first results, the performance of the models in different classes varies, which shows researchers in patent analysis can utilize the results of this study to choose the best proper model based on the specific section of patent data they used.


title: Fault-tolerant circuit synthesis for universal fault-tolerant quantum computing

abstract: We present a quantum circuit synthesis algorithm for implementing universal fault-tolerant quantum computing based on concatenated codes. To realize fault-tolerant quantum computing, the fault-tolerant quantum protocols should be transformed into executable quantum circuits based on the nearest-neighbor interaction. Unlike topological codes that are defined based on local operations fundamentally, for the concatenated codes, it is possible to obtain the circuits composed of the local operations by applying the quantum circuit synthesis. However, by the existing quantum circuit synthesis developed for ordinary quantum computational algorithms, the fault-tolerant of the protocol may not be preserved in the resulting circuit. Besides, we have to consider something more to implement the quantum circuit of universal fault-tolerant quantum computing. First, we have not to propagate quantum errors on data qubits when selecting a qubit move path (a sequence of \emph{SWAP} gates) to satisfy the geometric locality constraint. Second, the circuit should be self-contained so that it is possible to act independently regardless of the situation. Third, for universal fault-tolerant quantum computing, we require multiple fault-tolerant quantum circuits of multiple fault-tolerant quantum protocols acting on the same input, a logical data qubit. Last, we need to recall fault-tolerant protocols such as syndrome measure and encoder implicitly include classical control processing conditioned on the measurement outcomes, and therefore have to partition the quantum circuits in time flow to execute the classical control as the architect intended. We propose the circuit synthesis method resolving the requirements and show how to synthesize the set of universal fault-tolerant protocols for $[[7,1,3]]$ Steane code and the syndrome measurement protocol of $[[23, 1, 7]]$ Golay code.


title: Local False Discovery Rate Estimation with Competition-Based Procedures for Variable Selection

abstract: Multiple hypothesis testing has been widely applied to problems dealing with high-dimensional data, e.g., selecting significant variables and controlling the selection error rate. The most prevailing measure of error rate used in the multiple hypothesis testing is the false discovery rate (FDR). In recent years, local false discovery rate (fdr) has drawn much attention, due to its advantage of accessing the confidence of individual hypothesis. However, most methods estimate fdr through p-values or statistics with known null distributions, which are sometimes not available or reliable. Adopting the innovative methodology of competition-based procedures, e.g., knockoff filter, this paper proposes a new approach, named TDfdr, to local false discovery rate estimation, which is free of the p-values or known null distributions. Simulation results demonstrate that TDfdr can accurately estimate the fdr with two competition-based procedures. In real data analysis, the power of TDfdr on variable selection is verified on two biological datasets.


title: Evaluation of Twisted Gaussian Schell Model beams produced with phase randomized coherent fields

abstract: The twisted Gaussian Schell Model describes a family of partially coherent beams that present several interesting characteristics, and as such have attracted attention in classical and quantum optics. Recent techniques have been demonstrated to synthesize these beams from a coherent source using a discrete set of "pseudo-modes", where the phase of each mode is randomized so that they are mutually incoherent. Here we investigate this technique and evaluate the resulting beam parameters, such as divergence, coherence length and twist phase. We show that for a finite set of modes there is also some residual coherence, which can have an observable effect. A theoretical model is developed for the output field that includes residual coherence and agrees very well with experimental data. In addition, we demonstrate a simple method to measure the twist phase using double slit interference.


title: The Homogenization Cone: Polar Cone and Projection

abstract: Let $C$ be a closed convex subset of a real Hilbert space containing the origin, and assume that $K$ is the homogenization cone of $C$, i.e., the smallest closed convex cone containing $C \times \{1\}$. Homogenization cones play an important role in optimization as they include, for instance, the second-order/Lorentz/"ice cream" cone. In this note, we discuss the polar cone of $K$ as well as an algorithm for finding the projection onto $K$ provided that the projection onto $C$ is available. Various examples illustrate our results.


title: Disk Material Inflates Gaia RUWE Values in Single Stars

abstract: An understanding of the dynamical evolution of binary star systems, and their effects on stellar and planetary evolution, requires well-characterized binary populations across stellar ages. However, the observational resources required to find and characterize binaries are expensive. With the release of high-precision Gaia astrometry, the re-normalized unit weight error (RUWE) statistic has been shown to reveal the presence of binary systems, with RUWE values greater than 1.2 indicating the presence of a stellar companion within $ \sim 1$". Our goal is to assess whether this new diagnostic, which was developed for field-age systems ($>$1 Gyr), applies to young systems; specifically, those that host circumstellar disks. With a control sample of single-star systems, compiled from high-contrast imagining surveys of the Taurus and Upper Scorpius star-forming regions, we compare the RUWE values for systems with and without circumstellar disks. We show that the presence of a protoplanetary disk alone can result in inflated RUWE values. Based on the distribution of the RUWE for disk-bearing single stars, we suggest a more conservative single-star -- binary threshold is warranted in the presence of disk material. We place this cutoff at the distribution's 95th percentile, with RUWE $= 2.5$.


title: Learning to Ask Like a Physician

abstract: Existing question answering (QA) datasets derived from electronic health records (EHR) are artificially generated and consequently fail to capture realistic physician information needs. We present Discharge Summary Clinical Questions (DiSCQ), a newly curated question dataset composed of 2,000+ questions paired with the snippets of text (triggers) that prompted each question. The questions are generated by medical experts from 100+ MIMIC-III discharge summaries. We analyze this dataset to characterize the types of information sought by medical experts. We also train baseline models for trigger detection and question generation (QG), paired with unsupervised answer retrieval over EHRs. Our baseline model is able to generate high quality questions in over 62% of cases when prompted with human selected triggers. We release this dataset (and all code to reproduce baseline model results) to facilitate further research into realistic clinical QA and QG: https://github.com/elehman16/discq.


title: Convergence and local-to-global results for $p$-superminimizers on quasiopen sets

abstract: In this paper, several convergence results for fine $p$-(super)minimizers on quasiopen sets in metric spaces are obtained. For this purpose, we deduce a Caccioppoli-type inequality and local-to-global principles for fine $p$-(super)minimizers on quasiopen sets. A substantial part of these considerations is to show that the functions belong to a suitable local fine Sobolev space. We prove our results for a complete metric space equipped with a doubling measure supporting a $p$-Poincar\'e inequality with $1<p< \infty$. However, most of the results are new also for unweighted $\mathbf{R}^n$.


title: Prediction of time-reversal-symmetry breaking fermionic quadrupling condensate in twisted bilayer graphene

abstract: Recent mean-field calculations suggest that the superconducting state of twisted bilayer graphene exhibits either a nematic order or a spontaneous breakdown of the time-reversal symmetry. The two-dimensional character of the material and the large critical temperature relative to the Fermi energy dictate that the material should have significant fluctuations. We study the effects of these fluctuations using Monte Carlo simulations. We show that in a model proposed earlier for twisted bilayer graphene there is a fluctuation-induced phase with quadrupling fermionic order for all considered parameters. This four-electron condensate, instead of superconductivity, shows a spontaneous breaking of time-reversal symmetry. Our results suggest that twisted bilayer graphene is an especially promising platform to study different types of condensates, beyond the pair-condensate paradigm.


title: LQG Differential Stackelberg Game under Nested Observation Information Pattern

abstract: We investigate the linear quadratic Gaussian Stackelberg game under a class of nested observation information pattern. Two decision makers implement control strategies relying on different information sets: The follower uses its observation data to design its strategy, whereas the leader implements its strategy using global observation data. We show that the solution requires solving a new type of forward-backward stochastic differential equations whose drift terms contain two types of conditional expectation terms associated to the adjoint variables. We then propose a method to find the functional relations between each adjoint pair, i.e., each pair formed by an adjoint variable and the conditional expectation of its associated state. The proposed method follows a layered pattern. More precisely, in the inner layer, we seek the functional relation for the adjoint pair under the sigma-sub-algebra generated by follower's observation information; and in the outer layer, we look for the functional relation for the adjoint pair under the sigma-sub-algebra generated by leader's observation information. Our result shows that the optimal open-loop solution admits an explicit feedback type representation. More precisely, the feedback coefficient matrices satisfy tuples of coupled forward-backward differential Riccati equations, and feedback variables are computed by Kalman-Bucy filtering.


title: Forbidding Edges between Points in the Plane to Disconnect the Triangulation Flip Graph

abstract: The flip graph for a set $P$ of points in the plane has a vertex for every triangulation of $P$, and an edge when two triangulations differ by one flip that replaces one triangulation edge by another. The flip graph is known to have some connectivity properties: (1) the flip graph is connected; (2) connectivity still holds when restricted to triangulations containing some constrained edges between the points; (3) for $P$ in general position of size $n$, the flip graph is $\lceil \frac{n}{2} -2 \rceil$-connected, a recent result of Wagner and Welzl (SODA 2020). We introduce the study of connectivity properties of the flip graph when some edges between points are forbidden. An edge $e$ between two points is a flip cut edge if eliminating triangulations containing $e$ results in a disconnected flip graph. More generally, a set $X$ of edges between points of $P$ is a flip cut set if eliminating all triangulations that contain edges of $X$ results in a disconnected flip graph. The flip cut number of $P$ is the minimum size of a flip cut set. We give a characterization of flip cut edges that leads to an $O(n \log n)$ time algorithm to test if an edge is a flip cut edge and, with that as preprocessing, an $O(n)$ time algorithm to test if two triangulations are in the same connected component of the flip graph. For a set of $n$ points in convex position (whose flip graph is the 1-skeleton of the associahedron) we prove that the flip cut number is $n-3$.


title: Elementary construction of the minimal free resolution of the Specht ideal of shape $(n-d,d)$

abstract: Let $K$ be a field with ${\rm char}(K)=0$. For a partition $\lambda$ of $n \in {\mathbb N}$, let $I^{\rm Sp}_\lambda$ be the ideal of $R=K[x_1,\ldots,x_n]$ generated by all Specht polynomials of shape $\lambda$. These ideals have been studied from several points of view (and under several names). Using advanced tools of the representation theory, Berkesch Zamaere et al [BGS]. constructed a minimal free resolution of $I^{\rm Sp}_{(n-d,d)}$ except differential maps. The present paper constructs the differential maps, and also gives an elementary proof of the result of [BGS].


title: Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches

abstract: Stochastic variance reduction has proven effective at accelerating first-order algorithms for solving convex finite-sum optimization tasks such as empirical risk minimization. Incorporating additional second-order information has proven helpful in further improving the performance of these first-order methods. However, comparatively little is known about the benefits of using variance reduction to accelerate popular stochastic second-order methods such as Subsampled Newton. To address this, we propose Stochastic Variance-Reduced Newton (SVRN), a finite-sum minimization algorithm which enjoys all the benefits of second-order methods: simple unit step size, easily parallelizable large-batch operations, and fast local convergence, while at the same time taking advantage of variance reduction to achieve improved convergence rates (per data pass) for smooth and strongly convex problems. We show that SVRN can accelerate many stochastic second-order methods (such as Subsampled Newton) as well as iterative least squares solvers (such as Iterative Hessian Sketch), and it compares favorably to popular first-order methods with variance reduction.


title: Crosstalk Suppression in Individually Addressed Two-Qubit Gates in a Trapped-Ion Quantum Computer

abstract: Crosstalk between target and neighboring spectator qubits due to spillover of control signals represents a major error source limiting the fidelity of two-qubit entangling gates in quantum computers. We show that in our laser-driven trapped-ion system coherent crosstalk error can be modelled as residual $X\hat{\sigma}_{\phi}$ interaction and can be actively cancelled by single-qubit echoing pulses. We propose and demonstrate a crosstalk suppression scheme that eliminates all first-order crosstalk, yet only requires local control by driving rotations solely on the target qubits. We report a two-qubit Bell state fidelity of $99.52(6) \%$ with the echoing pulses applied after collective gates and $99.37(5) \%$ with the echoing pulses applied to each gate in a 5-ion chain. This scheme is widely applicable to other platforms with analogous interaction Hamiltonians.


title: Perturbation Learning Based Anomaly Detection

abstract: This paper presents a simple yet effective method for anomaly detection. The main idea is to learn small perturbations to perturb normal data and learn a classifier to classify the normal data and the perturbed data into two different classes. The perturbator and classifier are jointly learned using deep neural networks. Importantly, the perturbations should be as small as possible but the classifier is still able to recognize the perturbed data from unperturbed data. Therefore, the perturbed data are regarded as abnormal data and the classifier provides a decision boundary between the normal data and abnormal data, although the training data do not include any abnormal data. Compared with the state-of-the-art of anomaly detection, our method does not require any assumption about the shape (e.g. hypersphere) of the decision boundary and has fewer hyper-parameters to determine. Empirical studies on benchmark datasets verify the effectiveness and superiority of our method.


title: Human Behavior Recognition Method Based on CEEMD-ES Radar Selection

abstract: In recent years, the millimeter-wave radar to identify human behavior has been widely used in medical,security, and other fields. When multiple radars are performing detection tasks, the validity of the features contained in each radar is difficult to guarantee. In addition, processing multiple radar data also requires a lot of time and computational cost. The Complementary Ensemble Empirical Mode Decomposition-Energy Slice (CEEMD-ES) multistatic radar selection method is proposed to solve these problems. First, this method decomposes and reconstructs the radar signal according to the difference in the reflected echo frequency between the limbs and the trunk of the human body. Then, the radar is selected according to the difference between the ratio of echo energy of limbs and trunk and the theoretical value. The time domain, frequency domain and various entropy features of the selected radar are extracted. Finally, the Extreme Learning Machine (ELM) recognition model of the ReLu core is established. Experiments show that this method can effectively select the radar, and the recognition rate of three kinds of human actions is 98.53%.


title: Further on the Aharonov-Bohm Green function: the coincidence limit

abstract: For a scalar CFT with a monodromy defect, a `subtracted Green function' is derived in terms of an Appell $F_1$ function. A conjectured relation of Gimenez-Grau and Liendo is thereby proved and extended and shown to hold for generalised free fields. A possible means of determining the bulk block expansion is outlined. Finite coincidence limits are expressed as combinations of Beta functions.


title: Symmetry of solutions of semilinear PDEs on Riemannian domains

abstract: This paper deals with symmetry phenomena for solutions of the Dirichlet problem involving semilinear PDEs on Riemannian domains. We shall present a rather general framework where the symmetry problem can be formulated and provide some evidence that this framework is completely natural by pointing out some results for stable solutions. The case of manifolds with density, and corresponding weighted Laplacians, is inserted in the picture from the very beginning.


title: Modular convergence in $H$-Orlicz spaces of Banach valued functions

abstract: In this article we develop the theory of $H$-Orlicz space generated by generalised Young function. Modular convergence of $H$-Orlicz space for the case of vector-valued functions and norm convergence in $\mcH^\theta(X, \bar{\mu})$ where $X$ is any Banach space are discussed. Relationships of modular convergence and norm convergence of $H$-Orlicz spaces are discussed.


title: Strong Optomechanical Interactions with Long-lived Fundamental Acoustic Waves

abstract: Traveling-wave optomechanical interactions, known as Brillouin interactions, have now been established as a powerful and versatile resource for photonic sources, sensors, and radio-frequency processors. However, established Brillouin-based interactions with sufficient interaction strengths involve short phonon lifetimes, which critically limit their performance for applications including radio-frequency filtering and optomechanical storage devices. Here, we investigate a new paradigm of optomechanical interactions with fundamental acoustic modes, where interaction strength is decoupled from phonon lifetimes, enabling the uniquely desirable combination of high optomechanical coupling, long phonon lifetimes, tunable phonon frequencies, and single-sideband amplification. Using sensitive four-wave mixing spectroscopy controlling for noise and spatial mode coupling, optomechanical interactions with long > 2 $\mu s$ phonon lifetimes and strong > 400 $W^{-1} m^{-1}$ coupling are observed in a tapered fiber. In addition, we demonstrate novel phonon self-interference effects resulting from the unique combination of an axially varying device geometry with long phonon lifetimes. A generalized theoretical model, in excellent agreement with experiments, is developed with broad applicability to inhomogeneous optomechanical systems.


title: Benefits of Range-separated Hybrid and Double-Hybrid Functionals for a Large and Diverse Dataset of Reaction Energies and Barrier Heights

abstract: To better understand the thermochemical kinetics and mechanism of a specific chemical reaction, an accurate estimation of barrier heights (forward and reverse) and reaction energy are vital. Due to the large size of reactants and transition state structures involved in real-life mechanistic studies (e.g., enzymatically catalyzed reactions), DFT remains the workhorse for such calculations. In this paper, we have assessed the performance of 88 density functionals for modeling the reaction energies and barrier heights on a large and chemically diverse dataset (BH9) composed of 449 organic chemistry reactions. We have shown that range-separated hybrid functionals perform better than the global hybris for BH9 barrier heights and reaction energies. Except for the PBE-based range-separated nonempirical double hybrids, the exchange term's range separation helps improve the performance for barrier heights and reaction energies. The sixteen-parameter Berkeley double hybrid, {\omega}B97M(2), performs remarkably well for both properties. However, our minimally empirical range-separated double hybrid functionals offer marginally better accuracy than {\omega}B97M(2) for BH9 barrier heights and reaction energies.


title: Environmental Collapse Models

abstract: We propose dynamical collapse models in which the stochastic collapse terms affect only photons and/or gravitons. In principle, isolated systems comprising only massive particles could evolve unitarily indefinitely in such models. In practice, since photons and gravitons are ubiquitous and scatter from massive particles, dynamical collapses of the former will effectively induce collapses of the latter. In non-relativistic models in which particle number is conserved and interactions are modelled by classical potentials, massive systems can be modelled as collections of elementary massive particles bound by potentials, interacting with an environment of photons and gravitons. In this picture, although the photon and/or graviton collapse dynamics effectively localize massive systems, these collapses take the effective form of approximate measurements on the environment whose effect on the massive systems is indirect. We argue that these environmental collapse models, like standard mass-dependent spontaneous localisation models, may be consistent with quantum experiments on microscopic systems while predicting very rapid effective collapse of macroscopic massive systems, and hence a potential solution to the quantum measurement problem. However, the models considered here have different experimental signatures from standard mass-dependent spontaneous localisation models. For example, they predict no deviations from standard quantum interferometry for mesoscopic systems of massive particles isolated from a decohering environment, nor do they predict anomalous spontaneous emission of radiation from isolated matter of the type prediction by standard mass-dependent spontaneous localization models. New experiments and analyses are required to obtain empirical bounds on the decoherence rate in our models.


title: Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text Generation

abstract: Despite the success of text-to-text pre-trained models in various natural language generation (NLG) tasks, the generation performance is largely restricted by the number of labeled data in downstream tasks, particularly in data-to-text generation tasks. Existing works mostly utilize abundant unlabeled structured data to conduct unsupervised pre-training for task adaption, which fail to model the complex relationship between source structured data and target texts. Thus, we introduce self-training as a better few-shot learner than task-adaptive pre-training, which explicitly captures this relationship via pseudo-labeled data generated by the pre-trained model. To alleviate the side-effect of low-quality pseudo-labeled data during self-training, we propose a novel method called Curriculum-Based Self-Training (CBST) to effectively leverage unlabeled data in a rearranged order determined by the difficulty of text generation. Experimental results show that our method can outperform fine-tuning and task-adaptive pre-training methods, and achieve state-of-the-art performance in the few-shot setting of data-to-text generation.


title: Is a Modular Architecture Enough?

abstract: Inspired from human cognition, machine learning systems are gradually revealing advantages of sparser and more modular architectures. Recent work demonstrates that not only do some modular architectures generalize well, but they also lead to better out-of-distribution generalization, scaling properties, learning speed, and interpretability. A key intuition behind the success of such systems is that the data generating system for most real-world settings is considered to consist of sparsely interacting parts, and endowing models with similar inductive biases will be helpful. However, the field has been lacking in a rigorous quantitative assessment of such systems because these real-world data distributions are complex and unknown. In this work, we provide a thorough assessment of common modular architectures, through the lens of simple and known modular data distributions. We highlight the benefits of modularity and sparsity and reveal insights on the challenges faced while optimizing modular systems. In doing so, we propose evaluation metrics that highlight the benefits of modularity, the regimes in which these benefits are substantial, as well as the sub-optimality of current end-to-end learned modular systems as opposed to their claimed potential.


title: FuSS: Fusing Superpixels for Improved Segmentation Consistency

abstract: In this work, we propose two different approaches to improve the semantic consistency of Open Set Semantic Segmentation. First, we propose a method called OpenGMM that extends the OpenPCS framework using a Gaussian Mixture of Models to model the distribution of pixels for each class in a multimodal manner. The second approach is a post-processing which uses superpixels to enforce highly homogeneous regions to behave equally, rectifying erroneous classified pixels within these regions, we also proposed a novel superpixel method called FuSS. All tests were performed on ISPRS Vaihingen and Potsdam datasets, and both methods were capable to improve quantitative and qualitative results for both datasets. Besides that, the post-process with FuSS achieved state-of-the-art results for both datasets. The official implementation is available at: \url{https://github.com/iannunes/FuSS}.


title: Day-to-Night Image Synthesis for Training Nighttime Neural ISPs

abstract: Many flagship smartphone cameras now use a dedicated neural image signal processor (ISP) to render noisy raw sensor images to the final processed output. Training nightmode ISP networks relies on large-scale datasets of image pairs with: (1) a noisy raw image captured with a short exposure and a high ISO gain; and (2) a ground truth low-noise raw image captured with a long exposure and low ISO that has been rendered through the ISP. Capturing such image pairs is tedious and time-consuming, requiring careful setup to ensure alignment between the image pairs. In addition, ground truth images are often prone to motion blur due to the long exposure. To address this problem, we propose a method that synthesizes nighttime images from daytime images. Daytime images are easy to capture, exhibit low-noise (even on smartphone cameras) and rarely suffer from motion blur. We outline a processing framework to convert daytime raw images to have the appearance of realistic nighttime raw images with different levels of noise. Our procedure allows us to easily produce aligned noisy and clean nighttime image pairs. We show the effectiveness of our synthesis framework by training neural ISPs for nightmode rendering. Furthermore, we demonstrate that using our synthetic nighttime images together with small amounts of real data (e.g., 5% to 10%) yields performance almost on par with training exclusively on real nighttime images. Our dataset and code are available at https://github.com/SamsungLabs/day-to-night.


title: Stacked unsupervised learning with a network architecture found by supervised meta-learning

abstract: Stacked unsupervised learning (SUL) seems more biologically plausible than backpropagation, because learning is local to each layer. But SUL has fallen far short of backpropagation in practical applications, undermining the idea that SUL can explain how brains learn. Here we show an SUL algorithm that can perform completely unsupervised clustering of MNIST digits with comparable accuracy relative to unsupervised algorithms based on backpropagation. Our algorithm is exceeded only by self-supervised methods requiring training data augmentation by geometric distortions. The only prior knowledge in our unsupervised algorithm is implicit in the network architecture. Multiple convolutional "energy layers" contain a sum-of-squares nonlinearity, inspired by "energy models" of primary visual cortex. Convolutional kernels are learned with a fast minibatch implementation of the K-Subspaces algorithm. High accuracy requires preprocessing with an initial whitening layer, representations that are less sparse during inference than learning, and rescaling for gain control. The hyperparameters of the network architecture are found by supervised meta-learning, which optimizes unsupervised clustering accuracy. We regard such dependence of unsupervised learning on prior knowledge implicit in network architecture as biologically plausible, and analogous to the dependence of brain architecture on evolutionary history.


title: Scene Aware Person Image Generation through Global Contextual Conditioning

abstract: Person image generation is an intriguing yet challenging problem. However, this task becomes even more difficult under constrained situations. In this work, we propose a novel pipeline to generate and insert contextually relevant person images into an existing scene while preserving the global semantics. More specifically, we aim to insert a person such that the location, pose, and scale of the person being inserted blends in with the existing persons in the scene. Our method uses three individual networks in a sequential pipeline. At first, we predict the potential location and the skeletal structure of the new person by conditioning a Wasserstein Generative Adversarial Network (WGAN) on the existing human skeletons present in the scene. Next, the predicted skeleton is refined through a shallow linear network to achieve higher structural accuracy in the generated image. Finally, the target image is generated from the refined skeleton using another generative network conditioned on a given image of the target person. In our experiments, we achieve high-resolution photo-realistic generation results while preserving the general context of the scene. We conclude our paper with multiple qualitative and quantitative benchmarks on the results.


title: Generalizations of L- and M-weakly compact operators

abstract: L- and M-weakly compact operators were introduced by Meyer-Nieberg in the beginning of seventies in attempts of a diversification of the concept of weakly compact operators via imposing Banach lattice structure on the range or on the domain of operators. We investigate regularity and algebraic properties of various generalizations of L- and M-weakly compact operators from a unified point of view via using regularly P-operators.


title: Assessment of Consumers Awareness of Nutrition, Food Safety and Hygiene in the Life Cycle for Sustainable Development of Bangladesh- A Study on Sylhet City Corporation

abstract: The objective of the study is to explore the knowledge of consumers on nutrition, food safety and hygiene of the sampled respondents in the Sylhet City Corporation in Bangladesh in terms of different demographic characteristics. This study includes the different types of consumers in the life cycle viz. baby, child, adolescent, young and old so that an overall awareness level can be measured in the urban area of Bangladesh. The study is confined to SCC area in which all types of respondents has been included and findings from this study will be used generally for Bangladesh in making policy In conducting the study the population has been divided into six group as, Baby, child, adolescent, parental, unmarried adult young and married adult matured. We find that the average score of awareness of food nutrition and hygiene of unmarried adult is higher than that of married adults. The study suggested it is needed to increase awareness in of the parents for feeding babies. The average awareness of parents to their childs eating behavior between 5 and 9 years is 3.36 out of 5. The awareness is around 67 percent so we should be more careful in this regard. The average awareness adolescent food habit is 1.89 on three points scales which about 63 percent only. Therefore, the consciousness of adolescent has been to increase in taking food. The average feeding styles of parents is 4.24 out of 5 to their children up to 9 years and in percentage it is 84 percent.


title: Continuum limit for the Ablowitz--Ladik system

abstract: We show that solutions to the Ablowitz--Ladik system converge to solutions of the cubic nonlinear Schr\"odinger equation for merely $L^2$ initial data. Furthermore, we consider initial data for this lattice model that excites Fourier modes near both critical points of the discrete dispersion relation and demonstrate convergence to a decoupled system of nonlinear Schr\"odinger equations.