title: Optimal mean first-passage time of a Brownian searcher with resetting in one and two dimensions: Experiments, theory and numerical tests

abstract: We study experimentally, numerically and theoretically the optimal mean time needed by a Brownian particle, freely diffusing either in one or two dimensions, to reach, within a tolerance radius $R_{\text tol}$, a target at a distance $L$ from an initial position in the presence of resetting. The reset position is Gaussian distributed with width $\sigma$. We derived and tested two resetting protocols, one with a periodic and one with random (Poissonian) resetting times. We computed and measured the full first-passage probability distribution that displays spectacular spikes immediately after each resetting time for close targets. We study the optimal mean first-passage time as a function of the resetting period/rate for different target distances (values of the ratios $b=L/\sigma$) and target size ($a=R_\text{tol}/L$). We find an interesting phase transition at a critical value of $b$, both in one and two dimensions. The details of the calculations as well as experimental setup and limitations are discussed.


title: Semiparametric count data regression for self-reported mental health

abstract: "For how many days during the past 30 days was your mental health not good?" The responses to this question measure self-reported mental health and can be linked to important covariates in the National Health and Nutrition Examination Survey (NHANES). However, these count variables present major distributional challenges: the data are overdispersed, zero-inflated, bounded by 30, and heaped in five- and seven-day increments. To meet these challenges, we design a semiparametric estimation and inference framework for count data regression. The data-generating process is defined by simultaneously transforming and rounding (STAR) a latent Gaussian regression model. The transformation is estimated nonparametrically and the rounding operator ensures the correct support for the discrete and bounded data. Maximum likelihood estimators are computed using an EM algorithm that is compatible with any continuous data model estimable by least squares. STAR regression includes asymptotic hypothesis testing and confidence intervals, variable selection via information criteria, and customized diagnostics. Simulation studies validate the utility of this framework. STAR is deployed to study the factors associated with self-reported mental health and demonstrates substantial improvements in goodness-of-fit compared to existing count data regression models.


title: Clustering inference in multiple groups

abstract: Inference in clustering is paramount to uncovering inherent group structure in data. Clustering methods which assess statistical significance have recently drawn attention owing to their importance for the identification of patterns in high dimensional data with applications in many scientific fields. We present here a U-statistics based approach, specially tailored for high-dimensional data, that clusters the data into three groups while assessing the significance of such partitions. Because our approach stands on the U-statistics based clustering framework of the methods in R package uclust, it inherits its characteristics being a non-parametric method relying on very few assumptions about the data, and thus can be applied to a wide range of dataset. Furthermore our method aims to be a more powerful tool to find the best partitions of the data into three groups when that particular structure is present. In order to do so, we first propose an extension of the test U-statistic and develop its asymptotic theory. Additionally we propose a ternary non-nested significance clustering method. Our approach is tested through multiple simulations and found to have more statistical power than competing alternatives in all scenarios considered. Applications to peripheral blood mononuclear cells and to image recognition shows the versatility of our proposal, presenting a superior performance when compared with other approaches.


title: Periodic Points of Ward-Veech Surfaces

abstract: For a non-arithmetic Veech surface, it is known that the set points having finite orbit under the Veech group, called the set of periodic points, is finite. However, few examples of these periodic point sets have been computed. In what follows, we compute new examples of periodic point sets for a family of non-hyperelliptic Veech surfaces with unbounded complexity and consider applications to classifying the holomorphic sections of certain surface bundles as well as applications to the study of infinitely generated Veech groups.


title: DeepSplit: Scalable Verification of Deep Neural Networks via Operator Splitting

abstract: Analyzing the worst-case performance of deep neural networks against input perturbations amounts to solving a large-scale non-convex optimization problem, for which several past works have proposed convex relaxations as a promising alternative. However, even for reasonably-sized neural networks, these relaxations are not tractable, and so must be replaced by even weaker relaxations in practice. In this work, we propose a novel operator splitting method that can directly solve a convex relaxation of the problem to high accuracy, by splitting it into smaller sub-problems that often have analytical solutions. The method is modular, scales to very large problem instances, and compromises operations that are amenable to fast parallelization with GPU acceleration. We demonstrate our method in bounding the worst-case performance of large convolutional networks in image classification and reinforcement learning settings, and in reachability analysis of neural network dynamical systems.


title: Locally compact sofic groups

abstract: We introduce the notion of soficity for locally compact groups and list a number of open problems.


title: Behavioral Priors and Dynamics Models: Improving Performance and Domain Transfer in Offline RL

abstract: Offline Reinforcement Learning (RL) aims to extract near-optimal policies from imperfect offline data without additional environment interactions. Extracting policies from diverse offline datasets has the potential to expand the range of applicability of RL by making the training process safer, faster, and more streamlined. We investigate how to improve the performance of offline RL algorithms, its robustness to the quality of offline data, as well as its generalization capabilities. To this end, we introduce Offline Model-based RL with Adaptive Behavioral Priors (MABE). Our algorithm is based on the finding that dynamics models, which support within-domain generalization, and behavioral priors, which support cross-domain generalization, are complementary. When combined together, they substantially improve the performance and generalization of offline RL policies. In the widely studied D4RL offline RL benchmark, we find that MABE achieves higher average performance compared to prior model-free and model-based algorithms. In experiments that require cross-domain generalization, we find that MABE outperforms prior methods. Our website is available at https://sites.google.com/berkeley.edu/mabe .


title: A twisted Yu construction, Harish-Chandra characters, and endoscopy

abstract: We give a modification of Yu's construction of supercuspidal representations of a connected reductive group over a non-archimedean local field. This modification restores the validity of certain key intertwining property claims made by Yu, which were recently proven to be false for the original construction. This modification is also an essential ingredient in the explicit construction of supercuspidal L-packets. As further applications, we prove the stability and many instances of endoscopic character identities of these supercuspidal L-packets, subject to some conditions on the base field. In particular, for regular supercuspidal parameters we prove all instances of standard endoscopy. In addition, we prove that these supercuspidal L-packets satisfy a certain property, which, together with standard endoscopy, uniquely characterizes the local Langlands correspondence for supercuspidal L-packets (again subject to the above mentioned conditions on the base field). These results are based on a statement of the Harish-Chandra character formula for the supercuspidal representations arising from the twisted Yu construction.


title: Scaling-up Diverse Orthogonal Convolutional Networks with a Paraunitary Framework

abstract: Enforcing orthogonality in neural networks is an antidote for gradient vanishing/exploding problems, sensitivity by adversarial perturbation, and bounding generalization errors. However, many previous approaches are heuristic, and the orthogonality of convolutional layers is not systematically studied: some of these designs are not exactly orthogonal, while others only consider standard convolutional layers and propose specific classes of their realizations. To address this problem, we propose a theoretical framework for orthogonal convolutional layers, which establishes the equivalence between various orthogonal convolutional layers in the spatial domain and the paraunitary systems in the spectral domain. Since there exists a complete spectral factorization of paraunitary systems, any orthogonal convolution layer can be parameterized as convolutions of spatial filters. Our framework endows high expressive power to various convolutional layers while maintaining their exact orthogonality. Furthermore, our layers are memory and computationally efficient for deep networks compared to previous designs. Our versatile framework, for the first time, enables the study of architecture designs for deep orthogonal networks, such as choices of skip connection, initialization, stride, and dilation. Consequently, we scale up orthogonal networks to deep architectures, including ResNet, WideResNet, and ShuffleNet, substantially increasing the performance over the traditional shallow orthogonal networks.


title: Faster imaging simulation through complex systems: a coronagraphic example

abstract: End-to-end simulation of the influence of the optical train on the observed scene is important across optics and is particularly important for predicting the science yield of astronomical telescopes. As a consequence of their goal of suppressing starlight, coronagraphic instruments for high-contrast imaging have particularly complex field-dependent point-spread-functions (PSFs). The Roman Coronagraph Instrument (CGI), Hybrid Lyot Coronagraph (HLC) is one example. The purpose of the HLC is to image exoplanets and exozodiacal dust in order to understand dynamics of solar systems. This paper details how images of exoplanets and exozodiacal dust are simulated using some of the most recent PSFs generated for the CGI HLC imaging mode. First, PSFs are generated using physical optics propagation techniques. Then, the angular offset of pixels in image scenes, such as exozodiacal dust models, are used to create a library of interpolated PSFs using interpolation and rotation techniques, such that the interpolated PSFs correspond to angular offsets of the pixels. This means interpolation needs only be done once and an image can then be simulated by multiplying the vector array of the model astrophysical scene by the matrix array of the interpolated PSF data. This substantially reduces the time required to generate image simulations by reducing the process to matrix multiplication, allowing for faster scene analysis. We will detail the steps required to generate coronagraphic scenes, quantify the speed-up of our matrix approach versus other implementations, and provide example code for users who wish to simulate their own scenes using publicly available HLC PSFs.


title: Second-Order Conic and Polyhedral Approximations of the Exponential Cone: Application to Mixed-Integer Exponential Conic Programs

abstract: Exponents and logarithms are fundamental components in many important applications such as logistic regression, maximum likelihood, relative entropy, and so on. Since the exponential cone can be viewed as the epigraph of perspective of the natural exponential function or the hypograph of perspective of the natural logarithm function, many mixed-integer convex programs involving exponential or logarithm functions can be recast as mixed-integer exponential conic programs (MIECPs). However, unlike mixed-integer linear programs (MILPs) and mixed-integer second-order conic programs (MISOCPs), MIECPs are still under development. To harvest the past efforts on MILPs and MISOCPs, this paper presents second-order conic (SOC) and polyhedral approximation schemes for the exponential cone with application to MIECPs. To do so, we first extend and generalize existing SOC approximation approaches in the extended space, propose new scaling and shifting methods, prove approximation accuracies, and derive lower bounds of approximations. We then study the polyhedral outer approximation of the exponential cones in the original space using gradient inequalities, show its approximation accuracy, and derive a lower bound of the approximation. When implementing SOC approximations, we suggest learning the approximation pattern by testing smaller cases and then applying it to the large-scale ones; and for the polyhedral approximation, we suggest using the branch and cut method for MIECPs. Our numerical study shows that the proposed methods show speed-ups over solver MOSEK for MIECPs, and the scaling, shifting, and polyhedral outer approximation methods work very well.


title: Continuous evolution of electromagnetic field in heavy-ion collisions

abstract: In heavy-ion collisions the electromagnetic field exists before the hot nuclear matter emergence. Requiring the field continuity we compute it in the central rapidity region by taking into account the electromagnetic response of the Quark Gluon Plasma. We show that the electromagnetic field is nearly time-independent from about 1~fm/c after the collision until the freezeout.


title: Convex Optimization for Trajectory Generation

abstract: Reliable and efficient trajectory generation methods are a fundamental need for autonomous dynamical systems of tomorrow. The goal of this article is to provide a comprehensive tutorial of three major convex optimization-based trajectory generation methods: lossless convexification (LCvx), and two sequential convex programming algorithms known as SCvx and GuSTO. In this article, trajectory generation is the computation of a dynamically feasible state and control signal that satisfies a set of constraints while optimizing key mission objectives. The trajectory generation problem is almost always nonconvex, which typically means that it is not readily amenable to efficient and reliable solution onboard an autonomous vehicle. The three algorithms that we discuss use problem reformulation and a systematic algorithmic strategy to nonetheless solve nonconvex trajectory generation tasks through the use of a convex optimizer. The theoretical guarantees and computational speed offered by convex optimization have made the algorithms popular in both research and industry circles. To date, the list of applications includes rocket landing, spacecraft hypersonic reentry, spacecraft rendezvous and docking, aerial motion planning for fixed-wing and quadrotor vehicles, robot motion planning, and more. Among these applications are high-profile rocket flights conducted by organizations like NASA, Masten Space Systems, SpaceX, and Blue Origin. This article aims to give the reader the tools and understanding necessary to work with each algorithm, and to know what each method can and cannot do. A publicly available source code repository supports the provided numerical examples. By the end of the article, the reader should be ready to use the methods, to extend them, and to contribute to their many exciting modern applications.


title: The minimal ramification problem for rational function fields over finite fields

abstract: We study the minimal number of ramified primes in Galois extensions of rational function fields over finite fields with prescribed finite Galois group. In particular, we obtain a general conjecture in analogy with the well studied case of number fields, which we establish for abelian, symmetric and alternating groups in many cases.


title: Planning on a (Risk) Budget: Safe Non-Conservative Planning in Probabilistic Dynamic Environments

abstract: Planning in environments with other agents whose future actions are uncertain often requires compromise between safety and performance. Here our goal is to design efficient planning algorithms with guaranteed bounds on the probability of safety violation, which nonetheless achieve non-conservative performance. To quantify a system's risk, we define a natural criterion called interval risk bounds (IRBs), which provide a parametric upper bound on the probability of safety violation over a given time interval or task. We present a novel receding horizon algorithm, and prove that it can satisfy a desired IRB. Our algorithm maintains a dynamic risk budget which constrains the allowable risk at each iteration, and guarantees recursive feasibility by requiring a safe set to be reachable by a contingency plan within the budget. We empirically demonstrate that our algorithm is both safer and less conservative than strong baselines in two simulated autonomous driving experiments in scenarios involving collision avoidance with other vehicles, and additionally demonstrate our algorithm running on an autonomous class 8 truck.


title: Market Complete Option Valuation using a Jarrow-Rudd Pricing Tree with Skewness and Kurtosis

abstract: Applying the Cherny-Shiryaev-Yor invariance principle, we introduce a generalized Jarrow-Rudd (GJR) option pricing model with uncertainty driven by a skew random walk. The GJR pricing tree exhibits skewness and kurtosis in both the natural and risk-neutral world. We construct implied surfaces for the parameters determining the GJR tree. Motivated by Merton's pricing tree incorporating transaction costs, we extend the GJR pricing model to include a hedging cost. We demonstrate ways to fit the GJR pricing model to a market driver that influences the price dynamics of the underlying asset. We supplement our findings with numerical examples.


title: A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness

abstract: Successful adoption of deep learning (DL) in the wild requires models to be: (1) compact, (2) accurate, and (3) robust to distributional shifts. Unfortunately, efforts towards simultaneously meeting these requirements have mostly been unsuccessful. This raises an important question: Is the inability to create Compact, Accurate, and Robust Deep neural networks (CARDs) fundamental? To answer this question, we perform a large-scale analysis of popular model compression techniques which uncovers several intriguing patterns. Notably, in contrast to traditional pruning approaches (e.g., fine tuning and gradual magnitude pruning), we find that "lottery ticket-style" approaches can surprisingly be used to produce CARDs, including binary-weight CARDs. Specifically, we are able to create extremely compact CARDs that, compared to their larger counterparts, have similar test accuracy and matching (or better) robustness -- simply by pruning and (optionally) quantizing. Leveraging the compactness of CARDs, we develop a simple domain-adaptive test-time ensembling approach (CARD-Decks) that uses a gating module to dynamically select appropriate CARDs from the CARD-Deck based on their spectral-similarity with test samples. The proposed approach builds a "winning hand'' of CARDs that establishes a new state-of-the-art (on RobustBench) on CIFAR-10-C accuracies (i.e., 96.8% standard and 92.75% robust) and CIFAR-100-C accuracies (80.6% standard and 71.3% robust) with better memory usage than non-compressed baselines (pretrained CARDs and CARD-Decks available at https://github.com/RobustBench/robustbench). Finally, we provide theoretical support for our empirical findings.


title: Tetrahedron maps, Yang-Baxter maps, and partial linearisations

abstract: We study tetrahedron maps, which are set-theoretical solutions to the Zamolodchikov tetrahedron equation, and Yang-Baxter maps, which are set-theoretical solutions to the quantum Yang-Baxter equation. In particular, we clarify the structure of the nonlinear algebraic relations which define linear (parametric) tetrahedron maps (with nonlinear dependence on parameters), and we present several transformations which allow one to obtain new such maps from known ones. Furthermore, we prove that the differential of a (nonlinear) tetrahedron map on a manifold is a tetrahedron map as well. Similar results on the differentials of Yang-Baxter and entwining Yang-Baxter maps are also presented. Using the obtained general results, we construct new examples of (parametric) Yang-Baxter and tetrahedron maps. The considered examples include maps associated with integrable systems and matrix groups. In particular, we obtain a parametric family of new linear tetrahedron maps, which are linear approximations for the nonlinear tetrahedron map constructed by Dimakis and M\"uller-Hoissen [arXiv:1708.05694] in a study of soliton solutions of vector Kadomtsev-Petviashvili (KP) equations. Also, we present invariants for this nonlinear tetrahedron map.


title: Compactness for $\Omega$-Yang-Mills connections

abstract: On a Riemannian manifold of dimension $n$ we extend the known analytic results on Yang-Mills connections to the class of connections called $\Omega$-Yang-Mills connections, where $\Omega$ is a smooth, not necessarily closed, $(n-4)$-form. Special cases include $\Omega$-anti-self-dual connections and Hermitian-Yang-Mills connections over general complex manifolds. By a key observation, a weak compactness result is obtained for moduli space of smooth $\Omega$-Yang-Mills connections with uniformly $L^2$ bounded curvature, and it can be improved in the case of Hermitian-Yang-Mills connections over general complex manifolds. A removable singularity theorem for singular $\Omega$-Yang-Mills connections on a trivial bundle with small energy concentration is also proven. As an application, it is shown how to compactify the moduli space of smooth Hermitian-Yang-Mills connections on unitary bundles over a class of balanced manifolds of Hodge-Riemann type. This class includes the metrics coming from multipolarizations, and in particular, the Kaehler metrics. In the case of multipolarizations on a projective algebraic manifold, the compactification of smooth irreducible Hermitian-Yang-Mills connections with fixed determinant modulo gauge transformations inherits a complex structure from algebro-geometric considerations.


title: Multivariate Pair Trading by Volatility & Model Adaption Trade-off

abstract: Pair trading is one of the most discussed topics among financial researches. Despite a growing base of work, portfolio management for multivariate time series is rarely discussed. On the other hand, most researches focus on refining strategy rules instead of finding the optimal portfolio weight. In this paper, we brought up a simple yet profitable strategy called Volatility & Model Adaption Trade-off (VMAT) to leverage the issues. Experiment studies show its superior profit performance over baselines.


title: The nonabelian Hodge correspondence for balanced hermitian metrics of Hodge-Riemann type

abstract: This paper extends the nonabelian Hodge correspondence for Kaehler manifolds to a larger class of hermitian metrics on complex manifolds called balanced of Hodge-Riemann type. Essentially, it grows out of a few key observations so that the known results, especially the Donaldson-Uhlenbeck-Yau theorem and Corlette's theorem, can be applied in our setting. Though not necessarily Kaehler, we show that the Sampson-Siu Theorem proving that harmonic maps are pluriharmonic remains valid for a slightly smaller class by using the known argument. Special important examples include those balanced metrics arising from multipolarizations.


title: An Arecibo 327 MHz Search for Radio Pulsars and Bursts in the Dwarf Irregular Galaxies Leo A and T

abstract: We have conducted an Arecibo 327 MHz search of two dwarf irregular galaxies in the Local Group, Leo A and T, for radio pulsars and single pulses from fast radio bursts and other giant pulse emitters. We detected no astrophysical signals in this search, and we estimate flux density limits on both periodic and burst emission. Our derived luminosity limits indicate that only the most luminous radio pulsars known in our Galaxy and in the Magellanic Clouds (MCs) would have been detectable in our search if they were at the distances of Leo A and T. Given the much smaller stellar mass content and star formation rates of Leo A and T compared to the Milky Way and the MCs, there are likely to be few (if any) extremely luminous pulsars in these galaxies. It is therefore not surprising that we detected no pulsars in our search.


title: EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signals

abstract: Convolutional neural networks (CNN) have been frequently used to extract subject-invariant features from electroencephalogram (EEG) for classification tasks. This approach holds the underlying assumption that electrodes are equidistant analogous to pixels of an image and hence fails to explore/exploit the complex functional neural connectivity between different electrode sites. We overcome this limitation by tailoring the concepts of convolution and pooling applied to 2D grid-like inputs for the functional network of electrode sites. Furthermore, we develop various graph neural network (GNN) models that project electrodes onto the nodes of a graph, where the node features are represented as EEG channel samples collected over a trial, and nodes can be connected by weighted/unweighted edges according to a flexible policy formulated by a neuroscientist. The empirical evaluations show that our proposed GNN-based framework outperforms standard CNN classifiers across ErrP, and RSVP datasets, as well as allowing neuroscientific interpretability and explainability to deep learning methods tailored to EEG related classification problems. Another practical advantage of our GNN-based framework is that it can be used in EEG channel selection, which is critical for reducing computational cost, and designing portable EEG headsets.


title: Binary classification with corrupted labels

abstract: In a binary classification problem where the goal is to fit an accurate predictor, the presence of corrupted labels in the training data set may create an additional challenge. However, in settings where likelihood maximization is poorly behaved-for example, if positive and negative labels are perfectly separable-then a small fraction of corrupted labels can improve performance by ensuring robustness. In this work, we establish that in such settings, corruption acts as a form of regularization, and we compute precise upper bounds on estimation error in the presence of corruptions. Our results suggest that the presence of corrupted data points is beneficial only up to a small fraction of the total sample, scaling with the square root of the sample size.


title: Optical response and band structure of LiCoO2 including electron-hole interaction effects

abstract: The optical response functions and band structures of LiCoO$_2$ are studied at different levels of approximation, from density functional theory (DFT) in the generalized gradient approximation (GGA) to quasiparticle self-consistent QS$GW$ (with $G$ for Green's function and $W$ for screened Coulomb interaction) without and with ladder diagrams (QS$G\hat W$) and the Bethe Salpeter Equation (BSE) approach. The QS$GW$ method is found to strongly overestimate the band gap and electron-hole or excitonic effects are found to be important. They lower the quasiparticle gap by only about 11~\% but the lowest energy peaks in absorption are found to be excitonic in nature. The contributions from different band to band transitions and the relation of excitons to band-to-band transitions are analyzed. The excitons are found to be strongly localized. A comparison to experimental data is presented.


title: Comment on "Steady-State Coherences by Composite System-Bath Interactions"

abstract: In a recent Letter, Guarnieri et al. [1] reported on the possibility of generating steady-state coherence (SSC) in the energy basis of a two-level system by the sole action of a single thermal bath also for weak system-bath coupling and due to a composite form of this interaction. The results are based on a time-local Bloch-Redfield master equation without secular approximation and the associated set of Bloch equations, all derived in the Supplemental Material (SM) of Ref. [1]. We comment that the results reported by the authors present both technical flaws and conceptual limitations that substantially impact some of their main conclusions. Our objections mainly concern (a) technical errors in the calculation of SSC (Eqs.(2)-(4) in [1]) and (b) negativity issues associated with the weak-coupling master equation employed by the authors.


title: Blow-up and scattering for the 1D NLS with point nonlinearity above the mass-energy threshold

abstract: In this paper, we study the nonlinear Schr\"odinger equation with focusing point nonlinearity in dimension one. First, we establish a scattering criterion for the equation based on Kenig-Merle's compactness-rigidity argument. Then we prove the energy scattering below and above the mass-energy threshold. We also describe the dynamics of solutions with data at the ground state threshold. Finally, we prove a blow-up criteria for the equation with initial data with arbitrarily large energy.


title: Human-AI Interactions Through A Gricean Lens

abstract: Grice's Cooperative Principle (1975) describes the implicit maxims that guide conversation between humans. As humans begin to interact with non-human dialogue systems more frequently and in a broader scope, an important question emerges: what principles govern those interactions? The present study addresses this question by evaluating human-AI interactions using Grice's four maxims; we demonstrate that humans do, indeed, apply these maxims to interactions with AI, even making explicit references to the AI's performance through a Gricean lens. Twenty-three participants interacted with an American English-speaking Alexa and rated and discussed their experience with an in-lab researcher. Researchers then reviewed each exchange, identifying those that might relate to Grice's maxims: Quantity, Quality, Manner, and Relevance. Many instances of explicit user frustration stemmed from violations of Grice's maxims. Quantity violations were noted for too little but not too much information, while Quality violations were rare, indicating trust in Alexa's responses. Manner violations focused on speed and humanness. Relevance violations were the most frequent, and they appear to be the most frustrating. While the maxims help describe many of the issues participants encountered, other issues do not fit neatly into Grice's framework. Participants were particularly averse to Alexa initiating exchanges or making unsolicited suggestions. To address this gap, we propose the addition of human Priority to describe human-AI interaction. Humans and AIs are not conversational equals, and human initiative takes priority. We suggest that the application of Grice's Cooperative Principles to human-AI interactions is beneficial both from an AI development perspective and as a tool for describing an emerging form of interaction.


title: Probing Image-Language Transformers for Verb Understanding

abstract: Multimodal image-language transformers have achieved impressive results on a variety of tasks that rely on fine-tuning (e.g., visual question answering and image retrieval). We are interested in shedding light on the quality of their pretrained representations -- in particular, if these models can distinguish different types of verbs or if they rely solely on nouns in a given sentence. To do so, we collect a dataset of image-sentence pairs (in English) consisting of 421 verbs that are either visual or commonly found in the pretraining data (i.e., the Conceptual Captions dataset). We use this dataset to evaluate pretrained image-language transformers and find that they fail more in situations that require verb understanding compared to other parts of speech. We also investigate what category of verbs are particularly challenging.


title: A Real-World Markov Chain arising in Recreational Volleyball

abstract: Card shuffling models have provided simple motivating examples for the mathematical theory of mixing times for Markov chains. As a complement, we introduce a more intricate realistic model of a certain observable real-world scheme for mixing human players onto teams. We quantify numerically the effectiveness of this mixing scheme over the 7 or 8 steps performed in practice. We give a combinatorial proof of the non-trivial fact that the chain is indeed irreducible.


title: Staircase symmetries in Hirzebruch surfaces

abstract: This paper continues the investigation of staircases in the family of Hirzebruch surfaces formed by blowing up the projective plane with weight b, that was started in Bertozzi, Holm et al. in arXiv:2010.08567. We explain the symmetries underlying the structure of the set of b that admit staircases, and show how the properties of these symmetries arise from a governing Diophantine equation. We also greatly simplify the techniques needed to show that a family of steps does form a staircase by using arithmetic properties of the accumulation function. There should be analogous results about both staircases and mutations for the other rational toric domains considered, for example, by Cristofaro-Gardiner et al. in arXiv:2004.07829 and by Casals--Vianna in arXiv:2004.13232.


title: FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator

abstract: Recent works demonstrated the promise of using resistive random access memory (ReRAM) as an emerging technology to perform inherently parallel analog domain in-situ matrix-vector multiplication -- the intensive and key computation in DNNs. With weights stored in the ReRAM crossbar cells as conductance, when the input vector is applied to word lines, the matrix-vector multiplication results can be generated as the current in bit lines. A key problem is that the weight can be either positive or negative, but the in-situ computation assumes all cells on each crossbar column with the same sign. The current architectures either use two ReRAM crossbars for positive and negative weights, or add an offset to weights so that all values become positive. Neither solution is ideal: they either double the cost of crossbars, or incur extra offset circuity. To better solve this problem, this paper proposes FORMS, a fine-grained ReRAM-based DNN accelerator with polarized weights. Instead of trying to represent the positive/negative weights, our key design principle is to enforce exactly what is assumed in the in-situ computation -- ensuring that all weights in the same column of a crossbar have the same sign. It naturally avoids the cost of an additional crossbar. Such weights can be nicely generated using alternating direction method of multipliers (ADMM) regularized optimization, which can exactly enforce certain patterns in DNN weights. To achieve high accuracy, we propose to use fine-grained sub-array columns, which provide a unique opportunity for input zero-skipping, significantly avoiding unnecessary computations. It also makes the hardware much easier to implement. Putting all together, with the same optimized models, FORMS achieves significant throughput improvement and speed up in frame per second over ISAAC with similar area cost.


title: Topological full groups of minimal subshifts and quantifying local embeddings into finite groups

abstract: We investigate quantitative aspects of the LEF property for subgroups of the topological full group $[[ \sigma ]]$ of a two-sided minimal subshift over a finite alphabet, measured via the LEF growth function. We show that the LEF growth of $[[ \sigma ]]^{\prime}$ may be bounded from above and below in terms of the recurrence function and the complexity function of the subshift, respectively. As an application, we construct groups of previously unseen LEF growth types, and exhibit a continuum of finitely generated LEF groups which may be distinguished from one another by their LEF growth.


title: Contrastive Reinforcement Learning of Symbolic Reasoning Domains

abstract: Abstract symbolic reasoning, as required in domains such as mathematics and logic, is a key component of human intelligence. Solvers for these domains have important applications, especially to computer-assisted education. But learning to solve symbolic problems is challenging for machine learning algorithms. Existing models either learn from human solutions or use hand-engineered features, making them expensive to apply in new domains. In this paper, we instead consider symbolic domains as simple environments where states and actions are given as unstructured text, and binary rewards indicate whether a problem is solved. This flexible setup makes it easy to specify new domains, but search and planning become challenging. We introduce four environments inspired by the Mathematics Common Core Curriculum, and observe that existing Reinforcement Learning baselines perform poorly. We then present a novel learning algorithm, Contrastive Policy Learning (ConPoLe) that explicitly optimizes the InfoNCE loss, which lower bounds the mutual information between the current state and next states that continue on a path to the solution. ConPoLe successfully solves all four domains. Moreover, problem representations learned by ConPoLe enable accurate prediction of the categories of problems in a real mathematics curriculum. Our results suggest new directions for reinforcement learning in symbolic domains, as well as applications to mathematics education.


title: Efficient recurrence for the enumeration of permutations with fixed pinnacle set

abstract: Initiated by Davis, Nelson, Petersen and Tenner (2018), the enumerative study of pinnacle sets of permutations has attracted a fair amount of attention recently. In this article, we provide a recurrence that can be used to compute efficiently the number $|\mathfrak{S}_n(P)|$ of permutations of size $n$ with a given pinnacle set $P$, with arithmetic complexity $O(k^4 + k\log n)$ for $P$ of size $k$. A symbolic expression can also be computed in this way for pinnacle sets of fixed size. A weighted sum $q_n(P)$ of $|\mathfrak{S}_n(P)|$ proposed in Davis, Nelson, Petersen and Tenner (2018) seems to have a simple form, and a conjectural form is given recently by Flaque, Novelli and Thibon (2021+). We settle the problem by providing and proving an alternative form of $q_n(P)$, which has a strong combinatorial flavor. We also study admissible orderings of a given pinnacle set, first considered by Rusu (2020) and characterized by Rusu and Tenner (2021), and we give an efficient algorithm for their counting.


title: Quantum Optimal Control for Pure-State Preparation Using One Initial State

abstract: This paper presents a framework for solving the pure-state preparation problem using numerical optimal control. As an example, we consider the case where a number of qubits are dispersively coupled to a readout cavity. We model open system quantum dynamics using the Markovian Lindblad master equation, driven by external control pulses. The main result of this paper develops a basis of density matrices (a parameterization) where each basis element is a density matrix itself. Utilizing a specific objective function, we show how an ensemble of the basis elements can be used as a single initial state throughout the optimization process - independent of the system dimension. We apply the general framework to the specific application of ground-state reset of one and two qubits coupled to a readout cavity.


title: Fr\'{e}chet derivatives of expected functionals of solutions to stochastic differential equations

abstract: In the analysis of stochastic dynamical systems described by stochastic differential equations (SDEs), it is often of interest to analyse the sensitivity of the expected value of a functional of the solution of the SDE with respect to perturbations in the SDE parameters. In this paper, we consider path functionals that depend on the solution of the SDE up to a stopping time. We derive formulas for Fr\'{e}chet derivatives of the expected values of these functionals with respect to bounded perturbations of the drift, using the Cameron-Martin-Girsanov theorem for the change of measure. Using these derivatives, we construct an example to show that the map that sends the change of drift to the corresponding relative entropy is not in general convex. We then analyse the existence and uniqueness of solutions to stochastic optimal control problems defined on possibly random time intervals, as well as gradient-based numerical methods for solving such problems.


title: $k$-positivity of dual canonical basis elements from 1324- and 2143-avoiding Kazhdan-Lusztig immanants

abstract: In this note, we show that certain dual canonical basis elements of $\mathbb{C}[SL_m]$ are positive when evaluated on $k$-positive matrices, matrices whose minors of size $k \times k$ and smaller are positive. Skandera showed that all dual canonical basis elements of $\mathbb{C}[SL_m]$ can be written in terms of Kazhdan-Lusztig immanants, which were introduced by Rhoades and Skandera. We focus on the basis elements which are expressed in terms of Kazhdan-Lusztig immanants indexed by 1324- and 2143-avoiding permutations. This extends previous work of the authors on Kazhdan-Lusztig immanants and uses similar tools, namely Lewis Carroll's identity (also known as the Desnanot-Jacobi identity).


title: Recovery Guarantees for Time-varying Pairwise Comparison Matrices with Non-transitivity

abstract: Pairwise comparison matrices have received substantial attention in a variety of applications, especially in rank aggregation, the task of flattening items into a one-dimensional (and thus transitive) ranking. However, non-transitive preference cycles can arise in practice due to the fact that making a decision often requires a complex evaluation of multiple factors. In some applications, it may be important to identify and preserve information about the inherent non-transitivity, either in the pairwise comparison data itself or in the latent feature space. In this work, we develop structured models for non-transitive pairwise comparison matrices that can be exploited to recover such matrices from incomplete noisy data and thus allow the detection of non-transitivity. Considering that individuals' tastes and items' latent features may change over time, we formulate time-varying pairwise comparison matrix recovery as a dynamic skew-symmetric matrix recovery problem by modeling changes in the low-rank factors of the pairwise comparison matrix. We provide theoretical guarantees for the recovery and numerically test the proposed theory with both synthetic and real-world data.


title: Semi-microscopic construction of multi-$\alpha$ cluster spaces

abstract: An approximate but straight forward projection method to molecular many alpha-particle states is proposed and the overlap to the shell model space is determined. The resulting space is in accordance with the shell model, but still contains states which are not completely symmetric under permutations of the alpha-particles, which is one reason to call the construction semi-microscopic. A new contribution is the construction of the 6- and 7-$\alpha$-particle spaces. The errors of the method propagate toward larger number of alpha-particles and larger shell excitations. In order to show the effectiveness of the construction proposed, the so obtained spaces are applied, within an algebraic cluster model, to $^{20}$Ne, $^{24}$Mg and $^{28}$Si, each treated as a many-alpha-particle system. Former results on $^{12}$C and $^{16}$O are resumed.


title: Selecting for Selection: Learning To Balance Adaptive and Diversifying Pressures in Evolutionary Search

abstract: Inspired by natural evolution, evolutionary search algorithms have proven remarkably capable due to their dual abilities to radiantly explore through diverse populations and to converge to adaptive pressures. A large part of this behavior comes from the selection function of an evolutionary algorithm, which is a metric for deciding which individuals survive to the next generation. In deceptive or hard-to-search fitness landscapes, greedy selection often fails, thus it is critical that selection functions strike the correct balance between gradient-exploiting adaptation and exploratory diversification. This paper introduces Sel4Sel, or Selecting for Selection, an algorithm that searches for high-performing neural-network-based selection functions through a meta-evolutionary loop. Results on three distinct bitstring domains indicate that Sel4Sel networks consistently match or exceed the performance of both fitness-based selection and benchmarks explicitly designed to encourage diversity. Analysis of the strongest Sel4Sel networks reveals a general tendency to favor highly novel individuals early on, with a gradual shift towards fitness-based selection as deceptive local optima are bypassed.


title: Topological Magnetic Hysteresis in Single Crystals of CeAgSb2 Ferromagnet

abstract: Closed-topology magnetic domains are usually observed in thin films and in an applied magnetic field. Here we report the observation of rectangular cross-section tubular ferromagnetic domains in thick single crystals of CeAgSb2 in zero applied field. Relatively low exchange energy, small net magnetic moment, and anisotropic in-plane crystal electric fields lower the domain wall energy and allow for the formation of the closed-topology patterns. Upon cycling the magnetic field, the domain structure irreversibly transforms into a dendritic open-topology pattern. This transition between closed and open topologies results in a "topological magnetic hysteresis" - the actual hysteresis in magnetization, not due to the imperfections and pinning, but due to the difference in the pattern morphology. Similar physics was suggested before in pure type-I superconductors and is believed to be a generic feature of other nonlinear multi-phase systems in the clean limit.


title: On Planetary Orbits in Entropic Gravity

abstract: Starting with an entropy that includes volumetric, area and length terms as well as logarithmic contributions, we derive the corresponding modified Newtonian gravity and derive the expression for planetary orbits. We calculate the shift of the perihelion of Mercury to find bounds to the parameters associated to the modified Newtonian gravity. We compare the parameter associated to the volumetric contribution in the entropy-area relationship with the value derived for galactic rotation curves and the value obtained from the cosmological constant.


title: Separated and complete adelic models for one-dimensional Noetherian tensor-triangulated categories

abstract: We prove the existence of various adelic-style models for rigidly small-generated tensor-triangulated categories whose Balmer spectrum is a one-dimensional Noetherian topological space. This special case of our general programme of giving adelic models is particularly concrete and accessible, and we illustrate it with examples from algebra, geometry, topology and representation theory. This version: minor improvements, additional references and examples.


title: Positional Contrastive Learning for Volumetric Medical Image Segmentation

abstract: The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts. Contrastive learning, an unsupervised learning technique, has been proved powerful in learning image-level representations from unlabeled data. The learned encoder can then be transferred or fine-tuned to improve the performance of downstream tasks with limited labels. A critical step in contrastive learning is the generation of contrastive data pairs, which is relatively simple for natural image classification but quite challenging for medical image segmentation due to the existence of the same tissue or organ across the dataset. As a result, when applied to medical image segmentation, most state-of-the-art contrastive learning frameworks inevitably introduce a lot of false-negative pairs and result in degraded segmentation quality. To address this issue, we propose a novel positional contrastive learning (PCL) framework to generate contrastive data pairs by leveraging the position information in volumetric medical images. Experimental results on CT and MRI datasets demonstrate that the proposed PCL method can substantially improve the segmentation performance compared to existing methods in both semi-supervised setting and transfer learning setting.


title: Mixed-Integer Nonlinear Programming for State-based Non-Intrusive Load Monitoring

abstract: Energy disaggregation, known in the literature as Non-Intrusive Load Monitoring (NILM), is the task of inferring the energy consumption of each appliance given the aggregate signal recorded by a single smart meter. In this paper, we propose a novel two-stage optimization-based approach for energy disaggregation. In the first phase, a small training set consisting of disaggregated power profiles is used to estimate the parameters and the power states by solving a mixed integer programming problem. Once the model parameters are estimated, the energy disaggregation problem is formulated as a constrained binary quadratic optimization problem. We incorporate penalty terms that exploit prior knowledge on how the disaggregated traces are generated, and appliance-specific constraints characterizing the signature of different types of appliances operating simultaneously. Our approach is compared with existing optimization-based algorithms both on a synthetic dataset and on three real-world datasets. The proposed formulation is computationally efficient, able to disambiguate loads with similar consumption patterns, and successfully reconstruct the signatures of known appliances despite the presence of unmetered devices, thus overcoming the main drawbacks of the optimization-based methods available in the literature.


abstract: We propose Automatic Curricula via Expert Demonstrations (ACED), a reinforcement learning (RL) approach that combines the ideas of imitation learning and curriculum learning in order to solve challenging robotic manipulation tasks with sparse reward functions. Curriculum learning solves complicated RL tasks by introducing a sequence of auxiliary tasks with increasing difficulty, yet how to automatically design effective and generalizable curricula remains a challenging research problem. ACED extracts curricula from a small amount of expert demonstration trajectories by dividing demonstrations into sections and initializing training episodes to states sampled from different sections of demonstrations. Through moving the reset states from the end to the beginning of demonstrations as the learning agent improves its performance, ACED not only learns challenging manipulation tasks with unseen initializations and goals, but also discovers novel solutions that are distinct from the demonstrations. In addition, ACED can be naturally combined with other imitation learning methods to utilize expert demonstrations in a more efficient manner, and we show that a combination of ACED with behavior cloning allows pick-and-place tasks to be learned with as few as 1 demonstration and block stacking tasks to be learned with 20 demonstrations.


title: Large-scale regularity for the stationary Navier-Stokes equations over non-Lipschitz boundaries

abstract: In this paper we address the large-scale regularity theory for the stationary Navier-Stokes equations in highly oscillating bumpy John domains. These domains are very rough, possibly with fractals or cusps, at the microscopic scale, but are amenable to the mathematical analysis of the Navier-Stokes equations. We prove: (i) a large-scale Calder\'on-Zygmund estimate, (ii) a large-scale Lipschitz estimate, (iii) large-scale higher-order regularity estimates, namely, $C^{1,\gamma}$ and $C^{2,\gamma}$ estimates. These nice regularity results are inherited only at mesoscopic scales, and clearly fail in general at the microscopic scales. We emphasize that the large-scale $C^{1,\gamma}$ regularity is obtained by using first-order boundary layers constructed via a new argument. The large-scale $C^{2,\gamma}$ regularity relies on the construction of second-order boundary layers, which allows for certain boundary data with linear growth at spatial infinity. To the best of our knowledge, our work is the first to carry out such an analysis. In the wake of many works in quantitative homogenization, our results strongly advocate in favor of considering the boundary regularity of the solutions to fluid equations as a multiscale problem, with improved regularity at or above a certain scale.


title: Mungojerrie: Reinforcement Learning of Linear-Time Objectives

abstract: Reinforcement learning synthesizes controllers without prior knowledge of the system. At each timestep, a reward is given. The controllers optimize the discounted sum of these rewards. Applying this class of algorithms requires designing a reward scheme, which is typically done manually. The designer must ensure that their intent is accurately captured. This may not be trivial, and is prone to error. An alternative to this manual programming, akin to programming directly in assembly, is to specify the objective in a formal language and have it "compiled" to a reward scheme. Mungojerrie (https://plv.colorado.edu/mungojerrie/) is a tool for testing reward schemes for $\omega$-regular objectives on finite models. The tool contains reinforcement learning algorithms and a probabilistic model checker. Mungojerrie supports models specified in PRISM and $\omega$-automata specified in HOA.


title: An Open-Source Gaussian Beamlet Decomposition Tool for Modeling Astronomical Telescopes

abstract: In the pursuit of directly imaging exoplanets, the high-contrast imaging community has developed a multitude of tools to simulate the performance of coronagraphs on segmented-aperture telescopes. As the scale of the telescope increases and science cases move toward shorter wavelengths, the required physical optics propagation to optimize high-contrast imaging instruments becomes computationally prohibitive. Gaussian Beamlet Decomposition (GBD) is an alternative method of physical optics propagation that decomposes an arbitrary wavefront into paraxial rays. These rays can be propagated expeditiously using ABCD matrices, and converted into their corresponding Gaussian beamlets to accurately model physical optics phenomena without the need of diffraction integrals. The GBD technique has seen recent development and implementation in commercial software (e.g. FRED, CODE V, ASAP) but appears to lack an open-source platform. We present a new GBD tool developed in Python to model physical optics phenomena, with the goal of alleviating the computational burden for modeling complex apertures, many-element systems, and introducing the capacity to model misalignment errors. This study demonstrates the synergy of the geometrical and physical regimes of optics utilized by the GBD technique, and is motivated by the need for advancing open-source physical optics propagators for segmented-aperture telescope coronagraph design and analysis. This work illustrates GBD with Poisson's spot calculations and show significant runtime advantage of GBD over Fresnel propagators for many-element systems.


title: Politicians' Willingness to Agree: Evidence from the interactions in Twitter of Chilean Deputies

abstract: Measuring the number of "likes" in Twitter and the number of bills voted in favor by the members of the Chilean Chambers of Deputies. We empirically study how signals of agreement in Twitter translates into cross-cutting voting during a high political polarization period of time. Our empirical analysis is guided by a spatial voting model that can help us to understand Twitter as a market of signals. Our model, which is standard for the public choice literature, introduces authenticity, an intrinsic factor that distort politicians' willigness to agree (Trilling, 2009). As our main contribution, we document empirical evidence that "likes" between opponents are positively related to the number of bills voted by the same pair of politicians in Congress, even when we control by politicians' time-invariant characteristics, coalition affiliation and following links in Twitter. Our results shed light into several contingent topics, such as polarization and disagreement within the public sphere.


title: mPyPl: Python Monadic Pipeline Library for Complex Functional Data Processing

abstract: In this paper, we present a new Python library called mPyPl, which is intended to simplify complex data processing tasks using functional approach. This library defines operations on lazy data streams of named dictionaries represented as generators (so-called multi-field datastreams), and allows enriching those data streams with more 'fields' in the process of data preparation and feature extraction. Thus, most data preparation tasks can be expressed in the form of neat linear 'pipeline', similar in syntax to UNIX pipes, or |> functional composition operator in F#. We define basic operations on multi-field data streams, which resemble classical monadic operations, and show similarity of the proposed approach to monads in functional programming. We also show how the library was used in complex deep learning tasks of event detection in video, and discuss different evaluation strategies that allow for different compromises in terms of memory and performance.


title: Stability properties of complete self-shrinking surfaces in $\mathbb{R}^3$

abstract: This paper studies rigidity for immersed self-shrinkers of the mean curvature flow of surfaces in the three-dimensional Euclidean space $\mathbb{R}^3.$ We prove that an immersed self-shrinker with finite $L$-index must be proper and of finite topology. As one of consequences, there is no stable two-dimensional self-shrinker in $\mathbb{R}^3$ without assuming properness. We conclude the paper by giving an affirmative answer to a question of Mantegazza.


title: Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI

abstract: Recent research demonstrated the promise of using resistive random access memory (ReRAM) as an emerging technology to perform inherently parallel analog domain in-situ matrix-vector multiplication -- the intensive and key computation in deep neural networks (DNNs). However, hardware failure, such as stuck-at-fault defects, is one of the main concerns that impedes the ReRAM devices to be a feasible solution for real implementations. The existing solutions to address this issue usually require an optimization to be conducted for each individual device, which is impractical for mass-produced products (e.g., IoT devices). In this paper, we rethink the value of weight pruning in ReRAM-based DNN design from the perspective of model fault tolerance. And a differential mapping scheme is proposed to improve the fault tolerance under a high stuck-on fault rate. Our method can tolerate almost an order of magnitude higher failure rate than the traditional two-column method in representative DNN tasks. More importantly, our method does not require extra hardware cost compared to the traditional two-column mapping scheme. The improvement is universal and does not require the optimization process for each individual device.


title: Generalization of waving-plate theory to multiple interacting swimmers

abstract: Early research in aerodynamics and biological propulsion was dramatically advanced by the analytical solutions of Theodorsen, von K\'{a}rm\'{a}n, Wu and others. While these classical solutions apply only to isolated swimmers, the flow interactions between multiple swimmers are relevant to many practical applications, including the schooling and flocking of animal collectives. In this work, we derive a class of solutions that describe the hydrodynamic interactions between an arbitrary number of swimmers in a two-dimensional inviscid fluid. Our approach is rooted in multiply-connected complex analysis and exploits several recent results. Specifically, the transcendental (Schottky-Klein) prime function serves as the basic building block to construct the appropriate conformal maps and leading-edge-suction functions, which allows us to solve the modified Schwarz problem that arises. As such, our solutions generalize classical thin aerofoil theory, specifically Wu's waving-plate analysis, to the case of multiple swimmers. For the case of a pair of interacting swimmers, we develop an efficient numerical implementation that allows rapid computations of the forces on each swimmer. We investigate flow-mediated equilibria and find excellent agreement between our new solutions and previously reported experimental results. Our solutions recover and unify disparate results in the literature, thereby opening the door for future studies into the interactions between multiple swimmers.


title: Non-equilibrium plasma generation via nano-second multi-mode laser pulses

abstract: A non-equilibrium model for laser-induced plasmas is used to describe how nano-second temporal mode-beating affects plasma kernel formation and growth in quiescent air. The chemically reactive Navier-Stokes equations describe the hydrodynamics, and non-equilibrium effects are modeled based on a two-temperature model. Inverse Bremsstrahlung and multiphoton ionization are self-consistently taken into account via a coupled solution of the equations governing plasma dynamics and beam propagation and attenuation (i.e., Radiative Transfer Equation). This strategy, despite the additional challenges it may bring, allows to minimize empiricism and enables for more accurate simulations since it does not require an artificial plasma seed to trigger breakdown. The benefits of this methodology are demonstrated by the good agreement between the predicted and the experimental plasma boundary evolution and absorbed energy. The same goes for the periodic plasma kernel structures which, as suggested by experiments and confirmed by the simulations discussed here, are linked to the modulating frequency.


title: From wall observations to turbulence: The difficulty of flow reconstruction

abstract: Estimation of the initial state of turbulent channel flow from spatially and temporally resolved wall data is performed using adjoint-variational data assimilation. The accuracy of the predicted flow deteriorates with distance from the wall, most precipitously across the buffer layer beyond which only large-scale structures are reconstructed. To quantify the difficulty of the state estimation, the Hessian of the associated cost function is evaluated at the true solution. The forward-adjoint duality is exploited to efficiently compute the Hessian matrix from the ensemble-averaged cross-correlation of the adjoint fields due to impulses at the sensing locations and times. Characteristics of the Hessian are examined when observations correspond to the streamwise or spanwise wall shear stress or wall pressure. Most of the eigenmodes decay beyond the buffer layer, thus demonstrating weak sensitivity of wall observations to the turbulence in the bulk. However, when the measurement time $t_m^+ \gtrsim 20$, some streamwise-elongated Hessian eigenfunctions remain finite in the outer flow, which corresponds to the sensitivity of wall observations to outer large-scale motions. Furthermore, we report statistics of the adjoint-field kinetic-energy budget at long times, which are distinctly different from those of the forward model. One notable difference is the high concentration of energy within the buffer layer and its narrower support. A large and exponentially amplifying adjoint field in that region leads to large gradients of the cost function, smaller step size in the gradient-based optimization, and difficulty to achieve convergence especially elsewhere in the domain where the gradients are comparatively small.


title: A Survey on Semi-Supervised Learning for Delayed Partially Labelled Data Streams

abstract: Unlabelled data appear in many domains and are particularly relevant to streaming applications, where even though data is abundant, labelled data is rare. To address the learning problems associated with such data, one can ignore the unlabelled data and focus only on the labelled data (supervised learning); use the labelled data and attempt to leverage the unlabelled data (semi-supervised learning); or assume some labels will be available on request (active learning). The first approach is the simplest, yet the amount of labelled data available will limit the predictive performance. The second relies on finding and exploiting the underlying characteristics of the data distribution. The third depends on an external agent to provide the required labels in a timely fashion. This survey pays special attention to methods that leverage unlabelled data in a semi-supervised setting. We also discuss the delayed labelling issue, which impacts both fully supervised and semi-supervised methods. We propose a unified problem setting, discuss the learning guarantees and existing methods, explain the differences between related problem settings. Finally, we review the current benchmarking practices and propose adaptations to enhance them.


title: LiRA: Learning Visual Speech Representations from Audio through Self-supervision

abstract: The large amount of audiovisual content being shared online today has drawn substantial attention to the prospect of audiovisual self-supervised learning. Recent works have focused on each of these modalities separately, while others have attempted to model both simultaneously in a cross-modal fashion. However, comparatively little attention has been given to leveraging one modality as a training objective to learn from the other. In this work, we propose Learning visual speech Representations from Audio via self-supervision (LiRA). Specifically, we train a ResNet+Conformer model to predict acoustic features from unlabelled visual speech. We find that this pre-trained model can be leveraged towards word-level and sentence-level lip-reading through feature extraction and fine-tuning experiments. We show that our approach significantly outperforms other self-supervised methods on the Lip Reading in the Wild (LRW) dataset and achieves state-of-the-art performance on Lip Reading Sentences 2 (LRS2) using only a fraction of the total labelled data.


title: On integral conditions for the existence of first integrals analytic saddle singularities

abstract: We study one-parameter analytic integrable deformations of the germ of $2\times(n-2)$-type complex saddle singularity given by $d(xy)=0$ at the origin $0 \in \mathbb C^2\times \mathbb C^{n-2}$. Such a deformation writes ${\omega}^t=d(xy) + \sum\limits_{j=1}^\infty t^j \omega_j$ where $t\in \mathbb C,0$ is the parameter of the deformation and the coefficients $\omega_j$ are holomorphic one-forms in some neighborhood of the origin $0\in \mathbb C^n$. We prove that, under a nondegeneracy condition of the singular set of the deformation, with respect to the fibration $d(xy)=0$, the existence of a holomorphic first integral for each element ${\omega}^t$ of the deformation is equivalent to the vanishing of certain line integrals $\oint_{\gamma_c}{\omega}^t=0, \forall \gamma_c, \forall t$ calculated on cycles $\gamma_c$ contained in the fibers $xy=c, \,0 \ne c \in \mathbb C,0$. This result is quite sharp regarding the conditions of the singular set and on the vanishing of the integrals in cycles. It is also not valid for ramified saddles, i.e., for deformations of saddles of the form $x^ny^m=c$ where $n+m>2$. As an application of our techniques we obtain a criteria for the existence of first integrals for integrable codimension one deformations of quadratic analytic center-cylinder type singularities in terms of the vanishing of some easy to compute line integrals.


title: Cross-Language Code Search using Static and Dynamic Analyses

abstract: As code search permeates most activities in software development,code-to-code search has emerged to support using code as a query and retrieving similar code in the search results. Applications include duplicate code detection for refactoring, patch identification for program repair, and language translation. Existing code-to-code search tools rely on static similarity approaches such as the comparison of tokens and abstract syntax trees (AST) to approximate dynamic behavior, leading to low precision. Most tools do not support cross-language code-to-code search, and those that do, rely on machine learning models that require labeled training data. We present Code-to-Code Search Across Languages (COSAL), a cross-language technique that uses both static and dynamic analyses to identify similar code and does not require a machine learning model. Code snippets are ranked using non-dominated sorting based on code token similarity, structural similarity, and behavioral similarity. We empirically evaluate COSAL on two datasets of 43,146Java and Python files and 55,499 Java files and find that 1) code search based on non-dominated ranking of static and dynamic similarity measures is more effective compared to single or weighted measures; and 2) COSAL has better precision and recall compared to state-of-the-art within-language and cross-language code-to-code search tools. We explore the potential for using COSAL on large open-source repositories and discuss scalability to more languages and similarity metrics, providing a gateway for practical,multi-language code-to-code search.


title: Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modeling

abstract: Most prior work on task-oriented dialogue systems are restricted to limited coverage of domain APIs. However, users oftentimes have requests that are out of the scope of these APIs. This work focuses on responding to these beyond-API-coverage user turns by incorporating external, unstructured knowledge sources. Our approach works in a pipelined manner with knowledge-seeking turn detection, knowledge selection, and response generation in sequence. We introduce novel data augmentation methods for the first two steps and demonstrate that the use of information extracted from dialogue context improves the knowledge selection and end-to-end performances. Through experiments, we achieve state-of-the-art performance for both automatic and human evaluation metrics on the DSTC9 Track 1 benchmark dataset, validating the effectiveness of our contributions.


title: Efficient and accurate KAM tori construction for the dissipative spin-orbit problem using a map reduction

abstract: We consider the dissipative spin-orbit problem in Celestial Mechanics, which describes the rotational motion of a triaxial satellite moving on a Keplerian orbit subject to tidal forcing and "drift". Our goal is to construct quasi-periodic solutions with fixed frequency, satisfying appropriate conditions. With the goal of applying rigorous KAM theory, we compute such quasi-periodic solution with very high precision. To this end, we have developed a very efficient algorithm. The first step is to compute very accurately the return map to a surface of section (using a high order Taylor's method with extended precision). Then, we find an invariant curve for the return map using recent algorithms that take advantage of the geometric features of the problem. This method is based on a rapidly convergent Newton's method which is guaranteed to converge if the initial error is small enough. So, it is very suitable for a continuation algorithm. The resulting algorithm is quite efficient. We only need to deal with a one dimensional function. If this function is discretized in $N$ points, the algorithm requires $O(N \log N) $ operations and $O(N) $ storage. The most costly step (the numerical integration of the equation along a turn) is trivial to parallelize. The main goal of the paper is to present the algorithms, implementation details and several sample results of runs. We also present both a rigorous and a numerical comparison of the results of averaged and not averaged models.


title: Stability of tangential discontinuity for the vortex pancakes

abstract: Within the incompressible three-dimensional Euler equations, we study the pancake-like high vorticity regions, which arise during the onset of developed hydrodynamic turbulence. We show that these regions have an internal fine structure consisting of three vortex layers. Such a layered structure, together with the power law of self-similar evolution of the pancake, prevents development of the Kelvin-Helmholtz instability.


title: Insights into Data through Model Behaviour: An Explainability-driven Strategy for Data Auditing for Responsible Computer Vision Applications

abstract: In this study, we take a departure and explore an explainability-driven strategy to data auditing, where actionable insights into the data at hand are discovered through the eyes of quantitative explainability on the behaviour of a dummy model prototype when exposed to data. We demonstrate this strategy by auditing two popular medical benchmark datasets, and discover hidden data quality issues that lead deep learning models to make predictions for the wrong reasons. The actionable insights gained from this explainability driven data auditing strategy is then leveraged to address the discovered issues to enable the creation of high-performing deep learning models with appropriate prediction behaviour. The hope is that such an explainability-driven strategy can be complimentary to data-driven strategies to facilitate for more responsible development of machine learning algorithms for computer vision applications.


title: The Fishnet Open Images Database: A Dataset for Fish Detection and Fine-Grained Categorization in Fisheries

abstract: Camera-based electronic monitoring (EM) systems are increasingly being deployed onboard commercial fishing vessels to collect essential data for fisheries management and regulation. These systems generate large quantities of video data which must be reviewed on land by human experts. Computer vision can assist this process by automatically detecting and classifying fish species, however the lack of existing public data in this domain has hindered progress. To address this, we present the Fishnet Open Images Database, a large dataset of EM imagery for fish detection and fine-grained categorization onboard commercial fishing vessels. The dataset consists of 86,029 images containing 34 object classes, making it the largest and most diverse public dataset of fisheries EM imagery to-date. It includes many of the characteristic challenges of EM data: visual similarity between species, skewed class distributions, harsh weather conditions, and chaotic crew activity. We evaluate the performance of existing detection and classification algorithms and demonstrate that the dataset can serve as a challenging benchmark for development of computer vision algorithms in fisheries. The dataset is available at https://www.fishnet.ai/.


title: Amortized Auto-Tuning: Cost-Efficient Bayesian Transfer Optimization for Hyperparameter Recommendation

abstract: With the surge in the number of hyperparameters and training times of modern machine learning models, hyperparameter tuning is becoming increasingly expensive. However, after assessing 40 tuning methods systematically, we find that each faces certain limitations. In particular, methods that speed up tuning via knowledge transfer typically require the final performance of hyperparameters and do not focus on low-fidelity information. As we demonstrate empirically, this common practice is suboptimal and can incur an unnecessary use of resources. It is more cost-efficient to instead leverage low-fidelity tuning observations to measure inter-task similarity and transfer knowledge from existing to new tasks accordingly. However, performing multi-fidelity tuning comes with its own challenges in the transfer setting: the noise in additional observations and the need for performance forecasting. Therefore, we propose and conduct a thorough analysis of a multi-task multi-fidelity Bayesian optimization framework, which leads to the best instantiation--amortized auto-tuning (AT2). We further present an offline-computed 27-task hyperparameter recommendation (HyperRec) database to serve the community. Extensive experiments on HyperRec and other real-world databases illustrate the effectiveness of our AT2 method.


title: RHNAS: Realizable Hardware and Neural Architecture Search

abstract: The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges. To enable joint optimization of this vast space, there has been growing interest in differentiable NN-HW co-design. Fully differentiable co-design has reduced the resource requirements for discovering optimized NN-HW configurations, but fail to adapt to general hardware accelerator search spaces. This is due to the existence of non-synthesizable (invalid) designs in the search space of many hardware accelerators. To enable efficient and realizable co-design of configurable hardware accelerators with arbitrary neural network search spaces, we introduce RHNAS. RHNAS is a method that combines reinforcement learning for hardware optimization with differentiable neural architecture search. RHNAS discovers realizable NN-HW designs with 1.84x lower latency and 1.86x lower energy-delay product (EDP) on ImageNet and 2.81x lower latency and 3.30x lower EDP on CIFAR-10 over the default hardware accelerator design.


title: A cyclotomic family of thin hypergeometric monodromy groups in ${Sp}_4(\mathbb{R})$

abstract: We exhibit an infinite family of discrete subgroups of ${Sp}_4(\mathbb R)$ which have a number of remarkable properties. Our results are established by showing that each group plays ping-pong on an appropriate set of cones. The groups arise as the monodromy of hypergeometric differential equations with parameters $\left(\tfrac{N-3}{2N},\tfrac{N-1}{2N}, \tfrac{N+1}{2N}, \tfrac{N+3}{2N}\right)$ at infinity and maximal unipotent monodromy at zero, for any integer $N\geq 4$. Additionally, we relate the cones used for ping-pong in $\mathbb R^4$ with crooked surfaces, which we then use to exhibit domains of discontinuity for the monodromy groups in the Lagrangian Grassmannian.


title: Levi-flat CR structures on compact Lie groups

abstract: Pittie [Pit88] proved that the Dolbeault cohomology of all left-invariant complex structures on compact Lie groups can be computed by looking at the Dolbeault cohomology induced on a conveniently chosen maximal torus. We use the algebraic classification of left-invariant CR structures of maximal rank on compact Lie groups [CK04] to generalize Pittie's result to left-invariant Levi-flat CR structures of maximal rank on compact Lie groups.


title: Global Dynamics of a Predator-Prey Model with State-Dependent Maturation-Delay

abstract: In this paper, a stage structured predator-prey model with general nonlinear type of functional response is established and analyzed. The state-dependent time delay (hereafter SDTD) is the time taken from predator's birth to its maturity, formatted as a monotonical (ly) increasing, continuous(ly) differentiable and bounded function on the number of mature predator. The model is quite different from many previous models with SDTD, in the sense that the derivative of delay on the time is involved in the model. First, we have shown that for a large class of commonly used types of functional responses, including Holling types I, II and III, Beddington-DeAngelis-type (hereafter BD-type), etc, the predator coexists with the prey permanently if and only if the predator's net reproduction number is larger than one unit; Secondly, we have discussed the local stability of the equilibria of the model; Finally, for the special case of BD-type functional response, we claim that if the system is permanent, that is, the derivative of SDTD on the state is small enough and the predator interference is large enough, then the coexistence equilibrium is globally asymptotically stable.


title: A fourth-order compact time-splitting method for the Dirac equation with time-dependent potentials

abstract: In this paper, we present an approach to deal with the dynamics of the Dirac equation with time-dependent electromagnetic potentials using the fourth-order compact time-splitting method ($S_\text{4c}$). To this purpose, the time-ordering technique for time-dependent Hamiltonians is introduced, so that the influence of the time-dependence could be limited to certain steps which are easy to treat. Actually, in the case of the Dirac equation, it turns out that only those steps involving potentials need to be amended, and the scheme remains efficient, accurate, as well as easy to implement. Numerical examples in 1D and 2D are given to validate the scheme.


title: Dispersion relation analysis of the radiative corrections to $g_A$ in the neutron $\beta$-decay

abstract: We present the first and complete dispersion relation analysis of the inner radiative corrections to the axial coupling constant $g_A$ in the neutron $\beta$-decay. Using experimental inputs from the elastic form factors and the spin-dependent structure function $g_1$, we determine the contribution from the $\gamma W$-box diagram to a precision better than $10^{-4}$. Our calculation indicates that the inner radiative corrections to the Fermi and the Gamow-Teller matrix element in the neutron $\beta$-decay are almost identical, i.e. the ratio $\lambda=g_A/g_V$ is almost unrenormalized. With this result, we predict the bare axial coupling constant to be {$\mathring{g}_A=-1.2754(13)_\mathrm{exp}(2)_\mathrm{RC}$} based on the PDG average $\lambda=-1.2756(13)$


title: Influence of grain bidispersity on dense granular flow in a two dimensional hopper

abstract: Discrete element method is conducted to investigate the bidisperse dense granular flow having big and small grains in a two dimensional hopper. A half-circular dynamical force arch is observed above the outlet and Beverloo's law is verified to describe the relationship between flow rate and outlet size. The bidisperse flow can reach the maximum flow rate when a small fraction of big grains is added into the monodisperse flow with only small grains. The distributions of contact force, packing fraction and grain velocity indicate that the flow properties in the hopper are closely related to the local flow characteristics of the key area which almost overlaps with the force arch. The interior packing structures, i.e., ordered arrangement for monodisperse flow and disordered arrangement for bidisperse flow, play a dominant role in the flow pattern transition from mass flow to funnel flow. The earlier occurrence of the transition can effectively increase the grain velocity and therefore improve the flow rate.


title: Reduced density matrix approach to ultracold few-fermion systems in one dimension

abstract: The variational determination of the two-fermion reduced density matrix is described for harmonically trapped, ultracold few-fermion systems in one dimension with equal spin populations. This is accomplished by formulating the problem as a semi-definite program, with the two-fermion reduced density matrix being subject to well-known $N$-representability conditions. The ground-state energies, as well as the density, pair-correlation function, and lower-order eigenvalues of the two-fermion reduced density matrix of various fermionic systems are found by utilising an augmented Lagrangian method for semi-definite programming. The ground-state energies are found to match well to those determined by full-configuration interaction and coupled-cluster calculations and the density, pair-correlation function, and eigenvalue results demonstrate that the salient features of these systems are well-described by this method. These results collectively demonstrate the utility of the reduced density matrix method firstly in describing strong correlation arising from short-range interactions, suggesting that the well-known N-representability conditions are sufficient to model ultracold fermionic systems, and secondly in illustrating the prospect of treating larger systems currently out of the reach of established methods.


title: Physics-informed CoKriging model of a redox flow battery

abstract: Redox flow batteries (RFBs) offer the capability to store large amounts of energy cheaply and efficiently, however, there is a need for fast and accurate models of the charge-discharge curve of a RFB to potentially improve the battery capacity and performance. We develop a multifidelity model for predicting the charge-discharge curve of a RFB. In the multifidelity model, we use the Physics-informed CoKriging (CoPhIK) machine learning method that is trained on experimental data and constrained by the so-called "zero-dimensional" physics-based model. Here we demonstrate that the model shows good agreement with experimental results and significant improvements over existing zero-dimensional models. We show that the proposed model is robust as it is not sensitive to the input parameters in the zero-dimensional model. We also show that only a small amount of high-fidelity experimental datasets are needed for accurate predictions for the range of considered input parameters, which include current density, flow rate, and initial concentrations.


title: An Automated Bolide Detection Pipeline for GOES GLM

abstract: The Geostationary Lightning Mapper (GLM) instrument onboard the GOES 16 and 17 satellites has been shown to be capable of detecting bolides (bright meteors) in Earth's atmosphere. Due to its large, continuous field of view and immediate public data availability, GLM provides a unique opportunity to detect a large variety of bolides, including those in the 0.1 to 3 m diameter range and complements current ground-based bolide detection systems, which are typically sensitive to smaller events. We present a machine learning-based bolide detection and light curve generation pipeline being developed at NASA Ames Research Center as part of NASA's Asteroid Threat Assessment Project (ATAP). The ultimate goal is to generate a large catalog of calibrated bolide lightcurves to provide an unprecedented data set which will be used to inform meteor entry models on how incoming bodies interact with the Earth's atmosphere and to infer the pre-entry properties of the impacting bodies. The data set will also be useful for other asteroidal studies. This paper reports on the progress of the first part of this ultimate goal, namely, the automated bolide detection pipeline. Development of the training set, ML model training and iterative improvements in detection performance are presented. The pipeline runs in an automated fashion and bolide lightcurves along with other measured properties are promptly published on a NASA hosted publicly accessible website, https://neo-bolide.ndc.nasa.gov.


title: Diamond anvil cell with boron-doped diamond heater for high-pressure synthesis and in-situ transport measurements

abstract: Temperature and pressure are essential parameters in the synthesis, evaluation, and application of functional materials. This study proposes the addition of a heating function to a high-pressure diamond anvil cell (DAC) with in-situ measurement probes. The proposed DAC allows for simultaneous control of temperature and pressure within the sample space and can be used to synthesize functional materials under extreme conditions. The various components, namely the heater, thermometer, and measurement probes, were fabricated with a boron-doped diamond epitaxial film and could be used repeatedly. The developed DAC was used to successfully conduct the high-pressure annealing of La(O,F)BiS$_{2}$ single crystal and the high-pressure synthesis of EuFBiS$_{2}$ superconductors. The proposed technique shows promise for further exploration of superconductors to broaden the research field.


title: The Biot-Stokes coupling using total pressure: formulation, analysis and application to interfacial flow in the eye

abstract: We consider a multiphysics model for the flow of Newtonian fluid coupled with Biot consolidation equations through an interface, and incorporating total pressure as an unknown in the poroelastic region. A new mixed-primal finite element scheme is proposed solving for the pairs fluid velocity - pressure and displacement - total poroelastic pressure using Stokes-stable elements, and where the formulation does not require Lagrange multipliers to set up the usual transmission conditions on the interface. The stability and well-posedness of the continuous and semi-discrete problems are analysed in detail. Our numerical study is framed in the context of applicative problems pertaining to heterogeneous geophysical flows and to eye poromechanics. For the latter, we investigate different interfacial flow regimes in Cartesian and axisymmetric coordinates that could eventually help describe early morphologic changes associated with glaucoma development in canine species.


title: Simple interferometric setup enabling sub-Fourier-scale ultra-short laser pulses

abstract: In this work, we have developed a method to generate ultra-short pulses below the Fourier limit, extending the concept previously worked in reference 1 for generating sub-diffractive Gaussian beams. Alternatively, we introduce new alternatives based on a temporally non-symmetrical interference to narrow ultrashort pulses allowing, sub-Fourier scales. The experimental setup scheme is simple and versatile being able to work with high-power laser sources and ultra-short pulses with a broad bandwidth at any central wavelength. The results presented, are promising and help to enlighten new routes and strategies in the design of coherent control systems. We glimpse they will become broadly useful in different fields from strong field domain to quantum information.


title: Gravitational-wave constraints on the GWTC-2 events by measuring the tidal deformability and the spin-induced quadrupole moment

abstract: Gravitational waves from compact binary coalescences provide a unique laboratory to test properties of compact objects. As alternatives to the ordinary black holes in general relativity, various exotic compact objects have been proposed. Some of them have largely different values of the tidal deformability and spin-induced quadrupole moment from those of black holes, and their binaries could be distinguished from the binary black hole by using gravitational waves emitted during their inspiral regime, excluding the highly model-dependent merger and ringdown regimes. We reanalyze gravitational waves from low-mass merger events in the GWTC-2, detected by the Advanced LIGO and Advanced Virgo. Focusing on the influence of tidal deformability and spin-induced quadrupole moment in the inspiral waveform, we provide model-independent constraints on deviations from the standard binary black hole case. We find that all events that we have analyzed are consistent with the waveform of the binary black hole in general relativity. Bayesian model selection shows that the hypothesis that the binary is composed of exotic compact objects is disfavored by all events.


title: RG Flows and Dynamical Systems

abstract: In the context of Wilsonian Renormalization, renormalization group (RG) flows are a set of differential equations that defines how the coupling constants of a theory depend on an energy scale. These equations closely resemble thermodynamical equations and how thermodynamical systems are related to temperature. In this sense, it is natural to look for structures in the flows that show a thermodynamics-like behaviour. The mathematical theory to study these equations is called Dynamical Systems, and applications of that have been used to study RG flows. For example, the classical Zamolodchikov's C-Theorem and its higher-dimensional counterparts, that show that there is a monotonically decreasing function along the flow and it is a property that resembles the second-law of thermodynamics, is related to the Lyapunov function in the context of Dynamical Systems. It can be used to rule out exotic asymptotic behaviours like periodic flows (also known as limit cycles). We also study bifurcation theory and index theories, which have been proposed to be useful in the study of RG flows, the former can be used to explain couplings crossing through marginality and the latter to extract global information about the space the flows lives in. In this dissertation, we also look for applications in holographic RG flows and we try to see if the structural behaviours in holographic theories are the same as the ones in the dual field theory side.


title: On the Cohomology of the Total Space of Classifying Space for Commutativity in $U(3)$

abstract: In this paper, we describe the total space $E_{com} U(3)$ of the principal $U(3)$-bundle associated with the classifying space for commutativity $B_{com} U(3)$ as a homotopy colimit of a diagram of spaces and offer a computation of the mod $2$ and mod $3$ cohomologies of $E_{com} U(3)$ by utilizing the spectral sequence associated with a homotopy colimit. We investigate the cohomology of different spaces in the homotopy colimit diagram. These spaces are intriguing in their own right and contribute to the overall fascination of the analysis. We also present the ring structure of the rational cohomology of $E_{com} U(3)$.


title: CoreUI: Interactive Core Training System with 3D Human Shape

abstract: We present an interactive core training system for core training using a monocular camera image as input in this paper. It is commonly expensive to capture human pose using depth cameras or multiple cameras with conventional approaches. To solve this issue, we employ the skinned multi-person linear model of human shape to recover the 3D human pose from 2D images using pose estimation and human mesh recovery approaches. In order to support the user in maintaining the correct postures from target poses in the training, we adopt 3D human shape estimation for both the target image and input camera video. We propose CoreUI, a user interface for providing visual guidance showing the differences among the estimated targets and current human shapes in core training, which are visualized by markers at ten body parts with color changes. From our user studies, the proposed core training system is effective and convenient compared with the conventional guidance of 2D skeletons.


title: Finite temperature mean-field theory with intrinsic non-hermitian structures for Bose gases in optical lattices

abstract: We reveal a divergent issue associated with the mean-field theory for Bose gases in optical lattices constructed by the widely used straightforward mean-field decoupling of the hopping term, where the corresponding mean-field Hamiltonian generally assumes no lower energy bound once the spatial dependence of the mean-field superfluid order parameter is taken into account. Via a systematic functional integral approach, we solve this issue by establishing a general finite temperature mean-field theory that can treat any possible spatial dependence of the order parameter without causing the divergent issue. Interestingly, we find the theory generally assumes an intrinsic non-hermitian structure that originates from the indefiniteness of the hopping matrix of the system. Within this theory, we develop an efficient approach for investigating the physics of the system at finite temperature, where properties of the system can be calculated via straightforward investigation on the saddle points of an effective potential function for the order parameter. We illustrate our approach by investigating the finite temperature superfluid transition of Bose gases in optical lattices. Since the underlying finite temperature mean-field theory is quite general, this approach can be straightforwardly applied to investigate the finite temperature properties of related systems with phases possessing complex spatial structures.


title: Learning Perceptual Manifold of Fonts

abstract: Along the rapid development of deep learning techniques in generative models, it is becoming an urgent issue to combine machine intelligence with human intelligence to solve the practical applications. Motivated by this methodology, this work aims to adjust the machine generated character fonts with the effort of human workers in the perception study. Although numerous fonts are available online for public usage, it is difficult and challenging to generate and explore a font to meet the preferences for common users. To solve the specific issue, we propose the perceptual manifold of fonts to visualize the perceptual adjustment in the latent space of a generative model of fonts. In our framework, we adopt the variational autoencoder network for the font generation. Then, we conduct a perceptual study on the generated fonts from the multi-dimensional latent space of the generative model. After we obtained the distribution data of specific preferences, we utilize manifold learning approach to visualize the font distribution. In contrast to the conventional user interface in our user study, the proposed font-exploring user interface is efficient and helpful in the designated user preference.