title: 3D Human Shape Reconstruction from a Polarization Image

abstract: This paper tackles the problem of estimating 3D body shape of clothed humans from single polarized 2D images, i.e. polarization images. Polarization images are known to be able to capture polarized reflected lights that preserve rich geometric cues of an object, which has motivated its recent applications in reconstructing surface normal of the objects of interest. Inspired by the recent advances in human shape estimation from single color images, in this paper, we attempt at estimating human body shapes by leveraging the geometric cues from single polarization images. A dedicated two-stage deep learning approach, SfP, is proposed: given a polarization image, stage one aims at inferring the fined-detailed body surface normal; stage two gears to reconstruct the 3D body shape of clothing details. Empirical evaluations on a synthetic dataset (SURREAL) as well as a real-world dataset (PHSPD) demonstrate the qualitative and quantitative performance of our approach in estimating human poses and shapes. This indicates polarization camera is a promising alternative to the more conventional color or depth imaging for human shape estimation. Further, normal maps inferred from polarization imaging play a significant role in accurately recovering the body shapes of clothed people.


title: The number of saddles of the spherical $p$-spin model

abstract: We show that the quenched complexity of saddles of the spherical pure $p$-spin model agrees with the annealed complexity when both are positive. Precisely, we show that the second moment of the number of critical values of a given finite index in a given interval has twice the growth rate of the first moment.


title: Computing Blindfolded on Data Homomorphically Encrypted under Multiple Keys: An Extended Survey

abstract: New cryptographic techniques such as homomorphic encryption (HE) allow computations to be outsourced to and evaluated blindfolded in a resourceful cloud. These computations often require private data owned by multiple participants, engaging in joint evaluation of some functions. For example, Genome-Wide Association Study (GWAS) is becoming feasible because of recent proliferation of genome sequencing technology. Due to the sensitivity of genomic data, these data should be encrypted using different keys. However, supporting computation on ciphertexts encrypted under multiple keys is a non-trivial task. In this paper, we present a comprehensive survey on different state-of-the-art cryptographic techniques and schemes that are commonly used. We review techniques and schemes including Attribute-Based Encryption (ABE), Proxy Re-Encryption (PRE), Threshold Homomorphic Encryption (ThHE), and Multi-Key Homomorphic Encryption (MKHE). We analyze them based on different system and security models, and examine their complexities. We share lessons learned and draw observations for designing better schemes with reduced overheads.


title: OnlineAugment: Online Data Augmentation with Less Domain Knowledge

abstract: Data augmentation is one of the most important tools in training modern deep neural networks. Recently, great advances have been made in searching for optimal augmentation policies in the image classification domain. However, two key points related to data augmentation remain uncovered by the current methods. First is that most if not all modern augmentation search methods are offline and learning policies are isolated from their usage. The learned policies are mostly constant throughout the training process and are not adapted to the current training model state. Second, the policies rely on class-preserving image processing functions. Hence applying current offline methods to new tasks may require domain knowledge to specify such kind of operations. In this work, we offer an orthogonal online data augmentation scheme together with three new augmentation networks, co-trained with the target learning task. It is both more efficient, in the sense that it does not require expensive offline training when entering a new domain, and more adaptive as it adapts to the learner state. Our augmentation networks require less domain knowledge and are easily applicable to new tasks. Extensive experiments demonstrate that the proposed scheme alone performs on par with the state-of-the-art offline data augmentation methods, as well as improving upon the state-of-the-art in combination with those methods. Code is available at https://github.com/zhiqiangdon/online-augment .


title: Vertical extension of Noether Theorem for Scaling Symmetries

abstract: The aim of this paper is to present a new approach to construct constants of motion associated with scaling symmetries of dynamical systems. Scaling maps could be symmetries of the equations of motion but not of its associated Lagrangian action. We have constructed a Noether inspired theorem in a vertical extended space that can be used to obtain constants of motion for these symmetries. Noether theorem can be obtained as a particular case of our construction. To illustrate how the procedure works, we present two interesting examples, a) the Schwarzian Mechanics based on Schwarzian derivative operator and b) the Korteweg-de Vries (KdV) non linear partial differential equation in the context of the asymptotic dynamics of General Relativity on AdS$_3$. We also study the inverse of Noether theorem for scaling symmetries and show how we can construct and identify the generator of the scaling transformation, and how it works for the vertical extended constant of motion that we are able to construct. We find an interesting contribution to the symmetry associated with the fact that the scaling symmetry is not a Noether symmetry of the action. Finally, we have contrasted our results with recent analysis and previous attempts to find constants of motion associated with these beautiful scaling laws.


title: On Disentangling Spoof Trace for Generic Face Anti-Spoofing

abstract: Prior studies show that the key to face anti-spoofing lies in the subtle image pattern, termed "spoof trace", e.g., color distortion, 3D mask edge, Moire pattern, and many others. Designing a generic anti-spoofing model to estimate those spoof traces can improve not only the generalization of the spoof detection, but also the interpretability of the model's decision. Yet, this is a challenging task due to the diversity of spoof types and the lack of ground truth in spoof traces. This work designs a novel adversarial learning framework to disentangle the spoof traces from input faces as a hierarchical combination of patterns at multiple scales. With the disentangled spoof traces, we unveil the live counterpart of the original spoof face, and further synthesize realistic new spoof faces after a proper geometric correction. Our method demonstrates superior spoof detection performance on both seen and unseen spoof scenarios while providing visually convincing estimation of spoof traces. Code is available at https://github.com/yaojieliu/ECCV20-STDN.


title: A Note on Congruences for Weakly Holomorphic Modular Forms

abstract: Let $O_L$ be the ring of integers of a number field $L$. Write $q = e^{2 \pi i z}$, and suppose that $$f(z) = \sum_{n \gg - \infty}^{\infty} a_f(n) q^n \in M_{k}^{!}(\operatorname{SL}_2(\mathbb{Z})) \cap O_L[[q]]$$ is a weakly holomorphic modular form of even weight $k \leq 2$. We answer a question of Ono by showing that if $p \geq 5$ is prime and $ 2-k = r(p-1) + 2 p^t$ for some $r \geq 0$ and $t > 0$, then $a_f(p^t) \equiv 0 \pmod p$. For $p = 2,3,$ we show the same result, under the condition that $2 - k - 2 p^t$ is even and at least $4$. This represents the "missing case" of a theorem proved by Jin, Ma, and Ono.


title: Asymptotic identities for additive convolutions of sums of divisors

abstract: In a 1916 paper, Ramanujan studied the additive convolution $S_{a, b}(n)$ of sum-of-divisors functions $\sigma_a(n)$ and $\sigma_b(n)$, and proved an asymptotic formula for it when $a$ and $b$ are positive odd integers. He also conjectured that his asymptotic formula should hold for all positive real $a$ and $b$. Ramanujan's conjecture was subsequently proved by Ingham, and then by Halberstam with a power saving error term. In this paper, we give a new proof of Ramanujan's conjecture that obtains lower order terms in the asymptotics for most ranges of the parameters. We also describe a connection to a counting problem in geometric topology that was studied in the second author's thesis and which served as our initial motivation in studying this sum.


title: Constraining photohadronic scenarios for the unified origin of IceCube neutrinos and ultrahigh-energy cosmic rays

abstract: The diffuse neutrino flux measured in IceCube is comparable with the ultrahigh-energy cosmic ray (UHECR) flux, which has led to the concept of a unified origin of high-energy neutrino and UHECR backgrounds. We construct a generic unification model of sources to explain UHECR data at $\gtrsim 10^{19}$ eV, and high-energy neutrinos with energies that exceed $\sim100$ TeV in the framework of photo-meson production processes, and provide general constraints on the source properties. A source environment with moderately efficient in-situ production of $\gtrsim 100$ TeV neutrinos with an optical depth of $0.1 \lesssim \tau_{p\gamma}\lesssim 0.6$ must be realized to accelerate cosmic rays to ultrahigh energies. The measured fluxes of cosmic rays and neutrinos set a bound on the source luminosity and its rate density. Although the results are rather general and applicable to unknown source population, among the proposed source candidates, low-luminosity gamma-ray bursts (GRBs) and tidal disruption events (TDEs) could satisfy the requirements if the Lorentz bulk factor of plasma outflow and the equipartition parameters for cosmic rays and magnetic field are appropriately selected.


title: Confinement-induced Self-Pumping in 3D Active Fluids

abstract: Two dimensional active fluids display a transition from turbulent to coherent flow upon decreasing the size of the confining geometry. A recent experiment suggests that the behavior in three dimensions is remarkably different; emergent flows transition from turbulence to coherence upon \emph{increasing} the confinement height to match the width. Using a simple hydrodynamic model of a suspension of extensile rod-like units, we provide the theoretical explanation for this puzzling behavior. Furthermore, using extensive numerical simulations supported by theoretical arguments, we map out the conditions that lead to coherent flows and elucidate the critical role played by the aspect ratio of the confining channel. The mechanism that we identify applies to a large class of symmetries and propulsion mechanisms, leading to a unified set of design principles for self-pumping 3D active fluids.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech nlin.AO physics.flu-dyn


title: XingGAN for Person Image Generation

abstract: We propose a novel Generative Adversarial Network (XingGAN or CrossingGAN) for person image generation tasks, i.e., translating the pose of a given person to a desired one. The proposed Xing generator consists of two generation branches that model the person's appearance and shape information, respectively. Moreover, we propose two novel blocks to effectively transfer and update the person's shape and appearance embeddings in a crossing way to mutually improve each other, which has not been considered by any other existing GAN-based image generation work. Extensive experiments on two challenging datasets, i.e., Market-1501 and DeepFashion, demonstrate that the proposed XingGAN advances the state-of-the-art performance both in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/XingGAN.


title: Autoregressive Density Modeling with the Gaussian Process Mixture Transition Distribution

abstract: We develop a mixture model for transition density approximation, together with soft model selection, in the presence of noisy and heterogeneous nonlinear dynamics. Our model builds on the Gaussian mixture transition distribution (MTD) model for continuous state spaces, extending component means with nonlinear functions that are modeled using Gaussian process (GP) priors. The resulting model flexibly captures nonlinear and heterogeneous lag dependence when several mixture components are active, identifies low-order nonlinear dependence while inferring relevant lags when few components are active, and averages over multiple and competing single-lag models to quantify/propagate uncertainty. Sparsity-inducing priors on the mixture weights aid in selecting a subset of active lags. The hierarchical model specification follows conventions for both GP regression and MTD models, admitting a convenient Gibbs sampling scheme for posterior inference. We demonstrate properties of the proposed model with two simulated and two real time series, emphasizing approximation of lag-dependent transition densities and model selection. In most cases, the model decisively recovers important features. The proposed model provides a simple, yet flexible framework that preserves useful and distinguishing characteristics of the MTD model class.


title: Efficient Facemask Sterilization via Forced Ozone Convection

abstract: During the beginning of 2020, the Covid-19 pandemic took the world by surprise, rapidly spreading undetected between and within many countries and wreaking havoc on the global economy both through death tolls and lockdowns. Healthcare professionals treating the coronavirus patients grapple with a massive and unprecedented shortage of Facepiece Respirators (FPRs) and other personal protective equipment (PPE), which act as fundamental tools to protect the health of the medical staff treating the patients affected by the coronavirus. While many FPRs are designed to be disposable single-use devices, the development of sterilization strategies is necessary to circumvent future shortages. Here, we describe the development of a plasma-based method to sterilize PPE such as FPRs with ozone. The novel design uses a flow-through configuration where ozone directly flows through the fibers of the PPE through the maintenance of a pressure gradient. Canonical ozone-based methods place the mask into a sealed ozone-containing enclosure but lack pressurization to permeate the mask fibers. In this device, ozone is created through an atmospheric pressure Dielectric Barrier Discharge (DBD) fed with compressed air. Due to limited supply and clinical need of FPRs, we demonstrated sterilization with surgical masks. We demonstrate rapid sterilization using E. coli as a model pathogen. A flow-through configuration enables a >400% improvement of the sterilization efficiency with respect to the canonical approach. This method has potential for a broad and cost-effective utilization. Using the power supply from a readily available plasma ball toy, a plastic box, a glass tube, steel mesh, and 3D printed components, we designed and tested an extremely affordable portable prototype system for rapid single mask sterilization which produced comparable results to its large high-cost equivalent.


title: Efficient Iterative Solutions to Complex-Valued Nonlinear Least-Squares Problems with Mixed Linear and Antilinear Operators

abstract: We consider a setting in which it is desired to find an optimal complex vector $\mathbf{x}\in\mathbb{C}^N$ that satisfies $\mathcal{A}(\mathbf{x}) \approx \mathbf{b}$ in a least-squares sense, where $\mathbf{b} \in \mathbb{C}^M$ is a data vector (possibly noise-corrupted), and $\mathcal{A}(\cdot): \mathbb{C}^N \rightarrow \mathbb{C}^M$ is a measurement operator. If $\mathcal{A}(\cdot)$ were linear, this reduces to the classical linear least-squares problem, which has a well-known analytic solution as well as powerful iterative solution algorithms. However, instead of linear least-squares, this work considers the more complicated scenario where $\mathcal{A}(\cdot)$ is nonlinear, but can be represented as the summation and/or composition of some operators that are linear and some operators that are antilinear. Some common nonlinear operations that have this structure include complex conjugation or taking the real-part or imaginary-part of a complex vector. Previous literature has shown that this kind of mixed linear/antilinear least-squares problem can be mapped into a linear least-squares problem by considering $\mathbf{x}$ as a vector in $\mathbb{R}^{2N}$ instead of $\mathbb{C}^N$. While this approach is valid, the replacement of the original complex-valued optimization problem with a real-valued optimization problem can be complicated to implement, and can also be associated with increased computational complexity. In this work, we describe theory and computational methods that enable mixed linear/antilinear least-squares problems to be solved iteratively using standard linear least-squares tools, while retaining all of the complex-valued structure of the original inverse problem. An illustration is provided to demonstrate that this approach can simplify the implementation and reduce the computational complexity of iterative solution algorithms.


title: An APX for the Maximum-Profit Routing Problem with Variable Supply

abstract: In this paper, we study the Maximum-Profit Routing Problem with Variable Supply (MPRP-VS). This is a more general version of the Maximum-Profit Public Transportation Route Planning Problem, or simply Maximum-Profit Routing Problem (MPRP), introduced in \cite{Armaselu-PETRA}. In this new version, the quantity $q_i(t)$ supplied at site $i$ is linearly increasing in time $t$, as opposed to \cite{Armaselu-PETRA}, where the quantity is constant in time. Our main result is a $5.5 \log{T} (1 + \epsilon) (1 + \frac{1}{1 + \sqrt{m}})^2$ approximation algorithm, where $T$ is the latest time window and $m$ is the number of vehicles used. In addition, we improve upon the MPRP algorithm in \cite{Armaselu-PETRA} under certain conditions.


title: Proton Structure Functions from an AdS/QCD model with a deformed background

abstract: In this work we study unpolarized spin $1/2$ baryonic deep inelastic scattering (DIS) in the regime of large Bjorken parameter $x$. We calculate the corresponding structure functions $F_{1,2}(x,q^2)$. Our approach is based on an AdS/QCD model with a deformed background, where we consider an exponential factor in the AdS$_5$ metric. Such a deformation implies the introduction of an anomalous dimension in the model. Our results for the structure functions are consistent with those found in the literature from experimental data.


title: Optimal Bayesian estimation of Gaussian mixtures with growing number of components

abstract: We study Bayesian estimation of finite mixture models in a general setup where the number of components is unknown and allowed to grow with the sample size. An assumption on growing number of components is a natural one as the degree of heterogeneity present in the sample can grow and new components can arise as sample size increases, allowing full flexibility in modeling the complexity of data. This however will lead to a high-dimensional model which poses great challenges for estimation. We novelly employ the idea of a sample size dependent prior in a Bayesian model and establish a number of important theoretical results. We first show that under mild conditions on the prior, the posterior distribution concentrates around the true mixing distribution at a near optimal rate with respect to the Wasserstein distance. Under a separation condition on the true mixing distribution, we further show that a better and adaptive convergence rate can be achieved, and the number of components can be consistently estimated. Furthermore, we derive optimal convergence rates for the higher-order mixture models where the number of components diverges arbitrarily fast. In addition, we suggest a simple recipe for using Dirichlet process (DP) mixture prior for estimating the finite mixture models and provide theoretical guarantees. In particular, we provide a novel solution for adopting the number of clusters in a DP mixture model as an estimate of the number of components in a finite mixture model. Simulation study and real data applications are carried out demonstrating the utilities of our method.


title: Follow-up Studies of Five Cataclysmic Variable Candidates Discovered by LAMOST

abstract: We report follow-up observations of five cataclysmic variable candidates from LAMOST published by Hou et al. (2020). LAMOST J024048.51+195226.9 is the most unusual of the five; an early-M type secondary star contributes strongly to its spectrum, and its spectral and photometric behavior are strikingly reminiscent of the hitherto-unique propeller system AE Aqr. We confirm that a 7.34-hr period discovered in the Catalina survey data (Drake et al. 2014) is orbital. Another object, LAMOST J204305.95+341340.6 appears to be a near twin of the novalike variable V795 Her, with an orbital period in the so-called 2-3 hour "gap". LAMOST J035913.61+405035.0 is evidently an eclipsing, weakly-outbursting dwarf nova with a 5.48-hr period. Our spectrum of LAMOST J090150.09+375444.3 is dominated by a late-type secondary and shows weak, narrow Balmer emission moving in phase with the absorption lines, but at lower amplitude; we do not see the HeII 4686 emission evident in the published discovery spectrum. We again confirm that a period from the Catalina data, in this case 6.80 hr, is orbital. LAMOST J033940.98+414805.7 yields a radial-velocity period of 3.54 hr, and its spectrum appears to be typical of novalike variables in this period range. The spectroscopically-selected sample from LAMOST evidently includes some interesting cataclysmic variables that have been unrecognized until now, apparently because of the relatively modest range of their photometric variations.


title: On regularization of gradient descent, layer imbalance and flat minima

abstract: We analyze the training dynamics for deep linear networks using a new metric - layer imbalance - which defines the flatness of a solution. We demonstrate that different regularization methods, such as weight decay or noise data augmentation, behave in a similar way. Training has two distinct phases: 1) optimization and 2) regularization. First, during the optimization phase, the loss function monotonically decreases, and the trajectory goes toward a minima manifold. Then, during the regularization phase, the layer imbalance decreases, and the trajectory goes along the minima manifold toward a flat area. Finally, we extend the analysis for stochastic gradient descent and show that SGD works similarly to noise regularization.


title: Formation Flying Techniques for the Virtual Telescope for X-Ray Observations

abstract: The Virtual Telescope for X-Ray Observations (VTXO) is an Astrophysics SmallSat mission being developed to demonstrate 10-milliarcsecond X-ray imaging using a Phase Fresnel Lense (PFL) based space telescope. PFLs promise to provide several orders of magnitude improvement in angular resolution over current state of the art X-ray optics. However, PFLs for astronomical applications require a long focal length, for VTXO the focal length is estimated to be in the range of 0.5 km to 4 km. Since these focal lengths are not feasible on a single spacecraft, the proposed solution is to use two separate spacecraft, one with the lense(s), and the second with an X-ray camera. These two spacecrafts will then fly in a formation approximating a single rigid telescope. In order to achieve this configuration, the two spacecraft must maintain the formation a focal length distance apart, with centimeter level control, and sub-millimeter level knowledge requirements. Additionally, the system must keep the telescope axis pointed at a fixed target on the celestial sphere for extended durations. VTXOs system architecture calls for two CubeSats to operate in a highly eccentric Earth orbit with one of the spacecrafts traveling on a natural keplarian orbit. The second spacecraft will then fly on a pseudo orbit maintaining a fixed offset during observations. Observations with this system will occur near apogee where differential forces on the spacecrafts are minimal which in turn minimizes fuel consumption. This paper overviews VTXOs system architecture, and looks in depth at the formation flying techniques, including fuel consumption, and methods maintaining the formation. Beyond its use in X-ray astronomy, these formations flying techniques should eventually contribute to the development of distributed aperture telescopes, with imaging performance orders of magnitude better than the current state of the art.


title: Object Tracking by Least Spatiotemporal Searches

abstract: Tracking a car or a person in a city is crucial for urban safety management. How can we complete the task with minimal number of spatiotemporal searches from massive camera records? This paper proposes a strategy named IHMs (Intermediate Searching at Heuristic Moments): each step we figure out which moment is the best to search according to a heuristic indicator, then at that moment search locations one by one in descending order of predicted appearing probabilities, until a search hits; iterate this step until we get the object's current location. Five searching strategies are compared in experiments, and IHMs is validated to be most efficient, which can save up to 1/3 total costs. This result provides an evidence that "searching at intermediate moments can save cost".


abstract: Selected by NASA for an Astrophysics Science SmallSat study, The Virtual Telescope for X-Ray Observations (VTXO) is a small satellite mission being developed by NASAs Goddard Space Flight Center (GSFC) and New Mexico State University (NMSU). VTXO will perform X-ray observations with an angular resolution around 50 milliarcseconds, an order of magnitude better than is achievable by current state of the art X-ray telescopes. VTXOs fine angular resolution enables measuring the environments closer to the central engines in compact X-ray sources. This resolution will be achieved by the use of Phased Fresnel Lenses (PFLs) optics which provide near diffraction-limited imaging in the X-ray band. However, PFLs require long focal lengths in order to realize their imaging performance, for VTXO this dictates that the telescopes optics and the camera will have a separation of 1 km. As it is not realistic to build a structure this large in space, the solution being adapted for VTXO is to place the camera, and the optics on two separate spacecraft and fly them in formation with the necessary spacing. This requires centimeter level control, and sub-millimeter level knowledge of the two spacecrafts relative transverse position. This paper will present VTXOs current baseline, with particular emphasis on the missions flight dynamics design.


title: An iterative scaling function procedure for solving scalar non-linear hyperbolic balance laws

abstract: The scaling of the exact solution of a hyperbolic balance law generates a family of scaled problems in which the source term does not depend on the current solution. These problems are used to construct a sequence of solutions whose limiting function solves the original hyperbolic problem. Thus this gives rise to an iterative procedure. Its convergence is demonstrated both theoretically and analytically. The analytical demonstration is in terms of a local in time convergence and existence theorem in the $L^2$ framework for the class of problems in which the source term $s(q)$ is bounded, with $s(0) = 0$, is locally Lipschitz and belongs to $C^2(\mathbb{R}) \cap H^1 (\mathbb{R}) $. A convex flux function, which is usual for existence and uniqueness for conservation laws, is also needed. For the numerical demonstration, a set of model equations is solved, where a conservative finite volume method using a low-dissipation flux is implemented in the iteration stages. The error against reference solutions is computed and compared with the accuracy of a conventional first order approach in order to assess the gaining in accuracy of the present procedure. Regarding the accuracy only a first order scheme is explored because the development of a useful procedure is of interest in this work, high-order accurate methods should increase the computational cost of the global procedure. Numerical tests show that the present approach is a feasible method of solution.


title: Is the free-energy principle a formal theory of semantics? From variational density dynamics to neural and phenotypic representations

abstract: The aim of this paper is twofold: (1) to assess whether the construct of neural representations plays an explanatory role under the variational free-energy principle and its corollary process theory, active inference; and (2) if so, to assess which philosophical stance - in relation to the ontological and epistemological status of representations - is most appropriate. We focus on non-realist (deflationary and fictionalist-instrumentalist) approaches. We consider a deflationary account of mental representation, according to which the explanatorily relevant contents of neural representations are mathematical, rather than cognitive, and a fictionalist or instrumentalist account, according to which representations are scientifically useful fictions that serve explanatory (and other) aims. After reviewing the free-energy principle and active inference, we argue that the model of adaptive phenotypes under the free-energy principle can be used to furnish a formal semantics, enabling us to assign semantic content to specific phenotypic states (the internal states of a Markovian system that exists far from equilibrium). We propose a modified fictionalist account: an organism-centered fictionalism or instrumentalism. We argue that, under the free-energy principle, pursuing even a deflationary account of the content of neural representations licenses the appeal to the kind of semantic content involved in the aboutness or intentionality of cognitive systems; our position is thus coherent with, but rests on distinct assumptions from, the realist position. We argue that the free-energy principle thereby explains the aboutness or intentionality in living systems and hence their capacity to parse their sensory stream using an ontology or set of semantic factors.


title: Long-Range Correlations of Sequences Modulo 1

abstract: In this paper we consider the fractional parts of a general sequence, for example the sequence $\alpha \sqrt{n}$ or $\alpha n^2$. We give a general method, which allows one to show that long-range correlations (correlations where the support of the test function grows as we consider more points) are Poissonian. We show that these statements about convergence can be reduced to bounds on associated Weyl sums. In particular we apply this methodology to the aforementioned examples. In so doing, we recover a recent result of Technau-Walker (2020) for the triple correlation of $\alpha n^2$ and generalize the result to higher moments. For both of the aforementioned sequences this is one of the only results which indicates the pseudo-random nature of the higher level ($m \ge 3$) correlations.


title: Quantum ensemble of trained classifiers

abstract: Through superposition, a quantum computer is capable of representing an exponentially large set of states, according to the number of qubits available. Quantum machine learning is a subfield of quantum computing that explores the potential of quantum computing to enhance machine learning algorithms. An approach of quantum machine learning named quantum ensembles of quantum classifiers consists of using superposition to build an exponentially large ensemble of classifiers to be trained with an optimization-free learning algorithm. In this work, we investigate how the quantum ensemble works with the addition of an optimization method. Experiments using benchmark datasets show the improvements obtained with the addition of the optimization step.


title: Slot Contrastive Networks: A Contrastive Approach for Representing Objects

abstract: Unsupervised extraction of objects from low-level visual data is an important goal for further progress in machine learning. Existing approaches for representing objects without labels use structured generative models with static images. These methods focus a large amount of their capacity on reconstructing unimportant background pixels, missing low contrast or small objects. Conversely, we present a new method that avoids losses in pixel space and over-reliance on the limited signal a static image provides. Our approach takes advantage of objects' motion by learning a discriminative, time-contrastive loss in the space of slot representations, attempting to force each slot to not only capture entities that move, but capture distinct objects from the other slots. Moreover, we introduce a new quantitative evaluation metric to measure how "diverse" a set of slot vectors are, and use it to evaluate our model on 20 Atari games.


title: High-fidelity multi-photon-entangled cluster state with solid-state quantum emitters in photonic nanostructures

abstract: We propose a complete architecture for deterministic generation of entangled multiphoton states. Our approach utilizes periodic driving of a quantum-dot emitter and an efficient light-matter interface enabled by a photonic crystal waveguide. We assess the quality of the photonic states produced from a real system by including all intrinsic experimental imperfections. Importantly, the protocol is robust against the nuclear spin bath dynamics due to a naturally built-in refocussing method reminiscent to spin echo. We demonstrate the feasibility of producing Greenberger-Horne-Zeilinger and one-dimensional cluster states with fidelities and generation rates exceeding those achieved with conventional 'fusion' methods in current state-of-the-art experiments. The proposed hardware constitutes a scalable and resource-efficient approach towards implementation of measurement-based quantum communication and computing.


title: Towards Deeper Graph Neural Networks

abstract: Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of these neighborhood aggregation methods only consider immediate neighbors, and the performance decreases when going deeper to enable larger receptive fields. Several recent studies attribute this performance deterioration to the over-smoothing issue, which states that repeated propagation makes node representations of different classes indistinguishable. In this work, we study this observation systematically and develop new insights towards deeper graph neural networks. First, we provide a systematical analysis on this issue and argue that the key factor compromising the performance significantly is the entanglement of representation transformation and propagation in current graph convolution operations. After decoupling these two operations, deeper graph neural networks can be used to learn graph node representations from larger receptive fields. We further provide a theoretical analysis of the above observation when building very deep models, which can serve as a rigorous and gentle description of the over-smoothing issue. Based on our theoretical and empirical analysis, we propose Deep Adaptive Graph Neural Network (DAGNN) to adaptively incorporate information from large receptive fields. A set of experiments on citation, co-authorship, and co-purchase datasets have confirmed our analysis and insights and demonstrated the superiority of our proposed methods.


title: Modulation of viability signals for self-regulatory control

abstract: We revisit the role of instrumental value as a driver of adaptive behavior. In active inference, instrumental or extrinsic value is quantified by the information-theoretic surprisal of a set of observations measuring the extent to which those observations conform to prior beliefs or preferences. That is, an agent is expected to seek the type of evidence that is consistent with its own model of the world. For reinforcement learning tasks, the distribution of preferences replaces the notion of reward. We explore a scenario in which the agent learns this distribution in a self-supervised manner. In particular, we highlight the distinction between observations induced by the environment and those pertaining more directly to the continuity of an agent in time. We evaluate our methodology in a dynamic environment with discrete time and actions. First with a surprisal minimizing model-free agent (in the RL sense) and then expanding to the model-based case to minimize the expected free energy.


title: Fidelity of time-bin entangled multi-photon states from a quantum emitter

abstract: We devise a mathematical framework for assessing the fidelity of multi-photon entangled states generated by a single solid-state quantum emitter, such as a quantum dot or a nitrogen-vacancy center. Within this formalism, we theoretically study the role of imperfections present in real systems on the generation of time-bin encoded Greenberger-Horne-Zeilinger and one-dimensional cluster states. We consider both fundamental limitations, such as the effect of phonon-induced dephasing, interaction with the nuclear spin bath, and second-order emissions, as well as technological imperfections, such as branching effects, non-perfect filtering, and photon losses. In a companion paper, we consider a particular physical implementation based on a quantum dot emitter embedded in a photonic crystal waveguide and apply our theoretical formalism to assess the fidelities achievable with current technologies.


title: Local Convergence of an AMP Variant to the LASSO Solution in Finite Dimensions

abstract: A common sparse linear regression formulation is the l1 regularized least squares, which is also known as least absolute shrinkage and selection operator (LASSO). Approximate message passing (AMP) has been proved to asymptotically achieve the LASSO solution when the regression matrix has independent and identically distributed (i.i.d.) Gaussian entries in the sense that the averaged per-coordinate l2 distance between the AMP iterates and the LASSO solution vanishes as the signal dimension goes to infinity before the iteration number. However, in finite dimensional settings, characterization of AMP iterates in the limit of large iteration number has not been established. In this work, we propose an AMP variant by including a parameter that depends on the largest singular value of the regression matrix. The proposed algorithm can also be considered as a primal dual hybrid gradient algorithm with adaptive stepsizes. We show that whenever the AMP variant converges, it converges to the LASSO solution for arbitrary finite dimensional regression matrices. Moreover, we show that the AMP variant is locally stable around the LASSO solution under the condition that the LASSO solution is unique and that the regression matrix is drawn from a continuous distribution. Our local stability result implies that in the special case where the regression matrix is large and has i.i.d. random entries, the original AMP, which is a special case of the proposed AMP variant, is locally stable around the LASSO solution.


title: An Open-World Simulated Environment for Developmental Robotics

abstract: As the current trend of artificial intelligence is shifting towards self-supervised learning, conventional norms such as highly curated domain-specific data, application-specific learning models, extrinsic reward based learning policies etc. might not provide with the suitable ground for such developments. In this paper, we introduce SEDRo, a Simulated Environment for Developmental Robotics which allows a learning agent to have similar experiences that a human infant goes through from the fetus stage up to 12 months. A series of simulated tests based on developmental psychology will be used to evaluate the progress of a learning model.


title: Relativity without light: A new proof of Ignatowski's theorem

abstract: V. Ignatowski (1910) showed that assumptions about light are not necessary to obtain Lorentzian kinematics as one of only few possibilities. We give a much simplified proof of his result as formulated by V. Gorini (1971) for $n$+1-dimensional space-time.


title: Explicit Pseudo-K\"ahler Metrics on Flag Manifolds

abstract: The coadjoint orbits of compact Lie groups each carry a canonical (positive definite) K\"ahler structure, famously used to realize the group's irreducible representations in holomorphic sections of appropriate line bundles (Borel-Weil theorem). Less studied are the (indefinite) invariant *pseudo*-K\"ahler structures they also admit, which can be used to realize the same representations in higher cohomology of the sections (Bott's theorem). Using ``eigenflag'' embeddings, we give a very explicit description of these metrics in the case of the unitary group. As a byproduct we show that $U_n/(U_{n_1}\times\cdots\times U_{n_k})$ has exactly $k!$ invariant complex structures, a count which seems to have hitherto escaped attention.


title: Semi-Supervised Learning Approach to Discover Enterprise User Insights from Feedback and Support

abstract: With the evolution of the cloud and customer centric culture, we inherently accumulate huge repositories of textual reviews, feedback, and support data.This has driven enterprises to seek and research engagement patterns, user network analysis, topic detections, etc.However, huge manual work is still necessary to mine data to be able to mine actionable outcomes. In this paper, we proposed and developed an innovative Semi-Supervised Learning approach by utilizing Deep Learning and Topic Modeling to have a better understanding of the user voice.This approach combines a BERT-based multiclassification algorithm through supervised learning combined with a novel Probabilistic and Semantic Hybrid Topic Inference (PSHTI) Model through unsupervised learning, aiming at automating the process of better identifying the main topics or areas as well as the sub-topics from the textual feedback and support.There are three major break-through: 1. As the advancement of deep learning technology, there have been tremendous innovations in the NLP field, yet the traditional topic modeling as one of the NLP applications lag behind the tide of deep learning. In the methodology and technical perspective, we adopt transfer learning to fine-tune a BERT-based multiclassification system to categorize the main topics and then utilize the novel PSHTI model to infer the sub-topics under the predicted main topics. 2. The traditional unsupervised learning-based topic models or clustering methods suffer from the difficulty of automatically generating a meaningful topic label, but our system enables mapping the top words to the self-help issues by utilizing domain knowledge about the product through web-crawling. 3. This work provides a prominent showcase by leveraging the state-of-the-art methodology in the real production to help shed light to discover user insights and drive business investment priorities.


title: Bit-Slicing the Hilbert Space: Scaling Up Accurate Quantum Circuit Simulation to a New Level

abstract: Quantum computing is greatly advanced in recent years and is expected to transform the computation paradigm in the near future. Quantum circuit simulation plays a key role in the toolchain for the development of quantum hardware and software systems. However, due to the enormous Hilbert space of quantum states, simulating quantum circuits with classical computers is extremely challenging despite notable efforts have been made. In this paper, we enhance quantum circuit simulation in two dimensions: accuracy and scalability. The former is achieved by using an algebraic representation of complex numbers; the latter is achieved by bit-slicing the number representation and replacing matrix-vector multiplication with symbolic Boolean function manipulation. Experimental results demonstrate that our method can be superior to the state-of-the-art for various quantum circuits and can simulate certain benchmark families with up to tens of thousands of qubits.


title: Laser-Driven Growth of Semiconductor Nanowires from Colloidal Nanocrystals via the Young-Laplace Effect

abstract: The ability to produce nanowires through vapor- and solution-based processes has propelled nanowire material systems toward a wide range of technological applications. Conventional, vapor-based nanowire syntheses have enabled precise control over nanowire composition and phase. However, vapor-based nanowire growth employs batch processes with specialized pressure management systems designed to operate at high temperatures, limiting throughput. More recently developed solution-based nanowire growth processes have improved scalability but can require even more extensive pressure and temperature management systems. Here, we demonstrate a continuous-flow, solution-based nanowire growth process that utilizes the large Young-Laplace interfacial surface pressures and collective heating effects of colloidal metal nanocrystals under irradiation to drive semiconductor nanowire growth photothermally without the need for high-pressure or high-temperature equipment. In this process, a laser irradiates a solution containing metal nanocrystals and semiconductor precursors. Upon light absorption, the metal nanocrystals heat rapidly, inducing semiconductor precursor decomposition and nanowire growth. This process is performed on a benchtop in simple glassware under standard conditions. To demonstrate the generality of this technique, we synthesized three distinct semiconductor nanowire material systems: bismuth-seeded germanium nanowires, bismuth-seeded cadmium selenide nanowires, and indium-seeded germanium nanowires. The simplicity and versatility of this process opens the door to a range of experiments and technologies including in-line combinatorial identification of optimized reaction parameters, in situ spectroscopic measurements to study solution-based nanowire growth, and the potential production of nanowires with complex compositions or rationally incorporated dopants.


title: Two new transformation formulas for ${}_{8}\psi_{8}$ and ${}_{8}W_{7}$ series associated with Weierstrass' theta identity

abstract: In this paper, we establish two new transformation formulas for ${}_{8}\psi_{8}$ and ${}_8\phi_7$ series by means of Slater's general transformation for bilateral series. As applications, some specific transformation formulas are presented among which include a general form of Weierstrass' theta identity and new proofs of Bailey's VWP ${}_6\psi_6$ and Jackson's ${}_8\phi_7$ summation formula.


title: Unsupervised Shape Normality Metric for Severity Quantification

abstract: This work describes an unsupervised method to objectively quantify the abnormality of general anatomical shapes. The severity of an anatomical deformity often serves as a determinant in the clinical management of patients. However, experiential bias and distinctive random residuals among specialist individuals bring variability in diagnosis and patient management decisions, irrespective of the objective deformity degree. Therefore, supervised methods are prone to be misled given insufficient labeling of pathological samples that inevitably preserve human bias and inconsistency. Furthermore, subjects demonstrating a specific pathology are naturally rare relative to the normal population. To avoid relying on sufficient pathological samples by fully utilizing the power of normal samples, we propose the shape normality metric (SNM), which requires learning only from normal samples and zero knowledge about the pathology. We represent shapes by landmarks automatically inferred from the data and model the normal group by a multivariate Gaussian distribution. Extensive experiments on different anatomical datasets, including skulls, femurs, scapulae, and humeri, demonstrate that SNM can provide an effective normality measurement, which can significantly detect and indicate pathology. Therefore, SNM offers promising value in a variety of clinical applications.


title: Superluminal Motion-Assisted 4-Dimensional Light-in-Flight Imaging

abstract: Advances in high speed imaging techniques have opened new possibilities for capturing ultrafast phenomena such as light propagation in air or through media. Capturing light-in-flight in 3-dimensional xyt-space has been reported based on various types of imaging systems, whereas reconstruction of light-in-flight information in the fourth dimension z has been a challenge. We demonstrate the first 4-dimensional light-in-flight imaging based on the observation of a superluminal motion captured by a new time-gated megapixel single-photon avalanche diode camera. A high resolution light-in-flight video is generated with no laser scanning, camera translation, interpolation, nor dark noise subtraction. A machine learning technique is applied to analyze the measured spatio-temporal data set. A theoretical formula is introduced to perform least-square regression, and extra-dimensional information is recovered without prior knowledge. The algorithm relies on the mathematical formulation equivalent to the superluminal motion in astrophysics, which is scaled by a factor of a quadrillionth. The reconstructed light-in-flight trajectory shows a good agreement with the actual geometry of the light path. Our approach could potentially provide novel functionalities to high speed imaging applications such as non-line-of-sight imaging and time-resolved optical tomography.


title: Delay-Induced Uncertainty for a Paradigmatic Glucose-Insulin Model

abstract: Medical practice in the intensive care unit is based on the supposition that physiological systems such as the human glucose-insulin system are predictable. We demonstrate that delay within the glucose-insulin system can induce sustained temporal chaos, rendering the system unpredictable. Specifically, we exhibit such chaos for the Ultradian glucose-insulin model. This well-validated, finite-dimensional model represents feedback delay as a three-stage filter. Using the theory of rank one maps from smooth dynamical systems, we precisely explain the nature of the resulting delay-induced uncertainty (DIU). We develop a recipe one may use to diagnose DIU in a general oscillatory dynamical system. For infinite-dimensional delay systems, no analog of the theory of rank one maps exists. Nevertheless, we show that the geometric principles encoded in our DIU recipe apply to such systems by exhibiting sustained temporal chaos for a linear shear flow. Our results are potentially broadly applicable because delay is ubiquitous throughout mathematical physiology.


title: An Entropic Relevance Measure for Stochastic Conformance Checking in Process Mining

abstract: Given an event log as a collection of recorded real-world process traces, process mining aims to automatically construct a process model that is both simple and provides a useful explanation of the traces. Conformance checking techniques are then employed to characterize and quantify commonalities and discrepancies between the log's traces and the candidate models. Recent approaches to conformance checking acknowledge that the elements being compared are inherently stochastic - for example, some traces occur frequently and others infrequently - and seek to incorporate this knowledge in their analyses. Here we present an entropic relevance measure for stochastic conformance checking, computed as the average number of bits required to compress each of the log's traces, based on the structure and information about relative likelihoods provided by the model. The measure penalizes traces from the event log not captured by the model and traces described by the model but absent in the event log, thus addressing both precision and recall quality criteria at the same time. We further show that entropic relevance is computable in time linear in the size of the log, and provide evaluation outcomes that demonstrate the feasibility of using the new approach in industrial settings.


title: Knots and Non-Hermitian Bloch Bands

abstract: Knots have a twisted history in quantum physics. They were abandoned as failed models of atoms. Only much later was the connection between knot invariants and Wilson loops in topological quantum field theory discovered. Here we show that knots tied by the eigenenergy strings provide a complete topological classification of one-dimensional non-Hermitian (NH) Hamiltonians with separable bands. A $\mathbb{Z}_2$ knot invariant, the global biorthogonal Berry phase $Q$ as the sum of the Wilson loop eigenphases, is proved to be equal to the permutation parity of the NH bands. We show the transition between two phases characterized by distinct knots occur through exceptional points and come in two types. We further develop an algorithm to construct the corresponding tight-binding NH Hamiltonian for any desired knot, and propose a scheme to probe the knot structure via quantum quench. The theory and algorithm are demonstrated by model Hamiltonians that feature for example the Hopf link, the trefoil knot, the figure-8 knot and the Whitehead link.

categories: cond-mat.mes-hall cond-mat.quant-gas math-ph math.MP quant-ph


title: DWMD: Dimensional Weighted Orderwise Moment Discrepancy for Domain-specific Hidden Representation Matching

abstract: Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is establishing a metric that can exactly measure the data distribution discrepancy between two homogeneous domains and adopt it in distribution alignment, especially in the matching of feature representations in the hidden activation space. Existing distribution matching approaches can be interpreted as failing to either explicitly orderwise align higher-order moments or satisfy the prerequisite of certain assumptions in practical uses. We propose a novel moment-based probability distribution metric termed dimensional weighted orderwise moment discrepancy (DWMD) for feature representation matching in the UDA scenario. Our metric function takes advantage of a series for high-order moment alignment, and we theoretically prove that our DWMD metric function is error-free, which means that it can strictly reflect the distribution differences between domains and is valid without any feature distribution assumption. In addition, since the discrepancies between probability distributions in each feature dimension are different, dimensional weighting is considered in our function. We further calculate the error bound of the empirical estimate of the DWMD metric in practical applications. Comprehensive experiments on benchmark datasets illustrate that our method yields state-of-the-art distribution metrics.


title: On a problem by Nathan Jacobson

abstract: We prove a coordinatization theorem for unital alternative algebras containing 2 x 2 matrix algebra with the same identity element 1. This solves an old problem announced by Nathan Jacobson on the description of alternative algebras containing a generalized quaternion algebra H with the same 1, for the case when the algebra H is split. In particular, this is the case when the basic field is finite or algebraically closed.


title: Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification

abstract: Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality pedestrian retrieval problem. Due to the large intra-class variations and cross-modality discrepancy with large amount of sample noise, it is difficult to learn discriminative part features. Existing VI-ReID methods instead tend to learn global representations, which have limited discriminability and weak robustness to noisy images. In this paper, we propose a novel dynamic dual-attentive aggregation (DDAG) learning method by mining both intra-modality part-level and cross-modality graph-level contextual cues for VI-ReID. We propose an intra-modality weighted-part attention module to extract discriminative part-aggregated features, by imposing the domain knowledge on the part relationship mining. To enhance robustness against noisy samples, we introduce cross-modality graph structured attention to reinforce the representation with the contextual relations across the two modalities. We also develop a parameter-free dynamic dual aggregation learning strategy to adaptively integrate the two components in a progressive joint training manner. Extensive experiments demonstrate that DDAG outperforms the state-of-the-art methods under various settings.


title: Measurements of the Ca II infrared triplet emission lines of pre-main-sequence stars

abstract: We investigated the chromospheric activity of 60 pre-main-sequence (PMS) stars in four molecular clouds and five moving groups. It is considered that strong chromospheric activity is driven by the dynamo processes generated by the stellar rotation. In contrast, several researchers have pointed out that the chromospheres of PMS stars are activated by mass accretion from their protoplanetary disks. In this study, the Ca II infrared triplet (IRT) emission lines were investigated utilizing medium- and high-resolution spectroscopy. The observations were conducted with Nayuta/MALLS and Subaru/HDS. Additionally, archive data obtained by Keck/HIRES, VLT/UVES, and VLT/X-Shooter was used. The small ratios of the equivalent widths indicate that Ca II IRT emission lines arise primarily in dense chromospheric regions. Seven PMS stars show broad emission lines. Among them, four PMS stars have more than one order of magnitude brighter emission line fluxes compared to the low-mass stars in young open clusters. The four PMS stars have a high mass accretion rate, which indicates that the broad and strong emission results from a large mass accretion. However, most PMS stars exhibit narrow emission lines. No significant correlation was found between the accretion rate and flux of the emission line. The ratios of the surface flux of the Ca II IRT lines to the stellar bolometric luminosity, R'_IRT, of the PMS stars with narrow emission lines are as large as the largest R'_IRT of the low-mass stars in the young open clusters. This result indicates that most PMS stars, even in the classical T Tauri star stage, have chromospheric activity similar to zero-age main-sequence stars.


title: Learning from Extrinsic and Intrinsic Supervisions for Domain Generalization

abstract: The generalization capability of neural networks across domains is crucial for real-world applications. We argue that a generalized object recognition system should well understand the relationships among different images and also the images themselves at the same time. To this end, we present a new domain generalization framework that learns how to generalize across domains simultaneously from extrinsic relationship supervision and intrinsic self-supervision for images from multi-source domains. To be specific, we formulate our framework with feature embedding using a multi-task learning paradigm. Besides conducting the common supervised recognition task, we seamlessly integrate a momentum metric learning task and a self-supervised auxiliary task to collectively utilize the extrinsic supervision and intrinsic supervision. Also, we develop an effective momentum metric learning scheme with K-hard negative mining to boost the network to capture image relationship for domain generalization. We demonstrate the effectiveness of our approach on two standard object recognition benchmarks VLCS and PACS, and show that our methods achieve state-of-the-art performance.


title: Robust Optimal Designs when Missing Data Happen at Random

abstract: In this article, we investigate the robust optimal design problem for the prediction of response when the fitted regression models are only approximately specified, and observations might be missing completely at random. The intuitive idea is as follows: We assume that data are missing at random, and the complete case analysis is applied. To account for the occurrence of missing data, the design criterion we choose is the mean, for the missing indicator, of the averaged (over the design space) mean squared errors of the predictions. To describe the uncertainty in the specification of the real underlying model, we impose a neighborhood structure on the deterministic part of the regression response and maximize, analytically, the \textbf{M}ean of the averaged \textbf{M}ean squared \textbf{P}rediction \textbf{E}rrors (MMPE), over the entire neighborhood. The maximized MMPE is the ``worst'' loss in the neighborhood of the fitted regression model. Minimizing the maximum MMPE over the class of designs, we obtain robust ``minimax'' designs. The robust designs constructed afford protection from increases in prediction errors resulting from model misspecifications.


title: Monochromatic Triangles, Triangle Listing and APSP

abstract: One of the main hypotheses in fine-grained complexity is that All-Pairs Shortest Paths (APSP) for $n$-node graphs requires $n^{3-o(1)}$ time. Another famous hypothesis is that the $3$SUM problem for $n$ integers requires $n^{2-o(1)}$ time. Although there are no direct reductions between $3$SUM and APSP, it is known that they are related: there is a problem, $(\min,+)$-convolution that reduces in a fine-grained way to both, and a problem Exact Triangle that both fine-grained reduce to. In this paper we find more relationships between these two problems and other basic problems. P\u{a}tra\c{s}cu had shown that under the $3$SUM hypothesis the All-Edges Sparse Triangle problem in $m$-edge graphs requires $m^{4/3-o(1)}$ time. The latter problem asks to determine for every edge $e$, whether $e$ is in a triangle. It is equivalent to the problem of listing $m$ triangles in an $m$-edge graph where $m=\tilde{O}(n^{1.5})$, and can be solved in $O(m^{1.41})$ time [Alon et al.'97] with the current matrix multiplication bounds, and in $\tilde{O}(m^{4/3})$ time if $\omega=2$. We show that one can reduce Exact Triangle to All-Edges Sparse Triangle, showing that All-Edges Sparse Triangle (and hence Triangle Listing) requires $m^{4/3-o(1)}$ time also assuming the APSP hypothesis. This allows us to provide APSP-hardness for many dynamic problems that were previously known to be hard under the $3$SUM hypothesis. We also consider the previously studied All-Edges Monochromatic Triangle problem. Via work of [Lincoln et al.'20], our result on All-Edges Sparse Triangle implies that if the All-Edges Monochromatic Triangle problem has an $O(n^{2.5-\epsilon})$ time algorithm for $\epsilon>0$, then both the APSP and $3$SUM hypotheses are false. We also connect the problem to other ``intermediate'' problems, whose runtimes are between $O(n^\omega)$ and $O(n^3)$, such as the Max-Min product problem.


title: LiteFlowNet3: Resolving Correspondence Ambiguity for More Accurate Optical Flow Estimation

abstract: Deep learning approaches have achieved great success in addressing the problem of optical flow estimation. The keys to success lie in the use of cost volume and coarse-to-fine flow inference. However, the matching problem becomes ill-posed when partially occluded or homogeneous regions exist in images. This causes a cost volume to contain outliers and affects the flow decoding from it. Besides, the coarse-to-fine flow inference demands an accurate flow initialization. Ambiguous correspondence yields erroneous flow fields and affects the flow inferences in subsequent levels. In this paper, we introduce LiteFlowNet3, a deep network consisting of two specialized modules, to address the above challenges. (1) We ameliorate the issue of outliers in the cost volume by amending each cost vector through an adaptive modulation prior to the flow decoding. (2) We further improve the flow accuracy by exploring local flow consistency. To this end, each inaccurate optical flow is replaced with an accurate one from a nearby position through a novel warping of the flow field. LiteFlowNet3 not only achieves promising results on public benchmarks but also has a small model size and a fast runtime.


title: Convolution Bounds on Quantile Aggregation

abstract: Quantile aggregation with dependence uncertainty has a long history in probability theory with wide applications in finance, risk management, statistics, and operations research. Using a recent result on inf-convolution of quantile-based risk measures, we establish new analytical bounds for quantile aggregation which we call convolution bounds. Convolution bounds both unify every analytical result available in quantile aggregation and enlighten our understanding of these methods. These bounds are the best available in general. Moreover, convolution bounds are easy to compute, and we show that they are sharp in many relevant cases. They also allow for interpretability on the extremal dependence structure. The results directly lead to bounds on the distribution of the sum of random variables with arbitrary dependence. We discuss relevant applications in risk management and economics.


title: Studying the nature of the unidentified gamma-ray source HESS J1841-055 with the MAGIC telescopes

abstract: We investigate the physical nature and origin of the gamma-ray emission from the extended source HESS J1841-055 observed at TeV and GeV energies. We observed HESS J1841-055 at TeV energies for a total effective time of 43 hours with the MAGIC telescopes, in 2012 and 2013. Additionally, we analysed the GeV counterpart making use of about 10 years of Fermi-LAT data. Using both Fermi-LAT and MAGIC, we study both the spectral and energy-dependent morphology of the source for almost four decades of energy. The origin of the gamma-ray emission from this region is investigated using multi-waveband information on sources present in this region, suggested to be associated with this unidentified gamma-ray source. We find that the extended emission at GeV-TeV energies is best described by more than one source model. We also perform the first energy-dependent analysis of the HESS J1841-055 region at GeV-TeV. We find that the emission at lower energies comes from a diffuse or extended component, while the major contribution of gamma rays above 1 TeV arises from the southern part of the source. Moreover, we find that a significant curvature is present in the combined observed spectrum of MAGIC and Fermi-LAT. The first multi-wavelength spectral energy distribution of this unidentified source shows that the emission at GeV-TeV energies can be well explained with both leptonic and hadronic models. For the leptonic scenario, bremsstrahlung is the dominant emission compared to inverse Compton. On the other hand, for the hadronic model, gamma-ray resulting from the decay of neutral pions ($\pi^0$) can explain the observed spectrum. The presence of dense molecular clouds overlapping with HESS J1841-055 makes both bremsstrahlung and $\pi^0$-decay processes the dominant emission mechanisms for the source.


title: 1.4-mJ High Energy Terahertz Radiation from Lithium Niobates

abstract: Free-space super-strong terahertz (THz) electromagnetic fields offer multifaceted capabilities for reaching extreme nonlinear THz optics, accelerating and manipulating charged particles, and realizing other fascinating applications. However, the lack of powerful solid-state THz sources with single pulse energy >1 mJ is impeding the proliferation of extreme THz applications. The fundamental challenge lies in hard to achieve high efficiency due to high intensity pumping caused crystal damage, linear absorption and nonlinear distortion induced short effective interaction length, and so on. Here, through cryogenically cooling the crystals, delicately tailoring the pump laser spectra, chirping the pump pulses, and magnifying the laser energies, we first successfully realized the generation of 1.4-mJ THz pulses lithium niobates under the excitation of 214-mJ femtosecond laser pulses via tilted pulse front technique. The 800 nm-to-THz energy conversion efficiency reached 0.7%, and a free-space THz peak electric and magnetic fields reached 6.3 MV/cm and 2.1 Tesla. Our numerical simulations based on a frequencydomain second-order nonlinear wave equation under slowly varying envelope approximation reproduced the experimental optimization processes. To show the capability of this super-strong THz source, nonlinear absorption due to field-induced intervalley scattering effect in high conductive silicon induced by strong THz electric field was demonstrated. Such a high energy THz source with a relatively low peak frequency is very appropriate not only for electron acceleration towards table-top X-ray sources but also for extreme THz science and nonlinear applications.


title: Statistical inference for unknown parameters of stochastic SIS epidemics on complete graphs

abstract: In this paper, we are concerned with the stochastic susceptible-infectious-susceptible (SIS) epidemic model on the complete graph with $n$ vertices. This model has two parameters, which are the infection rate and the recovery rate. By utilizing the theory of density-dependent Markov chains, we give consistent estimations of the above two parameters as $n$ grows to infinity according to the sample path of the model in a finite time interval. Furthermore, we establish the central limit theorem (CLT) and the moderate deviation principle (MDP) of our estimations. As an application of our CLT, reject regions of hypothesis testings of two parameters are given. As an application of our MDP, confidence intervals with lengths converging to $0$ while confidence levels converging to $1$ are given as $n$ grows to infinity.


title: Non-relativistic Pauli--Fierz Hamiltonian for less than two photons

abstract: We consider the Pauli--Fierz model, which describes a particle (an electron) coupled to the quantized electromagnetic field and limit the number of photons to less than 2. By computing \red{the resolvent explicitly}, we located the spectrum of the Hamiltonian mass. Our results do not depend on the coupling constant $e$ nor on the infrared cutoff parameter $R$.


title: Kinetics and Free Energy of Ligand Dissociation Using Weighted Ensemble Milestoning

abstract: We consider the recently developed weighted ensemble milestoning (WEM) scheme [J. Chem. Phys. 152, 234114 (2020)], and test its capability of simulating ligand-receptor dissociation dynamics. We performed WEM simulations on the following host-guest systems: Na$^+$/Cl$^-$ ion pair and 4-hydroxy-2-butanone (BUT) ligand with FK506 binding protein (FKBP). As proof or principle, we show that the WEM formalism reproduces the Na$^+$/Cl$^-$ ion pair dissociation timescale and the free energy profile obtained from long conventional MD simulation. To increase accuracy of WEM calculations applied to kinetics and thermodynamics in protein-ligand binding, we introduced a modified WEM scheme called weighted ensemble milestoning with restraint release (WEM-RR), which can increase the number of starting points per milestone without adding additional computational cost. WEM-RR calculations obtained a ligand residence time and binding free energy in agreement with experimental and previous computational results. Moreover, using the milestoning framework, the binding time and rate constants, dissociation constant and the committor probabilities could also be calculated at a low computational cost. We also present an analytical approach for estimating the association rate constant ($k_{\text{on}}$) when binding is primarily diffusion driven. We show that the WEM method can efficiently calculate multiple experimental observables describing ligand-receptor binding/unbinding and is a promising candidate for computer-aided inhibitor design.


title: The Lieb-Thirring inequalities: Recent results and open problems

abstract: We attempt to survey recent results and open problems connected to Lieb-Thirring inequalities.


title: Towards Quantum-Secure Authentication and Key Agreement via Abstract Multi-Agent Interaction

abstract: Current methods for authentication and key agreement based on public-key cryptography are vulnerable to quantum computing. We propose a novel approach based on artificial intelligence research in which communicating parties are viewed as autonomous agents which interact repeatedly using their private decision models. Authentication and key agreement are decided based on the agents' observed behaviors during the interaction. The security of this approach rests upon the difficulty of modeling the decisions of interacting agents from limited observations, a problem which we conjecture is also hard for quantum computing. We release PyAMI, a prototype authentication and key agreement system based on the proposed method. We empirically validate our method for authenticating legitimate users while detecting different types of adversarial attacks. Finally, we show how reinforcement learning techniques can be used to train server models which effectively probe a client's decisions to achieve more sample-efficient authentication.


title: The comparison of spectral analyses and flow features in upper airways with obstructive sleep apnea (OSA) between successful and failed surgeries

abstract: Obstructive sleep apnea (OSA) is a common sleep disorder and widening the upper airway is often used in clinical practice. However, the success rate of this surgery is limited; the failed surgery would even make the situation worse, indicating the widened airway is not the unique criterion to evaluate the breathing quality. Therefore, we carried out both experimental measurement and numerical simulation on OSA upper airways and found that there existed an intrinsic dominant 3-5 Hz signal and the signal-to-noise ratio (SNR) at 3-5 Hz is inversely correlated with apnea-hypopnea index (AHI). Firstly, to validate the suitability of simulation methods, we carried out Laser Doppler measurement in 3D-printing OSA upper airway models, and found excellent agreement between the measured and calculated velocity profiles in two upper airway models for the first time. Then we carried out large eddy simulation (LES) to investigate four pairs of OSA upper airway models with 8 different AHI values for both pre- and post-surgery; among them, three surgeries were successful and one failed. The decreased the pressure drop for failed case, proving that only widening airway cannot guarantee to improve OSA. In our analysis, it is indicating that a dominant recirculation downstream of the minimum cross-section should be a main feature of a successful surgery, and the strength of 3-5 Hz signal induced by flow separation in the upper airway plays an important role in appraising breathing quality. This provides a new guideline for surgery planning. Furthermore, we found a strong correlation between AHI and the area ratio of minimum cross-section near the retro-palate to the maximum cross-section behind the tongue base, and this correlation is highly significant, r = - 0.833, p = 0.01 < 0.05.


title: Modeling lasers and saturable absorbers via multilevel atomic media in the Meep FDTD software: Theory and implementation

abstract: This technical note describes the physical model, numerical implementation, and validation of multilevel atomic media for lasers and saturable absorbers in Meep: a free/open-source finite-difference time-domain (FDTD) software package for electromagnetics simulation. Simulating multilevel media in the time domain involves coupling rate equations for the populations of electronic energy levels with Maxwell's equations via a generalization of the Maxwell--Bloch equations. We describe the underlying equations and their implementation using a second-order discretization scheme, and also demonstrate their equivalence to a quantum density-matrix model. The Meep implementation is validated using a separate FDTD density-matrix model as well as a frequency-domain solver based on steady-state ab-initio laser theory (SALT).


title: A new nature inspired modularity function adapted for unsupervised learning involving spatially embedded networks: A comparative analysis

abstract: Unsupervised machine learning methods can be of great help in many traditional engineering disciplines, where huge amount of labeled data is not readily available or is extremely difficult or costly to generate. Two specific examples include the structure of granular materials and atomic structure of metallic glasses. While the former is critically important for several hundreds of billion dollars global industries, the latter is still a big puzzle in fundamental science. One thing is common in both the examples is that the particles are the elements of the ensembles that are embedded in Euclidean space and one can create a spatially embedded network to represent their key features. Some recent studies show that clustering, which generically refers to unsupervised learning, holds great promise in partitioning these networks. In many complex networks, the spatial information of nodes play very important role in determining the network properties. So understanding the structure of such networks is very crucial. We have compared the performance of our newly developed modularity function with some of the well-known modularity functions. We performed this comparison by finding the best partition in 2D and 3D granular assemblies. We show that for the class of networks considered in this article, our method produce much better results than the competing methods.


title: Strudel: Learning Structured-Decomposable Probabilistic Circuits

abstract: Probabilistic circuits (PCs) represent a probability distribution as a computational graph. Enforcing structural properties on these graphs guarantees that several inference scenarios become tractable. Among these properties, structured decomposability is a particularly appealing one: it enables the efficient and exact computations of the probability of complex logical formulas, and can be used to reason about the expected output of certain predictive models under missing data. This paper proposes Strudel, a simple, fast and accurate learning algorithm for structured-decomposable PCs. Compared to prior work for learning structured-decomposable PCs, Strudel delivers more accurate single PC models in fewer iterations, and dramatically scales learning when building ensembles of PCs. It achieves this scalability by exploiting another structural property of PCs, called determinism, and by sharing the same computational graph across mixture components. We show these advantages on standard density estimation benchmarks and challenging inference scenarios.


title: Towards Environment-Aware 6G Communications via Channel Knowledge Map

abstract: This article proposes the concept of channel knowledge map (CKM) as an enabler towards environment-aware wireless communications. CKM is a site-specific database, tagged with the locations of the transmitters and/or receivers, that contains whatever channel-related information useful to enhance environmental-awareness and facilitate or even obviate sophisticated real-time channel state information (CSI) acquisition. Therefore, CKM is expected to play an important role for 6G networks targeting for super high capacity, extremely low latency, and ultra-massive connectivity, by offering potential solutions to practical challenges brought by the drastically increased channel dimensions and training overhead. In this article, the motivations of environmental-awareness enabled by CKM are firstly discussed, followed by the key techniques to build and utilize CKM. In particular, it is highlighted that CKM is especially appealing for four channel types: channels for yet-to-reach locations, channels for non-cooperative nodes, channels with large dimensions, and channels with severe hardware/processing limitations. Two case studies with extensive numerical results are presented to demonstrate the great potential of environment-aware communications enabled by CKM.


title: Additive Approximation Schemes for Load Balancing Problems

abstract: In this paper we introduce the concept of additive approximation schemes and apply it to load balancing problems. Additive approximation schemes aim to find a solution with an absolute error in the objective of at most $\epsilon h$ for some suitable parameter $h$. In the case that the parameter $h$ provides a lower bound an additive approximation scheme implies a standard multiplicative approximation scheme and can be much stronger when $h \ll$ OPT. On the other hand, when no PTAS exists (or is unlikely to exist), additive approximation schemes can provide a different notion for approximation. We consider the problem of assigning jobs to identical machines with lower and upper bounds for the loads of the machines. This setting generalizes problems like makespan minimization, the Santa Claus problem (on identical machines), and the envy-minimizing Santa Claus problem. For the last problem, in which the objective is to minimize the difference between the maximum and minimum load, the optimal objective value may be zero and hence it is NP-hard to obtain any multiplicative approximation guarantee. For this class of problems we present additive approximation schemes for $h = p_{\max}$, the maximum processing time of the jobs. Our technical contribution is two-fold. First, we introduce a new relaxation based on integrally assigning slots to machines and fractionally assigning jobs to the slots (the slot-MILP). We identify structural properties of (near-)optimal solutions of the slot-MILP, which allow us to solve it efficiently, assuming that there are $O(1)$ different lower and upper bounds on the machine loads (which is the relevant setting for the three problems mentioned above). The second technical contribution is a local-search based algorithm which rounds a solution to the slot-MILP introducing an additive error on the target load intervals of at most $\epsilon\cdot p_{\max}$.


title: Deep Learning of High-Order Interactions for Protein Interface Prediction

abstract: Protein interactions are important in a broad range of biological processes. Traditionally, computational methods have been developed to automatically predict protein interface from hand-crafted features. Recent approaches employ deep neural networks and predict the interaction of each amino acid pair independently. However, these methods do not incorporate the important sequential information from amino acid chains and the high-order pairwise interactions. Intuitively, the prediction of an amino acid pair should depend on both their features and the information of other amino acid pairs. In this work, we propose to formulate the protein interface prediction as a 2D dense prediction problem. In addition, we propose a novel deep model to incorporate the sequential information and high-order pairwise interactions to perform interface predictions. We represent proteins as graphs and employ graph neural networks to learn node features. Then we propose the sequential modeling method to incorporate the sequential information and reorder the feature matrix. Next, we incorporate high-order pairwise interactions to generate a 3D tensor containing different pairwise interactions. Finally, we employ convolutional neural networks to perform 2D dense predictions. Experimental results on multiple benchmarks demonstrate that our proposed method can consistently improve the protein interface prediction performance.


title: Drinking from a Firehose: Continual Learning with Web-scale Natural Language

abstract: Continual learning systems will interact with humans, with each other, and with the physical world through time -- and continue to learn and adapt as they do. An important open problem for continual learning is a large-scale benchmark that enables realistic evaluation of algorithms. In this paper, we study a natural setting for continual learning on a massive scale. We introduce the problem of personalized online language learning (POLL), which involves fitting personalized language models to a population of users that evolves over time. To facilitate research on POLL, we collect massive datasets of Twitter posts. These datasets, Firehose10M and Firehose100M, comprise 100 million tweets, posted by one million users over six years. Enabled by the Firehose datasets, we present a rigorous evaluation of continual learning algorithms on an unprecedented scale. Based on this analysis, we develop a simple algorithm for continual gradient descent (ConGraD) that outperforms prior continual learning methods on the Firehose datasets as well as earlier benchmarks. Collectively, the POLL problem setting, the Firehose datasets, and the ConGraD algorithm enable a complete benchmark for reproducible research on web-scale continual learning.


title: AABO: Adaptive Anchor Box Optimization for Object Detection via Bayesian Sub-sampling

abstract: Most state-of-the-art object detection systems follow an anchor-based diagram. Anchor boxes are densely proposed over the images and the network is trained to predict the boxes position offset as well as the classification confidence. Existing systems pre-define anchor box shapes and sizes and ad-hoc heuristic adjustments are used to define the anchor configurations. However, this might be sub-optimal or even wrong when a new dataset or a new model is adopted. In this paper, we study the problem of automatically optimizing anchor boxes for object detection. We first demonstrate that the number of anchors, anchor scales and ratios are crucial factors for a reliable object detection system. By carefully analyzing the existing bounding box patterns on the feature hierarchy, we design a flexible and tight hyper-parameter space for anchor configurations. Then we propose a novel hyper-parameter optimization method named AABO to determine more appropriate anchor boxes for a certain dataset, in which Bayesian Optimization and subsampling method are combined to achieve precise and efficient anchor configuration optimization. Experiments demonstrate the effectiveness of our proposed method on different detectors and datasets, e.g. achieving around 2.4% mAP improvement on COCO, 1.6% on ADE and 1.5% on VG, and the optimal anchors can bring 1.4% to 2.4% mAP improvement on SOTA detectors by only optimizing anchor configurations, e.g. boosting Mask RCNN from 40.3% to 42.3%, and HTC detector from 46.8% to 48.2%.


title: Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification

abstract: Retinal artery/vein (A/V) classification plays a critical role in the clinical biomarker study of how various systemic and cardiovascular diseases affect the retinal vessels. Conventional methods of automated A/V classification are generally complicated and heavily depend on the accurate vessel segmentation. In this paper, we propose a multi-task deep neural network with spatial activation mechanism that is able to segment full retinal vessel, artery and vein simultaneously, without the pre-requirement of vessel segmentation. The input module of the network integrates the domain knowledge of widely used retinal preprocessing and vessel enhancement techniques. We specially customize the output block of the network with a spatial activation mechanism, which takes advantage of a relatively easier task of vessel segmentation and exploits it to boost the performance of A/V classification. In addition, deep supervision is introduced to the network to assist the low level layers to extract more semantic information. The proposed network achieves pixel-wise accuracy of 95.70% for vessel segmentation, and A/V classification accuracy of 94.50%, which is the state-of-the-art performance for both tasks on the AV-DRIVE dataset. Furthermore, we have also tested the model performance on INSPIRE-AVR dataset, which achieves a skeletal A/V classification accuracy of 91.6%.


title: On loop celestial amplitudes for gauge theory and gravity

abstract: Scattering amplitudes of massless particles in Minkowski space can be expressed in a conformal basis by Mellin transforming the momentum space amplitudes to correlation functions on the celestial sphere at null infinity. In this paper, we study celestial amplitudes of loop level gluons and gravitons. We focus on the rational amplitudes that carry all-plus and single-minus external helicities. Because these amplitudes are finite, they provide a concrete example of celestial amplitudes of Yang- Mills and gravity theory beyond tree level. We give explicit examples of four and five point functions and comment on higher point amplitudes.


title: ML Privacy Meter: Aiding Regulatory Compliance by Quantifying the Privacy Risks of Machine Learning

abstract: When building machine learning models using sensitive data, organizations should ensure that the data processed in such systems is adequately protected. For projects involving machine learning on personal data, Article 35 of the GDPR mandates it to perform a Data Protection Impact Assessment (DPIA). In addition to the threats of illegitimate access to data through security breaches, machine learning models pose an additional privacy risk to the data by indirectly revealing about it through the model predictions and parameters. Guidances released by the Information Commissioner's Office (UK) and the National Institute of Standards and Technology (US) emphasize on the threat to data from models and recommend organizations to account for and estimate these risks to comply with data protection regulations. Hence, there is an immediate need for a tool that can quantify the privacy risk to data from models. In this paper, we focus on this indirect leakage about training data from machine learning models. We present ML Privacy Meter, a tool that can quantify the privacy risk to data from models through state of the art membership inference attack techniques. We discuss how this tool can help practitioners in compliance with data protection regulations, when deploying machine learning models.


title: Determinisability of one-clock timed automata

abstract: The deterministic membership problem for timed automata asks whether the timed language recognised by a nondeterministic timed automaton can be recognised by a deterministic timed automaton. We show that the problem is decidable when the input automaton is a one-clock nondeterministic timed automaton without epsilon transitions and the number of clocks of the deterministic timed automaton is fixed. We show that the problem in all the other cases is undecidable, i.e., when either 1) the input nondeterministic timed automaton has two clocks or more, or 2) it uses epsilon transitions, or 3) the number of clocks of the output deterministic automaton is not fixed.


title: Applications of brain imaging methods in driving behaviour research

abstract: Applications of neuroimaging methods have substantially contributed to the scientific understanding of human factors during driving by providing a deeper insight into the neuro-cognitive aspects of driver brain. This has been achieved by conducting simulated (and occasionally, field) driving experiments while collecting driver brain signals of certain types. Here, this sector of studies is comprehensively reviewed at both macro and micro scales. Different themes of neuroimaging driving behaviour research are identified and the findings within each theme are synthesised. The surveyed literature has reported on applications of four major brain imaging methods. These include Functional Magnetic Resonance Imaging (fMRI), Electroencephalography (EEG), Functional Near-Infrared Spectroscopy (fNIRS) and Magnetoencephalography (MEG), with the first two being the most common methods in this domain. While collecting driver fMRI signal has been particularly instrumental in studying neural correlates of intoxicated driving (e.g. alcohol or cannabis) or distracted driving, the EEG method has been predominantly utilised in relation to the efforts aiming at development of automatic fatigue/drowsiness detection systems, a topic to which the literature on neuro-ergonomics of driving particularly has shown a spike of interest within the last few years. The survey also reveals that topics such as driver brain activity in semi-automated settings or the brain activity of drivers with brain injuries or chronic neurological conditions have by contrast been investigated to a very limited extent. Further, potential topics in relation to driving behaviour are identified that could benefit from the adoption of neuroimaging methods in future studies.


title: Toward a Deep Learning-Driven Intrusion Detection Approach for Internet of Things

abstract: Internet of Things (IoT) has brought along immense benefits to our daily lives encompassing a diverse range of application domains that we regularly interact with, ranging from healthcare automation to transport and smart environments. However, due to the limitation of constrained resources and computational capabilities, IoT networks are prone to various cyber attacks. Thus, defending the IoT network against adversarial attacks is of vital importance. In this paper, we present a novel intrusion detection approach for IoT networks through the application of a deep learning technique. We adopt a cutting-edge IoT dataset comprising IoT traces and realistic attack traffic, including denial of service, distributed denial of service, reconnaissance and information theft attacks. We utilise the header field information in individual packets as generic features to capture general network behaviours, and develop a feed-forward neural networks model with embedding layers (to encode high-dimensional categorical features) for multi-class classification. The concept of transfer learning is subsequently adopted to encode high-dimensional categorical features to build a binary classifier. Results obtained through the evaluation of the proposed approach demonstrate a high classification accuracy for both binary and multi-class classifiers.


title: MTL2L: A Context Aware Neural Optimiser

abstract: Learning to learn (L2L) trains a meta-learner to assist the learning of a task-specific base learner. Previously, it was shown that a meta-learner could learn the direct rules to update learner parameters; and that the learnt neural optimiser updated learners more rapidly than handcrafted gradient-descent methods. However, we demonstrate that previous neural optimisers were limited to update learners on one designated dataset. In order to address input-domain heterogeneity, we introduce Multi-Task Learning to Learn (MTL2L), a context aware neural optimiser which self-modifies its optimisation rules based on input data. We show that MTL2L is capable of updating learners to classify on data of an unseen input-domain at the meta-testing phase.


title: Unsupervised Domain Attention Adaptation Network for Caricature Attribute Recognition

abstract: Caricature attributes provide distinctive facial features to help research in Psychology and Neuroscience. However, unlike the facial photo attribute datasets that have a quantity of annotated images, the annotations of caricature attributes are rare. To facility the research in attribute learning of caricatures, we propose a caricature attribute dataset, namely WebCariA. Moreover, to utilize models that trained by face attributes, we propose a novel unsupervised domain adaptation framework for cross-modality (i.e., photos to caricatures) attribute recognition, with an integrated inter- and intra-domain consistency learning scheme. Specifically, the inter-domain consistency learning scheme consisting an image-to-image translator to first fill the domain gap between photos and caricatures by generating intermediate image samples, and a label consistency learning module to align their semantic information. The intra-domain consistency learning scheme integrates the common feature consistency learning module with a novel attribute-aware attention-consistency learning module for a more efficient alignment. We did an extensive ablation study to show the effectiveness of the proposed method. And the proposed method also outperforms the state-of-the-art methods by a margin. The implementation of the proposed method is available at https://github.com/KeleiHe/DAAN.


title: Combinatorial and computational investigations of Neighbor-Joining bias

abstract: The Neighbor-Joining algorithm is a popular distance-based phylogenetic method that computes a tree metric from a dissimilarity map arising from biological data. Realizing dissimilarity maps as points in Euclidean space, the algorithm partitions the input space into polyhedral regions indexed by the combinatorial type of the trees returned. A full combinatorial description of these regions has not been found yet; different sequences of Neighbor-Joining agglomeration events can produce the same combinatorial tree, therefore associating multiple geometric regions to the same algorithmic output. We resolve this confusion by defining agglomeration orders on trees, leading to a bijection between distinct regions of the output space and weighted Motzkin paths. As a result, we give a formula for the number of polyhedral regions depending only on the number of taxa. We conclude with a computational comparison between these polyhedral regions, to unveil biases introduced in any implementation of the algorithm.