title: A Note on Latency Variability of Deep Neural Networks for Mobile Inference

abstract: Running deep neural network (DNN) inference on mobile devices, i.e., mobile inference, has become a growing trend, making inference less dependent on network connections and keeping private data locally. The prior studies on optimizing DNNs for mobile inference typically focus on the metric of average inference latency, thus implicitly assuming that mobile inference exhibits little latency variability. In this note, we conduct a preliminary measurement study on the latency variability of DNNs for mobile inference. We show that the inference latency variability can become quite significant in the presence of CPU resource contention. More interestingly, unlike the common belief that the relative performance superiority of DNNs on one device can carry over to another device and/or another level of resource contention, we highlight that a DNN model with a better latency performance than another model can become outperformed by the other model when resource contention be more severe or running on another device. Thus, when optimizing DNN models for mobile inference, only measuring the average latency may not be adequate; instead, latency variability under various conditions should be accounted for, including but not limited to different devices and different levels of CPU resource contention considered in this note.


title: Functional Thermodynamics of Maxwellian Ratchets: Constructing and Deconstructing Patterns, Randomizing and Derandomizing Behaviors

abstract: Maxwellian ratchets are autonomous, finite-state thermodynamic engines that implement input-output informational transformations. Previous studies of these "demons" focused on how they exploit environmental resources to generate work: They randomize ordered inputs, leveraging increased Shannon entropy to transfer energy from a thermal reservoir to a work reservoir while respecting both Liouvillian state-space dynamics and the Second Law. However, to date, correctly determining such functional thermodynamic operating regimes was restricted to a very few engines for which correlations among their information-bearing degrees of freedom could be calculated exactly and in closed form---a highly restricted set. Additionally, a key second dimension of ratchet behavior was largely ignored---ratchets do not merely change the randomness of environmental inputs, their operation constructs and deconstructs patterns. To address both dimensions, we adapt recent results from dynamical-systems and ergodic theories that efficiently and accurately calculate the entropy rates and the rate of statistical complexity divergence of general hidden Markov processes. In concert with the Information Processing Second Law, these methods accurately determine thermodynamic operating regimes for finite-state Maxwellian demons with arbitrary numbers of states and transitions. In addition, they facilitate analyzing structure versus randomness trade-offs that a given engine makes. The result is a greatly enhanced perspective on the information processing capabilities of information engines. As an application, we give a thorough-going analysis of the Mandal-Jarzynski ratchet, demonstrating that it has an uncountably-infinite effective state space.

categories: cond-mat.stat-mech cs.IT math.DS math.IT nlin.CD


title: Origin of the 50 Hz harmonics in the transverse beam spectrum of the Large Hadron Collider

abstract: Since the beginning of the Large Hadron Collider (LHC) commissioning, spectral components at harmonics of the mains frequency (50 Hz) have been observed in the transverse beam spectrum. This paper presents an overview of the most important observations, collected during the latest physics operation of the LHC in 2018, which clearly indicates that the harmonics are the result of a real beam excitation rather than an instrumental feature. Based on these findings, potential sources of the perturbation are discussed and a correlation with power supply ripple originating from the magnets' power supplies is presented.


title: Dynamics of ribosomes in mRNA translation under steady and non-steady state conditions

abstract: Recent advances in DNA sequencing and fluorescence imaging have made it possible to monitor the dynamics of ribosomes actively engaged in messenger RNA (mRNA) translation. Here, we model these experiments within the inhomogeneous totally asymmetric simple exclusion process (TASEP) using realistic kinetic parameters. In particular we present analytic expressions to describe the following three cases: (a) translation of a newly transcribed mRNA, (b) translation in the steady state and, specifically the dynamics of individual (tagged) ribosomes and (c) run-off translation after inhibition of translation initiation. In the cases (b) and (c) we develop an effective medium approximation to describe many-ribosome dynamics in terms of a single tagged ribosome in an effective medium. The predictions are in good agreement with stochastic simulations.


title: NLOptControl: A modeling language for solving optimal control problems

abstract: Current direct-collocation-based optimal control software is either easy to use or fast, but not both. This is a major limitation for users that are trying to formulate complex optimal control problems (OCPs) for use in on-line applications. This paper introduces NLOptControl, an open-source modeling language that allows users to both easily formulate and quickly solve nonlinear OCPs using direct-collocation methods. To achieve these attributes, NLOptControl (1) is written in an efficient, dynamically-typed computing language called Julia, (2) extends an optimization modeling language called JuMP to provide a natural algebraic syntax for modeling nonlinear OCPs; and (3) uses reverse automatic differentiation with the acrylic-coloring method to exploit sparsity in the Hessian matrix. This work explores the novel design features of NLOptControl and compares its syntax and speed to those of PROPT. The syntax comparisons shows that NLOptControl models OCPs more concisely than PROPT. The speeds of various collocation methods within PROPT and NLOptControl are benchmarked over a range of collocation points using performance profiles; overall, NLOptControl's single, two, and four interval pseudospectral methods are roughly $14$, $26$, and $36$ times faster than PROPT's, respectively. NLOptControl is well-suited to improve existing off-line and on-line control systems and to engender new ones.


title: Temperature-dependent photoluminescence in Ge: experiment and theory

abstract: We report a photoluminescence study of high-quality Ge samples at temperatures 12 K $\leq$ T $\leq$ 295 K, over a spectral range that covers phonon-assisted emission from the indirect gap (between the lowest conduction band at the L point of the Brillouin zone and the top of the valence band at the $\Gamma$ point), as well as direct gap emission (from the local minimum of the conduction band at the $\Gamma$ point). The spectra display a rich structure with a rapidly changing lineshape as a function of T. A theory is developed to account for the experimental results using analytical expressions for the contributions from LA, TO, LO, and TA phonons. Coupling of states exactly at the $\Gamma$ and L points is forbidden by symmetry for the latter two phonon modes, but becomes allowed for nearby states and can be accounted for using wave-vector dependent deformation potentials. Excellent agreement is obtained between predicted and observed photoluminescence lineshapes. A decomposition of the predicted signal in terms of the different phonon contributions implies that near room temperature indirect optical absorption and emission are dominated by forbidden processes, and the deformation potentials for allowed processes are smaller than previously assumed.


title: A Dynamic Epidemic Model for Rumor Spread in Multiplex Network with Numerical Analysis

abstract: This paper focuses on studying and understanding of stochastic dynamics in population composition when the population is subject to rumor spreading. We undertake the study by first developing an individual Susceptible-Exposed-Infectious-Removed (iSEIR) model, an extension of the SEIR model, for summarizing rumor-spreading behaviors of interacting groups in the population. With this iSEIR model, the interacting groups may be regarded as nodes in a multiplex network. Then various properties of the dynamic behaviors of the interacting groups in rumor spreading can be drawn from samples of the multiplex network. The samples are simulated based on the iSEIR model with different settings in terms of population scale, population distribution and transfer rate. Results from the simulation study show that effective control of rumor spreading in the multiplex network entails an efficient management on information flow, which may be achieved by setting appropriate immunization and spreading thresholds in individual behavior dynamics. Under the proposed iSEIR model we also have derived a steady-state result, named the "supersaturation phenomenon", when the rumor spreading process becomes equilibrium, which may help us to make the optimal or better control of information flow in the practice.


title: Generalization of trace codes to places of higher degree

abstract: In this note, we give a construction of codes on algebraic function field $F/ \mathbb{F}_{q}$ using places of $F$ (not necessarily of degree one) and trace functions from various extensions of $\mathbb{F}_{q}$. This is a generalization of trace code of geometric Goppa codes to higher degree places. We compute a bound on the dimension of this code. Furthermore, we give a condition under which we get exact dimension of the code. We also determine a bound on the minimum distance of this code in terms of $B_{r}(F)$ ( the number of places of degree $r$ in $F$), $1 \leq r < \infty$. Few quasi-cyclic codes over $\mathbb{F}_{p}$ are also obtained as examples of these codes.


title: WaveQ: Gradient-Based Deep Quantization of Neural Networks through Sinusoidal Adaptive Regularization

abstract: As deep neural networks make their ways into different domains, their compute efficiency is becoming a first-order constraint. Deep quantization, which reduces the bitwidth of the operations (below 8 bits), offers a unique opportunity as it can reduce both the storage and compute requirements of the network super-linearly. However, if not employed with diligence, this can lead to significant accuracy loss. Due to the strong inter-dependence between layers and exhibiting different characteristics across the same network, choosing an optimal bitwidth per layer granularity is not a straight forward. As such, deep quantization opens a large hyper-parameter space, the exploration of which is a major challenge. We propose a novel sinusoidal regularization, called SINAREQ, for deep quantized training. Leveraging the sinusoidal properties, we seek to learn multiple quantization parameterization in conjunction during gradient-based training process. Specifically, we learn (i) a per-layer quantization bitwidth along with (ii) a scale factor through learning the period of the sinusoidal function. At the same time, we exploit the periodicity, differentiability, and the local convexity profile in sinusoidal functions to automatically propel (iii) network weights towards values quantized at levels that are jointly determined. We show how SINAREQ balance compute efficiency and accuracy, and provide a heterogeneous bitwidth assignment for quantization of a large variety of deep networks (AlexNet, CIFAR-10, MobileNet, ResNet-18, ResNet-20, SVHN, and VGG-11) that virtually preserves the accuracy. Furthermore, we carry out experimentation using fixed homogenous bitwidths with 3- to 5-bit assignment and show the versatility of SINAREQ in enhancing quantized training algorithms (DoReFa and WRPN) with about 4.8% accuracy improvements on average, and then outperforming multiple state-of-the-art techniques.


title: Zero-Forcing Max-Power Beamforming for Hybrid mmWave Full-Duplex MIMO Systems

abstract: Full-duplex (FD) systems gained enormous attention because of the potential to double the spectral efficiency. In the context of 5G technology, FD systems operating at millimeter-wave (mmWave) frequencies become one of the most promising solutions to further increase the spectral efficiency and reduce the latency. However, such systems are vulnerable to the self-interference (SI) that significantly degrades the performance. To overcome this shortcoming, analog-only beamforming techniques have been developed to mitigate the SI. Because of the huge power consumption, systems operating at mmWave frequencies beamform the power by only tunning the phase shifters while maintaining constant amplitudes. Such a hardware constraint, known as the constant amplitude (CA) constraint, severely limits the system performance. In this work, we propose a digital and analog hybrid beamforming design that completely eliminates the SI while substantially minimizing the losses imposed by the CA constraint. Further, we develop a fully-digital beamforming design and derive the upper bound for the spectral efficiency as benchmarking tools to quantify the losses of our proposed hybrid design.


title: Entering the Era of Dark Matter Astronomy? Near to Long-Term Forecasts in X-Ray and Gamma-Ray Bands

abstract: We assess Galactic Dark Matter (DM) sensitivities to photons from annihilation and decay using the spatial and kinematic information determined by state-of-the-art simulations in the Latte suite of Feedback In Realistic Environments (FIRE-2). For kinematic information, we study the energy shift pattern of DM narrow emission lines predicted in FIRE-2 and discuss its potential as DM-signal diagnosis, showing for the first time the power of symmetric observations around $l=0^{\circ}$. We find that the exposures needed to resolve the line separation of DM to gas by XRISM at $5\sigma$ to be large, $\gtrsim 4$ Ms, while exposures are smaller for Athena ($\lesssim 50$ ks) and Lynx ($\lesssim 100$ ks). We find that large field-of-view exposures remain the most sensitive methods for detection of DM annihilation or decay by the luminosity of signals in the field of view dominating velocity information. The $\sim$4 sr view of the Galactic Center region by the Wide Field Monitor (WFM) aboard the eXTP mission will be highly sensitive to DM signals, with a prospect of $\sim 10^5$ to $10^6$ events from the 3.5 keV line in a 100 ks exposure, with the range dependent on photon acceptance in WFM's field of view. We also investigate detailed all-sky luminosity maps for both DM annihilation and decay signals - evaluating the signal-to-noise for a DM detection with realistic X-ray and gamma-ray backgrounds - as a guideline for what could be a forthcoming era of DM astronomy.


title: Anderson localisation in two dimensions: insights from Localisation Landscape Theory, exact diagonalisation, and time-dependent simulations

abstract: Motivated by experimental progress in cold atomic systems, we use and advance Localisation Landscape Theory (LLT), to examine two-dimensional systems with point-like random scatterers. We begin by showing that exact eigenstates cannot be efficiently used to extract the localisation length. We then provide a comprehensive review of known LLT, and confirm that the Hamiltonian with the effective potential of LLT has very similar low energy eigenstates to that with the physical potential. Next, we use LLT to compute the localisation length for very low-energy, maximally localised eigenstates and test our method against exact diagonalisation. Furthermore, we propose a transmission experiment that optimally detects Anderson localisation, and demonstrate how one may extract a length scale which is correlated with (and in general smaller than) the localisation length. In addition, we study the dimensional crossover from one to two dimensions, providing a new explanation to the established trends. The prediction of a mobility edge coming from LLT is tested by direct Schr\"odinger time evolution and is found to be unphysical. Moreover, we investigate expanding wavepackets, to find that these can be useful in detecting and quantifying Anderson localisation in a transmission experiment, with the only disadvantage being the inability to resolve the energy dependence of the localisation length. Then, we utilise LLT to uncover a connection between the Anderson model for discrete disordered lattices and continuous two-dimensional disordered systems, which provides powerful new insights. From here, we demonstrate that localisation can be distinguished from other effects by a comparison to dynamics in an ordered potential with all other properties unchanged. Finally, we thoroughly investigate the effect of acceleration and repulsive interparticle interactions, as relevant for current experiments.


title: Obstruction and Interference in Low Energy Models for Twisted Bilayer Graphene

abstract: The electronic bands of twisted bilayer graphene (TBLG) with a large-period moir\'e superlattice fracture to form narrow Bloch minibands that are spectrally isolated by forbidden energy gaps from remote dispersive bands. When these gaps are sufficiently large, one can study a band-projected Hamiltonian that correctly represents the dynamics within the minibands. This inevitably introduces nontrivial geometrical constraints that arise from the assumed form of the projection. Here we show that this choice has a profound consequence in a low-energy experimentally-observable signature which therefore can be used to tightly constrain the analytic form of the appropriate low-energy theory. We find that this can be accomplished by a careful analysis of the electron density produced by backscattering of Bloch waves from an impurity potential localized on the moir\'e superlattice scale. We provide numerical estimates of the effect that can guide experimental work to clearly discriminate between competing models for the low-energy band structure.


title: A Compiler Infrastructure for FPGA and ASIC Development

abstract: This whitepaper proposes a unified framework for hardware design tools to ease the development and inter-operability of said tools. By creating a large ecosystem of hardware development tools across vendors, academia, and the open source community, we hope to significantly increase much need productivity in hardware design.


title: Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs

abstract: A wide variety of deep learning techniques from style transfer to multitask learning rely on training affine transformations of features. Most prominent among these is the popular feature normalization technique BatchNorm, which normalizes activations and then subsequently applies a learned affine transform. In this paper, we aim to understand the role and expressive power of affine parameters used to transform features in this way. To isolate the contribution of these parameters from that of the learned features they transform, we investigate the performance achieved when training only these parameters in BatchNorm and freezing all weights at their random initializations. Doing so leads to surprisingly high performance considering the significant limitations that this style of training imposes. For example, sufficiently deep ResNets reach 82% (CIFAR-10) and 32% (ImageNet, top-5) accuracy in this configuration, far higher than when training an equivalent number of randomly chosen parameters elsewhere in the network. BatchNorm achieves this performance in part by naturally learning to disable around a third of the random features. Not only do these results highlight the expressive power of affine parameters in deep learning, but - in a broader sense - they characterize the expressive power of neural networks constructed simply by shifting and rescaling random features.


title: Learning Near Optimal Policies with Low Inherent Bellman Error

abstract: We study the exploration problem with approximate linear action-value functions in episodic reinforcement learning under the notion of low inherent Bellman error, a condition normally employed to show convergence of approximate value iteration. First we relate this condition to other common frameworks and show that it is strictly more general than the low rank (or linear) MDP assumption of prior work. Second we provide an algorithm with a high probability regret bound $\widetilde O(\sum_{t=1}^H d_t \sqrt{K} + \sum_{t=1}^H \sqrt{d_t} \IBE K)$ where $H$ is the horizon, $K$ is the number of episodes, $\IBE$ is the value if the inherent Bellman error and $d_t$ is the feature dimension at timestep $t$. In addition, we show that the result is unimprovable beyond constants and logs by showing a matching lower bound. This has two important consequences: 1) it shows that exploration is possible using only \emph{batch assumptions} with an algorithm that achieves the optimal statistical rate for the setting we consider, which is more general than prior work on low-rank MDPs 2) the lack of closedness (measured by the inherent Bellman error) is only amplified by $\sqrt{d_t}$ despite working in the online setting. Finally, the algorithm reduces to the celebrated \textsc{LinUCB} when $H=1$ but with a different choice of the exploration parameter that allows handling misspecified contextual linear bandits. While computational tractability questions remain open for the MDP setting, this enriches the class of MDPs with a linear representation for the action-value function where statistically efficient reinforcement learning is possible.


title: Automated Regression Unit Test Generation for Program Merges

abstract: Merging other branches into the current working branch is common in collaborative software development. However, developers still heavily rely on the textual merge tools to handle the complicated merge tasks. The latent semantic merge conflicts may fail to be detected and degrade the software quality. Regression testing is able to prevent regression faults and has been widely used in real-world software development. However, the merged software may fail to be well examined by rerunning the existing whole test suite. Intuitively, if the test suite fails to cover the changes of different branches at the same time, the merge conflicts would fail to be detected. Recently, it has been proposed to conduct verification on 3-way merges, but this approach does not support even some common cases such as different changes made to different parts of the program. In this paper, we propose an approach of regression unit test generation specifically for checking program merges according to our proposed test oracles. And our general test oracles support us to examine not only 3-way merges, but also 2-way and octopus merges. Considering the conflicts may arise in other locations besides changed methods of the project, we design an algorithm to select UUTs based on the dependency analysis of the whole project. On this basis, we implement a tool called TOM to generate unit tests for Java program merges. We also design the benchmark MCon4J consisting of 389 conflict 3-way merges and 389 conflict octopus merges to facilitate further studies on this topic. The experimental results show that TOM finds 45 conflict 3- way merges and 87 conflicts octopus merges, while the verification based tool fails to work on MCon4J.


title: Quark-gluon cluster -- a composite entity just due to color confinement

abstract: We incorporate confining effects into statistical formulation of quantum chromodynamics (QCD). It implies that quark-gluon clusters existed in the early universe, triggering the information accumulation in nature. The confinement-driven clustering would explain the reason why the quark-gluon plasma in the heavy-ion ollision experiments looks like liquid unlike the QCD expectation.


title: Superfluid-Normal Quantum Phase Transitions in an Imbalanced Fermi Gas

abstract: We investigate the superfluid-to-normal zero temperature quantum phase transitions of asymmetric two-component Fermi gases as a function of the chemical potential imbalance $h$. The calculations are performed for homogeneous and trapped imbalanced systems. We concentrate at unitarity, characterized by a divergent interaction parameter $k_F a$, where most of the current experiments are realized. For homogeneous systems, we determine the critical chemical potential imbalance $h_c$ at which possible phase transitions occur. In the case of trapped gases, we show how $h_c$ can be consistently determined from experimental observations.

categories: cond-mat.quant-gas cond-mat.supr-con hep-th nucl-th


title: Learning to Make Chemical Predictions: the Interplay of Feature Representation, Data, and Machine Learning Algorithms

abstract: Recently supervised machine learning has been ascending in providing new predictive approaches for chemical, biological and materials sciences applications. In this Perspective we focus on the interplay of machine learning algorithm with the chemically motivated descriptors and the size and type of data sets needed for molecular property prediction. Using Nuclear Magnetic Resonance chemical shift prediction as an example, we demonstrate that success is predicated on the choice of feature extracted or real-space representations of chemical structures, whether the molecular property data is abundant and/or experimentally or computationally derived, and how these together will influence the correct choice of popular machine learning algorithms drawn from deep learning, random forests, or kernel methods.


title: Octagonal Family of Monolayers, Bulk and Nanotubes

abstract: A new class of tetragonally symmetric 2D octagonal family of monolayers (o-MLs) has emerged recently and demands understanding at the fundamental level. o-MLs of metal nitride and carbide family (BN, AlN, GaN, GeC, SiC) along with C and BP are computationally designed and their stability and electronic structure are investigated. These binary o-MLs show mixed ionic and covalent bonding with the hybridized p states dominating the electronic structure around the Fermi level. Geometric and structural similarity of o-C and o-BN has been exploited to form patterned hybrid o-MLs ranging from metallic to insulating phases. Stacking of zigzag buckled o-MLs results in stable body centered tetragonal (bct)-bulk phase that is suitable for most materials from group IV, III-V and II-VI. Vertically cut chunks of o-BN and o-C bulk or stacking of o-rings, unlike rolling of hexagonal (h)-ML, provide a plausible way to form very thin o-nanotubes (o-NT). Confined and bulk structures formed with an octagonal motif are of fundamental importance to understand the underlying science and for technological applications.


title: When does the onset of multiple stellar populations in star clusters occur-III: No evidence of significant chemical variations in main-sequence stars of NGC 419

abstract: Recent studies have revealed that the onset age for the presence of multiple stellar populations (MPs) in star clusters seems to correspond to the disappearance of the extended main-sequence turnoff (eMSTO) in young clusters, a pattern associated with stellar rotations. A speculative suggestion is that MPs might be caused by the magnetic brake, a stellar evolutionary effect linked to the rotation. In this work, we use the young massive cluster NGC 419 as a testbed. We examined if its magnetically baked MS stars would exhibit MPs. Using the deep ultraviolet and visible images observed through the Hubble Space Telescope, combined with a specific color index that is sensitive to the nitrogen (N) abundance, we examined if its late G- and K-type MS stars are affected by N variation. Our analysis reports that the morphology of its GK-type MS is most likely an SSP, and only a negligible probability that indicates a N variation up to 0.4 dex is present. We conclude that there is no significant N variation among its GK-type MS stars. The absence of a significant chemical variation among the late-type MS stars indicates that MPs might not be a specific pattern of magnetically braked stars.


title: Non-Eulerian Dehn-Sommerville relations

abstract: The classical Dehn--Sommerville relations assert that the $h$-vector of an Eulerian simplicial complex is symmetric. We establish three generalizations of the Dehn--Sommerville relations: one for the $h$-vectors of pure simplicial complexes, another one for the flag $h$-vectors of balanced simplicial complexes and graded posets, and yet another one for the toric $h$-vectors of graded posets with restricted singularities. In all of these cases, we express any failure of symmetry in terms of "errors coming from the links." For simplicial complexes, this further extends Klee's semi-Eulerian relations.


title: A Real-time Automatic Validation System for Optical Transients detected by GWAC

abstract: The ground-based wide-angle camera array (GWAC) generates millions of single frame alerts per night. After the complicated and elaborate filters by multiple methods, a couple of dozens of candidates are still needed to be confirmed by follow-up observations in real-time. In order to free scientists from the complex and high-intensity follow-up tasks, we developed a Real-time Automatic transient Validation System (RAVS), and introduce here its system architecture, data processing flow, database schema, automatic follow-up control flow, and mobile message notification solution. This system is capable of automatically carrying out all operations in real-time without human intervention, including the validation of transient candidates, the adaptive light-curve sampling for identified targets in multi-band, and the pushing of observation results to the mobile client. The running of RAVS shows that an M-type stellar flare event can be well sampled by RAVS without a significant loss of the details, while the observing time is only less than one-third of the time coverage. Because the control logic of RAVS is designed to be independent of the telescope hardware, RAVS can be conveniently transplanted to other telescopes, especially the follow-up system of SVOM. Some future improvements are presented for the adaptive light-curve sampling, after taking into account both the brightness of sources and the evolution trends of the corresponding light-curves.


title: Decentralized Multi-player Multi-armed Bandits with No Collision Information

abstract: The decentralized stochastic multi-player multi-armed bandit (MP-MAB) problem, where the collision information is not available to the players, is studied in this paper. Building on the seminal work of Boursier and Perchet (2019), we propose error correction synchronization involving communication (EC-SIC), whose regret is shown to approach that of the centralized stochastic MP-MAB with collision information. By recognizing that the communication phase without collision information corresponds to the Z-channel model in information theory, the proposed EC-SIC algorithm applies optimal error correction coding for the communication of reward statistics. A fixed message length, as opposed to the logarithmically growing one in Boursier and Perchet (2019), also plays a crucial role in controlling the communication loss. Experiments with practical Z-channel codes, such as repetition code, flip code and modified Hamming code, demonstrate the superiority of EC-SIC in both synthetic and real-world datasets.


title: COVID-19 Docking Server: A meta server for docking small molecules, peptides and antibodies against potential targets of COVID-19

abstract: Motivation: The coronavirus disease 2019 (COVID-19) caused by a new type of coronavirus has been emerging from China and led to thousands of death globally since December 2019. Despite many groups have engaged in studying the newly emerged virus and searching for the treatment of COVID-19, the understanding of the COVID-19 target-ligand interactions represents a key chal-lenge. Herein, we introduce COVID-19 Docking Server, a web server that predicts the binding modes between COVID-19 targets and the ligands including small molecules, peptides and anti-bodies. Results: Structures of proteins involved in the virus life cycle were collected or constructed based on the homologs of coronavirus, and prepared ready for docking. The meta platform provides a free and interactive tool for the prediction of COVID-19 target-ligand interactions and following drug discovery for COVID-19.


title: Towards Using Count-level Weak Supervision for Crowd Counting

abstract: Most existing crowd counting methods require object location-level annotation, i.e., placing a dot at the center of an object. While being simpler than the bounding-box or pixel-level annotation, obtaining this annotation is still labor-intensive and time-consuming especially for images with highly crowded scenes. On the other hand, weaker annotations that only know the total count of objects can be almost effortless in many practical scenarios. Thus, it is desirable to develop a learning method that can effectively train models from count-level annotations. To this end, this paper studies the problem of weakly-supervised crowd counting which learns a model from only a small amount of location-level annotations (fully-supervised) but a large amount of count-level annotations (weakly-supervised). To perform effective training in this scenario, we observe that the direct solution of regressing the integral of density map to the object count is not sufficient and it is beneficial to introduce stronger regularizations on the predicted density map of weakly-annotated images. We devise a simple-yet-effective training strategy, namely Multiple Auxiliary Tasks Training (MATT), to construct regularizes for restricting the freedom of the generated density maps. Through extensive experiments on existing datasets and a newly proposed dataset, we validate the effectiveness of the proposed weakly-supervised method and demonstrate its superior performance over existing solutions.


title: Entanglement transfer from quantum matter to classical geometry in an emergent holographic dual description of a scalar field theory

abstract: Applying recursive renormalization group transformations to a scalar field theory, we obtain an effective quantum gravity theory with an emergent extra dimension, described by a dual holographic Einstein-Klein-Gordon type action. Here, the dynamics of both the dual order-parameter field and the metric tensor field originate from density-density and energy-momentum tensor-tensor effective interactions, respectively, in the recursive renormalization group transformation, performed approximately in the Gaussian level. This linear approximation in the recursive renormalization group transformation for the gravity sector gives rise to a linearized quantum Einstein-scalar theory along the $z-$directional emergent space. In the large $N$ limit, where $N$ is the flavor number of the original scalar fields, quantum fluctuations of both dynamical metric and dual scalar fields are suppressed, leading to a classical field theory of the Einstein-scalar type in $(D+1)$-spacetime dimensions. We show that this emergent background gravity describes the renormalization group flows of coupling functions in the UV quantum field theory through the extra dimension. More precisely, the IR boundary conditions of the gravity equations correspond to the renormalization group $\beta$-functions of the quantum field theory, where the infinitesimal distance in the extra-dimensional space is identified with an energy scale for the renormalization group transformation. Finally, we also show that this dual holographic formulation describes quantum entanglement in a geometrical way, encoding the transfer of quantum entanglement from quantum matter to classical gravity in the large $N$ limit. We claim that this entanglement transfer serves as a microscopic foundation for the emergent holographic duality description.


title: Depth-Adaptive Graph Recurrent Network for Text Classification

abstract: The Sentence-State LSTM (S-LSTM) is a powerful and high efficient graph recurrent network, which views words as nodes and performs layer-wise recurrent steps between them simultaneously. Despite its successes on text representations, the S-LSTM still suffers from two drawbacks. Firstly, given a sentence, certain words are usually more ambiguous than others, and thus more computation steps need to be taken for these difficult words and vice versa. However, the S-LSTM takes fixed computation steps for all words, irrespective of their hardness. The secondary one comes from the lack of sequential information (e.g., word order) that is inherently important for natural language. In this paper, we try to address these issues and propose a depth-adaptive mechanism for the S-LSTM, which allows the model to learn how many computational steps to conduct for different words as required. In addition, we integrate an extra RNN layer to inject sequential information, which also serves as an input feature for the decision of adaptive depths. Results on the classic text classification task (24 datasets in various sizes and domains) show that our model brings significant improvements against the conventional S-LSTM and other high-performance models (e.g., the Transformer), meanwhile achieving a good accuracy-speed trade off.


title: Design optimization of stochastic complex systems via iterative density estimation

abstract: Reliability-based design optimization (RBDO) provides a rational and sound framework for finding the optimal design while taking uncertainties into ac-count. The main issue in implementing RBDO methods, particularly stochastic simu-lation based ones, is the computational burden arising from the evaluation of reliability constraints. In this contribution, we propose an efficient method which ap-proximates the failure probability functions (FPF) to decouple reliability. Based on the augmentation concept, the approximation of FPF is equivalent to density estimation of failure design samples. Unlike traditional density estimation schemes, where the esti-mation is conducted in the entire design space, in the proposed method we iteratively partition the design space into several subspaces according to the distribution of fail-ure design samples. Numerical results of an illustrative example indicate that the pro-posed method can improve the computational performance considerably.


title: Two-Level Attention-based Fusion Learning for RGB-D Face Recognition

abstract: With recent advances in RGB-D sensing technologies as well as improvements in machine learning and fusion techniques, RGB-D facial recognition has become an active area of research. A novel attention aware method is proposed to fuse two image modalities, RGB and depth, for enhanced RGB-D facial recognition. The proposed method first extracts features from both modalities using a convolutional feature extractor. These features are then fused using a two-layer attention mechanism. The first layer focuses on the fused feature maps generated by the feature extractor, exploiting the relationship between feature maps using LSTM recurrent learning. The second layer focuses on the spatial features of those maps using convolution. The training database is preprocessed and augmented through a set of geometric transformations, and the learning process is further aided using transfer learning from a pure 2D RGB image training process. Comparative evaluations demonstrate that the proposed method outperforms other state-of-the-art approaches, including both traditional and deep neural network-based methods, on the challenging CurtinFaces and IIIT-D RGB-D benchmark databases, achieving classification accuracies over 98.2% and 99.3% respectively. The proposed attention mechanism is also compared with other attention mechanisms, demonstrating more accurate results.


title: Polynomially Isometric Matrices in Low Dimensions

abstract: Given two $d\times d$ matrices, say $A$ and $B$, when do $p(A)$ and $p(B)$ have the same ``size'' for every polynomial $p$? In this article, we provide definitive results in the cases $d=2$ and $d=3$ when the notion of size used is the spectral norm.


title: Expression Recognition in the Wild Using Sequence Modeling

abstract: As we exceed upon the procedures for modelling the different aspects of behaviour, expression recognition has become a key field of research in Human Computer Interactions. Expression recognition in the wild is a very interesting problem and is challenging as it involves detailed feature extraction and heavy computation. This paper presents the methodologies and techniques used in our contribution to recognize different expressions i.e., neutral, anger, disgust, fear, happiness, sadness, surprise in ABAW competition on Aff-Wild2 database. Aff-Wild2 database consists of videos in the wild labelled for seven different expressions at frame level. We used a bi-modal approach by fusing audio and visual features and train a sequence-to-sequence model that is based on Gated Recurrent Units (GRU) and Long Short Term Memory (LSTM) network. We show experimental results on validation data. The overall accuracy of the proposed approach is 41.5 \%, which is better than the competition baseline of 37\%.


title: Preserving Symmetries for Variational Quantum Eigensolvers in the Presence of Noise

abstract: One of the most promising applications of noisy intermediate-scale quantum computers is the simulation of molecular Hamiltonians using the variational quantum eigensolver. We show that encoding symmetries of the simulated Hamiltonian in the VQE ansatz reduces both classical and quantum resources compared to other, widely available ansatze. Through simulations of the H$_2$ molecule, we verify that these improvements persist in the presence of noise. This simulation is performed with IBM software using noise models from real devices. We also demonstrate how these techniques can be used to find molecular excited states of various symmetries using a noisy processor. We use error mitigation techniques to further improve the quality of our results.


title: Entity Profiling in Knowledge Graphs

abstract: Knowledge Graphs (KGs) are graph-structured knowledge bases storing factual information about real-world entities. Understanding the uniqueness of each entity is crucial to the analyzing, sharing, and reusing of KGs. Traditional profiling technologies encompass a vast array of methods to find distinctive features in various applications, which can help to differentiate entities in the process of human understanding of KGs. In this work, we present a novel profiling approach to identify distinctive entity features. The distinctiveness of features is carefully measured by a HAS model, which is a scalable representation learning model to produce a multi-pattern entity embedding. We fully evaluate the quality of entity profiles generated from real KGs. The results show that our approach facilitates human understanding of entities in KGs.


title: Vorticity Confinement and TVD Applied to Wing Tip Vortices for Accurate Drag Prediction

abstract: The vorticity confinement (VC) method was used with total variation diminishing (TVD) schemes to reduce possible over-confinement and applied to tip vortices shed by edges of wings in order to predict induced drag using far-field integration. The optimal VC parameter was determined first by application to 2-D vortices and then to tip vortices shed by a 3-D wing. The 3-D inviscid simulations were post-processed using the wake-integral technique to determine lift-induced drag force. Dependence of the VC parameter on the flight Mach number and the angle of attack was evaluated. Grid convergence studies were conducted for 2-D vortices and for induced drag generated by 3-D wing. VC was used with TVD minmod and differentiable flux limiters to evaluate their effect on the VC method. Finally, the VC approach was combined with the Reynolds stress equation turbulence model, and the results were compared to experimental data of tip vortex evolution.


title: Metastability on the steady states in a Fermi-like model of counterflowing particles

abstract: In this work we propose a two-dimensional extension of a previously defined one-dimensional version of a model of counterflowing particles, which considers an adapted Fermi-Dirac distribution to describe the transition probabilities. In this modified and extended version of the model, we consider that only particles of different species interact and they hop through the cells of a two dimensional rectangular lattice with probabilities taking into account diffusive and scattering aspects. We show that for a sufficiently low level of randomness ($\alpha \geq 10$), the system can relax to a mobile self-organized steady state of counterflow (lane formation) or to an immobile state (clog) depending sensitively on the initial conditions if the system has an average density near the crossover value ($\rho _{c}$). We also show that for certain suitable mixing of the species, we peculiarly have 3 different situations: (i) The immobile,(ii) Mobile organized by lanes, and (iii) Mobile without lane formation for the same density value. All of our results were obtained by performing Monte Carlo simulations.


title: DangKiller: Eliminating Dangling Pointers Efficiently via Implicit Identifier

abstract: Use-After-Free vulnerabilities, allowing the attacker to access unintended memory via dangling pointers, are more threatening. However, most detection schemes can only detect dangling pointers and invalid them, but not provide a tolerance mechanism to repair the errors at runtime. Also, these techniques obtain and manage the metadata inefficiently with complex structures and too much scan (sweep). The goal of this paper is to use compiler instrumentation to eliminate dangling pointers automatically and efficiently. In this paper, we observe that most techniques lack accurate efficient pointer graph metadata maintaining methods, so they need to scan the log to reduce the redundancy and sweep the whole address space to find dangling pointers. Also, they lack a direct, efficiently obtaining metadata approach. The key insight of this paper is that a unique identifier can be used as a key to a hash or direct-map algorithm. Thus, this paper maintains the same implicit identifier with each memory object and its corresponding referent. Associating the unique ID with metadata for memory objects, obtaining and managing the pointer graph metadata can be efficiently. Therefore, with the delayed free technique adopted into C/C++, we present the DangKiller as a novel and lightweight dangling pointer elimination solution. We first demonstrate the MinFat Pointer, which can calculate unique implicit ID for each object and pointer quickly, and use hash algorithm to obtain metadata. Secondly, we propose the Log Cache and Log Compression mechanism based on the ID to decrease the redundancy of dangling pointer candidates. Coupled with the Address Tagging architecture on an ARM64 system, our experiments show that the DangKiller can eliminate use-after-free vulnerabilities at only 11% and 3% runtime overheads for the SPEC CPU2006 and 2017 benchmarks respectively, except for unique cases.


title: Observation of the polaronic character of excitons in a two-dimensional semiconducting magnet $\mathrm{CrI_3}$

abstract: Exciton dynamics can be strongly affected by lattice vibrations through electron-phonon coupling. This is rarely explored in two-dimensional magnetic semiconductors. Focusing on bilayer CrI3, we first show the presence of strong electron-phonon coupling through temperature-dependent photoluminescence and absorption spectroscopy. We then report the observation of periodic broad modes up to the 8th order in Raman spectra, attributed to the polaronic character of excitons. We establish that this polaronic character is dominated by the coupling between the charge-transfer exciton at 1.96 eV and a longitudinal optical phonon at 120.6 cm-1. We further show that the emergence of long-range magnetic order enhances the electron-phonon coupling strength by about 50$\%$ and that the transition from layered antiferromagnetic to ferromagnetic order tunes the spectral intensity of the periodic broad modes, suggesting a strong coupling among the lattice, charge and spin in two-dimensional CrI3. Our study opens opportunities for tailoring light-matter interactions in two-dimensional magnetic semiconductors.


title: Optimal Feature Manipulation Attacks Against Linear Regression

abstract: In this paper, we investigate how to manipulate the coefficients obtained via linear regression by adding carefully designed poisoning data points to the dataset or modify the original data points. Given the energy budget, we first provide the closed-form solution of the optimal poisoning data point when our target is modifying one designated regression coefficient. We then extend the analysis to the more challenging scenario where the attacker aims to change one particular regression coefficient while making others to be changed as small as possible. For this scenario, we introduce a semidefinite relaxation method to design the best attack scheme. Finally, we study a more powerful adversary who can perform a rank-one modification on the feature matrix. We propose an alternating optimization method to find the optimal rank-one modification matrix. Numerical examples are provided to illustrate the analytical results obtained in this paper.


title: Algorithmic decomposition for efficient multiple nuclear spin detection in diamond

abstract: Efficiently detecting and characterizing individual spins in solid-state hosts is an essential step to expand the fields of quantum sensing and quantum information processing. While selective detection and control of a few 13C nuclear spins in diamond have been demonstrated using the electron spin of nitrogen-vacancy (NV) centers, a reliable, efficient, and automatic characterization method is desired. Here, we develop an automated algorithmic method for decomposing spectral data to identify and characterize multiple nuclear spins in diamond. We demonstrate efficient nuclear spin identification and accurate reproduction of hyperfine interaction components for both virtual and experimental nuclear spectroscopy data. We conduct a systematic analysis of this methodology and discuss the range of hyperfine interaction components of each nuclear spin that the method can efficiently detect. The result demonstrates a systematic approach that automatically detects nuclear spins with the aid of computational methods, facilitating the future scalability of devices.


title: TAdam: A Robust Stochastic Gradient Optimizer

abstract: Machine learning algorithms aim to find patterns from observations, which may include some noise, especially in robotics domain. To perform well even with such noise, we expect them to be able to detect outliers and discard them when needed. We therefore propose a new stochastic gradient optimization method, whose robustness is directly built in the algorithm, using the robust student-t distribution as its core idea. Adam, the popular optimization method, is modified with our method and the resultant optimizer, so-called TAdam, is shown to effectively outperform Adam in terms of robustness against noise on diverse task, ranging from regression and classification to reinforcement learning problems. The implementation of our algorithm can be found at https://github.com/Mahoumaru/TAdam.git


title: Realizing gapped surface states in magnetic topological insulator MnBi$_{2-x}$Sb$_{x}$Te$_{4}$

abstract: The interplay between magnetism and non-trivial topology in magnetic topological insulators (MTI) is expected to give rise to a variety of exotic topological quantum phenomena, such as the quantum anomalous Hall (QAH) effect and the topological axion states. A key to assessing these novel properties is to tune the Fermi level in the exchange gap of the Dirac surface band. MnBi$_2$Te$_4$ possesses non-trivial band topology with intrinsic antiferromagnetic (AFM) state that can enable all of these quantum states, however, highly electron-doped nature of the MnBi$_2$Te$_4$ crystals obstructs the exhibition of the gapped topological surface states. Here, we tailor the material through Sb-substitution to reveal the gapped surface states in MnBi$_{2-x}$Sb$_{x}$Te$_{4}$ (MBST). By shifting the Fermi level into the bulk band gap of MBST, we access the surface states and show a band gap of 50 meV at the Dirac point from quasi-particle interference (QPI) measured by scanning tunneling microscopy/spectroscopy (STM/STS). Surface-dominant conduction is confirmed below the N\'eel temperature through transport spectroscopy measured by multiprobe STM. The surface band gap is robust against out-of-plane magnetic field despite the promotion of field-induced ferromagnetism. The realization of bulk-insulating MTI with the large exchange gap offers a promising platform for exploring emergent topological phenomena.


title: Connecting far-from-equilibrium hydrodynamics to resummed transport coefficients and attractors

abstract: We investigate whether hydrodynamic attractors are present in simulations of the quark-gluon plasma formed in heavy-ion collisions. We argue that Lagrangian schemes to solve the relativistic viscous fluid equations can be particularly useful to characterize the properties of attractors in heavy ion collisions. Preliminary results are shown in Israel-Stewart theory to support such a claim. We also discuss how to perform the slow-roll expansion in Israel-Stewart theory undergoing a general flow, which naturally leads to the definition of a resummed shear viscosity coefficient that depends on the gradients of the hydrodynamic fields.


title: D-brane central charge and Landau-Ginzburg orbifolds

abstract: We propose a formula for the exact central charge of a B-type D-brane that is expected to hold in all regions of the Kahler moduli space of a Calabi-Yau. For Landau-Ginzburg orbifolds we propose explicit expressions for the mathematical objects that enter into the central charge formula. We show that our results are consistent with results in FJRW theory and the hemisphere partition function of the gauged linear sigma model.


title: High-resolution Monte Carlo study of the order-parameter distribution of the three-dimensional Ising model

abstract: We apply extensive Monte Carlo simulations to study the probability distribution $P(m)$ of the order parameter $m$ for the simple cubic Ising model with periodic boundary condition at the transition point. Sampling is performed with the Wolff cluster flipping algorithm, and histogram reweighting together with finite-size scaling analyses are then used to extract a precise functional form for the probability distribution of the magnetization, $P(m)$, in the thermodynamic limit. This form should serve as a benchmark for other models in the three-dimensional Ising Universality class.


title: Robustness of Uncertain Switching Nonlinear Feedback Systems against Large Time-Variation

abstract: For a non-linear MIMO feedback system, the robustness against uncertain time-variations in the feedback loop is investigated in an input-output framework. A general sufficient condition in terms of a bound on average rates of time-variation for the system to be stable is derived. The condition gives a tolerable limit on infrequent large variations or slow time-variation rate of a non-linear MIMO adaptive switching system.


title: Chen's inequalities for submanifolds in $(\kappa,\mu)$-contact space form with generalized semi-symmetric non-metric connections

abstract: In this paper, we obtain Chen's inequalities for submanifolds in $(\kappa,\mu)$-contact space form with two kinds of generalized semi-symmetric non-metric connections.


title: HVNet: Hybrid Voxel Network for LiDAR Based 3D Object Detection

abstract: We present Hybrid Voxel Network (HVNet), a novel one-stage unified network for point cloud based 3D object detection for autonomous driving. Recent studies show that 2D voxelization with per voxel PointNet style feature extractor leads to accurate and efficient detector for large 3D scenes. Since the size of the feature map determines the computation and memory cost, the size of the voxel becomes a parameter that is hard to balance. A smaller voxel size gives a better performance, especially for small objects, but a longer inference time. A larger voxel can cover the same area with a smaller feature map, but fails to capture intricate features and accurate location for smaller objects. We present a Hybrid Voxel network that solves this problem by fusing voxel feature encoder (VFE) of different scales at point-wise level and project into multiple pseudo-image feature maps. We further propose an attentive voxel feature encoding that outperforms plain VFE and a feature fusion pyramid network to aggregate multi-scale information at feature map level. Experiments on the KITTI benchmark show that a single HVNet achieves the best mAP among all existing methods with a real time inference speed of 31Hz.


title: Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation

abstract: Unpaired image-to-image (I2I) translation has received considerable attention in pattern recognition and computer vision because of recent advancements in generative adversarial networks (GANs). However, due to the lack of explicit supervision, unpaired I2I models often fail to generate realistic images, especially in challenging datasets with different backgrounds and poses. Hence, stabilization is indispensable for GANs and applications of I2I translation. Herein, we propose Augmented Cyclic Consistency Regularization (ACCR), a novel regularization method for unpaired I2I translation. Our main idea is to enforce consistency regularization originating from semi-supervised learning on the discriminators leveraging real, fake, reconstructed, and augmented samples. We regularize the discriminators to output similar predictions when fed pairs of original and perturbed images. We qualitatively clarify why consistency regularization on fake and reconstructed samples works well. Quantitatively, our method outperforms the consistency regularized GAN (CR-GAN) in real-world translations and demonstrates efficacy against several data augmentation variants and cycle-consistent constraints.


title: Robust 6D Object Pose Estimation by Learning RGB-D Features

abstract: Accurate 6D object pose estimation is fundamental to robotic manipulation and grasping. Previous methods follow a local optimization approach which minimizes the distance between closest point pairs to handle the rotation ambiguity of symmetric objects. In this work, we propose a novel discrete-continuous formulation for rotation regression to resolve this local-optimum problem. We uniformly sample rotation anchors in SO(3), and predict a constrained deviation from each anchor to the target, as well as uncertainty scores for selecting the best prediction. Additionally, the object location is detected by aggregating point-wise vectors pointing to the 3D center. Experiments on two benchmarks: LINEMOD and YCB-Video, show that the proposed method outperforms state-of-the-art approaches. Our code is available at https://github.com/mentian/object-posenet.


title: Logarithmic Regret for Adversarial Online Control

abstract: We introduce a new algorithm for online linear-quadratic control in a known system subject to adversarial disturbances. Existing regret bounds for this setting scale as $\sqrt{T}$ unless strong stochastic assumptions are imposed on the disturbance process. We give the first algorithm with logarithmic regret for arbitrary adversarial disturbance sequences, provided the state and control costs are given by known quadratic functions. Our algorithm and analysis use a characterization for the optimal offline control law to reduce the online control problem to (delayed) online learning with approximate advantage functions. Compared to previous techniques, our approach does not need to control movement costs for the iterates, leading to logarithmic regret.


title: Terahertz metallic photonic crystals integrated with dielectric waveguides

abstract: Compact and low-loss photonic crystal waveguides are critical in integrated terahertz (THz) applications. Compared with pure metal or dielectric photonic crystal waveguides, hybrid (metal-dielectric) integrated waveguides provide a simple way to further improve the field confinement and the propagation loss. In this work, we investigate a hybrid waveguide consisting of metallic photonic crystals and dielectric films in 0.1-1.0 THz. Photonic crystal waveguides based on metal pillar arrays (MPAs) support two resonance modes including the fundamental and high-order transverse magnetic (TM) modes and then form one apparent bandgap in 0.45-0.55 THz. The high-order TM-mode shows higher confinement than the fundamental mode and are thus sensitive to the dielectric film on the MPAs. The propagation loss and field confinement can be optimized by changing the dielectric film thickness and refractive index. The investigation shows that the lowest loss occurs at 0.68 THz because the high-order TM-mode THz waves are tightly confined inside the hybrid waveguide. This work proves that such hybrid waveguides based on metallic photonic crystals are promising to develop as a compact integrated terahertz device.


title: Cavityless self-organization of ultracold atoms due to the feedback-induced phase transition

abstract: Feedback is a general idea of modifying system behaviour depending on the measurement outcomes. It spreads from natural sciences, engineering, and artificial intelligence to contemporary classical and rock music. Recently, feedback has been suggested as a tool to induce phase transitions beyond the dissipative ones and tune their universality class. Here, we propose and theoretically investigate a system possessing such a feedback-induced phase transition. The system contains a Bose-Einstein condensate placed in an optical potential with the depth that is feedback-controlled according to the intensity of the Bragg-reflected probe light. We show that there is a critical value of the feedback gain where the uniform gas distribution loses its stability and the ordered periodic density distribution emerges. Due to the external feedback, the presence of a cavity is not necessary for this type of atomic self-organization. We analyze the dynamics after a sudden change of the feedback control parameter. The feedback time constant is shown to determine the relaxation above the critical point. We show as well that the control algorithm with the derivative of the measured signal dramatically decreases the transient time.

categories: quant-ph cond-mat.quant-gas physics.atom-ph physics.optics


title: Simultaneous test for Means: An Unblind Way to the F-test in One-way Analysis of Variance

abstract: After rejecting the null hypothesis in the analysis of variance, the next step is to make the pairwise comparisons to find out differences in means. The purpose of this paper is threefold. The foremost aim is to suggest expression for calculating decision limit that enables us to collect the test and pairwise comparisons in one step. This expression is proposed as the ratio of between square for each treatment and within sum of squares for all treatments. The second aim is to obtain the exact sampling distribution of the proposed ratio under the null hypothesis. The exact sampling distribution is derived as the beta distribution of the second type. The third aim is to use beta distribution and adjusted p values to create decision limit. Therefore, reject the null hypothesis of equal means if any adjusted point falls outsides the decision limit. Simulation study is conducted to compute Type one error. The results show that the proposed method controls the type one error near nominal values using Benjamini-Hochberg adjusted p-values. Two applications are given to show the benefits of the proposed method.


title: AMAGOLD: Amortized Metropolis Adjustment for Efficient Stochastic Gradient MCMC

abstract: Stochastic gradient Hamiltonian Monte Carlo (SGHMC) is an efficient method for sampling from continuous distributions. It is a faster alternative to HMC: instead of using the whole dataset at each iteration, SGHMC uses only a subsample. This improves performance, but introduces bias that can cause SGHMC to converge to the wrong distribution. One can prevent this using a step size that decays to zero, but such a step size schedule can drastically slow down convergence. To address this tension, we propose a novel second-order SG-MCMC algorithm---AMAGOLD---that infrequently uses Metropolis-Hastings (M-H) corrections to remove bias. The infrequency of corrections amortizes their cost. We prove AMAGOLD converges to the target distribution with a fixed, rather than a diminishing, step size, and that its convergence rate is at most a constant factor slower than a full-batch baseline. We empirically demonstrate AMAGOLD's effectiveness on synthetic distributions, Bayesian logistic regression, and Bayesian neural networks.


title: Lindblad Plus From Feynman-Vernon

abstract: I show how the Lindblad Plus equation will follow from the Feynman-Vernon theory. The Plus refers to the inclusion of non-Markov processes in the Lindblad equation resulting in an integro-differential general master equation. The equivalence of this general master equation and not the Lindblad equation alone to the Feynman-Vernon theory should be expected because the sum over histories approach of the FV theory clearly includes non-Markov processes, which Lindblad equation ignores. This should close the seeming gap between these two approaches to quantum open systems.


title: Be X-ray binaries in the SMC as indicators of mass transfer efficiency

abstract: Be X-ray binaries (BeXRBs) consist of rapidly rotating Be stars with neutron star companions accreting from the circumstellar emission disk. We compare the observed population of BeXRBs in the Small Magellanic Cloud with simulated populations of BeXRB-like systems produced with the COMPAS population synthesis code. We focus on the apparently higher minimal mass of Be stars in BeXRBs than in the Be population at large. Assuming that BeXRBs experienced only dynamically stable mass transfer, their mass distribution suggests that at least 30% of the mass donated by the progenitor of the neutron star is typically accreted by the B-star companion. We expect these results to affect predictions for the population of double compact object mergers. A convolution of the simulated BeXRB population with the star formation history of the Small Magellanic Cloud shows that the excess of BeXRBs is most likely explained by this galaxy's burst of star formation around 20--40 Myr ago.


title: First Order Motion Model for Image Animation

abstract: Image animation consists of generating a video sequence so that an object in a source image is animated according to the motion of a driving video. Our framework addresses this problem without using any annotation or prior information about the specific object to animate. Once trained on a set of videos depicting objects of the same category (e.g. faces, human bodies), our method can be applied to any object of this class. To achieve this, we decouple appearance and motion information using a self-supervised formulation. To support complex motions, we use a representation consisting of a set of learned keypoints along with their local affine transformations. A generator network models occlusions arising during target motions and combines the appearance extracted from the source image and the motion derived from the driving video. Our framework scores best on diverse benchmarks and on a variety of object categories. Our source code is publicly available.


title: VideoSSL: Semi-Supervised Learning for Video Classification

abstract: We propose a semi-supervised learning approach for video classification, VideoSSL, using convolutional neural networks (CNN). Like other computer vision tasks, existing supervised video classification methods demand a large amount of labeled data to attain good performance. However, annotation of a large dataset is expensive and time consuming. To minimize the dependence on a large annotated dataset, our proposed semi-supervised method trains from a small number of labeled examples and exploits two regulatory signals from unlabeled data. The first signal is the pseudo-labels of unlabeled examples computed from the confidences of the CNN being trained. The other is the normalized probabilities, as predicted by an image classifier CNN, that captures the information about appearances of the interesting objects in the video. We show that, under the supervision of these guiding signals from unlabeled examples, a video classification CNN can achieve impressive performances utilizing a small fraction of annotated examples on three publicly available datasets: UCF101, HMDB51 and Kinetics.


title: A drift-kinetic method for obtaining gradients in plasma properties from single-point distribution function data

abstract: In this paper, we derive a new drift-kinetic method for estimating gradients in the plasma properties through a velocity space distribution at a single point. The gradients are intrinsically related to agyrotropic features of the distribution function. This method predicts the gradients in the magnetized distribution function, and can predict gradients of arbitrary moments of the gyrotropic background distribution function. The method allows for estimates on density and pressure gradients on the scale of a Larmor radius, proving to resolve smaller scales than any method currently available to spacecraft. The model is verified with a set of fully-kinetic VPIC particle-in-cell simulations.


title: Energy-Efficient Federated Edge Learning with Joint Communication and Computation Design

abstract: This paper studies a federated edge learning system, in which an edge server coordinates a set of edge devices to train a shared machine learning model based on their locally distributed data samples. During the distributed training, we exploit the joint communication and computation design for improving the system energy efficiency, in which both the communication resource allocation for global ML parameters aggregation and the computation resource allocation for locally updating MLparameters are jointly optimized. In particular, we consider two transmission protocols for edge devices to upload ML parameters to edge server, based on the non orthogonal multiple access and time division multiple access, respectively. Under both protocols, we minimize the total energy consumption at all edge devices over a particular finite training duration subject to a given training accuracy, by jointly optimizing the transmission power and rates at edge devices for uploading MLparameters and their central processing unit frequencies for local update. We propose efficient algorithms to optimally solve the formulated energy minimization problems by using the techniques from convex optimization. Numerical results show that as compared to other benchmark schemes, our proposed joint communication and computation design significantly improves the energy efficiency of the federated edge learning system, by properly balancing the energy tradeoff between communication and computation.


title: Compactification, T-Duality and Quantum Erasers

abstract: Using T-duality, we will argue that a zero point length exists in the low energy effective field theory of string theory on compactified extra dimensions. Furthermore, if we neglect the oscillator modes, this zero point length would modify low quantum mechanical systems. As this zero length is fixed geometrically, it is important to analyze how it modifies purely quantum mechanical effects. Thus, we will analyze its effects on quantum erasers, because they are based on quantum effects like entanglement. It will be observed that the behavior of these quantum erasers gets modified by this zero point length. As the zero point length is fixed by the radius of compactification, we argue that these results demonstrate a deeper connection between geometry and quantum effects.


title: What Emotions Make One or Five Stars? Understanding Ratings of Online Product Reviews by Sentiment Analysis and XAI

abstract: When people buy products online, they primarily base their decisions on the recommendations of others given in online reviews. The current work analyzed these online reviews by sentiment analysis and used the extracted sentiments as features to predict the product ratings by several machine learning algorithms. These predictions were disentangled by various meth-ods of explainable AI (XAI) to understand whether the model showed any bias during prediction. Study 1 benchmarked these algorithms (knn, support vector machines, random forests, gradient boosting machines, XGBoost) and identified random forests and XGBoost as best algorithms for predicting the product ratings. In Study 2, the analysis of global feature importance identified the sentiment joy and the emotional valence negative as most predictive features. Two XAI visualization methods, local feature attributions and partial dependency plots, revealed several incorrect prediction mechanisms on the instance-level. Performing the benchmarking as classification, Study 3 identified a high no-information rate of 64.4% that indicated high class imbalance as underlying reason for the identified problems. In conclusion, good performance by machine learning algorithms must be taken with caution because the dataset, as encountered in this work, could be biased towards certain predictions. This work demonstrates how XAI methods reveal such prediction bias.


title: Dynamic geometric set cover and hitting set

abstract: We investigate dynamic versions of geometric set cover and hitting set where points and ranges may be inserted or deleted, and we want to efficiently maintain an (approximately) optimal solution for the current problem instance. While their static versions have been extensively studied in the past, surprisingly little is known about dynamic geometric set cover and hitting set. For instance, even for the most basic case of one-dimensional interval set cover and hitting set, no nontrivial results were known. The main contribution of our paper are two frameworks that lead to efficient data structures for dynamically maintaining set covers and hitting sets in $\mathbb{R}^1$ and $\mathbb{R}^2$. The first framework uses bootstrapping and gives a $(1+\varepsilon)$-approximate data structure for dynamic interval set cover in $\mathbb{R}^1$ with $O(n^\alpha/\varepsilon)$ amortized update time for any constant $\alpha > 0$; in $\mathbb{R}^2$, this method gives $O(1)$-approximate data structures for unit-square (and quadrant) set cover and hitting set with $O(n^{1/2+\alpha})$ amortized update time. The second framework uses local modification, and leads to a $(1+\varepsilon)$-approximate data structure for dynamic interval hitting set in $\mathbb{R}^1$ with $\widetilde{O}(1/\varepsilon)$ amortized update time; in $\mathbb{R}^2$, it gives $O(1)$-approximate data structures for unit-square (and quadrant) set cover and hitting set in the \textit{partially} dynamic settings with $\widetilde{O}(1)$ amortized update time.


title: Contextual Policy Transfer in Reinforcement Learning Domains via Deep Mixtures-of-Experts

abstract: In reinforcement learning, agents that consider the context, or current state, when selecting source policies for transfer have been shown to outperform context-free approaches. However, none of the existing approaches transfer knowledge contextually from model-based learners to a model-free learner. This could be useful, for instance, when source policies are intentionally learned on diverse simulations with plentiful data but transferred to a real-world setting with limited data. In this paper, we assume knowledge of estimated source task dynamics and policies, and common sub-goals but different dynamics. We introduce a novel deep mixture-of-experts formulation for learning state-dependent beliefs over source task dynamics that match the target dynamics using state trajectories collected from the target task. The mixture model is easy to interpret, demonstrates robustness to estimation errors in dynamics, and is compatible with most learning algorithms. We then show how this model can be incorporated into standard policy reuse frameworks, and demonstrate its effectiveness on benchmarks from OpenAI-Gym.


title: Signatures of the Higgs mode in transport through a normal-metal--superconductor junction

abstract: A superconductor subject to electromagnetic irradiation in the terahertz range can show amplitude oscillations of its order parameter. However, coupling this so-called Higgs mode to the charge current is notoriously difficult. We propose to achieve such a coupling in a particle-hole-asymmetric configuration using a DC-voltage-biased normal-metal--superconductor tunnel junction. Using the quasiclassical Green's function formalism, we demonstrate three characteristic signatures of the Higgs mode: (i) The AC charge current exhibits a pronounced resonant behavior and is maximal when the radiation frequency coincides with the order parameter. (ii) The AC charge current amplitude exhibits a characteristic nonmonotonic behavior with increasing voltage bias. (iii) At resonance for large voltage bias, the AC current vanishes inversely proportional to the bias. These signatures provide an electric detection scheme for the Higgs mode.


title: The GWAC Data Processing and Management System

abstract: GWAC will have been built an integrated FOV of 5,000 $degree^2$ and have already built 1,800 square $degree^2$. The limit magnitude of a 10-second exposure image in the moonless night is 16R. In each observation night, GWAC produces about 0.7TB of raw data, and the data processing pipeline generates millions of single frame alerts. We describe the GWAC Data Processing and Management System (GPMS), including hardware architecture, database, detection-filtering-validation of transient candidates, data archiving, and user interfaces for the check of transient and the monitor of the system. GPMS combines general technology and software in astronomy and computer field, and use some advanced technologies such as deep learning. Practical results show that GPMS can fully meet the scientific data processing requirement of GWAC. It can online accomplish the detection, filtering and validation of millions of transient candidates, and feedback the final results to the astronomer in real-time. During the observation from October of 2018 to December of 2019, we have already found 102 transients.


title: Spontaneous formation of magnetic dipoles by interaction of intense laser with overdense plasma

abstract: When a laser field is incident on an overdense plasma it is unable to penetrate inside it. Nevertheless, a part of its energy gets transferred to the electrons through a variety of mechanisms (e.g. vacuum and $\vec{J}\times \vec{B}) heating [1, 2]). The dynamics of these energetic electrons inside the plasma is a field of great interest. It is demonstrated here using 2-D PIC (Particle-In-Cell) simulation that when a high intensity laser pulse is incident on an overdense target, energetic electrons get generated which spontaneously organize themselves to form coherent structures. These coherent structures are observed to have similar dynamical traits as displayed by the solutions of the EMHD (Electron Magnetohydrodynamic) model [3]. This is noteworthy that EMHD is an approximate model and is applicable for the dynamics of non-relativistic electrons. However, in these simulations, the electron energy is in the relativistic regime as the laser intensity is significantly high. Thus, it shows that the relativistic dynamics also permits the existence of robust coherent structures. Interesting kinetic behaviour at particle level is observed in the simulation which shows that the coherent structures take background electrons in its fold and subsequently emit them at a higher energy.


title: Cryogenic Characterization of 180 nm CMOS Technology at 100 mK

abstract: Conventional CMOS technology operated at cryogenic conditions has recently attracted interest for its uses in low-noise electronics. We present one of the first characterizations of 180 nm CMOS technology at a temperature of 100 mK, extracting I/V characteristics, threshold voltages, and transconductance values, as well as observing their temperature dependence. We find that CMOS devices remain fully operational down to these temperatures, although we observe hysteresis effects in some devices. The measurements described in this paper can be used to inform the future design of CMOS devices intended to be operated in this deep cryogenic regime.


title: An integral arising from dyadic average of Riesz transforms

abstract: In the work of S. Petermichl, S. Treil and A. Volberg it was explicitly constructed that the Riesz transforms in any dimension $n \geq 2$ can be obtained as an average of dyadic Haar shifts provided that an integral is nonzero. It was shown in the paper that when $n=2$, the integral is indeed nonzero (negative) but for $n \geq 3$ the nonzero property remains unsolved. In this paper we show that the integral is nonzero (negative) for $n=3$. The novelty in our proof is the delicate decompositions of the integral for which we can either find their closed forms or prove an upper bound.


title: An algorithm of selection of meteor candidates in GWAC system

abstract: With its large field of view, GWAC can record hundreds of meteors every day. These meteors are valuable treasures for some meteor research groups. It is therefore very important to accurately find all of these meteors. To address the challenge of precisely distinguishing meteors from other elongated objects in a GWAC-like sky survey system, we design and implement a meteor candidate recognition algorithm, including the recognizing and morphology analysis of the light curves of the meteor candidates. Although the algorithm may filter out some real meteors, it can provide a sample of meteor with high confidence. After processing the images of Mini-GWAC taken in two months, we detect 109,000 elongated objects in which more than 90 percent of objects are not meteor. Among the elongated objects, about 5.9% objects are identified as meteors with high confidence, after the filters based upon an existence in a single frame, a single peak in the light curves, and a slow variation of the light curves.


title: Learning to Compare Relation: Semantic Alignment for Few-Shot Learning

abstract: Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Directly comparing query images with example images can not handle content misalignment. The representation and metric for comparison are critical but challenging to learn due to the scarcity and wide variation of the samples in few-shot learning. In this paper, we present a novel semantic alignment model to compare relations, which is robust to content misalignment. We propose to add two key ingredients to existing few-shot learning frameworks for better feature and metric learning ability. First, we introduce a semantic alignment loss to align the relation statistics of the features from samples that belong to the same category. And second, local and global mutual information maximization is introduced, allowing for representations that contain locally-consistent and intra-class shared information across structural locations in an image. Thirdly, we introduce a principled approach to weigh multiple loss functions by considering the homoscedastic uncertainty of each stream. We conduct extensive experiments on several few-shot learning datasets. Experimental results show that the proposed method is capable of comparing relations with semantic alignment strategies, and achieves state-of-the-art performance.


title: Nanofluidics coming of age

abstract: This is a turning point for nanofluidics. Recent progress allows envisioning both fundamental discoveries for the transport of fluids at the ultimate scales, and disruptive technologies for the water-energy nexus.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.flu-dyn


title: Randomized block Krylov space methods for trace and log-determinant estimators

abstract: We present randomized algorithms based on block Krylov space method for estimating the trace and log-determinant of Hermitian positive semi-definite matrices. Using the properties of Chebyshev polynomial and Gaussian random matrix, we provide the error analysis of the proposed estimators and obtain the expectation and concentration error bounds. These bounds improve the corresponding ones given in the literature. Numerical experiments are presented to illustrate the performance of the algorithms and to test the error bounds.


title: Cross-Spectrum Dual-Subspace Pairing for RGB-infrared Cross-Modality Person Re-Identification

abstract: Due to its potential wide applications in video surveillance and other computer vision tasks like tracking, person re-identification (ReID) has become popular and been widely investigated. However, conventional person re-identification can only handle RGB color images, which will fail at dark conditions. Thus RGB-infrared ReID (also known as Infrared-Visible ReID or Visible-Thermal ReID) is proposed. Apart from appearance discrepancy in traditional ReID caused by illumination, pose variations and viewpoint changes, modality discrepancy produced by cameras of the different spectrum also exists, which makes RGB-infrared ReID more difficult. To address this problem, we focus on extracting the shared cross-spectrum features of different modalities. In this paper, a novel multi-spectrum image generation method is proposed and the generated samples are utilized to help the network to find discriminative information for re-identifying the same person across modalities. Another challenge of RGB-infrared ReID is that the intra-person (images from the same person) discrepancy is often larger than the inter-person (images from different persons) discrepancy, so a dual-subspace pairing strategy is proposed to alleviate this problem. Combining those two parts together, we also design a one-stream neural network combining the aforementioned methods to extract compact representations of person images, called Cross-spectrum Dual-subspace Pairing (CDP) model. Furthermore, during the training process, we also propose a Dynamic Hard Spectrum Mining method to automatically mine more hard samples from hard spectrum based on the current model state to further boost the performance. Extensive experimental results on two public datasets, SYSU-MM01 with RGB + near-infrared images and RegDB with RGB + far-infrared images, have demonstrated the efficiency and generality of our proposed method.


title: Channel Equilibrium Networks for Learning Deep Representation

abstract: Convolutional Neural Networks (CNNs) are typically constructed by stacking multiple building blocks, each of which contains a normalization layer such as batch normalization (BN) and a rectified linear function such as ReLU. However, this work shows that the combination of normalization and rectified linear function leads to inhibited channels, which have small magnitude and contribute little to the learned feature representation, impeding the generalization ability of CNNs. Unlike prior arts that simply removed the inhibited channels, we propose to "wake them up" during training by designing a novel neural building block, termed Channel Equilibrium (CE) block, which enables channels at the same layer to contribute equally to the learned representation. We show that CE is able to prevent inhibited channels both empirically and theoretically. CE has several appealing benefits. (1) It can be integrated into many advanced CNN architectures such as ResNet and MobileNet, outperforming their original networks. (2) CE has an interesting connection with the Nash Equilibrium, a well-known solution of a non-cooperative game. (3) Extensive experiments show that CE achieves state-of-the-art performance on various challenging benchmarks such as ImageNet and COCO.


title: Convergence estimates of a semi-Lagrangian scheme for the ellipsoidal BGK model for polyatomic molecules

abstract: In this paper, we propose a new semi-Lagrangian scheme for the polyatomic ellipsoidal BGK model. In order to avoid time step restrictions coming from convection term and small Knudsen number, we combine a semi-Lagrangian approach for the convection term with an implicit treatment for the relaxation term. We show how to explicitly solve the implicit step, thus obtaining an efficient and stable scheme for any Knudsen number. We also derive an explicit error estimate on the convergence of the proposed scheme for every fixed value of the Knudsen number.


title: 3D Quantum Hall Effect Manipulated by Chiral Landau Levels in Weyl Semimetals

abstract: We investigate the 3D quantum Hall effect in Weyl semimetals and elucidate a global picture of the edge states. The edge states hosting 3D quantum Hall effect are combinations of Fermi arcs and chiral bulk Landau levels parallel to the magnetic field. The Hall conductance, $\sigma_{xz}^H$, shows quantized plateaus at Weyl nodes while tuning the magnetic field. However, the chiral Landau levels manipulate the quantization of Weyl orbits, especially under a tilted magnetic field, and the resulting edge states lead to distinctive Hall transport phenomena. A tilted magnetic field contributes an intrinsic initial value to $\sigma_{xz}^H$ and such initial value is determined by the tilting angle $\theta$. Particularly, even if the perpendicular magnetic field is fixed, $\sigma_{xz}^H$ will change its sign with an abrupt spatial shift of edge states when $\theta$ exceeds a critical angle $\theta_c$ in an experiment. Our work uncovers the unique edge-state nature of 3D quantum Hall effect in Weyl semimetals.


title: NAS-Count: Counting-by-Density with Neural Architecture Search

abstract: Most of the recent advances in crowd counting have evolved from hand-designed density estimation networks, where multi-scale features are leveraged to address the scale variation problem, but at the expense of demanding design efforts. In this work, we automate the design of counting models with Neural Architecture Search (NAS) and introduce an end-to-end searched encoder-decoder architecture, Automatic Multi-Scale Network (AMSNet). Specifically, we utilize a counting-specific two-level search space. The encoder and decoder in AMSNet are composed of different cells discovered from micro-level search, while the multi-path architecture is explored through macro-level search. To solve the pixel-level isolation issue in MSE loss, AMSNet is optimized with an auto-searched Scale Pyramid Pooling Loss (SPPLoss) that supervises the multi-scale structural information. Extensive experiments on four datasets show AMSNet produces state-of-the-art results that outperform hand-designed models, fully demonstrating the efficacy of NAS-Count.


title: Multiplicative Gaussian Particle Filter

abstract: We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the distribution with a weighted sum of functions from a set of continuous functions. Central to the approach is the use of sampling to approximate multiplications in the Bayes filter. We provide theoretical analysis, giving conditions for sampling to give good approximation. We next specialize to the case of weighted sums of Gaussians, and show how properties of Gaussians enable closed-form transition and efficient multiplication. Lastly, we conduct preliminary experiments on a robot localization problem and compare performance with the particle filter, to demonstrate the potential of the proposed method.


title: Wronskian/Casoratian Identities and their Application to Quantum Mechanical Systems

abstract: Corresponding to a certain Wronskian identity, we present two types of new Casoratian identities. We apply these identities to the Darboux transformations of quantum mechanical systems. The Wronskian identity is applied to the ordinary quantum mechanics, and the two Casoratian identities are applied to the discrete quantum mechanics with pure imaginary and real shifts, respectively.


title: Effective Localization Using Double Ideal Quotient and Its Implementation

abstract: In this paper, we propose a new method for localization of polynomial ideal, which we call "Local Primary Algorithm". For an ideal $I$ and a prime ideal $P$, our method computes a $P$-primary component of $I$ after checking if $P$ is associated with $I$ by using "double ideal quotient" $(I:(I:P))$ and its variants which give us a lot of information about localization of $I$.


title: Atomic cluster expansion of scalar, vectorial and tensorial properties and including magnetism and charge transfer

abstract: The atomic cluster expansion (Drautz, Phys. Rev. B 99, 014104 (2019)) is extended in two ways, the modelling of vectorial and tensorial atomic properties and the inclusion of atomic degrees of freedom in addition to the positions of the atoms. In particular, atomic species, magnetic moments and charges are attached to the atomic positions and an atomic cluster expansion that includes the different degrees of freedom on equal footing is derived. Expressions for the efficient evaluation of forces and torques are given. Relations to other methods are discussed.


title: Rigorous upper bound for the discrete Bak-Sneppen model

abstract: Fix some $p\in[0,1]$ and a positive integer $n$. The discrete Bak-Sneppen model is a Markov chain on the space of zero-one sequences of length $n$ with periodic boundary conditions. At each moment of time a minimum element (typically, zero) is chosen with equal probability, and is then replaced together with both its neighbours by independent Bernoulli(p) random variables. Let $\nu^{(n)}(p)$ be the probability that an element of this sequence equals one under the stationary distribution of this Markov chain. It was shown in [Barbay, Kenyon (2001)] that $\nu^{(n)}(p)\to 1$ as $n\to\infty$ when $p>0.54\dots$; the proof there is, alas, not rigorous. The complimentary fact that $\limsup \nu^{(n)}(p)< 1$ for $p\in(0,p')$ for some $p'>0$ is much harder; this was eventually shown in [Meester, Znamenski (2002)]. The purpose of this note is to provide a rigorous proof of the result from Barbay et al, as well as to improve it, by showing that $\nu^{(n)}(p)\to 1$ when $p>0.45$. In fact, our method with some finer tuning allows to show this fact even for all $p>0.419533$.


title: Deep differentiable forest with sparse attention for the tabular data

abstract: We present a general architecture of deep differentiable forest and its sparse attention mechanism. The differentiable forest has the advantages of both trees and neural networks. Its structure is a simple binary tree, easy to use and understand. It has full differentiability and all variables are learnable parameters. We would train it by the gradient-based optimization method, which shows great power in the training of deep CNN. We find and analyze the attention mechanism in the differentiable forest. That is, each decision depends on only a few important features, and others are irrelevant. The attention is always sparse. Based on this observation, we improve its sparsity by data-aware initialization. We use the attribute importance to initialize the attention weight. Then the learned weight is much sparse than that from random initialization. Our experiment on some large tabular dataset shows differentiable forest has higher accuracy than GBDT, which is the state of art algorithm for tabular datasets. The source codes are available at https://github.com/closest-git/QuantumForest


title: Seeing through multimode fibers with real-valued intensity transmission matrices

abstract: Image transmission through multimode optical fibers has been an area of immense interests driven by the demand for miniature endoscopes in biomedicine and higher speed and capacity in telecommunications. Conventionally, a complex-valued transmission matrix is obtained experimentally to link the input and output light fields of a multimode fiber for image retrieval, which complicates the experimental setup and increases the computational complexity. Here, we report a simple and high-speed method for image retrieval based on our discovery of a pseudo-linearity between the input and output light intensity distributions of multimode fibers. We studied the impact of several key parameters to image retrieval, including image pixel count, fiber core diameter and numerical aperture. We further demonstrated that a wide variety of input binary images could be faithfully retrieved from measured output speckle patterns using this method, promising to be useful for highly miniaturized endoscopy in biomedicine and spatial-mode-division multiplexing in telecommunications.


title: Comparison of Distal Teacher Learning with Numerical and Analytical Methods to Solve Inverse Kinematics for Rigid-Body Mechanisms

abstract: Several publications are concerned with learning inverse kinematics, however, their evaluation is often limited and none of the proposed methods is of practical relevance for rigid-body kinematics with a known forward model. We argue that for rigid-body kinematics one of the first proposed machine learning (ML) solutions to inverse kinematics -- distal teaching (DT) -- is actually good enough when combined with differentiable programming libraries and we provide an extensive evaluation and comparison to analytical and numerical solutions. In particular, we analyze solve rate, accuracy, sample efficiency and scalability. Further, we study how DT handles joint limits, singularities, unreachable poses, trajectories and provide a comparison of execution times. The three approaches are evaluated on three different rigid body mechanisms with varying complexity. With enough training data and relaxed precision requirements, DT has a better solve rate and is faster than state-of-the-art numerical solvers for a 15-DoF mechanism. DT is not affected by singularities while numerical solutions are vulnerable to them. In all other cases numerical solutions are usually better. Analytical solutions outperform the other approaches by far if they are available.