title: On the Relevance-Complexity Region of Scalable Information Bottleneck

abstract: The Information Bottleneck method is a learning technique that seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description length, and distortion evaluated under logarithmic loss measure. In this paper, we study a variation of the problem, called scalable information bottleneck, where the encoder outputs multiple descriptions of the observation with increasingly richer features. The problem at hand is motivated by some application scenarios that require varying levels of accuracy depending on the allowed level of generalization. First, we establish explicit (analytic) characterizations of the relevance-complexity region for memoryless Gaussian sources and memoryless binary sources. Then, we derive a Blahut-Arimoto type algorithm that allows us to compute (an approximation of) the region for general discrete sources. Finally, an application example in the pattern classification problem is provided along with numerical results.


title: Recyclable Waste Identification Using CNN Image Recognition and Gaussian Clustering

abstract: Waste recycling is an important way of saving energy and materials in the production process. In general cases recyclable objects are mixed with unrecyclable objects, which raises a need for identification and classification. This paper proposes a convolutional neural network (CNN) model to complete both tasks. The model uses transfer learning from a pretrained Resnet-50 CNN to complete feature extraction. A subsequent fully connected layer for classification was trained on the augmented TrashNet dataset [1]. In the application, sliding-window is used for image segmentation in the pre-classification stage. In the post-classification stage, the labelled sample points are integrated with Gaussian Clustering to locate the object. The resulting model has achieved an overall detection rate of 48.4% in simulation and final classification accuracy of 92.4%.


title: Unsupervised Monocular Depth Learning with Integrated Intrinsics and Spatio-Temporal Constraints

abstract: Monocular depth inference has gained tremendous attention from researchers in recent years and remains as a promising replacement for expensive time-of-flight sensors, but issues with scale acquisition and implementation overhead still plague these systems. To this end, this work presents an unsupervised learning framework that is able to predict at-scale depth maps and egomotion, in addition to camera intrinsics, from a sequence of monocular images via a single network. Our method incorporates both spatial and temporal geometric constraints to resolve depth and pose scale factors, which are enforced within the supervisory reconstruction loss functions at training time. Only unlabeled stereo sequences are required for training the weights of our single-network architecture, which reduces overall implementation overhead as compared to previous methods. Our results demonstrate strong performance when compared to the current state-of-the-art on multiple sequences of the KITTI driving dataset and can provide faster training times with its reduced network complexity.


title: Patch2Self: Denoising Diffusion MRI with Self-Supervised Learning

abstract: Diffusion-weighted magnetic resonance imaging (DWI) is the only noninvasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources create significant additive noise in DWI data which must be suppressed before subsequent microstructure analysis. We introduce a self-supervised learning method for denoising DWI data, Patch2Self, which uses the entire volume to learn a full-rank locally linear denoiser for that volume. By taking advantage of the oversampled q-space of DWI data, Patch2Self can separate structure from noise without requiring an explicit model for either. We demonstrate the effectiveness of Patch2Self via quantitative and qualitative improvements in microstructure modeling, tracking (via fiber bundle coherency) and model estimation relative to other unsupervised methods on real and simulated data.


title: The Kudla-Rapoport conjecture at a ramified prime for $U(1, 1)$

abstract: In this paper, we proved a local arithmetic Siegel-Weil formula for a $U(1, 1)$-Shimura variety at a ramified prime, a.k.a. a Kudla-Rapoport conjecture at a ramified case. The formula needs to be modified from the original Kudla-Rapoport conjecture. In the process, we also gives an explicit decomposition of the special divisors of the Rapoport-Zink space of unitary type $(1, 1)$ (Kr\"amer model). A key ingredient is to relate the Rapoport-Zink space to the Drinfeld upper plane.


title: Remote detection of explosives using Field Asymmetric Ion Mobility Spectrometer installed on multicopter

abstract: The detection of explosives and drugs in hard-to-reach places is a considerable challenge. We report the development and initial experimental characterization of the air analysis system that includes Field Asymmetric Ion Mobility Spectrometer (FAIMS), array of the semiconductor gas sensors and is installed on multicopter. The system was developed based on the commercially available DJI Matrix 100 platform. For data collection and communication with operator, the special compact computer (Intel Compute Stick) was installed onboard. The total weight of the system was 3.3 kg. The system allows the 15 minutes flight and provide the remote access to the obtained data. The developed system can be effectively used for the detection of impurities in the air, ecology monitoring, detection of chemical warfare agents and explosives, what is especially important in light of recent terroristic attacks. The capabilities of the system was tested on the several explosives such as trinitrotoluene and nitro powder.


title: Predicting Localized Primordial Star Formation with Deep Convolutional Neural Networks

abstract: We investigate applying 3D deep convolutional neural networks as fast surrogate models of the formation and feedback effects of primordial stars in hydrodynamic cosmological simulations of the first galaxies. Here, we present the surrogate model to predict localized primordial star formation; the feedback model will be presented in a subsequent paper. The star formation prediction model consists of two sub-models: the first is a 3D volume classifier that predicts which (10 comoving kpc)$^3$ volumes will host star formation, followed by a 3D Inception-based U-net voxel segmentation model that predicts which voxels will form primordial stars. We find that the combined model predicts primordial star forming volumes with high skill, with $F_1 >0.995$ and true skill score $>0.994$. The star formation is localized within the volume to $\lesssim5^3$~voxels ($\sim1.6$~comoving kpc$^3$) with $F_1>0.399$ and true skill score $>0.857$. Applied to simulations with low spatial resolution, the model predicts star forming regions in the same locations and at similar redshifts as sites in resolved full-physics simulations that explicitly model primordial star formation and feedback. When applied to simulations with lower mass resolution, we find that the model predicts star forming regions at later redshift due to delayed structure formation resulting from lower mass resolution. Our model predicts primordial star formation without halo finding, so will be useful in spatially under-resolved simulations that cannot resolve primordial star forming halos. To our knowledge, this is the first model that can predict primordial star forming regions that match highly-resolved cosmological simulations.


title: Sharp growth of the Ornstein-Uhlenbeck operator on Gaussian tail spaces

abstract: Let $X$ be a standard Gaussian random variable. For any $p \in (1, \infty)$, we prove the existence of a universal constant $C_{p}>0$ such that the inequality $$(\mathbb{E} |h'(X)|^{p})^{1/p} \geq C_{p} \sqrt{d} (\mathbb{E} |h(X)|^{p})^{1/p}$$ holds for all $d\geq 1$ and all polynomials $h : \mathbb{R} \to \mathbb{C}$ whose spectrum is supported on frequencies at least $d$, that is, $\mathbb{E} h(X) X^{k}=0$ for all $k=0,1, \ldots, d-1$. As an application of this optimal estimate, we obtain an affirmative answer to the Gaussian analogue of a question of Mendel and Naor (2014) concerning the growth of the Ornstein-Uhlenbeck operator on tail spaces of the real line. We also show the same bound for the gradient of analytic polynomials in an arbitrary dimension.


title: Equality Constrained Linear Optimal Control With Factor Graphs

abstract: This paper presents a novel factor graph-based approach to solve the discrete-time finite-horizon Linear Quadratic Regulator problem subject to auxiliary linear equality constraints within and across time steps. We represent such optimal control problems using constrained factor graphs and optimize the factor graphs to obtain the optimal trajectory and the feedback control policies using the variable elimination algorithm with a modified Gram-Schmidt process. We prove that our approach has the same order of computational complexity as the state-of-the-art dynamic programming approach. Furthermore, current dynamic programming approaches can only handle equality constraints between variables at the same time step, but ours can handle equality constraints among any combination of variables at any time step while maintaining linear complexity with respect to trajectory length. Our approach can be used to efficiently generate trajectories and feedback control policies to achieve periodic motion or repetitive manipulation.


title: Synthesis and characterization of vertically aligned La0.7Sr0.3MnO3:NiO nanocomposite thin films for spintronic applications

abstract: The microstructures and interfaces of two-phase vertically aligned nanocomposite (VAN) thin films play a key role in the design of spintronic device architectures and their multifunctional properties. Here, we show how the microstructures in self-assembled VAN thin films of La0.7Sr0.3MnO3:NiO (LSMO:NiO) can be effectively tuned from nano-granular to nano-columnar, and to nano-maze by controlling the number of laser shots from the two constituent phase targets in the pulsed laser deposition (PLD) film growth. The observed microstructural induced strain is found to significantly enhance the magnetoresistance in a very broad temperature range between 10-240 K and to modulate the in-plane exchange bias (EB), with the largest EB value observed in the maximally strained heterostructures. Most interestingly, a unique perpendicular exchange bias (PEB) effect is also observed for these heterostructures with an enhanced PEB field of up to 230 Oe. X-ray magnetic circular dichroism and training effect measurements demonstrate that the observed EB is disorder-induced and arises due to the pinning of NiO uncompensated moments at the disordered interface which is ferromagnetically coupled with LSMO. Furthermore, systematic changes in the electronic structure across the vertical interface related to a variation of the Mn3+/Mn4+ content arise as a consequence of out-of-plane tensile strain.


title: Numerical simulation of dark atom interaction with nuclei

abstract: The old and still not solved problem of dark atom solution for the puzzles of direct dark matter searches is related with rigorous prove of the existence of a low energy bound state in the dark atom interaction with nuclei. Such prove must involve a self-consistent account of the nuclear attraction and Coulomb repulsion in such interaction. In the lack of usual small parameters of atomic physics like smallness of electromagnetic coupling of the electronic shell or smallness of the size of nucleus as compared with the radius of the Bohr orbit the rigorous study of this problem inevitably implies numerical simulation of dark atom interaction with nuclei. Our approach to such simulations of $OHe-$nucleus interaction involves multi-step approximation to the realistic picture by continuous addition to the initially classical picture of three point-like body problem essential quantum mechanical features.


title: The Heidelberg compact electron beam ion traps

abstract: Electron beam ion traps (EBIT) are ideal tools for both production and study of highly charged ions (HCI). In order to reduce their construction, maintenance, and operation costs we have developed a novel, compact, room-temperature design, the Heidelberg Compact EBIT (HC-EBIT). Four already commissioned devices operate at the strongest fields (up to 0.86 T) reported for such EBITs using permanent magnets, run electron beam currents up to 80 mA and energies up to 10 keV. They demonstrate HCI production, trapping, and extraction of pulsed Ar$^{16+}$ bunches and continuous 100 pA ion beams of highly charged Xe up to charge state 29+, already with a 4 mA, 2 keV electron beam. Moreover, HC-EBITs offer large solid-angle ports and thus high photon count rates, e. g., in x-ray spectroscopy of dielectronic recombination in HCIs up to Fe$^{24+}$, achieving an electron-energy resolving power of $E/\Delta E > 1500$ at 5 keV. Besides traditional on-axis electron guns, we have also implemented a novel off-axis gun for laser, synchrotron, and free-electron laser applications, offering clear optical access along the trap axis. We report on its first operation at a synchrotron radiation facility demonstrating resonant photoexcitation of highly charged oxygen.

categories: physics.atom-ph astro-ph.IM physics.acc-ph physics.ins-det physics.plasm-ph


title: Exact Asymptotics for Linear Quadratic Adaptive Control

abstract: Recent progress in reinforcement learning has led to remarkable performance in a range of applications, but its deployment in high-stakes settings remains quite rare. One reason is a limited understanding of the behavior of reinforcement algorithms, both in terms of their regret and their ability to learn the underlying system dynamics---existing work is focused almost exclusively on characterizing rates, with little attention paid to the constants multiplying those rates that can be critically important in practice. To start to address this challenge, we study perhaps the simplest non-bandit reinforcement learning problem: linear quadratic adaptive control (LQAC). By carefully combining recent finite-sample performance bounds for the LQAC problem with a particular (less-recent) martingale central limit theorem, we are able to derive asymptotically-exact expressions for the regret, estimation error, and prediction error of a rate-optimal stepwise-updating LQAC algorithm. In simulations on both stable and unstable systems, we find that our asymptotic theory also describes the algorithm's finite-sample behavior remarkably well.


title: GaN/AlGaN 2DEGs in the quantum regime: Magneto-transport and photoluminescence to 60 tesla

abstract: Using high magnetic fields up to 60 T, we report magneto-transport and photoluminescence (PL) studies of a two-dimensional electron gas (2DEG) in a GaN/AlGaN heterojunction grown by molecular-beam epitaxy. Transport measurements demonstrate that the quantum limit can be exceeded (Landau level filling factor $\nu < 1$), and show evidence for the $\nu =2/3$ fractional quantum Hall state. Simultaneous optical and transport measurements reveal synchronous quantum oscillations of both the PL intensity and longitudinal resistivity in the integer quantum Hall regime. PL spectra directly reveal the dispersion of occupied Landau levels in the 2DEG and therefore the electron mass. These results demonstrate the utility of high (pulsed) magnetic fields for detailed measurements of quantum phenomena in high-density 2DEGs.


title: Recent Advances on the Graph Isomorphism Problem

abstract: We give an overview of recent advances on the graph isomorphism problem. Our main focus will be on Babai's quasi-polynomial time isomorphism test and subsequent developments that led to the design of isomorphism algorithms with a quasi-polynomial parameterized running time of the from $n^{\text{polylog}(k)}$, where $k$ is a graph parameter such as the maximum degree. A second focus will be the combinatorial Weisfeiler-Leman algorithm.


title: A position paper on GDPR compliance in sharded blockchains: rehash of old ideas or new interesting challenges?

abstract: Sharding has emerged as one of the common techniques to address the scalability problems of blockchain systems. To this end, various sharding techniques for blockchain systems have been proposed in the literature. When sharded blockchains process personal data, the data controllers and the data processors associated with the sharded blockchains need to be compliant with the General Data Protection Regulation (GDPR). To this end, this article makes the first attempt to address the following key question: to what extent the existing techniques developed by different communities such as the distributed computing community, the distributed systems community, the database community, identity and access control community and the dependability community can be used by the data controllers and data processors for complying with the GDPR requirements of data subject rights in sharded blockchains? As part of answering this question, this article argues that there is a need for cross-disciplinary research towards finding optimal solutions for implementing the data subject rights in sharded blockchains.


title: A population of compact radio variables and transients in the radio bright zone at the Galactic center observed with the Jansky Very Large Array

abstract: Using JVLA data obtained from high-resolution observations at 5.5 GHz at multiple epochs in 2014 and 2019, we have detected a population of radio variables and transients in the radio bright zone at the Galactic center. With observations covering a sky area of 180 arcmin$^2$ at an angular resolution of 0.4 arcsec, we report new detections of 110 Galactic center compact radio (GCCR) sources with a size of $<1$ arcsec. The flux densities of GCCRs exceed 70 $\mu$Jy, with at least 10$\sigma$ significance. Among these sources, 82 are variable or transient and 28 are non-variable. About 10\% of them are expected to be extragalactic background sources. We discuss the possible astrophysical nature of the detected sources. As compared to the Galactic disk (GD) population of normal pulsars (NPs) and millisecond pulsars (MSPs), a majority (80\%) of the GCCRs appears to fall within the high flux-density tail of the pulsar distribution, as extrapolated from a sample of NPs in the Galactic disk. However, MSPs extrapolated from the GD population are too weak to have contributed significantly to the GCCR population that have been detected. We also cross-correlated the GCCRs with X-ray sources in Chandra X-ray catalogs and found that 42 GCCRs have candidate X-ray counterparts. Most of the GCCRs having X-ray counterparts are likely to be associated with unresolved or slightly resolved radio jets launched from X-ray binaries with a compact object, either a black hole or a neutron star.


title: Compressed Sensing with Upscaled Vector Approximate Message Passing

abstract: The Recently proposed Vector Approximate Message Passing (VAMP) algorithm demonstrates a great reconstruction potential at solving compressed sensing related linear inverse problems. VAMP provides high per-iteration improvement, can utilize powerful denoisers like BM3D, has rigorously defined dynamics and is able to recover signals measured by highly undersampled and ill-conditioned linear operators. Yet, its applicability is limited to relatively small problem sizes due to the necessity to compute the expensive LMMSE estimator at each iteration. In this work we consider the problem of upscaling VAMP by utilizing Conjugate Gradient (CG) to approximate the intractable LMMSE estimator. We propose a rigorous method for correcting and tuning CG withing CG-VAMP to achieve a stable and efficient reconstruction. To further improve the performance of CG-VAMP, we design a warm-starting scheme for CG and develop theoretical models for the Onsager correction and the State Evolution of Warm-Started CG-VAMP (WS-CG-VAMP). Additionally, we develop robust and accurate methods for implementing the WS-CG-VAMP algorithm. The numerical experiments on large-scale image reconstruction problems demonstrate that WS-CG-VAMP requires much fewer CG iterations compared to CG-VAMP to achieve the same or superior level of reconstruction.


title: Characterisation of Laser Wakefield Acceleration Efficiency with Octave Spanning Near-IR Spectrum Measurements

abstract: We report on experimental measurements of energy transfer efficiencies in a GeV-class laser wakefield accelerator. Both the transfer of energy from the laser to the plasma wakefield, and from the plasma to the accelerated electron beam were diagnosed by simultaneous measurement of the deceleration of laser photons and the acceleration of electrons as a function of plasma length. The extraction efficiency, which we define as the ratio of the energy gained by the electron beam to the energy lost by the self-guided laser mode, was maximised at $19\pm3$\% by tuning of the plasma density and length. The additional information provided by the octave-spanning laser spectrum measurement allows for independent optimisation of the plasma efficiency terms, which is required for the key goal of improving the overall efficiency of laser wakefield accelerators.


title: Error- and Tamper-Tolerant State Estimation for Discrete Event Systems under Cost Constraints

abstract: This paper deals with the state estimation problem in discrete-event systems modeled with nondeterministic finite automata, partially observed via a sensor measuring unit whose measurements (reported observations) may be vitiated by a malicious attacker. The attacks considered in this paper include arbitrary deletions, insertions, or substitutions of observed symbols by taking into account a bounded number of attacks or, more generally, a total cost constraint (assuming that each deletion, insertion, or substitution bears a positive cost to the attacker). An efficient approach is proposed to describe possible sequences of observations that match the one received by the measuring unit, as well as their corresponding state estimates and associated total costs. We develop an algorithm to obtain the least-cost matching sequences by reconstructing only a finite number of possible sequences, which we subsequently use to efficiently perform state estimation. We also develop a technique for verifying tamper-tolerant diagnosability under attacks that involve a bounded number of deletions, insertions, and substitutions (or, more generally, under attacks of bounded total cost) by using a novel structure obtained by attaching attacks and costs to the original plant. The overall construction and verification procedure have complexity that is of O(|X|^2 C^2),where |X| is the number of states of the given finite automaton and C is the maximum total cost that is allowed for all the deletions, insertions, and substitutions. We determine the minimum value of C such that the attacker can coordinate its tampering action to keep the observer indefinitely confused while utilizing a finite number of attacks. Several examples are presented to demonstrate the proposed methods.


title: Probing the pathway of an ultrafast structural phase transition to illuminate the transition mechanism in Cu2S

abstract: Disentangling the primary order parameter from secondary order parameters in phase transitions is critical to the interpretation of the transition mechanisms in strongly correlated systems and quantum materials. Here we present a study of structural phase transition pathways in superionic Cu2S nanocrystals that exhibit intriguing properties. Utilizing ultrafast electron diffraction techniques sensitive in both momentum-space and the time-domain, we distinguish the dynamics of crystal symmetry breaking and lattice expansion in this system. We are able to follow the transient states along the transition pathway and so observe the dynamics of both the primary and secondary order parameters. Based on these observations we argue that the mechanism of the structural phase transition in Cu2S is dominated by the electron-phonon coupling. This mechanism advances the understanding from previous results where the focus was solely on dynamic observations of the lattice expansion.


title: Capillary Sorting of Particles by Dip Coating

abstract: In this letter, we describe the capillary sorting of particles by size based on dip coating. A substrate withdrawn from a liquid bath entrains a coating whose thickness depends on the withdrawal speed and the liquid properties. If the coating material contains particles, they will only be entrained when the viscous force pulling them with the substrate overcomes the opposing capillary force at the deformable meniscus. This force threshold occurs at different liquid thicknesses for particles of different sizes. Here, we show that this difference can be used to separate small particles from a mixed suspension through capillary filtration. In a bidisperse suspension, we observe three distinct filtration regimes. At low capillary numbers, Ca, no particles are entrained in the liquid coating. At high Ca, all particle sizes are entrained. For a range of capillary numbers between these two extremes, only the smallest particles are entrained while the larger ones remain in the reservoir. We explain how this technique can be applied to polydisperse suspension. We also provide an estimate of the range of capillary number to separate particles of given sizes. The combination of this technique with the scalability and robustness of dip coating makes it a promising candidate for high-throughput separation or purification of industrial and biomedical suspensions.


title: Synthetic Data Generation for Economists

abstract: As more tech companies engage in rigorous economic analyses, we are confronted with a data problem: in-house papers cannot be replicated due to use of sensitive, proprietary, or private data. Readers are left to assume that the obscured true data (e.g., internal Google information) indeed produced the results given, or they must seek out comparable public-facing data (e.g., Google Trends) that yield similar results. One way to ameliorate this reproducibility issue is to have researchers release synthetic datasets based on their true data; this allows external parties to replicate an internal researcher's methodology. In this brief overview, we explore synthetic data generation at a high level for economic analyses.


title: Neutrino Event Selection in the MicroBooNE Liquid Argon Time Projection Chamber using Wire-Cell 3-D Imaging, Clustering, and Charge-Light Matching

abstract: An accurate and efficient event reconstruction is required to realize the full scientific capability of liquid argon time projection chambers (LArTPCs). The current and future neutrino experiments that rely on massive LArTPCs create a need for new ideas and reconstruction approaches. Wire-Cell, proposed in recent years, is a novel tomographic event reconstruction method for LArTPCs. The Wire-Cell 3D imaging approach capitalizes on charge, sparsity, time, and geometry information to reconstruct a topology-agnostic 3D image of the ionization electrons prior to pattern recognition. A second novel method, the many-to-many charge-light matching, then pairs the TPC charge activity to the detected scintillation light signal, thus enabling a powerful rejection of cosmic-ray muons in the MicroBooNE detector. A robust processing of the scintillation light signal and an appropriate clustering of the reconstructed 3D image are fundamental to this technique. In this paper, we describe the principles and algorithms of these techniques and their successful application in the MicroBooNE experiment. A quantitative evaluation of the performance of these techniques is presented. Using these techniques, a 95% efficient pre-selection of neutrino charged-current events is achieved with a 30-fold reduction of non-beam-coincident cosmic-ray muons, and about 80\% of the selected neutrino charged-current events are reconstructed with at least 70% completeness and 80% purity.


title: Collisionless shock acceleration in the corona of an inertial confinement fusion pellet with possible application to ion fast ignition

abstract: Two-dimensional Particle-In-Cell simulations are used to explore collisionless shock acceleration in the corona plasma surrounding the compressed core of an inertial confinement fusion pellet. We show that an intense laser pulse interacting with the long scale-length plasma corona is able to launch a collisionless shock around the critical density. The nonlinear wave travels up-ramp through the plasma reflecting and accelerating the background ions. Our results suggest that protons with characteristics suitable for ion fast ignition may be achieved in this way.


title: Finite-energy infinite clusters without anchored expansion

abstract: Hermon and Hutchcroft have recently proved the long-standing conjecture that in Bernoulli(p) bond percolation on any nonamenable transitive graph G, at any p > p_c(G), the probability that the cluster of the origin is finite but has a large volume n decays exponentially in n. A corollary is that all infinite clusters have anchored expansion almost surely. They have asked if these results could hold more generally, for any finite energy ergodic invariant percolation. We give a counterexample, an invariant percolation on the 4-regular tree.


title: Classification of partially hyperbolic surface endomorphisms

abstract: We show that in the absence of periodic centre annuli, a partially hyperbolic surface endomorphism is dynamically coherent and leaf conjugate to its linearisation. We proceed to characterise the dynamics in the presence of periodic centre annuli. This completes a classification of partially hyperbolic surface endomorphisms.


title: Detecting direct causality in multivariate time series: A comparative study

abstract: The concept of Granger causality is increasingly being applied for the characterization of directional interactions in different applications. A multivariate framework for estimating Granger causality is essential in order to account for all the available information from multivariate time series. However, the inclusion of non-informative or non-significant variables creates estimation problems related to the 'curse of dimensionality'. To deal with this issue, direct causality measures using variable selection and dimension reduction techniques have been introduced. In this comparative work, the performance of an ensemble of bivariate and multivariate causality measures in the time domain is assessed, focusing on dimension reduction causality measures. In particular, different types of high-dimensional coupled discrete systems are used (involving up to 100 variables) and the robustness of the causality measures to time series length and different noise types is examined. The results of the simulation study highlight the superiority of the dimension reduction measures, especially for high-dimensional systems.


title: Instrumental Variable Identification of Dynamic Variance Decompositions

abstract: Macroeconomists increasingly use external sources of exogenous variation for causal inference. However, unless such external instruments (proxies) capture the underlying shock without measurement error, existing methods are silent on the importance of that shock for macroeconomic fluctuations. We show that, in a general moving average model with external instruments, variance decompositions for the instrumented shock are interval-identified, with informative bounds. Various additional restrictions guarantee point identification of both variance and historical decompositions. Unlike SVAR analysis, our methods do not require invertibility. Applied to U.S. data, they give a tight upper bound on the importance of monetary shocks for inflation dynamics.


title: Optimal Policies for the Homogeneous Selective Labels Problem

abstract: Selective labels are a common feature of consequential decision-making applications, referring to the lack of observed outcomes under one of the possible decisions. This paper reports work in progress on learning decision policies in the face of selective labels. The setting considered is both a simplified homogeneous one, disregarding individuals' features to facilitate determination of optimal policies, and an online one, to balance costs incurred in learning with future utility. For maximizing discounted total reward, the optimal policy is shown to be a threshold policy, and the problem is one of optimal stopping. In contrast, for undiscounted infinite-horizon average reward, optimal policies have positive acceptance probability in all states. Future work stemming from these results is discussed.


title: Hybrid quantum-classical algorithms and quantum error mitigation

abstract: Quantum computers can exploit a Hilbert space whose dimension increases exponentially with the number of qubits. In experiment, quantum supremacy has recently been achieved by the Google team by using a noisy intermediate-scale quantum (NISQ) device with over 50 qubits. However, the question of what can be implemented on NISQ devices is still not fully explored, and discovering useful tasks for such devices is a topic of considerable interest. Hybrid quantum-classical algorithms are regarded as well-suited for execution on NISQ devices by combining quantum computers with classical computers, and are expected to be the first useful applications for quantum computing. Meanwhile, mitigation of errors on quantum processors is also crucial to obtain reliable results. In this article, we review the basic results for hybrid quantum-classical algorithms and quantum error mitigation techniques. Since quantum computing with NISQ devices is an actively developing field, we expect this review to be a useful basis for future studies.


title: Cortex: A Compiler for Recursive Deep Learning Models

abstract: Optimizing deep learning models is generally performed in two steps: (i) high-level graph optimizations such as kernel fusion and (ii) low level kernel optimizations such as those found in vendor libraries. This approach often leaves significant performance on the table, especially for the case of recursive deep learning models. In this paper, we present Cortex, a compiler-based approach to generate highly-efficient code for recursive models for low latency inference. Our compiler approach and low reliance on vendor libraries enables us to perform end-to-end optimizations, leading to up to 14X lower inference latencies over past work, across different backends.


title: The evolution of a circumplanetary disc with a dead zone

abstract: We investigate whether the regular Galilean satellites could have formed in the dead zone of a circumplanetary disc. A dead zone is a region of weak turbulence in which the magnetorotational instability (MRI) is suppressed, potentially an ideal environment for satellite formation. With the grid-based hydrodynamic code, FARGO3D, we examine the evolution of a circumplanetary disc model with a dead zone. Material accumulates in the dead zone of the disc leading to a higher total mass and but a similar temperature profile compared to a fully turbulent disc model. The tidal torque increases the rate of mass transport through the dead zone leading to a steady state disc with a dead zone that does not undergo accretion outbursts. We explore a range of disc, dead zone and mass inflow parameters and find that the maximum mass of the disc is around 0.001 MJ . Since the total solid mass of such a disc is much lower, we find that there is not sufficient material in the disc for in situ formation of the Galilean satellites and that external supplement is required.


title: Dual Attention on Pyramid Feature Maps for Image Captioning

abstract: Generating natural sentences from images is a fundamental learning task for visual-semantic understanding in multimedia. In this paper, we propose to apply dual attention on pyramid image feature maps to fully explore the visual-semantic correlations and improve the quality of generated sentences. Specifically, with the full consideration of the contextual information provided by the hidden state of the RNN controller, the pyramid attention can better localize the visually indicative and semantically consistent regions in images. On the other hand, the contextual information can help re-calibrate the importance of feature components by learning the channel-wise dependencies, to improve the discriminative power of visual features for better content description. We conducted comprehensive experiments on three well-known datasets: Flickr8K, Flickr30K and MS COCO, which achieved impressive results in generating descriptive and smooth natural sentences from images. Using either convolution visual features or more informative bottom-up attention features, our composite captioning model achieves very promising performance in a single-model mode. The proposed pyramid attention and dual attention methods are highly modular, which can be inserted into various image captioning modules to further improve the performance.


title: Dynamics and Rheology of Ring-Linear Blend Semidilute Solutions in Extensional Flow: Modeling and Molecular Simulations

abstract: We use Brownian dynamics (BD) simulations and single molecule experiments to investigate the influence of topological constraints and hydrodynamic interactions on the dynamics and rheology of solutions of ring-linear polymer blends at the overlap concentration. We find agreement between simulation and experiment in that rings in solution blends exhibit large conformational fluctuations, including extension overshoots in the startup of flow and tumbling and tank-treading at steady state. Ring polymer fluctuations increase with blend fraction of linear polymers and are peaked at a ring Weissenberg number $\textrm{Wi}_R \approx 1.5$. On the contrary, linear and ring polymers in pure solutions show a peak in fluctuations at the critical coil-stretch Weissenberg number $\textrm{Wi} = 0.5$. BD simulations show that extension overshoots on startup of flow are due to flow-induced intermolecular ring-linear polymer hooks, whereas fluctuations at steady state are dominated by intermolecular hydrodynamic interactions (HI). This is supported by simulations of bidisperse linear polymer solution blends, which show similar trends in conformational dynamics between rings and linear polymers with a matched contour length. Compared to BD simulations, single molecule experiments show quantitatively larger fluctuations, which could arise because experiments are performed on higher molecular weight polymers with stronger topological constraints. To this end, we have advanced the understanding of the effects of topological interactions and intermolecular HI on the dynamics of semidilute ring-linear polymer blend solutions.


title: Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Composition

abstract: We study the problem of realizing the full spectrum of bipedal locomotion on a real robot with sim-to-real reinforcement learning (RL). A key challenge of learning legged locomotion is describing different gaits, via reward functions, in a way that is intuitive for the designer and specific enough to reliably learn the gait across different initial random seeds or hyperparameters. A common approach is to use reference motions (e.g. trajectories of joint positions) to guide learning. However, finding high-quality reference motions can be difficult and the trajectories themselves narrowly constrain the space of learned motion. At the other extreme, reference-free reward functions are often underspecified (e.g. move forward) leading to massive variance in policy behavior, or are the product of significant reward-shaping via trial-and-error, making them exclusive to specific gaits. In this work, we propose a reward-specification framework based on composing simple probabilistic periodic costs on basic forces and velocities. We instantiate this framework to define a parametric reward function with intuitive settings for all common bipedal gaits - standing, walking, hopping, running, and skipping. Using this function we demonstrate successful sim-to-real transfer of the learned gaits to the bipedal robot Cassie, as well as a generic policy that can transition between all of the two-beat gaits.


title: A framework for causal inference in the presence of extreme inverse probability weights: the role of overlap weights

abstract: In this paper, we consider recent progress in estimating the average treatment effect when extreme inverse probability weights are present and focus on methods that account for a possible violation of the positivity assumption. These methods aim at estimating the treatment effect on the subpopulation of patients for whom there is a clinical equipoise. We propose a systematic approach to determine their related causal estimands and develop new insights into the properties of the weights targeting such a subpopulation. Then, we examine the roles of overlap weights, matching weights, Shannon's entropy weights, and beta weights. This helps us characterize and compare their underlying estimators, analytically and via simulations, in terms of the accuracy, precision, and root mean squared error. Moreover, we study the asymptotic behaviors of their augmented estimators (that mimic doubly robust estimators), which lead to improved estimations when either the propensity or the regression models are correctly specified. Based on the analytical and simulation results, we conclude that overall overlap weights are preferable to matching weights, especially when there is moderate or extreme violations of the positivity assumption. Finally, we illustrate the methods using a real data example marked by extreme inverse probability weights.


title: Fully-Compensated Ferrimagnetic Spin Filter Materials within the Cr$\textit{M}\textit{N}$Al Equiatomic Quaternary Heusler Alloys

abstract: XX'YZ equiatomic quaternary Heusler alloys (EQHA's) containing Cr, Al, and select Group IVB elements ($\textit{M}$ = Ti, Zr, Hf) and Group VB elements ($\textit{N}$ = V, Nb, Ta) were studied using state-of-the-art density functional theory to determine their effectiveness in spintronic applications. Each alloy is classified based on their spin-dependent electronic structure as a half-metal, a spin gapless semiconductor, or a spin filter material. We predict several new fully-compensated ferrimagnetic spin filter materials with small electronic gaps and large exchange splitting allowing for robust spin polarization with small resistance. CrVZrAl, CrVHfAl, CrTiNbAl, and CrTiTaAl are identified as particularly robust spin filter candidates with an exchange splitting of $\sim 0.20$ eV. In particular, CrTiNbAl and CrTiTaAl have exceptionally small band gaps of $\sim 0.10$ eV. Moreover, in these compounds, a spin asymmetric electronic band gap is maintained in 2 of 3 possible atomic arrangements they can take, making the electronic properties less susceptible to random site disorder. In addition, hydrostatic stress is applied to a subset of the studied compounds in order to determine the stability and tunability of the various electronic phases. Specifically, we find the CrAlV$\textit{M}$ subfamily of compounds to be exceptionally sensitive to hydrostatic stress, yielding transitions between all spin-dependent electronic phases.


title: In situ mechanical testing of an Al matrix composite to investigate compressive plasticity and failure on multiple length scales

abstract: SiC particle-reinforced Al matrix composites exhibit high strength, high wear resistance, and excellent high-temperature performance, but can also have low plasticity and fracture toughness, which limits their use in structural applications. This study investigates the plasticity and failure of such a composite on multiple length scales, from strain localization through a complex microstructure to the debonding of individual microparticles from the matrix. Three microscale pillars containing microstructures with different complexities and sizes/volume fraction of SiC particles were used to study the effect of these features on deformation. For the matrix, nanoscale intermetallic precipitates within the Al grains contribute most to the strengthening effect, and the Al grain boundaries are shown to be effective obstacles for preventing strain localization by dominant shear bands and, therefore, catastrophic failure. When shear localization occurs, SiC particles can then debond from the matrix if the shear band and interface are aligned. To investigate whether the interface is a weak point during catastrophic failure, a number of SiC particles were separated from the matrix with direct debonding tests, which yield an interface strength that is much higher than the critical resolved shear stress for a pillar exhibiting both shear localization and interface debonding. Therefore, the matrix-particle interface is ruled out as a possible weak point, and instead shear localization is identified as the mechanism that can drive subsequent interface debonding.


title: Parameter Efficient Deep Neural Networks with Bilinear Projections

abstract: Recent research on deep neural networks (DNNs) has primarily focused on improving the model accuracy. Given a proper deep learning framework, it is generally possible to increase the depth or layer width to achieve a higher level of accuracy. However, the huge number of model parameters imposes more computational and memory usage overhead and leads to the parameter redundancy. In this paper, we address the parameter redundancy problem in DNNs by replacing conventional full projections with bilinear projections. For a fully-connected layer with $D$ input nodes and $D$ output nodes, applying bilinear projection can reduce the model space complexity from $\mathcal{O}(D^2)$ to $\mathcal{O}(2D)$, achieving a deep model with a sub-linear layer size. However, structured projection has a lower freedom of degree compared to the full projection, causing the under-fitting problem. So we simply scale up the mapping size by increasing the number of output channels, which can keep and even boosts the model accuracy. This makes it very parameter-efficient and handy to deploy such deep models on mobile systems with memory limitations. Experiments on four benchmark datasets show that applying the proposed bilinear projection to deep neural networks can achieve even higher accuracies than conventional full DNNs, while significantly reduces the model size.


title: Data-Driven Control of the COVID-19 Outbreak via Non-Pharmaceutical Interventions: A Geometric Programming Approach

abstract: In this paper we propose a data-driven model for the spread of SARS-CoV-2 and use it to design optimal control strategies of human-mobility restrictions that both curb the epidemic and minimize the economic costs associated with implementing non-pharmaceutical interventions. We develop an extension of the SEIR epidemic model that captures the effects of changes in human mobility on the spread of the disease. The parameters of our data-driven model are learned using a multitask learning approach that leverages both data on the number of deaths across a set of regions, and cellphone data on individuals' mobility patterns specific to each region. We propose an optimal control problem on this data-driven model with a tractable solution provided by geometric programming. The result of this framework is a mobility-based intervention strategy that curbs the spread of the epidemic while obeying a budget on the economic cost incurred. Furthermore, in the absence of a straightforward mapping from human mobility data to economic costs, we propose a practical method by which a budget on economic losses incurred may be chosen to eliminate excess deaths due to over-utilization of hospital resources. Our results are demonstrated with numerical simulations using real data from the Philadelphia metropolitan area.


title: GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning over Large-scale Graphs

abstract: Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging nodes features with the aggregated neighboring nodes information. Most existing GNN models exploit a single type of aggregator (e.g., mean-pooling) to aggregate neighboring nodes information, and then add or concatenate the output of aggregator to the current representation vector of the center node. However, using only a single type of aggregator is difficult to capture the different aspects of neighboring information and the simple addition or concatenation update methods limit the expressive capability of GNNs. Not only that, existing supervised or semi-supervised GNN models are trained based on the loss function of the node label, which leads to the neglect of graph structure information. In this paper, we propose a novel graph neural network architecture, Graph Attention \& Interaction Network (GAIN), for inductive learning on graphs. Unlike the previous GNN models that only utilize a single type of aggregation method, we use multiple types of aggregators to gather neighboring information in different aspects and integrate the outputs of these aggregators through the aggregator-level attention mechanism. Furthermore, we design a graph regularized loss to better capture the topological relationship of the nodes in the graph. Additionally, we first present the concept of graph feature interaction and propose a vector-wise explicit feature interaction mechanism to update the node embeddings. We conduct comprehensive experiments on two node-classification benchmarks and a real-world financial news dataset. The experiments demonstrate our GAIN model outperforms current state-of-the-art performances on all the tasks.


title: The Formation of Bilobate Comet Shapes through Sublimative Torques

abstract: Recent spacecraft and radar observations have found that ~70 percent of short-period comet nuclei, mostly Jupiter-family comets (JFCs), have bilobate shapes (two masses connected by a narrow neck). This is in stark contrast to the shapes of asteroids of similar sizes, of which ~14% are bilobate. This suggests that a process or mechanism unique to comets is producing these shapes. Here we show that the bilobate shapes of JFC nuclei are a natural byproduct of sublimative activity during their dynamical migration from their trans-Neptunian reservoir, through the Centaur population, and into the Jupiter family. We model the torques resulting from volatile sublimation during this dynamical migration and find that they tend to spin up these nuclei to disruption. Once disrupted, the rubble pile-like material properties of comet nuclei (tensile strengths of ~1-10 Pa and internal friction angles of ~35$^\circ$) cause them to reform as bilobate objects. We find that JFCs likely experienced rotational disruption events prior to entering the Jupiter family, which could explain the prevalence of bilobate shapes. These results suggest that the bilobate shapes of observed comets developed recently in their history (within the past ~1-10 Myr), rather than during solar system formation or collisions during planet migration and residency in the trans-Neptunian population.


title: Lifts of Borel actions on quotient spaces

abstract: Given a countable Borel equivalence relation E and a countable group G, we study the problem of when a Borel action of G on X/E can be lifted to a Borel action of G on X.


title: A multipoint stress-flux mixed finite element method for the Stokes-Biot model

abstract: In this paper we present and analyze a fully-mixed formulation for the coupled problem arising in the interaction between a free fluid and a flow in a poroelastic medium. The flows are governed by the Stokes and Biot equations, respectively, and the transmission conditions are given by mass conservation, balance of stresses, and the Beavers-Joseph-Saffman law. We apply dual-mixed formulations in both domains, where the symmetry of the Stokes and poroelastic stress tensors is imposed by setting the vorticity and structure rotation tensors as auxiliary unknowns. In turn, since the transmission conditions become essential, they are imposed weakly, which is done by introducing the traces of the fluid velocity, structure velocity, and the poroelastic media pressure on the interface as the associated Lagrange multipliers. The existence and uniqueness of a solution are established for the continuous weak formulation, as well as a semidiscrete continuous-in-time formulation with non-matching grids, together with the corresponding stability bounds. In addition, we develop a new multipoint stress-flux mixed finite element method by involving the vertex quadrature rule, which allows for local elimination of the stresses, rotations, and Darcy fluxes. Well-posedness and error analysis with corresponding rates of convergences for the fully-discrete scheme are complemented by several numerical experiments.


title: Guided Navigation from Multiple Viewpoints using Qualitative Spatial Reasoning

abstract: Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined motion model, has received little attention from research in AI and Robotics. One way to tackle this problem is to use guided navigation, in which other autonomous agents, endowed with perception, can combine their distinct viewpoints to infer the localisation and the appropriate commands to guide a sensory deprived agent through a particular path. Due to the limited knowledge about the physical and perceptual characteristics of the guided agent, this task should be conducted on a level of abstraction allowing the use of a generic motion model, and high-level commands, that can be applied by any type of autonomous agents, including humans. The main task considered in this work is, given a group of autonomous agents perceiving their common environment with their independent, egocentric and local vision sensors, the development and evaluation of algorithms capable of producing a set of high-level commands (involving qualitative directions: e.g. move left, go straight ahead) capable of guiding a sensory deprived robot to a goal location.


title: Dark Matter from $SU(6) \to SU(5) \times U(1)_N$

abstract: Matter and dark matter are unified under the framework of $SU(6)\to SU(5) \times U(1)_N$. A dark-matter candidate is possible, not because it is stable, but because it has a very long lifetime, in analogy to that of the proton in theories of grand unification. A specific example is presented.


title: Controlling directed atomic motion and second-order tunneling of a spin-orbit-coupled atom in optical lattices

abstract: We theoretically explore the tunneling dynamics for the tight-binding (TB) model of a single spin-orbit-coupled atom trapped in an optical lattice subjected to lattice shaking and to time-periodic Zeeman field. By means of analytical and numerical methods, we demonstrate that the spin-orbit (SO) coupling adds some new results to the tunneling dynamics in both multiphoton resonance and far-off-resonance parameter regimes. When the driving frequency is resonant with the static Zeeman field (multi-photon resonances), we obtain an unexpected new dynamical localization (DL) phenomenon where the single SO-coupled atom is restricted to making perfect two-site Rabi oscillation accompanied by spin flipping.By using the unconventional DL phenomenon, we are able to generate a ratchetlike effect which enables directed atomic motion towards different directions and accompanies periodic spin-flipping under the action of SO coupling. For the far-off-resonance case, we show that by suppressing the usual inter-site tunneling alone, it is possible to realize a type of spin-conserving second-order tunneling between next-nearest-neighboring sites, which is not accessible in the conventional lattice system without SO coupling. We also show that simultaneous controls of the usual inter-site tunneling and the SO-coupling-related second-order-tunneling are necessary for quasienergies flatness (collapse) and completely frozen dynamics to exist. These results may be relevant to potential applications such as spin-based quantum information processing and design of novel spintronics devices.


title: All-electron periodic $G_0W_0$ implementation with numerical atomic orbital basis functions: algorithm and benchmarks

abstract: We present an all-electron, periodic {\GnWn} implementation within the numerical atomic orbital (NAO) basis framework. A localized variant of the resolution-of-the-identity (RI) approximation is employed to significantly reduce the computational cost of evaluating and storing the two-electron Coulomb repulsion integrals. We demonstrate that the error arising from localized RI approximation can be reduced to an insignificant level by enhancing the set of auxiliary basis functions, used to expand the products of two single-particle NAOs. An efficient algorithm is introduced to deal with the Coulomb singularity in the Brillouin zone sampling that is suitable for the NAO framework. We perform systematic convergence tests and identify a set of computational parameters, which can serve as the default choice for most practical purposes. Benchmark calculations are carried out for a set of prototypical semiconductors and insulators, and compared to independent reference values obtained from an independent $G_0W_0$ implementation based on linearized augmented plane waves (LAPW) plus high-energy localized orbitals (HLOs) basis set, as well as experimental results. With a moderate (FHI-aims \textit{tier} 2) NAO basis set, our $G_0W_0$ calculations produce band gaps that typically lie in between the standard LAPW and the LAPW+HLO results. Complementing \textit{tier} 2 with highly localized Slater-type orbitals (STOs), we find that the obtained band gaps show an overall convergence towards the LAPW+HLO results. The algorithms and techniques developed in this work pave the way for efficient implementations of correlated methods within the NAO framework.


title: Ferroic orders in two-dimensional transition/rare-earth metal halides

abstract: Since the discovery of graphene, two-dimensional materials with atomic level thickness have rapidly grown to be a prosperous field of physical science with interdisciplinary interests, for their fascinating properties and broad applications. Very recently, the experimental observation of ferromagnetism in Cr$_2$Ge$_2$Te$_6$ bilayer and CrI$_3$ monolayer opened a door to pursuit long-absent intrinsic magnetic orders in two-dimensional materials. Meanwhile, the ferroelectricity was also experimentally found in SnTe monolayer and CuInP$_2$S$_6$ few layers. The emergence of these ferroic orders in the two-dimensional limit not only brings new challenges to our physical knowledge, but also provides more functionalities for potential applications. Among various two-dimensional ferroic ordered materials, transition/rare-earth metal halides and their derivants are very common. In this Research Update, based on transition/rare-earth metal halides, the physics of various ferroic orders in two-dimensional will be illustrated. The potential applications based on their magnetic and polar properties will also be discussed.


title: Lifting generic maps to embeddings. Triangulation and smoothing

abstract: We show that if a non-degenerate PL map $f:N\to M$ lifts to a topological embedding in $M\times\mathbb R^k$ then it lifts to a PL embedding in there. We also show that if a stable smooth map $N^n\to M^m$, $m\ge n$, lifts to a topological embedding in $M\times\mathbb R$, then it lifts to a smooth embedding in there.


title: Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

abstract: State-of-the-art natural language understanding classification models follow two-stages: pre-training a large language model on an auxiliary task, and then fine-tuning the model on a task-specific labeled dataset using cross-entropy loss. However, the cross-entropy loss has several shortcomings that can lead to sub-optimal generalization and instability. Driven by the intuition that good generalization requires capturing the similarity between examples in one class and contrasting them with examples in other classes, we propose a supervised contrastive learning (SCL) objective for the fine-tuning stage. Combined with cross-entropy, our proposed SCL loss obtains significant improvements over a strong RoBERTa-Large baseline on multiple datasets of the GLUE benchmark in few-shot learning settings, without requiring specialized architecture, data augmentations, memory banks, or additional unsupervised data. Our proposed fine-tuning objective leads to models that are more robust to different levels of noise in the fine-tuning training data, and can generalize better to related tasks with limited labeled data.


title: Faraway-Frustum: Dealing with Lidar Sparsity for 3D Object Detection using Fusion

abstract: Learned pointcloud representations do not generalize well with an increase in distance to the sensor. For example, at a range greater than 60 meters, the sparsity of lidar pointclouds reaches to a point where even humans cannot discern object shapes from each other. However, this distance should not be considered very far for fast-moving vehicles: A vehicle can traverse 60 meters under two seconds while moving at 70 mph. For safe and robust driving automation, acute 3D object detection at these ranges is indispensable. Against this backdrop, we introduce faraway-frustum: a novel fusion strategy for detecting faraway objects. The main strategy is to depend solely on the 2D vision for recognizing object class, as object shape does not change drastically with an increase in depth, and use pointcloud data for object localization in the 3D space for faraway objects. For closer objects, we use learned pointcloud representations instead, following state-of-the-art. This strategy alleviates the main shortcoming of object detection with learned pointcloud representations. Experiments on the KITTI dataset demonstrate that our method outperforms state-of-the-art by a considerable margin for faraway object detection in bird's-eye-view and 3D. Our code is open-source and publicly available: https://github.com/dongfang-steven-yang/faraway-frustum.


title: Foveated Model Observers for Visual Search in 3D Medical Images

abstract: Model observers have a long history of success in predicting human observer performance in clinically-relevant detection tasks. New 3D image modalities provide more signal information but vastly increase the search space to be scrutinized. Here, we compared standard linear model observers (ideal observers, non-pre-whitening matched filter with eye filter, and various versions of Channelized Hotelling models) to human performance searching in 3D 1/f$^{2.8}$ filtered noise images and assessed its relationship to the more traditional location known exactly detection tasks and 2D search. We investigated two different signal types that vary in their detectability away from the point of fixation (visual periphery). We show that the influence of 3D search on human performance interacts with the signal's detectability in the visual periphery. Detection performance for signals difficult to detect in the visual periphery deteriorates greatly in 3D search but not in 3D location known exactly and 2D search. Standard model observers do not predict the interaction between 3D search and signal type. A proposed extension of the Channelized Hotelling model (foveated search model) that processes the image with reduced spatial detail away from the point of fixation, explores the image through eye movements, and scrolls across slices can successfully predict the interaction observed in humans and also the types of errors in 3D search. Together, the findings highlight the need for foveated model observers for image quality evaluation with 3D search.


title: BIGPrior: Towards Decoupling Learned Prior Hallucination and Data Fidelity in Image Restoration

abstract: Classic image-restoration algorithms use a variety of priors, either implicitly or explicitly. Their priors are hand-designed and their corresponding weights are heuristically assigned. Hence, deep learning methods often produce superior image restoration quality. Deep networks are, however, capable of inducing strong and hardly predictable hallucinations. Networks implicitly learn to be jointly faithful to the observed data while learning an image prior; and the separation of original data and hallucinated data downstream is then not possible. This limits their wide-spread adoption in image restoration. Furthermore, it is often the hallucinated part that is victim to degradation-model overfitting. We present an approach with decoupled network-prior based hallucination and data fidelity terms. We refer to our framework as the Bayesian Integration of a Generative Prior (BIGPrior). Our method is rooted in a Bayesian framework and tightly connected to classic restoration methods. In fact, it can be viewed as a generalization of a large family of classic restoration algorithms. We use network inversion to extract image prior information from a generative network. We show that, on image colorization, inpainting and denoising, our framework consistently improves the inversion results. Our method, though partly reliant on the quality of the generative network inversion, is competitive with state-of-the-art supervised and task-specific restoration methods. It also provides an additional metric that sets forth the degree of prior reliance per pixel relative to data fidelity.


title: Exempla Gratis (E.G.): Code Examples for Free

abstract: Modern software engineering often involves using many existing APIs, both open source and, in industrial coding environments, proprietary. Programmers reference documentation and code search tools to remind themselves of proper common usage patterns of APIs. However, high-quality API usage examples are computationally expensive to curate and maintain, and API usage examples retrieved from company-wide code search can be tedious to review. We present a tool, EG, that mines codebases and shows the common, idiomatic usage examples for API methods. EG was integrated into Facebook's internal code search tool for the Hack language and evaluated on open-source GitHub projects written in Python. EG was also compared against code search results and hand-written examples from a popular programming website called ProgramCreek. Compared with these two baselines, examples generated by EG are more succinct and representative with less extraneous statements. In addition, a survey with Facebook developers shows that EG examples are preferred in 97 percent of cases.


title: Hybrid Visual Servoing Tracking Control of Uncalibrated Robotic Systems for Dynamic Dwarf Culture Orchards Harvest

abstract: The paper is concerned with the dynamic tracking problem of SNAP orchards harvesting robots in the presence of multiple uncalibrated model parameters in the application of dwarf culture orchards harvest. A new hybrid visual servoing adaptive tracking controller and three adaptive laws are proposed to guarantee harvesting robots to finish the dynamic harvesting task and the adaption to unknown parameters including camera intrinsic and extrinsic model and robot dynamics. By the Lyapunov theory, asymptotic convergence of the closed-loop system with the proposed control scheme is rigorously proven. Experimental and simulation results have been conducted to verify the performance of the proposed control scheme. The results demonstrate its effectiveness and superiority.


title: Topological isotopy and Cochran's derived invariants

abstract: We construct a link in the $3$-space that is not isotopic to any PL link (non-ambiently). In fact, there exist uncountably many $I$-equivalence classes of links. The paper also includes some observations on Cochran's invariants $\beta_i$.


title: Multi-level Forwarding and Scheduling Recovery Algorithm in Rapidly-changing Network for Erasure-coded Clusters

abstract: A key design goal of erasure-coded clusters is to reduce the repair time. The existing Erasure-coded data repair schemes are roughly classified into two categories: 1. Designing rapid data repair (e.g., PPR) in a homogeneous environment. 2. Constructing data repair (e.g., PPT) based on bandwidth in a heterogeneous environment. However, these solutions are difficult to cope with the heterogeneous and Rapidly-changing network in erasure-coded clusters. To address this problem, a bandwidth-aware multi-level forwarding repair algorithm, called BMFRepair, is proposed. BMFRepair monitors the network bandwidth in real time when data is forwarded, and selects idle nodes with high-bandwidth links to assist in forwarding. Thus, it can reduce the time bottleneck caused by low link transmission. At the same time, multi-node repair becomes very complicated when the bandwidth changes drastically. A multi-node scheduling repairing algorithm, called MSRepair, is proposed for multi-node repairing problems, which can repair multiple failed blocks in parallel by scheduling node resources. The two algorithms can flexibly adapt to the rapidly changing network environment and make full use of the bandwidth resources of idle nodes. Most importantly, algorithms can continuously adjust the repair plan according to the bandwidth change in fast and dynamic network. The algorithms have been evaluated by both simulations on Mininet and real experiments on Aliyun cloud platform ECS. Results show that compared with the state-of-the-art repair schemes PPR and PPT, the algorithms can significantly reduce the repair time in rapidly-changing network.


title: Simon's OPUC Hausdorff Dimension Conjecture

abstract: We show that the Szeg\H{o} matrices, associated with Verblunsky coefficients $\{\alpha_n\}_{n\in\mathbb{Z}_+}$ obeying $\sum_{n = 0}^\infty n^\gamma |\alpha_n|^2 < \infty$ for some $\gamma \in (0,1)$, are bounded for values $z \in \partial \mathbb{D}$ outside a set of Hausdorff dimension no more than $1 - \gamma$. In particular, the singular part of the associated probability measure on the unit circle is supported by a set of Hausdorff dimension no more than $1-\gamma$. This proves the OPUC Hausdorff dimension conjecture of Barry Simon from 2005.


title: Sampling and Recovery of Graph Signals based on Graph Neural Networks

abstract: We propose interpretable graph neural networks for sampling and recovery of graph signals, respectively. To take informative measurements, we propose a new graph neural sampling module, which aims to select those vertices that maximally express their corresponding neighborhoods. Such expressiveness can be quantified by the mutual information between vertices' features and neighborhoods' features, which are estimated via a graph neural network. To reconstruct an original graph signal from the sampled measurements, we propose a graph neural recovery module based on the algorithm-unrolling technique. Compared to previous analytical sampling and recovery, the proposed methods are able to flexibly learn a variety of graph signal models from data by leveraging the learning ability of neural networks; compared to previous neural-network-based sampling and recovery, the proposed methods are designed through exploiting specific graph properties and provide interpretability. We further design a new multiscale graph neural network, which is a trainable multiscale graph filter bank and can handle various graph-related learning tasks. The multiscale network leverages the proposed graph neural sampling and recovery modules to achieve multiscale representations of a graph. In the experiments, we illustrate the effects of the proposed graph neural sampling and recovery modules and find that the modules can flexibly adapt to various graph structures and graph signals. In the task of active-sampling-based semi-supervised learning, the graph neural sampling module improves the classification accuracy over 10% in Cora dataset. We further validate the proposed multiscale graph neural network on several standard datasets for both vertex and graph classification. The results show that our method consistently improves the classification accuracies.


title: Out-of-Distribution Detection for Automotive Perception

abstract: Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD samples is important for safety-critical applications, such as automotive perception, to trigger a safe fallback mode. NNs often rely on softmax normalization for confidence estimation, which can lead to high confidences being assigned to OOD samples, thus hindering the detection of failures. This paper presents a method for determining whether inputs are OOD, which does not require OOD data during training and does not increase the computational cost of inference. The latter property is especially important in automotive applications with limited computational resources and real-time constraints. Our proposed approach outperforms state-of-the-art methods on real-world automotive datasets.


title: Content-based Analysis of the Cultural Differences between TikTok and Douyin

abstract: Short-form video social media shifts away from the traditional media paradigm by telling the audience a dynamic story to attract their attention. In particular, different combinations of everyday objects can be employed to represent a unique scene that is both interesting and understandable. Offered by the same company, TikTok and Douyin are popular examples of such new media that has become popular in recent years, while being tailored for different markets (e.g. the United States and China). The hypothesis that they express cultural differences together with media fashion and social idiosyncrasy is the primary target of our research. To that end, we first employ the Faster Regional Convolutional Neural Network (Faster R-CNN) pre-trained with the Microsoft Common Objects in COntext (MS-COCO) dataset to perform object detection. Based on a suite of objects detected from videos, we perform statistical analysis including label statistics, label similarity, and label-person distribution. We further use the Two-Stream Inflated 3D ConvNet (I3D) pre-trained with the Kinetics dataset to categorize and analyze human actions. By comparing the distributional results of TikTok and Douyin, we uncover a wealth of similarity and contrast between the two closely related video social media platforms along the content dimensions of object quantity, object categories, and human action categories.


title: Ideal-Gas Approach to Hydrodynamics

abstract: Transport is one of the most important physical processes in all energy and length scales. Ideal gases and hydrodynamics are, respectively, two opposite limits of transport. Here, we present an unexpected mathematical connection between these two limits; that is, there exist situations that the solution to a class of interacting hydrodynamic equations with certain initial conditions can be exactly constructed from the dynamics of noninteracting ideal gases. We analytically provide three such examples. The first two examples focus on scale-invariant systems, which generalize fermionization to the hydrodynamics of strongly interacting systems, and determine specific initial conditions for perfect density oscillations in a harmonic trap. The third example recovers the dark soliton solution in a one-dimensional Bose condensate. The results can explain a recent puzzling experimental observation in ultracold atomic gases by the Paris group and make further predictions for future experiments. We envision that extensive examples of such an ideal-gas approach to hydrodynamics can be found by systematical numerical search, which can find broad applications in different problems in various subfields of physics.


title: Dynamics of Small Bodies in Orbits Between Jupiter and Saturn

abstract: We examine the dynamics of small bodies in orbits similar to that of comet 29P/Schwassmann-Wachmann 1, i.e. near-circular orbits between Jupiter and Saturn. As of late 2019, there are 14 other known bodies in this region that lie in similar orbits. Previous research has shown that this region of the solar system, which in this work we call the "near Centaur region" (NCR), is not stable, suggesting that any bodies found in it would have very short lifetimes. We performed 20 Myr high-precision numerical simulations of the evolution of massless particles, initially located in the Kuiper belt but close to Neptune, with perihelia slightly below 33 au ("Neptune crossers"). Some of these particles quickly migrate inward, passing through the NCR before becoming Jupiter Family Comets. We find that objects in the NCR do indeed generally travel through it very quickly. However, our simulations reveal that resonant behavior in this region is somewhat common and can trap objects for up to 100 Kyr. We summarize the dynamics of 29P and other observed bodies in the region---two of which seem to be clearly exhibiting resonant behavior---and use our simulations to put limits on the reservoir size of the Neptune crossers, which at its time determines the reservoir size of the Kuiper belt. Finally, we put some constraints on the current population of Centaurs and particularly of the NCR population, based on the injection rates required to keep the observed population of Jupiter family comets in steady-state.


title: Non-Equilibrium Skewness, Market Crises, and Option Pricing: Non-Linear Langevin Model of Markets with Supersymmetry

abstract: This paper presents a tractable model of non-linear dynamics of market returns using a Langevin approach. Due to non-linearity of an interaction potential, the model admits regimes of both small and large return fluctuations. Langevin dynamics are mapped onto an equivalent quantum mechanical (QM) system. Borrowing ideas from supersymmetric quantum mechanics (SUSY QM), a parameterized ground state wave function (WF) of this QM system is used as a direct input to the model, which also fixes a non-linear Langevin potential. Using a two-component Gaussian mixture as a ground state WF with an asymmetric double well potential produces a tractable low-parametric model with interpretable parameters, referred to as the NES (Non-Equilibrium Skew) model. Supersymmetry (SUSY) is then used to find time-dependent solutions of the model in an analytically tractable way. Additional approximations give rise to a final practical version of the NES model, where real-measure and risk-neutral return distributions are given by three component Gaussian mixtures. This produces a closed-form approximation for option pricing in the NES model by a mixture of three Black-Scholes prices, providing accurate calibration to option prices for either benign or distressed market environments, while using only a single volatility parameter. These results stand in stark contrast to the most of other option pricing models such as local, stochastic, or rough volatility models that need more complex specifications of noise to fit the market data.


title: Meta-learning Transferable Representations with a Single Target Domain

abstract: Recent works found that fine-tuning and joint training---two popular approaches for transfer learning---do not always improve accuracy on downstream tasks. First, we aim to understand more about when and why fine-tuning and joint training can be suboptimal or even harmful for transfer learning. We design semi-synthetic datasets where the source task can be solved by either source-specific features or transferable features. We observe that (1) pre-training may not have incentive to learn transferable features and (2) joint training may simultaneously learn source-specific features and overfit to the target. Second, to improve over fine-tuning and joint training, we propose Meta Representation Learning (MeRLin) to learn transferable features. MeRLin meta-learns representations by ensuring that a head fit on top of the representations with target training data also performs well on target validation data. We also prove that MeRLin recovers the target ground-truth model with a quadratic neural net parameterization and a source distribution that contains both transferable and source-specific features. On the same distribution, pre-training and joint training provably fail to learn transferable features. MeRLin empirically outperforms previous state-of-the-art transfer learning algorithms on various real-world vision and NLP transfer learning benchmarks.


title: Heartbeat Diagnosis of Performance Anomaly in OpenMP Multi-Threaded Systems

abstract: This paper presents a novel heartbeat diagnosis regarding performance anomaly for OpenMP multi-threaded applications. First, we design injected heartbeat APIs for OpenMP multi-threaded applications. Then, we leverage the heartbeat sequences to extract features of previously-observed anomalies. Finally, we adopt a tree-based algorithm, namely HSA, to identify the features that are required to diagnose anomalies. To evaluate our framework, the NAS Parallel NPB benchmark, EPCC OpenMP micro-benchmark suite, and Jacobi benchmark are used to test the performance of our approach proposed.


title: Learning-based Load Balancing Handover in Mobile Millimeter Wave Networks

abstract: Millimeter-wave (mmWave) communication is a promising solution to the high data rate demands in the upcoming 5G and beyond communication networks. When it comes to supporting seamless connectivity in mobile scenarios, resource and handover management are two of the main challenges in mmWave networks. In this paper, we address these two problems jointly and propose a learning-based load balancing handover in multi-user mobile mmWave networks. Our handover algorithm selects a backup base station and allocates the resource to maximize the sum rate of all the users while ensuring a target rate threshold and preventing excessive handovers. We model the user association as a non-convex optimization problem. Then, by applying a deep deterministic policy gradient (DDPG) method, we approximate the solution of the optimization problem. Through simulations, we show that our proposed algorithm minimizes the number of the events where a user's rate is less than its minimum rate requirement and minimizes the number of handovers while increasing the sum rate of all users.


title: WSL-DS: Weakly Supervised Learning with Distant Supervision for Query Focused Multi-Document Abstractive Summarization

abstract: In the Query Focused Multi-Document Summarization (QF-MDS) task, a set of documents and a query are given where the goal is to generate a summary from these documents based on the given query. However, one major challenge for this task is the lack of availability of labeled training datasets. To overcome this issue, in this paper, we propose a novel weakly supervised learning approach via utilizing distant supervision. In particular, we use datasets similar to the target dataset as the training data where we leverage pre-trained sentence similarity models to generate the weak reference summary of each individual document in a document set from the multi-document gold reference summaries. Then, we iteratively train our summarization model on each single-document to alleviate the computational complexity issue that occurs while training neural summarization models in multiple documents (i.e., long sequences) at once. Experimental results in Document Understanding Conferences (DUC) datasets show that our proposed approach sets a new state-of-the-art result in terms of various evaluation metrics.


title: GAGE: Geometry Preserving Attributed Graph Embeddings

abstract: Node embedding is the task of extracting concise and informative representations of certain entities that are connected in a network. Various real-world networks include information about both node connectivity and certain node attributes, in the form of features or time-series data. Modern representation learning techniques employ both the connectivity and attribute information of the nodes to produce embeddings in an unsupervised manner. In this context, deriving embeddings that preserve the geometry of the network and the attribute vectors would be highly desirable, as they would reflect both the topological neighborhood structure and proximity in feature space. While this is fairly straightforward to maintain when only observing the connectivity or attribute information of the network, preserving the geometry of both types of information is challenging. A novel tensor factorization approach for node embedding in attributed networks is proposed in this paper, that preserves the distances of both the connections and the attributes. Furthermore, an effective and lightweight algorithm is developed to tackle the learning task and judicious experiments with multiple state-of-the-art baselines suggest that the proposed algorithm offers significant performance improvements in downstream tasks.


title: Day Ahead Price Forecasting Models in Thin Electricity Market

abstract: Day Ahead Electricity Markets (DAMs) in India are thin but growing. Consistent price forecasts are important for their utilization in portfolio optimization models. Univariate or multivariate models with standard exogenous variables such as special day effects etc. are not always useful. Drivers of demand and supply include weather variations over large geographic areas, outages of power system elements and sudden changes in contracts which lead the players to access power exchanges. These needs to be considered in forecasting models. Such models are observed to considerably reduce forecasting errors by outperforming other models under conditions, which are neither infrequent nor recur at defined intervals. This paper develops models for India and tests the utility of these models using Model Confidence Set (MCS) approach which picks up the best models. The approach has been developed for a power utility in India over a period of two years in live business environment.


title: Distilling Knowledge by Mimicking Features

abstract: Knowledge distillation (KD) is a popular method to train efficient networks ("student") with the help of high-capacity networks ("teacher"). Traditional methods use the teacher's soft logits as extra supervision to train the student network. In this paper, we argue that it is more advantageous to make the student mimic the teacher's features in the penultimate layer. Not only the student can directly learn more effective information from the teacher feature, feature mimicking can also be applied for teachers trained without a softmax layer. Experiments show that it can achieve higher accuracy than traditional KD. To further facilitate feature mimicking, we decompose a feature vector into the magnitude and the direction. We argue that the teacher should give more freedom to the student feature's magnitude, and let the student pay more attention on mimicking the feature direction. To meet this requirement, we propose a loss term based on locality-sensitive hashing (LSH). With the help of this new loss, our method indeed mimics feature directions more accurately, relaxes constraints on feature magnitudes, and achieves state-of-the-art distillation accuracy. We provide theoretical analyses of how LSH facilitates feature direction mimicking, and further extend feature mimicking to multi-label recognition and object detection.


title: The blow-up analysis of an affine Toda system corresponding to superconformal minimal surfaces in ${\mathbb S}^4$

abstract: In this paper, we study the blow-up analysis of an affine Toda system corresponding to minimal surfaces into ${\mathbb S}^4$ [19]. This system is an integrable system which is a natural generalization of sinh-Gordon equation [18]. By exploring a refined blow-up analysis in the bubble domain, we prove that the blow-up values are multiple of $8\pi$, which generalizes the previous results proved in \cite{Spruck, OS, Jost-Wang-Ye-Zhou, Jevnikar-Wei-Yang} for the sinh-Gordon equation. Let $(u_k^1,u_k^2, u^3_k)$ be a sequence of solutions of \begin{align*} -\Delta u^1&=e^{u^1}-e^{u^3},\\ -\Delta u^2&=e^{u^2}-e^{u^3},\\ -\Delta u^3&=-\frac{1}{2}e^{u^1}-\frac{1}{2}e^{u^2}+ e^{u^3},\\ u^1+u^2+2u^3&=0, \end{align*} in $B_1(0)$, which has a uniformly bounded energy in $B_1(0)$, a uniformly bounded oscillation on $\partial B_1(0)$ and blows up at an isolated blow-up point $\{0\}$, then the local masses $(\sigma_1,\sigma_2, \sigma_3) \not = 0$ satisfy \begin{align*} \begin{array}{rcl} \sigma_1&=&m_1(m_1+3)+m_2(m_2-1)\\ \sigma_2&=& m_1(m_1-1)+m_2(m_2+3)\\ \sigma_3 &=& m_1(m_1-1)+m_2(m_2-1) \end{array} \, \qquad \hbox { for some } \begin{array} {l} (m_1, m_2)\in {\mathbb Z} \hbox { with }\\ m_1, m_2= 0 \hbox{ or } 1 \hbox{ mod } 4,\\ m_1, m_2 = 2 \hbox { or } 3\hbox { mod } 4. \end{array} \end{align*} Here the local mass is defined by $ \sigma_i:=\frac 1{2\pi}\lim_{\delta\to 0}\lim_{k\to\infty}\int_{B_\delta(0)}e^{u_k^i}dx.$


title: Nesting and Degeneracy of Mie Resonances of Dielectric Cavities within Zero-Index Materials

abstract: Resonances in optical cavities have been used to manipulate light propagation, enhance light-matter interaction, modulate quantum states, and so on. However, in traditional cavities, the permittivity contrast in and out the cavity is not so high. Recently, zero-index materials (ZIMs) with unique properties and specific applications have attracted great interest. By putting optical cavity into ZIMs, the extreme circumstance with infinite permittivity contrast can be obtained. Here, we theoretically study Mie resonances of dielectric cavities embedded in ZIMs with $\varepsilon \approx 0$, or $\mu \approx 0$, or $(\varepsilon,\mu) \approx 0$. Owing to ultrahigh contrast ratio of $\varepsilon$ or $\mu$ in and out the cavities, with fixed wavelength, a series of Mie resonances with the same angular mode number $l$ but with different cavity radii are obtained; more interestingly, its $2^l$-TM (TE) and $2^{l+1}$-TE (TM) modes have the same resonant solution for the cavity in $\varepsilon \approx 0$ ($\mu \approx 0$) material, and the resonance degeneracy also occurs between $2^l$-TM mode and $2^l$-TE mode for $(\varepsilon,\mu) \approx 0$ material. We further use resonance degeneracy to modulate the Purcell effect of quantum emitter inside the cavity. The results of resonance nesting and degeneracy will provide an additional view or freedom to enhance the performance of cavity behaviors.


title: Positivity of the second exterior power of the tangent bundles

abstract: Let $X$ be a smooth complex projective variety with nef $\bigwedge^2 T_X$ and $\dim X \geq 3$. We prove that, up to a finite \'etale cover $\tilde{X} \to X$, the Albanese map $\tilde{X} \to {\rm Alb}(\tilde{X})$ is a locally trivial fibration whose fibers are isomorphic to a smooth Fano variety $F$ with nef $\bigwedge^2 T_F$. As a bi-product, we see that either $T_X$ is nef or $X$ is a Fano variety. Moreover we study a contraction of a $K_X$-negative extremal ray $\varphi: X \to Y$. In particular, we prove that $X$ is isomorphic to the blow-up of a projective space at a point if $\varphi$ is of birational type. We also prove that $\varphi$ is a smooth morphism if $\varphi$ is of fiber type. As a consequence, we give a structure theorem of varieties with nef $\bigwedge^2 T_X$.


title: Leaf-like Origami with Bistability for Self-Adaptive Grasping Motions

abstract: The leaf-like origami structure was inspired by geometric patterns found in nature, exhibiting unique transitions between open and closed shapes. With a bistable energy landscape, leaf-like origami is able to replicate the autonomous grasping of objects observed in biological systems like the Venus flytrap. We show uniform grasping motions of the leaf-like origami, as well as various non-uniform grasping motions which arise from its multi-transformable nature. Grasping motions can be triggered with high tunability due to the structure's bistable energy landscape. We demonstrate the self-adaptive grasping motion by dropping a target object onto our paper prototype, which does not require an external power source to retain the capture of the object. We also explore the non-uniform grasping motions of the leaf-like structure by selectively controlling the creases, which reveals various unique grasping configurations that can be exploited for versatile, autonomous, and self-adaptive robotic operations.


title: Self-semi-supervised Learning to Learn from NoisyLabeled Data

abstract: The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training models robust to noisy labels. To achieve this goal, on the one hand, many papers have been dedicated to differentiating noisy labels from clean ones to increase the generalization of DNN. On the other hand, the increasingly prevalent methods of self-semi-supervised learning have been proven to benefit the tasks when labels are incomplete. By 'semi' we regard the wrongly labeled data detected as un-labeled data; by 'self' we choose a self-supervised technique to conduct semi-supervised learning. In this project, we designed methods to more accurately differentiate clean and noisy labels and borrowed the wisdom of self-semi-supervised learning to train noisy labeled data.


title: Multi-system Bayesian constraints on the transport coefficients of QCD matter

abstract: We study the properties of the strongly-coupled quark-gluon plasma with a multistage model of heavy ion collisions that combines the T$_\mathrm{R}$ENTo initial condition ansatz, free-streaming, viscous relativistic hydrodynamics, and a relativistic hadronic transport. A model-to-data comparison with Bayesian inference is performed, revisiting assumptions made in previous studies. The role of parameter priors is studied in light of their importance towards the interpretation of results. We emphasize the use of closure tests to perform extensive validation of the analysis workflow before comparison with observations. Our study combines measurements from the Large Hadron Collider and the Relativistic Heavy Ion Collider, achieving a good simultaneous description of a wide range of hadronic observables from both colliders. The selected experimental data provide reasonable constraints on the shear and the bulk viscosities of the quark-gluon plasma at $T\sim$ 150-250 MeV, but their constraining power degrades at higher temperatures $T \gtrsim 250$ MeV. Furthermore, these viscosity constraints are found to depend significantly on how viscous corrections are handled in the transition from hydrodynamics to the hadronic transport. Several other model parameters, including the free-streaming time, show similar model sensitivity while the initial condition parameters associated with the T$_\mathrm{R}$ENTo ansatz are quite robust against variations of the particlization prescription. We also report on the sensitivity of individual observables to the various model parameters. Finally, Bayesian model selection is used to quantitatively compare the agreement with measurements for different sets of model assumptions, including different particlization models and different choices for which parameters are allowed to vary between RHIC and LHC energies.


title: Selected topics of quantum computing for nuclear physics

abstract: Nuclear physics, whose underling theory is described by quantum gauge field coupled with matter, is fundamentally important and yet is formidably challenge for simulation with classical computers. Quantum computing provides a perhaps transformative approach for studying and understanding nuclear physics. With rapid scaling-up of quantum processors as well as advances on quantum algorithms, the digital quantum simulation approach for simulating quantum gauge fields and nuclear physics has gained lots of attentions. In this review, we aim to summarize recent efforts on solving nuclear physics with quantum computers. We first discuss a formulation of nuclear physics in the language of quantum computing. In particular, we review how quantum gauge fields~(both Abelian and non-Abelian) and its coupling to matter field can be mapped and studied on a quantum computer. We then introduce related quantum algorithms for solving static properties and real-time evolution for quantum systems, and show their applications for a broad range of problems in nuclear physics, including simulation of lattice gauge field, solving nucleon and nuclear structure, quantum advantage for simulating scattering in quantum field theory, non-equilibrium dynamics, and so on. Finally, a short outlook on future work is given.


title: CDF of non-central $\chi^2$ distribution revisited. Incomplete hypergeometric type functions approach

abstract: The cumulative distribution function of the non-central chi-square distribution $\chi_\nu'^2(\lambda),\, \nu\in\mathbb{R}^+$ possesses an integral representation in terms of a generalized Marcum $Q$-function. Regarding some already known results, here we derive a simpler form of the cumulative distribution function for $\nu = 2n \in\mathbb{N}$ degrees of freedom. Also, we express these representations in terms of an incomplete Fox-Wright function ${}_p\Psi_q^{(\gamma)}$ and the generalized incomplete hypergeometric functions concerning the important special cases as ${}_1\Gamma_1,\, {}_2\Gamma_1$ and ${}_2\gamma_1$. New identities are established between ${}_1\Gamma_1$ and ${}_2\Gamma_1$ as well.