title: I Will Survive: An Online Conformance Checking Algorithm Using Decay Time

abstract: Process executions in organizations generate a large variety of data. Process mining is a data-driven analytical approach for analyzing this data from a business process point of view. Online conformance checking deals with finding discrepancies between real-life and modeled process behavior on data streams. The current state-of-the-art output of online conformance checking is a prefix-alignment, which is used for pinpointing the exact deviations in terms of the trace and the model while accommodating a trace's unknown termination in a streaming setting. However, producing prefix-alignments entails a state space search to find the shortest path from a common start state to a common end state between the trace and the model. This is computationally expensive and makes the method infeasible in an online setting. Previously, the trie data structure has been shown to be efficient for constructing alignments, utilizing a proxy log representing the process model in a finite way. This paper introduces a new approximate algorithm (IWS) on top of the trie for online conformance checking. The algorithm is shown to be fast, memory-efficient, and able to output both a prefix and a complete alignment event-by-event while keeping track of previously seen cases and their state. Comparative analysis against the current state-of-the-art algorithm for finding prefix-alignments shows that the IWS algorithm achieves, in some cases, an order of magnitude faster execution time while having a smaller error cost. In extreme cases, the IWS finds prefix-alignments roughly three orders of magnitude faster than the current state of the art. The IWS algorithm includes a discounted decay time setting for efficient memory usage and a look-ahead limit for improving computation time. Finally, the algorithm is stress tested for performance using a simulation of high-traffic event streams.


title: An Efficient Split Fine-tuning Framework for Edge and Cloud Collaborative Learning

abstract: To enable the pre-trained models to be fine-tuned with local data on edge devices without sharing data with the cloud, we design an efficient split fine-tuning (SFT) framework for edge and cloud collaborative learning. We propose three novel techniques in this framework. First, we propose a matrix decomposition-based method to compress the intermediate output of a neural network to reduce the communication volume between the edge device and the cloud server. Second, we eliminate particular links in the model without affecting the convergence performance in fine-tuning. Third, we implement our system atop PyTorch to allow users to easily extend their existing training scripts to enjoy the efficient edge and cloud collaborative learning. Experiments results on 9 NLP datasets show that our framework can reduce the communication traffic by 96 times with little impact on the model accuracy.


title: Fundamental limit of linear bosonic sensors and the Schawlow-Townes laser linewidth limit

abstract: In recent years, many peculiar sensors have been proposed, such as the sensors based on exceptional points, Parity-Time symmetric structures or non-reciprocal systems. It is crucial to evaluate the fundamental limit of these sensing schemes and to judge whether there is an enhanced performance. Several papers have already investigated the fundamental limits based on different aspects and criteria, some led to different conclusions. In this paper, we suggest that for linear bosonic sensors that can be modeled as coupled oscillators below threshold, a measurement of the mode frequency $w_0$ can not has a precision beyond $\frac{\sqrt{\kappa_0}}{2\sqrt{n\tau}}$, in which $\kappa_{0}$ is the intrinsic loss, $n$ is the average particle number at that mode and $\tau$ is the measurement time. Such a precision limit can already be achieved for a single mode passive sensor, and we have proved that it can not be exceeded by adding gain components, or by coupling it to other modes to form a n-mode linear sensor. Further more, we recognize that the above limit is comparative to the frequency uncertainty ($\frac{\sqrt{\kappa_0}}{\sqrt{2 n\tau}}$) for an above-threshold oscillation mode (e.g. a laser cavity above threshold), which is related to the Schawlow-Townes laser linewidth limit. This observation makes us conjecture that the limit we proposed for linear sensors may be a basic general limit which restricts most, if not all, sensors.


title: The radio structure of the $\gamma$-ray narrow-line Seyfert 1 galaxy SDSS J211852.96$-$073227.5

abstract: The $\gamma$-ray narrow-line Seyfert 1 (NLS1) galaxies can be considered to be the third class of $\gamma$-ray active galactic nuclei possessing relativistic jets. In this paper, we present multi-band high resolution Very Long Baseline Array (VLBA) images of the $\gamma$-ray NLS1, SDSS J211852.96$-$073227.5 (J2118$-$0732, $z=0.26$). We find a core-jet radio morphology and significant flux density variations in the radio core. The high brightness temperature estimated from VLBA images and core variability demonstrate that it exhibits substantial relativistic beaming effects. From considering radio emission in several bands, we find that the source has an inverted spectrum above 1 GHz but a steep spectrum at low frequencies from 74 MHz to 1 GHz; these may arise from the present activity and the old diffuse/extended emission, respectively. The core-jet morphology, significant flux density variations, and beaming effect make J2118$-$0732 resemble a blazar. Considering the low mass of its central black hole and ongoing merger environment, J2118$-$0732 may represent a low-mass, low-power counterpart of blazars, and may finally evolve to a blazar.


title: A $3 \times 3$ Lax Form for the $q$-Painlev\'e Equation of Type $E_6$

abstract: For the $q$-Painlev\'e equation with affine Weyl group symmetry of type $E_6^{(1)}$, a $2\times 2$ matrix Lax form and a second order scalar lax form were known. We give a new $3\times 3$ matrix Lax form and a third order scalar equation related to it. Continuous limit is also discussed.


title: Vandermonde Constrained Tensor Decomposition for Hybrid Beamforming in Multi-Carrier MIMO Systems

abstract: Hybrid beamforming has evolved as a promising technology that offers the balance between system performance and design complexity in mmWave MIMO systems. Existing hybrid beamforming methods either impose unit-modulus constraints or a codebook constraint on the analog precoders/combiners, which in turn results in a performance-overhead tradeoff. This paper puts forth a tensor framework to handle the wideband hybrid beamforming problem, with Vandermonde constraints on the analog precoders/combiners. The proposed method strikes the balance between performance, overhead and complexity. Numerical results on a 3GPP link-level test bench reveal the efficacy of the proposed approach relative to the codebook-based method while attaining the same feedback overhead. Moreover, the proposed method is shown to achieve comparable performance to the unit-modulus approaches, with substantial reductions in overhead.


title: Statistical treatment of convolutional neural network super-resolution of inland surface wind for subgrid-scale variability quantification

abstract: Machine learning models have been employed to perform either physics-free data-driven or hybrid dynamical downscaling of climate data. Most of these implementations operate over relatively small downscaling factors because of the challenge of recovering fine-scale information from coarse data. This limits their compatibility with many global climate model outputs, often available between $\sim$50--100 km resolution, to scales of interest such as cloud resolving or urban scales. This study systematically examines the capability of convolutional neural networks (CNNs) to downscale surface wind speed data over land surface from different coarse resolutions (25 km, 48 km, and 100 km resolution) to 3 km. For each downscaling factor, we consider three CNN configurations that generate super-resolved predictions of fine-scale wind speed, which take between 1 to 3 input fields: coarse wind speed, fine-scale topography, and diurnal cycle. In addition to fine-scale wind speeds, probability density function parameters are generated, through which sample wind speeds can be generated accounting for the intrinsic stochasticity of wind speed. For generalizability assessment, CNN models are tested on regions with different topography and climate that are unseen during training. The evaluation of super-resolved predictions focuses on subgrid-scale variability and the recovery of extremes. Models with coarse wind and fine topography as inputs exhibit the best performance compared with other model configurations, operating across the same downscaling factor. Our diurnal cycle encoding results in lower out-of-sample generalizability compared with other input configurations.


title: Entropy fluctuation formulas of fermionic Gaussian states

abstract: We study the statistical behaviour of quantum entanglement in bipartite systems over fermionic Gaussian states as measured by von Neumann entropy. The formulas of average von Neumann entropy with and without particle number constrains have been recently obtained, whereas the main results of this work are the exact yet explicit formulas of variances for both cases. For the latter case of no particle number constrain, the results resolve a recent conjecture on the corresponding variance. Different than existing methods in computing variances over other generic state models, the key ingredient in proving the results of this work relies on a new simplification framework. The framework consists of a set of new tools in simplifying finite summations of what we refer to as dummy summation and re-summation techniques. As a byproduct, the proposed framework leads to various new transformation formulas of hypergeometric functions.


title: Extracting Semantic Knowledge from GANs with Unsupervised Learning

abstract: Recently, unsupervised learning has made impressive progress on various tasks. Despite the dominance of discriminative models, increasing attention is drawn to representations learned by generative models and in particular, Generative Adversarial Networks (GANs). Previous works on the interpretation of GANs reveal that GANs encode semantics in feature maps in a linearly separable form. In this work, we further find that GAN's features can be well clustered with the linear separability assumption. We propose a novel clustering algorithm, named KLiSH, which leverages the linear separability to cluster GAN's features. KLiSH succeeds in extracting fine-grained semantics of GANs trained on datasets of various objects, e.g., car, portrait, animals, and so on. With KLiSH, we can sample images from GANs along with their segmentation masks and synthesize paired image-segmentation datasets. Using the synthesized datasets, we enable two downstream applications. First, we train semantic segmentation networks on these datasets and test them on real images, realizing unsupervised semantic segmentation. Second, we train image-to-image translation networks on the synthesized datasets, enabling semantic-conditional image synthesis without human annotations.


title: Revealing temperature evolution of the Dirac band in ZrTe$_5$ via magneto-infrared spectroscopy

abstract: We report the temperature evolution of the Dirac band in semiconducting zirconium pentatelluride (ZrTe$_5$) using magneto-infrared spectroscopy. We find that the band gap is temperature independent at low temperatures and increases with temperature at elevated temperatures. Although such an observation seems to support a weak topological insulator phase at all temperatures and defy the previously reported topological phase transition (TPT) at an intermediate temperature in ZrTe$_5$, we show that it is also possible to explain the observation by considering the effect of conduction-valence band mixing and band inversion with a strong topological insulator phase at low temperatures. Our work provides an alternative picture of the band gap evolution across TPT.


title: Coordinating Cross-modal Distillation for Molecular Property Prediction

abstract: In recent years, molecular graph representation learning (GRL) has drawn much more attention in molecular property prediction (MPP) problems. The existing graph methods have demonstrated that 3D geometric information is significant for better performance in MPP. However, accurate 3D structures are often costly and time-consuming to obtain, limiting the large-scale application of GRL. It is an intuitive solution to train with 3D to 2D knowledge distillation and predict with only 2D inputs. But some challenging problems remain open for 3D to 2D distillation. One is that the 3D view is quite distinct from the 2D view, and the other is that the gradient magnitudes of atoms in distillation are discrepant and unstable due to the variable molecular size. To address these challenging problems, we exclusively propose a distillation framework that contains global molecular distillation and local atom distillation. We also provide a theoretical insight to justify how to coordinate atom and molecular information, which tackles the drawback of variable molecular size for atom information distillation. Experimental results on two popular molecular datasets demonstrate that our proposed model achieves superior performance over other methods. Specifically, on the largest MPP dataset PCQM4Mv2 served as an "ImageNet Large Scale Visual Recognition Challenge" in the field of graph ML, the proposed method achieved a 6.9% improvement compared with the best works. And we obtained fourth place with the MAE of 0.0734 on the test-challenge set for OGB-LSC 2022 Graph Regression Task. We will release the code soon.


title: Uniformizations of compact Sasakian manifolds

abstract: We give a criterion for compact Sasakian manifolds to be deformed to Sasakian manifolds which are locally isomorphic to circle bundles of anti-canonical bundles over Hermitian symmetric spaces as a Sasakian analogue of Simpson's uniformization results related to variations of Hodge structure and Higgs bundles.


title: Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models

abstract: The assumption of group heterogeneity has become popular in panel data models. We develop a constrained Bayesian grouped estimator that exploits researchers' prior beliefs on groups in a form of pairwise constraints, indicating whether a pair of units is likely to belong to a same group or different groups. We propose a prior to incorporate the pairwise constraints with varying degrees of confidence. The whole framework is built on the nonparametric Bayesian method, which implicitly specifies a distribution over the group partitions, and so the posterior analysis takes the uncertainty of the latent group structure into account. Monte Carlo experiments reveal that adding prior knowledge yields more accurate estimates of coefficient and scores predictive gains over alternative estimators. We apply our method to two empirical applications. In a first application to forecasting U.S. CPI inflation, we illustrate that prior knowledge of groups improves density forecasts when the data is not entirely informative. A second application revisits the relationship between a country's income and its democratic transition; we identify heterogeneous income effects on democracy with five distinct groups over ninety countries.


title: Policy Optimization over General State and Action Spaces

abstract: Reinforcement learning (RL) problems over general state and action spaces are notoriously challenging. In contrast to the tableau setting, one can not enumerate all the states and then iteratively update the policies for each state. This prevents the application of many well-studied RL methods especially those with provable convergence guarantees. In this paper, we first present a substantial generalization of the recently developed policy mirror descent method to deal with general state and action spaces. We introduce new approaches to incorporate function approximation into this method, so that we do not need to use explicit policy parameterization at all. Moreover, we present a novel policy dual averaging method for which possibly simpler function approximation techniques can be applied. We establish linear convergence rate to global optimality or sublinear convergence to stationarity for these methods applied to solve different classes of RL problems under exact policy evaluation. We then define proper notions of the approximation errors for policy evaluation and investigate their impact on the convergence of these methods applied to general-state RL problems with either finite-action or continuous-action spaces. To the best of our knowledge, the development of these algorithmic frameworks as well as their convergence analysis appear to be new in the literature.


title: Automated Generating Natural Language Requirements based on Domain Ontology

abstract: Software requirements specification is undoubtedly critical for the whole software life-cycle. Nowadays, writing software requirements specifications primarily depends on human work. Although massive studies have been proposed to fasten the process via proposing advanced elicitation and analysis techniques, it is still a time-consuming and error-prone task that needs to take domain knowledge and business information into consideration. In this paper, we propose an approach, named ReqGen, which can provide recommendations by automatically generating natural language requirements specifications based on certain given keywords. Specifically, ReqGen consists of three critical steps. First, keywords-oriented knowledge is selected from domain ontology and is injected to the basic Unified pre-trained Language Model (UniLM) for domain fine-tuning. Second, a copy mechanism is integrated to ensure the occurrence of keywords in the generated statements. Finally, a requirement syntax constrained decoding is designed to close the semantic and syntax distance between the candidate and reference specifications. Experiments on two public datasets from different groups and domains show that ReqGen outperforms six popular natural language generation approaches with respect to the hard constraint of keywords(phrases) inclusion, BLEU, ROUGE and syntax compliance. We believe that ReqGen can promote the efficiency and intelligence of specifying software requirements.


title: Findings of the WMT 2022 Shared Task on Translation Suggestion

abstract: We report the result of the first edition of the WMT shared task on Translation Suggestion (TS). The task aims to provide alternatives for specific words or phrases given the entire documents generated by machine translation (MT). It consists two sub-tasks, namely, the naive translation suggestion and translation suggestion with hints. The main difference is that some hints are provided in sub-task two, therefore, it is easier for the model to generate more accurate suggestions. For sub-task one, we provide the corpus for the language pairs English-German and English-Chinese. And only English-Chinese corpus is provided for the sub-task two. We received 92 submissions from 5 participating teams in sub-task one and 6 submissions for the sub-task 2, most of them covering all of the translation directions. We used the automatic metric BLEU for evaluating the performance of each submission.


title: GPU-Accelerated DNS of Compressible Turbulent Flows

abstract: This paper explores strategies to transform an existing CPU-based high-performance computational fluid dynamics solver, HyPar, for compressible flow simulations on emerging exascale heterogeneous (CPU+GPU) computing platforms. The scientific motivation for developing a GPU-enhanced version of HyPar is to simulate canonical turbulent flows at the highest resolution possible on such platforms. We show that optimizing memory operations and thread blocks results in 200x speedup of computationally intensive kernels compared with a CPU core. Using multiple GPUs and CUDA-aware MPI communication, we demonstrate both strong and weak scaling of our GPU-based HyPar implementation on the NVIDIA Volta V100 GPUs. We simulate the decay of homogeneous isotropic turbulence in a triply periodic box on grids with up to $1024^3$ points (5.3 billion degrees of freedom) and on up to 1,024 GPUs. We compare the wall times for CPU-only and CPU+GPU simulations. The results presented in the paper are obtained on the Summit and Lassen supercomputers at Oak Ridge and Lawrence Livermore National Laboratories, respectively.


title: Transport in honeycomb lattice with random $\pi$-fluxes: implications for low-temperature thermal transport in the Kitaev spin liquids

abstract: Motivated by the thermal transport problem in the Kitaev spin liquids, we consider a nearest-neighbor tight-binding model on the honeycomb lattice in the presence of random uncorrelated $\pi$-fluxes. We employ different numerical methods to study its transport properties near half-filling. The zero-temperature DC conductivity away from the Dirac point is found to be quadratic in Fermi momentum and inversely proportional to the flux density. Localization due to the random $\pi$-fluxes is observed and the localization length is extracted. Our results imply that, for realistic system size, the thermal conductivity of a pure Kitaev spin liquid diverges as $\kappa_\text{K}\sim T^3 e^{\Delta_v/k_BT}$ when $k_B T\ll \Delta_v$, and suggest the possible occurrence of strong Majorana localization $\kappa_\text{K}/T\ll k_B^2/2\pi\hbar$ when $k_B T\sim \Delta_v$, where $\Delta_v$ is the vison gap.


title: Quadratic Programming for Continuous Control of Safety-Critical Multi-Agent Systems Under Uncertainty

abstract: This paper studies the control problem for safety-critical multi-agent systems based on quadratic programming (QP). Each controlled agent is modeled as a cascade connection of an integrator and an uncertain nonlinear actuation system. In particular, the integrator represents the position-velocity relation, and the actuation system describes the dynamic response of the actual velocity to the velocity reference signal. The notion of input-to-output stability (IOS) is employed to characterize the essential velocity-tracking capability of the actuation system. The uncertain actuation dynamics may cause infeasibility or discontinuous solutions of QP algorithms for collision avoidance. Also, the interaction between the controlled integrator and the uncertain actuation dynamics may lead to significant robustness issues. By using nonlinear control methods and numerical optimization methods, this paper first contributes a new feasible-set reshaping technique and a refined QP algorithm for feasibility, robustness, and local Lipschitz continuity. Then, we present a nonlinear small-gain analysis to handle the inherent interaction for guaranteed safety of the closed-loop multi-agent system. The proposed methods are illustrated by numerical simulations and a physical experiment.


title: Where Am I Now? Dynamically Finding Optimal Sensor States to Minimize Localization Uncertainty for a Perception-Denied Rover

abstract: We present DyFOS, an active perception method that dynamically finds optimal states to minimize localization uncertainty while avoiding obstacles and occlusions. We consider the scenario where a perception-denied rover relies on position and uncertainty measurements from a viewer robot to localize itself along an obstacle-filled path. The position uncertainty from the viewer's sensor is a function of the states of the sensor itself, the rover, and the surrounding environment. To find an optimal sensor state that minimizes the rover's localization uncertainty, DyFOS uses a localization uncertainty prediction pipeline in an optimization search. Given numerous samples of the states mentioned above, the pipeline predicts the rover's localization uncertainty with the help of a trained, complex state-dependent sensor measurement model (a probabilistic neural network). Our pipeline also predicts occlusion and obstacle collision to remove undesirable viewer states and reduce unnecessary computations. We evaluate the proposed method numerically and in simulation. Our results show that DyFOS is faster than brute force yet performs on par. DyFOS also yielded lower localization uncertainties than faster random and heuristic-based searches.


title: On the critical exponent $p_c$ of the 3D quasilinear wave equation $-\big(1+(\partial_t\phi)^p\big)\partial_t^2\phi+\Delta\phi=0$ with short pulse initial data. II, shock formation

abstract: In the previous paper [Ding Bingbing, Lu Yu, Yin Huicheng, On the critical exponent $p_c$ of the 3D quasilinear wave equation $-\big(1+(\partial_t\phi)^p\big)\partial_t^2\phi+\Delta\phi=0$ with short pulse initial data. I, global existence, Preprint, 2022], for the 3D quasilinear wave equation $-\big(1+(\partial_t\phi)^p\big)\partial_t^2\phi+\Delta\phi=0$ with short pulse initial data $(\phi,\partial_t\phi)(1,x)=\big(\delta^{2-\varepsilon_0}\phi_0(\frac{r-1}{\delta},\omega),\delta^{1-\varepsilon_0}\phi_1(\frac{r-1}{\delta},\omega)\big)$, where $p\in\mathbb{N}$, $0<\varepsilon_0<1$, under the outgoing constraint condition $(\partial_t+\partial_r)^k\phi(1,x)=O(\delta^{2-\varepsilon_0-k\max\{0,1-(1-\varepsilon_0)p\}})$ for $k=1,2$, the authors establish the global existence of smooth large solution $\phi$ when $p>p_c$ with $p_c=\frac{1}{1-\varepsilon_0}$. In the present paper, under the same outgoing constraint condition, when $1\leq p\leq p_c$, we will show that the smooth solution $\phi$ blows up and further the outgoing shock is formed in finite time.


title: Bayesian modeling of the political preferences of the Colombian Senate 2006-2010: electoral behavior and parapolitics

abstract: In this paper, a Bayesian spatial voting model is applied for the first time to characterize the legislative behavior of the Senate of the Republic of Colombia for the period 2006-2010. The analysis is carried out based on the plenary nominal votes of the Senate. The estimation of the model is done using Markov Monte Carlo chain algorithms. The estimated ideal points provide empirical evidence supporting a latent non-ideological feature (opposition--non-opposition) underlying senators' voting. Additionally, the relationship between the parapolitics scandal and the legislative behavior of senators is analyzed through a logistic model, both Bayesian and frequentist. The results indicate a significant relationship between being or having been involved with the parapolitics scandal and the legislative behavior of the senators from the period 2006-2010.


title: Large Amplitude Oscillatory Shear Study of a Colloidal Gel at the Critical State

abstract: We investigate the nonlinear viscoelastic behavior of a colloidal dispersion at the critical gel state using large amplitude oscillatory shear (LAOS) rheology. The colloidal gel at the critical point is subjected to oscillatory shear flow with increasing strain amplitude at different frequencies. We observe that the first harmonic of the elastic and viscous moduli exhibits a monotonic decrease as the material undergoes a linear to nonlinear transition. We analyze the stress waveform across this transition and obtain the nonlinear moduli and viscosity as a function of frequency and strain amplitude. The analysis of the nonlinear moduli and viscosities suggests intracycle strain stiffening and intracycle shear thinning in the colloidal dispersion. Based on the insights obtained from the nonlinear analysis, we propose a potential scenario of the microstructural changes occurring in the nonlinear region. We also develop an integral model using the time-strain separable K-BKZ constitutive equation with a power-law relaxation modulus and damping function obtained from experiments. At low strain amplitudes, this model compares well with experimental data at all frequencies. However, a stronger damping function, which can be efficiently inferred using a spectral method, is required to obtain quantitative fits across the entire range of strain amplitudes and the explored frequencies.


title: Dynamics and Origins of the Near-Resonant Kepler Planets

abstract: Short-period super-Earths and mini-Neptunes encircle more than $\sim50\%$ of Sun-like stars and are relatively amenable to direct observational characterization. Despite this, environments in which these planets accrete are difficult to probe directly. Nevertheless, pairs of planets that are close to orbital resonances provide a unique window into the inner regions of protoplanetary disks, as they preserve the conditions of their formation, as well as the early evolution of their orbital architectures. In this work, we present a novel approach toward quantifying transit timing variations within multi-planetary systems and examine the near-resonant dynamics of over 100 planet pairs detected by \textit{Kepler}. Using an integrable model for first-order resonances, we find a clear transition from libration to circulation of the resonant angle at a period ratio of $\approx 0.6\%$ wide of exact resonance. The orbital properties of these systems indicate that they systematically lie far away from the resonant forced equilibrium. Cumulatively our modeling indicates that while orbital architectures shaped by strong disk damping or tidal dissipation are inconsistent with observations, a scenario where stochastic stirring by turbulent eddies augments the dissipative effects of protoplanetary disks reproduces several features of the data.


title: Boosted Dynamic Neural Networks

abstract: Early-exiting dynamic neural networks (EDNN), as one type of dynamic neural networks, has been widely studied recently. A typical EDNN has multiple prediction heads at different layers of the network backbone. During inference, the model will exit at either the last prediction head or an intermediate prediction head where the prediction confidence is higher than a predefined threshold. To optimize the model, these prediction heads together with the network backbone are trained on every batch of training data. This brings a train-test mismatch problem that all the prediction heads are optimized on all types of data in training phase while the deeper heads will only see difficult inputs in testing phase. Treating training and testing inputs differently at the two phases will cause the mismatch between training and testing data distributions. To mitigate this problem, we formulate an EDNN as an additive model inspired by gradient boosting, and propose multiple training techniques to optimize the model effectively. We name our method BoostNet. Our experiments show it achieves the state-of-the-art performance on CIFAR100 and ImageNet datasets in both anytime and budgeted-batch prediction modes. Our code is released at https://github.com/SHI-Labs/Boosted-Dynamic-Networks.


title: JWST NIRCam Defocused Imaging: Photometric Stability Performance and How it Can Sense Mirror Tilts

abstract: We use JWST NIRCam short wavelength photometry to capture a transit lightcurve of the exoplanet HAT-P-14 b to assess performance as part of instrument commissioning. The short wavelength precision is 152 ppm per 27 second integration as measured over the full time series compared to a theoretical limit of 107 ppm, after corrections to spatially correlated 1/f noise. Persistence effects from charge trapping are well fit by an exponential function with short characteristic timescales, settling on the order of 5-15 minutes. The short wavelength defocused photometry is also uniquely well suited to measure the realtime wavefront error of JWST. Analysis of the images and reconstructed wavefront maps indicate that two different hexagonal primary mirror segments exhibited "tilt events" where they changed orientation rapidly in less than ~1.4 seconds. In some cases, the magnitude and timing of the flux jumps caused by tilt events can be accurately predicted with a telescope model. These tilt events can be sensed by simultaneous longer-wavelength NIRCam grism spectral images alone in the form of changes to the point spread function, diagnosed from the FWHM. They can also be sensed with the FGS instrument from difference images. Tilt events possibly from sudden releases of stress in the backplane structure behind the mirrors were expected during the commissioning period because they were found in ground-based testing. Tilt events have shown signs of decreasing in frequency but have not disappeared completely. The detectors exhibit some minor (less than 1%) deviations from linear behavior in the first few groups of each integration, potentially impacting absolute fluxes and transit depths on bright targets where only a handful of groups are possible. Overall, the noise is within 50% of the theoretical photon noise and read noise. This bodes well for high precision time series measurements.


title: Kempe Equivalent List Colorings Revisited

abstract: A \emph{Kempe chain} on colors $a$ and $b$ is a component of the subgraph induced by colors $a$ and $b$. A \emph{Kempe change} is the operation of interchanging the colors of some Kempe chain. For a list-assignment $L$ and an $L$-coloring $\varphi$, a Kempe change is \emph{$L$-valid} for $\varphi$ if performing the Kempe change yields another $L$-coloring. Two $L$-colorings are \emph{$L$-equivalent} if we can form one from the other by a sequence of $L$-valid Kempe changes. A \emph{degree-assignment} is a list-assignment $L$ such that $L(v)\ge d(v)$ for every $v\in V(G)$. Cranston and Mahmoud (\emph{Combinatorica}, 2023) asked: For which graphs $G$ and degree-assignment $L$ of $G$ is it true that all the $L$-colorings of $G$ are $L$-equivalent? We prove that for every 4-connected graph $G$ which is not complete and every degree-assignment $L$ of $G$, all $L$-colorings of $G$ are $L$-equivalent.


title: Spectral patterns of elastic transmission eigenfunctions: boundary localisation, surface resonance and stress concentration

abstract: We present a comprehensive study of new discoveries on the spectral patterns of elastic transmission eigenfunctions, including boundary localisation, surface resonance, and stress concentration. In the case where the domain is radial and the underlying parameters are constant, we give rigorous justifications and derive a thorough understanding of those intriguing geometric and physical patterns. We also present numerical examples to verify that the same results hold in general geometric and parameter setups.


title: Exact Controllability for a Refined Stochastic Plate Equation

abstract: A widely used stochastic plate equation is the classical plate equation perturbed by a term of It\^o's integral. However, it is known that this equation is not exactly controllable even if the controls are effective everywhere in both the drift and the diffusion terms and also on the boundary. In some sense, this means that some key feature has been ignored in this model. Then, a one-dimensional refined stochastic plate equation is proposed and its exact controllability is established in [28]. In this paper, by means of a new global Carleman estimate, we establish the exact controllability of the multidimensional refined stochastic plate equation with two interior controls and two boundary controls. Moreover, we give a result about the lack of exact controllability, which shows that the action of two interior controls and at least one boundary control is necessary.


title: Towards Training GNNs using Explanation Directed Message Passing

abstract: With the increasing use of Graph Neural Networks (GNNs) in critical real-world applications, several post hoc explanation methods have been proposed to understand their predictions. However, there has been no work in generating explanations on the fly during model training and utilizing them to improve the expressive power of the underlying GNN models. In this work, we introduce a novel explanation-directed neural message passing framework for GNNs, EXPASS (EXplainable message PASSing), which aggregates only embeddings from nodes and edges identified as important by a GNN explanation method. EXPASS can be used with any existing GNN architecture and subgraph-optimizing explainer to learn accurate graph embeddings. We theoretically show that EXPASS alleviates the oversmoothing problem in GNNs by slowing the layer wise loss of Dirichlet energy and that the embedding difference between the vanilla message passing and EXPASS framework can be upper bounded by the difference of their respective model weights. Our empirical results show that graph embeddings learned using EXPASS improve the predictive performance and alleviate the oversmoothing problems of GNNs, opening up new frontiers in graph machine learning to develop explanation-based training frameworks.


title: Determining Dust Properties in Protoplanetary Disks: SED-derived Masses and Settling With ALMA

abstract: We present spectral energy distribution (SED) modeling of 338 disks around T Tauri stars from eleven star-forming regions, ranging from $\sim$0.5 to 10 Myr old. The disk masses we infer from our SED models are typically greater than those reported from (sub)mm surveys by a factor of 1.5-5, with the discrepancy being generally higher for the more massive disks. Masses derived from (sub)mm fluxes rely on the assumption that the disks are optically thin at all millimeter wavelengths, which may cause the disk masses to be underestimated since the observed flux is not sensitive to the whole mass in the disk; SED models do not make this assumption and thus yield higher masses. Disks with more absorbing material should be optically thicker at a given wavelength; which could lead to a larger discrepancy for disks around massive stars when the disk temperature is scaled by the stellar luminosity. We also compare the disk masses and degree of dust settling across the different star-forming regions and find that disks in younger regions have more massive disks than disks in older regions, but a similar degree of dust settling. Together, these results offer potential partial solutions to the "missing" mass problem: disks around T Tauri stars may indeed have enough material to form planetary systems, though previous studies have underestimated the mass by assuming the disks to be optically thin; these planetary systems may also form earlier than previously theorized since significant dust evolution (i.e., settling) is already apparent in young disks.


title: A minor extension of the logistic equation for growth of word counts on online media: Parametric description of diversity of growth phenomena in society

abstract: To understand the growing phenomena of new vocabulary on nationwide online social media, we analyzed monthly word count time series extracted from approximately 1 billion Japanese blog articles from 2007 to 2019. In particular, we first introduced the extended logistic equation by adding one parameter to the original equation and showed that the model can consistently reproduce various patterns of actual growth curves, such as the logistic function, linear growth, and finite-time divergence. Second, by analyzing the model parameters, we found that the typical growth pattern is not only a logistic function, which often appears in various complex systems, but also a nontrivial growth curve that starts with an exponential function and asymptotically approaches a power function without a steady state. Furthermore, we observed a connection between the functional form of growth and the peak-out. Finally, we showed that the proposed model and statistical properties are also valid for Google Trends data (English, French, Spanish, and Japanese), which is a time series of the nationwide popularity of search queries.


title: The Force Balance of Electrons During Kinetic Anti-parallel Magnetic Reconnection

abstract: Fully kinetic simulations are applied to the study of 2D anti-parallel reconnection, elucidating the dynamics by which the electron fluid maintains force balance within both the electron diffusion region (EDR) and the ion diffusion region (IDR). Inside the IDR, magnetic field-aligned electron pressure anisotropy ($p_{e\parallel}\gg p_{e\perp})$ develops upstream of the EDR. Compared to previous investigations, the use of modern computer facilities allows for simulations at the natural proton to electron mass ratio $m_i/m_e=1836$. In this high-$m_i/m_e$-limit the electron dynamics changes qualitatively, as the electron inflow to the EDR is enhanced and mainly driven by the anisotropic pressure. Using a coordinate system with the $x$-direction aligned with the reconnecting magnetic field and the $y$-direction aligned with the central current layer, it is well-known that for the much studied 2D laminar anti-parallel and symmetric scenario the reconnection electric field at the $X$-line must be balanced by the $\partial p_{exy}/ \partial x$ and $\partial p_{eyz}/ \partial z$ off-diagonal electron pressure stress components. We find that the electron anisotropy upstream of the EDR imposes large values of $\partial p_{exy}/ \partial x$ within the EDR, and along the direction of the reconnection $X$-line this stress cancels with the stress of a previously determined theoretical form for $\partial p_{eyz}/ \partial z$. The electron frozen-in law is instead broken by pressure tensor gradients related to the direct heating of the electrons by the reconnection electric field. The reconnection rate is free to adjust to the value imposed externally by the plasma dynamics at larger scales.


title: Unsafe at Any Copy: Name Collisions from Mixing Case Sensitivities

abstract: File name confusion attacks, such as malicious symbolic links and file squatting, have long been studied as sources of security vulnerabilities. However, a recently emerged type, i.e., case-sensitivity-induced name collisions, has not been scrutinized. These collisions are introduced by differences in name resolution under case-sensitive and case-insensitive file systems or directories. A prominent example is the recent Git vulnerability (CVE-2021-21300) which can lead to code execution on a victim client when it clones a maliciously crafted repository onto a case-insensitive file system. With trends including ext4 adding support for per-directory case-insensitivity and the broad deployment of the Windows Subsystem for Linux, the prerequisites for such vulnerabilities are increasingly likely to exist even in a single system. In this paper, we make a first effort to investigate how and where the lack of any uniform approach to handling name collisions leads to a diffusion of responsibility and resultant vulnerabilities. Interestingly, we demonstrate the existence of a range of novel security challenges arising from name collisions and their inconsistent handling by low-level utilities and applications. Specifically, our experiments show that utilities handle many name collision scenarios unsafely, leaving the responsibility to applications whose developers are unfortunately not yet aware of the threats. We examine three case studies as a first step towards systematically understanding the emerging type of name collision vulnerability.


title: Understanding transit ridership in an equity context through a comparison of statistical and machine learning algorithms

abstract: Building an accurate model of travel behaviour based on individuals' characteristics and built environment attributes is of importance for policy-making and transportation planning. Recent experiments with big data and Machine Learning (ML) algorithms toward a better travel behaviour analysis have mainly overlooked socially disadvantaged groups. Accordingly, in this study, we explore the travel behaviour responses of low-income individuals to transit investments in the Greater Toronto and Hamilton Area, Canada, using statistical and ML models. We first investigate how the model choice affects the prediction of transit use by the low-income group. This step includes comparing the predictive performance of traditional and ML algorithms and then evaluating a transit investment policy by contrasting the predicted activities and the spatial distribution of transit trips generated by vulnerable households after improving accessibility. We also empirically investigate the proposed transit investment by each algorithm and compare it with the city of Brampton's future transportation plan. While, unsurprisingly, the ML algorithms outperform classical models, there are still doubts about using them due to interpretability concerns. Hence, we adopt recent local and global model-agnostic interpretation tools to interpret how the model arrives at its predictions. Our findings reveal the great potential of ML algorithms for enhanced travel behaviour predictions for low-income strata without considerably sacrificing interpretability.


title: $f(R)$ gravity in the Jordan Frame as a Paradigm for the Hubble Tension

abstract: We analyse the $f(R)$ gravity in the so-called Jordan frame, as implemented to the isotropic Universe dynamics. The goal of the present study is to show that, according to recent data analyses of the supernovae Ia Pantheon sample, it is possible to account for an effective redshift dependence of the Hubble constant. This is achieved via the dynamics of a non-minimally coupled scalar field, as it emerges in the $f(R)$ gravity. We face the question both from an analytical and purely numerical point of view, following the same technical paradigm. We arrive to establish that the expected decay of the Hubble constant with the redshift $z$ is ensured by a form of the scalar field potential, which remains essentially constant for $z\lesssim0.3$, independently if this request is made a priori, as in the analytical approach, or obtained a posteriori, when the numerical procedure is addressed. Thus, we demonstrate that an $f(R)$ dark energy model is able to account for an apparent variation of the Hubble constant due to the rescaling of the Einstein constant by the $f(R)$ scalar mode.


title: Growing Instance Mask on Leaf

abstract: Contour-based instance segmentation methods include one-stage and multi-stage schemes. These approaches achieve remarkable performance. However, they have to define plenty of points to segment precise masks, which leads to high complexity. We follow this issue and present a single-shot method, called \textbf{VeinMask}, for achieving competitive performance in low design complexity. Concretely, we observe that the leaf locates coarse margins via major veins and grows minor veins to refine twisty parts, which makes it possible to cover any objects accurately. Meanwhile, major and minor veins share the same growth mode, which avoids modeling them separately and ensures model simplicity. Considering the superiorities above, we propose VeinMask to formulate the instance segmentation problem as the simulation of the vein growth process and to predict the major and minor veins in polar coordinates. Besides, centroidness is introduced for instance segmentation tasks to help suppress low-quality instances. Furthermore, a surroundings cross-correlation sensitive (SCCS) module is designed to enhance the feature expression by utilizing the surroundings of each pixel. Additionally, a Residual IoU (R-IoU) loss is formulated to supervise the regression tasks of major and minor veins effectively. Experiments demonstrate that VeinMask performs much better than other contour-based methods in low design complexity. Particularly, our method outperforms existing one-stage contour-based methods on the COCO dataset with almost half the design complexity.


title: Quasi Non-Negative Quaternion Matrix Factorization with Application to Color Face Recognition

abstract: To address the non-negativity dropout problem of quaternion models, a novel quasi non-negative quaternion matrix factorization (QNQMF) model is presented for color image processing. To implement QNQMF, the quaternion projected gradient algorithm and the quaternion alternating direction method of multipliers are proposed via formulating QNQMF as the non-convex constraint quaternion optimization problems. Some properties of the proposed algorithms are studied. The numerical experiments on the color image reconstruction show that these algorithms encoded on the quaternion perform better than these algorithms encoded on the red, green and blue channels. Furthermore, we apply the proposed algorithms to the color face recognition. Numerical results indicate that the accuracy rate of face recognition on the quaternion model is better than on the red, green and blue channels of color image as well as single channel of gray level images for the same data, when large facial expressions and shooting angle variations are presented.


title: Explicit Knowledge Transfer for Weakly-Supervised Code Generation

abstract: Large language models (LLMs) can acquire strong code-generation capabilities through few-shot learning. In contrast, supervised fine-tuning is still needed for smaller models to achieve good performance. Such fine-tuning demands a large number of task-specific NL-code pairs, which are expensive to obtain. In this paper, we attempt to transfer the code generation ability of an LLM to a smaller model with the aid of weakly-supervised data. More specifically, we propose explicit knowledge transfer (EKT), which uses the few-shot capabilities of a teacher LLM to create NL-code pairs that we then filter for correctness and fine-tune the student on. We evaluate EKT on the task of generating code solutions to math word problems from the GSM8k dataset. We find that EKT not only yields better performance than training with expert iteration, but also outperforms knowledge distillation, another form of knowledge transfer. A GPT-Neo 1.3B model trained using EKT with a GPT-J teacher achieves a 12.4% pass@100 on GSM8k, while the same student and teacher trained with knowledge distillation yield only a 3.7% pass@100. We also show that it is possible for a student model to outperform the teacher using EKT.


title: The binary and the disk: the beauty is found within NGC3132 with JWST

abstract: The planetary nebula (PN) NGC3132 is a striking example of the dramatic but poorly understood, mass-loss phenomena that (1-8) Msun stars undergo during their death throes as they evolve into white dwarfs (WDs). From an analysis of JWST multiwavelength (0.9-18 micron) imaging of NGC3132, we report the discovery of an asymmetrical dust cloud around the WD central star (CS) of NGC3132, seen most prominently in the 18 micron~image, with a surface-brightness limited radial extent of >~2 arcsec. We show that the A2V star located 1.7 arcsec to CS's North-East (and 0.75 kpc from Earth) is gravitationally-bound to the latter, by the detection of relative orbital angular motion of (0.24+/-0.045) deg between these stars over ~20 yr. Using aperture photometry of the CS extracted from the JWST images, together with published optical photometry and an archival UV spectrum, we have constructed the spectral-energy distribution (SED) of the CS and its extended emission over the UV to mid-IR (0.091-18 micron) range. We find that fitting the SED of the CS and the radial intensity distributions at 7.7, 12.8 and 18 micron with thermal emission from dust requires a cloud that extends to a radius of >~1785 au, with a dust mass of ~1.3 x 10^(-2) M(Earth) and grains that are 70% silicate and 30% amorphous carbon. We propose plausible origins of the dust cloud and an evolutionary scenario in which a system of three stars -- the CS, a close low-mass companion, and a more distant A2V star -- forms a stable hierarchical triple system on the main-sequence but becomes dynamically unstable later, resulting in the spectacular mass-ejections that form the current, multipolar PN.


title: Protein Language Models and Structure Prediction: Connection and Progression

abstract: The prediction of protein structures from sequences is an important task for function prediction, drug design, and related biological processes understanding. Recent advances have proved the power of language models (LMs) in processing the protein sequence databases, which inherit the advantages of attention networks and capture useful information in learning representations for proteins. The past two years have witnessed remarkable success in tertiary protein structure prediction (PSP), including evolution-based and single-sequence-based PSP. It seems that instead of using energy-based models and sampling procedures, protein language model (pLM)-based pipelines have emerged as mainstream paradigms in PSP. Despite the fruitful progress, the PSP community needs a systematic and up-to-date survey to help bridge the gap between LMs in the natural language processing (NLP) and PSP domains and introduce their methodologies, advancements and practical applications. To this end, in this paper, we first introduce the similarities between protein and human languages that allow LMs extended to pLMs, and applied to protein databases. Then, we systematically review recent advances in LMs and pLMs from the perspectives of network architectures, pre-training strategies, applications, and commonly-used protein databases. Next, different types of methods for PSP are discussed, particularly how the pLM-based architectures function in the process of protein folding. Finally, we identify challenges faced by the PSP community and foresee promising research directions along with the advances of pLMs. This survey aims to be a hands-on guide for researchers to understand PSP methods, develop pLMs and tackle challenging problems in this field for practical purposes.


title: Unitarity bounds on extensions of Higgs sector

abstract: It is widely believed that extensions of the minimal Higgs sector is one of the promising directions for resolving many puzzles beyond the Standard Model (SM). In this work, we study the unitarity bounds on the models by extending the two-Higgs-doublet model with an additional real or complex Higgs triplet scalar. By noting that the SM gauge symmetries $SU(2)_L\times U(1)_Y$ are recovered at high energies, we can classify the two-body scattering states by decomposing the direct product of two scalar multiplets into their direct sum of irreducible representations of electroweak gauge groups. In such state bases, the s-wave amplitudes of two-body scalar scatterings can be written in the form of block-diagonalized scattering matrices. Then the application of the perturbative unitarity conditions on the eigenvalues of scattering matrices leads to the analytic constraints on the model parameters. Finally, we numerically investigate the complex triplet scalar extension of the two-Higgs-doublet model, finding that the perturbative unitarity places useful stringent bounds on the model parameter space.


title: Spin-polarized antichiral exciton-polariton edge states

abstract: We consider theoretically a system of exciton-polariton micropillars arranged in a honeycomb lattice. The naturally present TE-TM splitting and an alternating Zeeman splitting, where the different sublattices experience opposite Zeeman splitting, shifts the Dirac points in energy, giving rise to antichiral behavior. In a strip geometry having zigzag edges, two pairs of edge states exist and propagate in the same direction (including the states at the opposite edges). The edge modes localized at the opposite edges have opposite spins (circular polarizations), which leads to co-propagating "+-" spin channels. The antichiral edge states are protected by non-zero winding numbers and can propagate around a 60 degree bend without being reflected. We further compare the transport properties of these edge states with chiral edge modes and propose a scheme to realize them experimentally.


title: A Pseudo-Value Regression Approach for Differential Network Analysis of Co-Expression Data

abstract: The differential network (DN) analysis identifies changes in measures of association among genes under two or more experimental conditions. In this article, we introduce a Pseudo-value Regression Approach for Network Analysis (PRANA). This is a novel method of differential network analysis that also adjusts for additional clinical covariates. We start from mutual information (MI) criteria, followed by pseudo-value calculations, which are then entered into a robust regression model. This article assesses the model performances of PRANA in a multivariable setting, followed by a comparison to dnapath and DINGO in both univariable and multivariable settings through variety of simulations. Performance in terms of precision, recall, and F1 score of differentially connected (DC) genes is assessed. By and large, PRANA outperformed dnapath and DINGO, neither of which is equipped to adjust for available covariates such as patient-age. Lastly, we employ PRANA in a real data application from the Gene Expression Omnibus (GEO) database to identify DC genes that are associated with chronic obstructive pulmonary disease (COPD) to demonstrate its utility. To the best of our knowledge, this is the first attempt of utilizing a regression modeling for DN analysis by collective gene expression levels between two or more groups with the inclusion of additional clinical covariates. By and large, adjusting for available covariates improves accuracy of a DN analysis.


title: ClaRet -- A CNN Architecture for Optical Coherence Tomography

abstract: Optical Coherence Tomography is a technique used to scan the Retina of the eye and check for tears. In this paper, we develop a Convolutional Neural Network Architecture for OCT scan classification. The model is trained to detect Retinal tears from an OCT scan and classify the type of tear. We designed a block-based approach to accompany a pre-trained VGG-19 using Transfer Learning by writing customised layers in blocks for better feature extraction. The approach achieved substantially better results than the baseline we initially started out with.


title: Approximate minimum cuts and their enumeration

abstract: We show that every $\alpha$-approximate minimum cut in a connected graph is the unique minimum $(S,T)$-terminal cut for some subsets $S$ and $T$ of vertices each of size at most $\lfloor2\alpha\rfloor+1$. This leads to an alternative proof that the number of $\alpha$-approximate minimum cuts in a $n$-vertex connected graph is $n^{O(\alpha)}$ and they can all be enumerated in deterministic polynomial time for constant $\alpha$.


title: Extreme nature of four blue-excess dust-obscured galaxies revealed by optical spectroscopy

abstract: We report optical spectroscopic observations of four blue-excess dust-obscured galaxies (BluDOGs) identified by Subaru Hyper Suprime-Cam. BluDOGs are a sub-class of dust-obscured galaxies (DOGs, defined with the extremely red color $(i-[22])_{\rm AB} \geq 7.0$; Toba et al. 2015), showing a significant flux excess in the optical $g$- and $r$-bands over the power-law fits to the fluxes at the longer wavelengths. Noboriguchi et al. (2019) has suggested that BluDOGs may correspond to the blowing-out phase involved in a gas-rich major merger scenario. However the detailed properties of BluDOGs are not understood because of the lack of spectroscopic information. In this work, we carry out deep optical spectroscopic observations of four BluDOGs using Subaru/FOCAS and VLT/FORS2. The obtained spectra show broad emission lines with extremely large equivalent widths, and a blue wing in the CIV line profile. The redshifts are between 2.2 and 3.3. The averaged rest-frame equivalent widths of the CIV lines are $160\pm33$ $\mathrm{\mathring{A}}$, $\sim$7 times higher than the average of a typical type-1 quasar. The FWHMs of their velocity profiles are between 1990 and 4470 ${\rm km\ s^{-1}}$, and their asymmetric parameters are 0.05 and 0.25. Such strong CIV lines significantly affect the broad-band magnitudes, which is partly the origin of the blue excess seen in the spectral energy distribution of BluDOGs. Their estimated supermassive black hole masses are $1.1\times10^8 < M_{\rm BH}/M_\odot < 5.5 \times 10^8$. The inferred Eddington ratios of the BluDOGs are higher than 1 ($1.1< \lambda_{\rm Edd} < 3.8$), suggesting that the BluDOGs are in a rapidly evolving phase of supermassive black holes.


title: HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression

abstract: Transformers have attained superior performance in natural language processing and computer vision. Their self-attention and feedforward layers are overparameterized, limiting inference speed and energy efficiency. Tensor decomposition is a promising technique to reduce parameter redundancy by leveraging tensor algebraic properties to express the parameters in a factorized form. Prior efforts used manual or heuristic factorization settings without hardware-aware customization, resulting in poor hardware efficiencies and large performance degradation. In this work, we propose a hardware-aware tensor decomposition framework, dubbed HEAT, that enables efficient exploration of the exponential space of possible decompositions and automates the choice of tensorization shape and decomposition rank with hardware-aware co-optimization. We jointly investigate tensor contraction path optimizations and a fused Einsum mapping strategy to bridge the gap between theoretical benefits and real hardware efficiency improvement. Our two-stage knowledge distillation flow resolves the trainability bottleneck and thus significantly boosts the final accuracy of factorized Transformers. Overall, we experimentally show that our hardware-aware factorized BERT variants reduce the energy-delay product by 5.7x with less than 1.1% accuracy loss and achieve a better efficiency-accuracy Pareto frontier than hand-tuned and heuristic baselines.


title: Score-based Continuous-time Discrete Diffusion Models

abstract: Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e., the score function, is not properly defined for discrete spaces. This makes it non-trivial to adapt \textcolor{\cdiff}{the score-based modeling} to categorical data. In this paper, we extend diffusion models to discrete variables by introducing a stochastic jump process where the reverse process denoises via a continuous-time Markov chain. This formulation admits an analytical simulation during backward sampling. To learn the reverse process, we extend score matching to general categorical data and show that an unbiased estimator can be obtained via simple matching of the conditional marginal distributions. We demonstrate the effectiveness of the proposed method on a set of synthetic and real-world music and image benchmarks.


title: DiProber: Using Dual Probing to Estimate Tor Relay Capacities in Underloaded Networks

abstract: Tor is the most popular anonymous communication network. It has millions of daily users seeking privacy while browsing the internet. It has thousands of relays to route and anonymize the source and destinations of the users packets. To create a path, Tor authorities generate a probability distribution over relays based on the estimates of the capacities of the relays. An incoming user will then sample this probability distribution and choose three relays for their paths. The estimates are based on the bandwidths of observation probes the authority assigns to each relay in the network. Thus, in order to achieve better load balancing between users, accurate estimates are necessary. Unfortunately, the currently implemented estimation algorithm generate inaccurate estimates causing the network to be under utilized and its capacities unfairly distributed between the users paths. We propose DiProber, a new relay capacity estimation algorithm. The algorithm proposes a new measurement scheme in Tor consisting of two probes per relay and uses maximum likelihood to estimate their capacities. We show that the new technique works better in the case of under-utilized networks where users tend to have very low demand on the Tor network.


title: DimenFix: A novel meta-dimensionality reduction method for feature preservation

abstract: Dimensionality reduction has become an important research topic as demand for interpreting high-dimensional datasets has been increasing rapidly in recent years. There have been many dimensionality reduction methods with good performance in preserving the overall relationship among data points when mapping them to a lower-dimensional space. However, these existing methods fail to incorporate the difference in importance among features. To address this problem, we propose a novel meta-method, DimenFix, which can be operated upon any base dimensionality reduction method that involves a gradient-descent-like process. By allowing users to define the importance of different features, which is considered in dimensionality reduction, DimenFix creates new possibilities to visualize and understand a given dataset. Meanwhile, DimenFix does not increase the time cost or reduce the quality of dimensionality reduction with respect to the base dimensionality reduction used.


title: VI-PINNs: Variance-involved Physics-informed Neural Networks for Fast and Accurate Prediction of Partial Differential Equations

abstract: Although physics-informed neural networks(PINNs) have progressed a lot in many real applications recently, there remains problems to be further studied, such as achieving more accurate results, taking less training time, and quantifying the uncertainty of the predicted results. Recent advances in PINNs have indeed significantly improved the performance of PINNs in many aspects, but few have considered the effect of variance in the training process. In this work, we take into consideration the effect of variance and propose our VI-PINNs to give better predictions. We output two values in the final layer of the network to represent the predicted mean and variance respectively, and the latter is used to represent the uncertainty of the output. A modified negative log-likelihood loss and an auxiliary task are introduced for fast and accurate training. We perform several experiments on a wide range of different problems to highlight the advantages of our approach. The results convey that our method not only gives more accurate predictions but also converges faster.


title: Kinetic Equation for Stochastic Vector Bundles

abstract: The kinetic equation is crucial for understanding the statistical properties of stochastic processes, yet current equations, such as the classical Fokker-Planck, are limited to local analysis. This paper derives a new kinetic equation for stochastic systems on vector bundles, addressing global scale randomness. The kinetic equation was derived by cumulant expansion of the ensemble-averaged local probability density function, which is a functional of state transition trajectories. The kinetic equation is the geodesic equation for the probability space. It captures global and historical influences, accounts for non-Markovianity, and can be reduced to the classical Fokker-Planck equation for Markovian processes. This paper also discusses relative issues concerning the kinetic equation, including non-Markovianity, Markov approximation, macroscopic conservation equations, gauge transformation, and truncation of the infinite-order kinetic equation, as well as limitations that require further attention.


title: Nuclear Volterra composition operators between Bloch and weighted type spaces

abstract: In this paper, we completely characterize nuclear Volterra composition operators $T^\phi_g : \mathcal H^\infty_\nu \longrightarrow \mathcal H^\infty_\mu$ and $S^\phi_g : \mathcal H^\infty_\nu \longrightarrow \mathcal H^\infty_\mu$ acting between weighted type spaces in terms of the symbols $g$ and $\phi$ of $T^\phi_g$ and $S^\phi_g$ and weights $\nu$ and $\mu$, when the weights $\nu$ and $\mu$ are normal weights in the sense of Shields and Williams. Moreover, nuclear Volterra composition operators acting between little weighted type spaces and Bloch spaces of order $\beta$ are also characterized.


title: Split-PU: Hardness-aware Training Strategy for Positive-Unlabeled Learning

abstract: Positive-Unlabeled (PU) learning aims to learn a model with rare positive samples and abundant unlabeled samples. Compared with classical binary classification, the task of PU learning is much more challenging due to the existence of many incompletely-annotated data instances. Since only part of the most confident positive samples are available and evidence is not enough to categorize the rest samples, many of these unlabeled data may also be the positive samples. Research on this topic is particularly useful and essential to many real-world tasks which demand very expensive labelling cost. For example, the recognition tasks in disease diagnosis, recommendation system and satellite image recognition may only have few positive samples that can be annotated by the experts. These methods mainly omit the intrinsic hardness of some unlabeled data, which can result in sub-optimal performance as a consequence of fitting the easy noisy data and not sufficiently utilizing the hard data. In this paper, we focus on improving the commonly-used nnPU with a novel training pipeline. We highlight the intrinsic difference of hardness of samples in the dataset and the proper learning strategies for easy and hard data. By considering this fact, we propose first splitting the unlabeled dataset with an early-stop strategy. The samples that have inconsistent predictions between the temporary and base model are considered as hard samples. Then the model utilizes a noise-tolerant Jensen-Shannon divergence loss for easy data; and a dual-source consistency regularization for hard data which includes a cross-consistency between student and base model for low-level features and self-consistency for high-level features and predictions, respectively.


title: Taming Hyperparameter Tuning in Continuous Normalizing Flows Using the JKO Scheme

abstract: A normalizing flow (NF) is a mapping that transforms a chosen probability distribution to a normal distribution. Such flows are a common technique used for data generation and density estimation in machine learning and data science. The density estimate obtained with a NF requires a change of variables formula that involves the computation of the Jacobian determinant of the NF transformation. In order to tractably compute this determinant, continuous normalizing flows (CNF) estimate the mapping and its Jacobian determinant using a neural ODE. Optimal transport (OT) theory has been successfully used to assist in finding CNFs by formulating them as OT problems with a soft penalty for enforcing the standard normal distribution as a target measure. A drawback of OT-based CNFs is the addition of a hyperparameter, $\alpha$, that controls the strength of the soft penalty and requires significant tuning. We present JKO-Flow, an algorithm to solve OT-based CNF without the need of tuning $\alpha$. This is achieved by integrating the OT CNF framework into a Wasserstein gradient flow framework, also known as the JKO scheme. Instead of tuning $\alpha$, we repeatedly solve the optimization problem for a fixed $\alpha$ effectively performing a JKO update with a time-step $\alpha$. Hence we obtain a "divide and conquer" algorithm by repeatedly solving simpler problems instead of solving a potentially harder problem with large $\alpha$.


title: Extracting GHZ states from linear cluster states

abstract: Quantum information processing architectures typically only allow for nearest-neighbour entanglement creation. In many cases, this prevents the direct generation of GHZ states, which are commonly used for many communication and computation tasks. Here, we show how to obtain GHZ states between nodes in a network that are connected in a straight line, naturally allowing them to initially share linear cluster states. We prove a strict upper bound of $\lfloor (n+3)/2 \rfloor$ on the size of the set of nodes sharing a GHZ state that can be obtained from a linear cluster state of $n$ qubits, using local Clifford unitaries, local Pauli measurements, and classical communication. Furthermore, we completely characterize all selections of nodes below this threshold that can share a GHZ state obtained within this setting. Finally, we demonstrate these transformations on the IBMQ Montreal quantum device for linear cluster states of up to $n=19$ qubits.


title: General policy mapping: online continual reinforcement learning inspired on the insect brain

abstract: We have developed a model for online continual or lifelong reinforcement learning (RL) inspired on the insect brain. Our model leverages the offline training of a feature extraction and a common general policy layer to enable the convergence of RL algorithms in online settings. Sharing a common policy layer across tasks leads to positive backward transfer, where the agent continuously improved in older tasks sharing the same underlying general policy. Biologically inspired restrictions to the agent's network are key for the convergence of RL algorithms. This provides a pathway towards efficient online RL in resource-constrained scenarios.


title: Ferromagnetic Crossover within the Ferromagnetic Order of U$_{7}$Te$_{12}$

abstract: We investigate the physical properties of a single crystal of uranium telluride U$_{7}$Te$_{12}$. We have confirmed that U$_{7}$Te$_{12}$ crystallizes in the hexagonal structure with three nonequivalent crystallographic uranium sites. The paramagnetic moments are estimated to be approximately 1 $\mu_{\rm B}$ per the uranium site, assuming a uniform moment on all the sites. A ferromagnetic phase transition occurs at $T_{\rm C}=48$ K, where the in-plane magnetization increases sharply, whereas the out-of-plane component does not increase significantly. With decreasing temperature further below $T_{\rm C}$ under field-cooling conditions, the out-of-plane component increases rapidly around $T^{\star}=26$ K. In contrast, the in-plane component hardly changes at $T^{\star}$. Specific heat measurement indicates no $\lambda$-type anomaly around $T^{\star}$, so this is a cross-over suggesting a reorientation of the ordering moments or successive magnetic ordering on the part of the multiple uranium sites.


title: Improving Cross-Modal Retrieval with Set of Diverse Embeddings

abstract: Cross-modal retrieval across image and text modalities is a challenging task due to its inherent ambiguity: An image often exhibits various situations, and a caption can be coupled with diverse images. Set-based embedding has been studied as a solution to this problem. It seeks to encode a sample into a set of different embedding vectors that capture different semantics of the sample. In this paper, we present a novel set-based embedding method, which is distinct from previous work in two aspects. First, we present a new similarity function called smooth-Chamfer similarity, which is designed to alleviate the side effects of existing similarity functions for set-based embedding. Second, we propose a novel set prediction module to produce a set of embedding vectors that effectively captures diverse semantics of input by the slot attention mechanism. Our method is evaluated on the COCO and Flickr30K datasets across different visual backbones, where it outperforms existing methods including ones that demand substantially larger computation at inference.


title: GeoUDF: Surface Reconstruction from 3D Point Clouds via Geometry-guided Distance Representation

abstract: We present a learning-based method, namely GeoUDF,to tackle the long-standing and challenging problem of reconstructing a discrete surface from a sparse point cloud.To be specific, we propose a geometry-guided learning method for UDF and its gradient estimation that explicitly formulates the unsigned distance of a query point as the learnable affine averaging of its distances to the tangent planes of neighboring points on the surface. Besides,we model the local geometric structure of the input point clouds by explicitly learning a quadratic polynomial for each point. This not only facilitates upsampling the input sparse point cloud but also naturally induces unoriented normal, which further augments UDF estimation. Finally, to extract triangle meshes from the predicted UDF we propose a customized edge-based marching cube module. We conduct extensive experiments and ablation studies to demonstrate the significant advantages of our method over state-of-the-art methods in terms of reconstruction accuracy, efficiency, and generality. The source code is publicly available at https://github.com/rsy6318/GeoUDF.


title: Inverse molecular design and parameter optimization with H\"uckel theory using automatic differentiation

abstract: Semi-empirical quantum chemistry has recently seen a renaissance with applications in high-throughput virtual screening and machine learning. The simplest semi-empirical model still in widespread use in chemistry is H\"uckel's $\pi$-electron molecular orbital theory. In this work, we implemented a H\"uckel program using differentiable programming with the JAX framework, based on limited modifications of a pre-existing NumPy version. The auto-differentiable H\"uckel code enabled efficient gradient-based optimization of model parameters tuned for excitation energies and molecular polarizabilities, respectively, based on as few as 100 data points from density functional theory simulations. In particular, the facile computation of the polarizability, a second-order derivative, via auto-differentiation shows the potential of differentiable programming to bypass the need for numeric differentiation or derivation of analytical expressions. Finally, we employ gradient-based optimization of atom identity for inverse design of organic electronic materials with targeted orbital energy gaps and polarizabilities. Optimized structures are obtained after as little as 15 iterations, using standard gradient-based optimization algorithms.


title: A General Unfolding Speech Enhancement Method Motivated by Taylor's Theorem

abstract: While deep neural networks have facilitated significant advancements in the field of speech enhancement, most existing methods are developed following either empirical or relatively blind criteria, lacking adequate guidelines in pipeline design. Inspired by Taylor's theorem, we propose a general unfolding framework for both single- and multi-channel speech enhancement tasks. Concretely, we formulate the complex spectrum recovery into the spectral magnitude mapping in the neighborhood space of the noisy mixture, in which an unknown sparse term is introduced and applied for phase modification in advance. Based on that, the mapping function is decomposed into the superimposition of the 0th-order and high-order polynomials in Taylor's series, where the former coarsely removes the interference in the magnitude domain and the latter progressively complements the remaining spectral detail in the complex spectrum domain. In addition, we study the relation between adjacent order terms and reveal that each high-order term can be recursively estimated with its lower-order term, and each high-order term is then proposed to evaluate using a surrogate function with trainable weights so that the whole system can be trained in an end-to-end manner. Given that the proposed framework is devised based on Taylor's theorem, it possesses improved internal flexibility. Extensive experiments are conducted on WSJ0-SI84, DNS-Challenge, Voicebank+Demand, spatialized Librispeech, and L3DAS22 multi-channel speech enhancement challenge datasets. Quantitative results show that the proposed approach yields competitive performance over existing top-performing approaches in terms of multiple objective metrics.


title: Electron-phonon interactions in the Andreev Bound States of aluminum nanobridge Josephson junctions

abstract: We report continuous measurements of quasiparticles trapping and clearing from Andreev Bound States in aluminum nanobridge Josephson junctions integrated into a superconducting-qubit-like device. We find that trapping is well modeled by independent spontaneous emission events. Above 80 mK the clearing process is well described by absorption of thermal phonons, but other temperature-independent mechanisms dominate at low temperature. We find complex structure in the dependence of the low-temperature clearing rate on the Andreev Bound State energy. Our results shed light on quasiparticle behavior in qubit-like circuits.


title: Arithmetic autocorrelation distribution of binary $m$-sequences

abstract: Binary $m$-sequences are ones with the largest period $n=2^m-1$ among the binary sequences produced by linear shift registers with length $m$. They have a wide range of applications in communication since they have several desirable pseudorandomness such as balance, uniform pattern distribution and ideal (classical) autocorrelation. In his reseach on arithmetic codes, Mandelbaum \cite{9Mand} introduces a 2-adic version of classical autocorrelation of binary sequences, called arithmetic autocorrelation. Later, Goresky and Klapper \cite{3G1,4G2,5G3,6G4} generalize this notion to nonbinary case and develop several properties of arithmetic autocorrelation related to linear shift registers with carry. Recently, Z. Chen et al. \cite{1C1} show an upper bound on arithmetic autocorrelation of binary $m$-sequences and raise a conjecture on absolute value distribution on arithmetic autocorrelation of binary $m$-sequences.


title: NMR evidence for a Peierls transition in the layered square-net compound LaAgSb$_2$

abstract: We measured the central ($1/2\leftrightarrow -1/2$) and first satellite ($\pm3/2\leftrightarrow \pm1/2$) lines of the \la\ NMR spectra as a function of temperature in LaAgSb$_2$, in order to elucidate the origin and nature of the charge-density-wave (CDW) transitions at $T_\text{CDW1}=207$ K and $T_\text{CDW2}=186$ K. In the normal state, the Knight shift K reveals a fairly linear relationship with decreasing temperature, which is ascribed to a pseudogap in the spin excitation spectrum, pointing towards the material being an unconventional metal. Upon further cooling, K decreases more steeply below $T_\text{CDW1}$, indicative of the partial Fermi surface gap opening on top of the pseudogap. The most remarkable finding in our study is a clear splitting of the satellite lines at $T_\text{CDW1}$ observed for $H\parallel c$, whose temperature dependence behaves as the BCS order parameter in the weak-coupling limit, evidencing that the CDW transition induces the periodic lattice distortion. Our NMR findings therefore demonstrate that the CDW transition in LaAgSb$_2$ is of Peierls type, being driven by the electronic instability in the vicinity of the Fermi level.


title: Data-driven simultaneous vertex and energy reconstruction for large liquid scintillator detectors

abstract: High precision vertex and energy reconstruction is crucial for large liquid scintillator detectors such as JUNO, especially for the determination of the neutrino mass ordering by analyzing the energy spectrum of reactor neutrinos. This paper presents a data-driven method to obtain more realistic and more accurate expected PMT response of positron events in JUNO, and develops a simultaneous vertex and energy reconstruction method that combines the charge and time information of PMTs. For the JUNO detector, the impact of vertex inaccuracy on the energy resolution is about 0.6\%.


title: Uncertainty-Aware Image Captioning

abstract: It is well believed that the higher uncertainty in a word of the caption, the more inter-correlated context information is required to determine it. However, current image captioning methods usually consider the generation of all words in a sentence sequentially and equally. In this paper, we propose an uncertainty-aware image captioning framework, which parallelly and iteratively operates insertion of discontinuous candidate words between existing words from easy to difficult until converged. We hypothesize that high-uncertainty words in a sentence need more prior information to make a correct decision and should be produced at a later stage. The resulting non-autoregressive hierarchy makes the caption generation explainable and intuitive. Specifically, we utilize an image-conditioned bag-of-word model to measure the word uncertainty and apply a dynamic programming algorithm to construct the training pairs. During inference, we devise an uncertainty-adaptive parallel beam search technique that yields an empirically logarithmic time complexity. Extensive experiments on the MS COCO benchmark reveal that our approach outperforms the strong baseline and related methods on both captioning quality as well as decoding speed.


title: The photon production and collective flows from magnetic induced gluon fusion and splitting in early stage of high energy nuclear collision

abstract: We present an event-by-event study of photon production in early stage of high energy nuclear collisions, where the system is dominant by highly occupied of gluons and initialized by McLerran-Venugopalan model. The photons are produced through the gluon fusion and splitting processes when strong magnetic field is included. We study the spectra and collective flows of the photons and show their dependence on transverse momentum $q_{T}$. It is found that in our approach the photons from boost invariant evolving glasma provide visible enhancement on spectrum and obvious contribution on $v_{2}$ of the total direct photons. The results, by weighting on top of parton-hadron-string dynamics (PHSD) model, agree even better with experiment measurements in Au-Au 20\%-40\% centrality collisions at $\sqrt{s_{NN}}=200$GeV.


title: Handling Missing Data via Max-Entropy Regularized Graph Autoencoder

abstract: Graph neural networks (GNNs) are popular weapons for modeling relational data. Existing GNNs are not specified for attribute-incomplete graphs, making missing attribute imputation a burning issue. Until recently, many works notice that GNNs are coupled with spectral concentration, which means the spectrum obtained by GNNs concentrates on a local part in spectral domain, e.g., low-frequency due to oversmoothing issue. As a consequence, GNNs may be seriously flawed for reconstructing graph attributes as graph spectral concentration tends to cause a low imputation precision. In this work, we present a regularized graph autoencoder for graph attribute imputation, named MEGAE, which aims at mitigating spectral concentration problem by maximizing the graph spectral entropy. Notably, we first present the method for estimating graph spectral entropy without the eigen-decomposition of Laplacian matrix and provide the theoretical upper error bound. A maximum entropy regularization then acts in the latent space, which directly increases the graph spectral entropy. Extensive experiments show that MEGAE outperforms all the other state-of-the-art imputation methods on a variety of benchmark datasets.


title: Non-Stationary Difference Equation and Affine Laumon Space: Quantization of Discrete Painlev\'e Equation

abstract: We show the relation of the non-stationary difference equation proposed by one of the authors and the quantized discrete Painlev\'e VI equation. The five-dimensional Seiberg-Witten curve associated with the difference equation has a consistent four-dimensional limit. We also show that the original equation can be factorized as a coupled system for a pair of functions $\bigl(\mathcal{F}^{(1)},\mathcal{F}^{(2)}\bigr)$, which is a consequence of the identification of the Hamiltonian as a translation element in the extended affine Weyl group. We conjecture that the instanton partition function coming from the affine Laumon space provides a solution to the coupled system.


title: KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords Learning

abstract: In task-oriented dialogs (TOD), reinforcement learning (RL) algorithms train a model to directly optimize response for task-related metrics. However, RL needs to perform exploration, which can be time-consuming due to the slow auto-regressive sequence generation process. We investigate an approach to create a more efficient RL-based algorithm to improve TOD performance in an offline setting. First, we use a faster generation procedure that samples from independent next-word distributions after training the language model (LM) with supervised learning. We then introduce a fine-grained reward function to help the model focus on learning key information in a dialog, by measuring the importance and semantic closeness of each generated token. Experiments on the MultiWoZ dataset show our new training algorithm, Keywords Reinforcement Learning with Next-word Sampling (KRLS), achieves state-of-the-art performance on the end-to-end response generation task, with a 15% training time reduction compared to a standard RL algorithm using auto-regressive generation.


title: Stellar $s$-process neutron capture cross sections of $^{69,71}$Ga

abstract: The stable gallium isotopes, $^{69,71}$Ga, are mostly produced by the weak slow ($s$) process in massive stars. We report here on measurements of astrophysically-relevant neutron capture cross sections of the $^{69,71}$Ga$(n,\gamma)$ reactions. The experiments were performed by the activation technique using a high-intensity ($3-5\times10^{10}$ n/s), quasi-Maxwellian neutron beam that closely mimics conditions of stellar $s$-process nucleosynthesis at $kT \approx$ 40 keV. The neutron field was produced by a mA proton beam at $E_p=1925$ keV (beam power of 2-3 kW) from the Soreq Applied Research Accelerator Facility (SARAF), bombarding the Liquid-Lithium Target (LiLiT). A 473 mg sample of Ga$_2$O$_3$ of natural isotopic composition was activated in the LiLiT neutron field and the activities of $^{70,72}$Ga were measured by decay counting via $\gamma$-spectrometry with a high-purity germanium detector. The Maxwellian-averaged cross sections at $kT$ = 30 keV of $^{69}$Ga and $^{71}$Ga determined in this work are 136(8) mb and 105(7) mb, respectively, in good agreement with previous experimental values. Astrophysical implications of the measurements are discussed.


title: First steps towards a theory of the Dense Plasma Focus: Part-I: Kinematic framework with built-in propagation delay and nonzero thickness of dense sheath for generalized electrode geometry

abstract: This paper, Part I of a series, describes a kinematic framework for the theory of a Dense Plasma Focus which is very similar to the GV model in spirit but which differs in its scope in four respects. First, the GV model derives most of its results from the mathematical properties of the solution of a certain partial differential equation derived from assumptions that apparently represent conservation of momentum but are not a rigorous application of the relevant physics. The present model is based on the scaling properties of the standard equations of motion, which lead to mathematical results identical with the GV model. Second, the GV model is purely kinematic in nature. The present model is also kinematic like the GV model but it incorporates additional insights borrowed from other physical theories, models and experiments. Third, the GV model does not take into account the experimentally observed delay between the start of current and start of plasma propagation and the existence of a nonzero thickness of the dense plasma sheath. The present model incorporates both these features in its kinematic structure. Fourth, the unlike the GV model, the present model allows considerations of some modifications of standard Mather type geometry. In addition to the current waveform, the proposed model reproduces the height and radius of the pinch column, the ratio of pinch density to fill density, the general appearance of the umbrella like plasma profile and streak picture and formation of bounded 3-dimensional plasma structures embedded within the pinch plasma without taking into account microscopic details of physical phenomena


title: From Coarse to Fine: Hierarchical Pixel Integration for Lightweight Image Super-Resolution

abstract: Image super-resolution (SR) serves as a fundamental tool for the processing and transmission of multimedia data. Recently, Transformer-based models have achieved competitive performances in image SR. They divide images into fixed-size patches and apply self-attention on these patches to model long-range dependencies among pixels. However, this architecture design is originated for high-level vision tasks, which lacks design guideline from SR knowledge. In this paper, we aim to design a new attention block whose insights are from the interpretation of Local Attribution Map (LAM) for SR networks. Specifically, LAM presents a hierarchical importance map where the most important pixels are located in a fine area of a patch and some less important pixels are spread in a coarse area of the whole image. To access pixels in the coarse area, instead of using a very large patch size, we propose a lightweight Global Pixel Access (GPA) module that applies cross-attention with the most similar patch in an image. In the fine area, we use an Intra-Patch Self-Attention (IPSA) module to model long-range pixel dependencies in a local patch, and then a $3\times3$ convolution is applied to process the finest details. In addition, a Cascaded Patch Division (CPD) strategy is proposed to enhance perceptual quality of recovered images. Extensive experiments suggest that our method outperforms state-of-the-art lightweight SR methods by a large margin. Code is available at https://github.com/passerer/HPINet.


title: Reliable Quantum Certification of Bosonic Code Preparations

abstract: Bosonic fault tolerant quantum computing requires preparations of Bosonic code states like cat states and GKP states with high fidelity and reliable quantum certification of these states. Although many proposals on preparing these states have been developed, few investigation has been done on how to reliably certify these experimental states. In this paper, we develop approaches to certify whether a continuous-variable state falls inside a certain Bosonic qubit code space by detecting a witness using Gaussian measurements. Our results can be applied to certification of various cat codes including two-component cat states, four-component cat states, and squeezed two-component cat states as well as Gottesman-Kitaev-Preskill codes. Then we further apply our approach to certify resource states in continuous-variable universal fault tolerant measurement-based quantum computing and quantum outputs of instantaneous quantum polynomial circuits, which can be used to show quantum supremacy. The sample complexity of our approach is efficient in terms of number of modes, so significantly reducing overhead compared to quantum state tomography in certification of many-mode quantum states.


title: Rethinking Out-of-Distribution Detection From a Human-Centric Perspective

abstract: Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a discrepancy between the conventional evaluation vs. the essential purpose of OOD detection. On the one hand, the conventional evaluation exclusively considers risks caused by label-space distribution shifts while ignoring the risks from input-space distribution shifts. On the other hand, the conventional evaluation reward detection methods for not rejecting the misclassified image in the validation dataset. However, the misclassified image can also cause risks and should be rejected. We appeal to rethink OOD detection from a human-centric perspective, that a proper detection method should reject the case that the deep model's prediction mismatches the human expectations and adopt the case that the deep model's prediction meets the human expectations. We propose a human-centric evaluation and conduct extensive experiments on 45 classifiers and 8 test datasets. We find that the simple baseline OOD detection method can achieve comparable and even better performance than the recently proposed methods, which means that the development in OOD detection in the past years may be overestimated. Additionally, our experiments demonstrate that model selection is non-trivial for OOD detection and should be considered as an integral of the proposed method, which differs from the claim in existing works that proposed methods are universal across different models.


title: Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection

abstract: Monocular 3D object detection is a low-cost but challenging task, as it requires generating accurate 3D localization solely from a single image input. Recent developed depth-assisted methods show promising results by using explicit depth maps as intermediate features, which are either precomputed by monocular depth estimation networks or jointly evaluated with 3D object detection. However, inevitable errors from estimated depth priors may lead to misaligned semantic information and 3D localization, hence resulting in feature smearing and suboptimal predictions. To mitigate this issue, we propose ADD, an Attention-based Depth knowledge Distillation framework with 3D-aware positional encoding. Unlike previous knowledge distillation frameworks that adopt stereo- or LiDAR-based teachers, we build up our teacher with identical architecture as the student but with extra ground-truth depth as input. Credit to our teacher design, our framework is seamless, domain-gap free, easily implementable, and is compatible with object-wise ground-truth depth. Specifically, we leverage intermediate features and responses for knowledge distillation. Considering long-range 3D dependencies, we propose \emph{3D-aware self-attention} and \emph{target-aware cross-attention} modules for student adaptation. Extensive experiments are performed to verify the effectiveness of our framework on the challenging KITTI 3D object detection benchmark. We implement our framework on three representative monocular detectors, and we achieve state-of-the-art performance with no additional inference computational cost relative to baseline models. Our code is available at https://github.com/rockywind/ADD.