title: Constraints on the Sub-pc Environment of the Nearby Type Iax SN 2014dt from Deep X-ray and Radio Observations

abstract: We present X-ray and radio observations of what may be the closest type Iax supernova (SN) to date, SN 2014dt (d=12.3-19.3 Mpc) and provide tight constraints on the radio and X-ray emission. We infer a specific radio luminosity of < (1.0-2.4)E25 erg/s/Hz at a frequency of 7.5 GHz and a X-ray luminosity < 1.4E38 erg/s (0.3-10 keV) at ~38-48 days post-explosion. We interpret these limits in the context of Inverse Compton (IC) emission and synchrotron emission from a population of electrons accelerated at the forward shock of the explosion in a power-law distribution $N_e(\gamma_e)\propto \gamma_e^{-p}$ with p=3. Our analysis constrains the progenitor system mass-loss rate to be smaller than 5E-6 solar masses per year at distances where r <= 1E16 cm for an assumed wind velocity v=100 km/s, and a fraction of post-shock energy into magnetic fields and relativistic electrons of epsilon_B=0.01 and epsilon_e=0.1, respectively. This result rules out some of the parameter space of symbiotic giant star companions, and it is consistent with the low mass-loss rates expected from He-star companions. Our calculations also show that the improved sensitivity of the next generation Very Large Array (ngVLA) is needed to probe the very low-density media characteristic of He stars that are the leading model for binary stellar companions of white dwarfs giving origin to type Iax SNe.


title: Magnetic structure and low temperature properties of geometrically frustrated SrNd$_2$O$_4$

abstract: We report the low-temperature properties of SrNd$_2$O$_4$, a geometrically frustrated magnet. Magnetisation and heat capacity measurements performed on polycrystalline samples indicate the appearance of a magnetically ordered state at $T_{\rm N}=2.28(4)$~K. Powder neutron diffraction measurements reveal that an \afm\ state with the propagation vector \QV\ is stabilised below this temperature. The magnetic order is incomplete, as only one of the two Nd$^{3+}$ sites carries a significant magnetic moment while the other site remains largely disordered. The presence of a disordered magnetic component below $T_{\rm N}$ is confirmed with polarised neutron diffraction measurements. In an applied magnetic field, the bulk properties measurements indicate a phase transition at about 30~kOe. We construct a tentative $H$-$T$ phase diagram of \sno\ from these measurements.


title: The effect of Informative Selection on the estimation of parameters related to Spatial Processes

abstract: This paper extends the concept of informative selection, population distribution and sample distribution to a spatial process context. These notions were first defined in a context where the output of the random process of interest consists of independent and identically distributed realisations for each individual of a population. It has been showed that informative selection was inducing a stochastic dependence among realisations on the selected units. In the context of spatial processes, the "population" is a continuous space and realisations for two different elements of the population are not independent. We show how informative selection may induce a different dependence among selected units and how the sample distribution differs from the population distribution.


title: Quantitative investigation of low-dose PET imaging and post-reconstruction smoothing

abstract: In this study, 18F-FDG PET/CT brain scans of 50 patients with head and neck malignant lesions were employed to systematically assess the relationship between the amount of injected dose (10%, 8%, 6%, 5%, 4%, 3%, 2%, and 1% of standard dose) and the image quality through measuring standard image quality metrics (peak-signal-to-noise-ration (PSNR), structural similarity index (SSIM), root mean square error (RMSE), and standard uptake value (SUV) bias) for the whole head region as well as within the malignant lesions, considering the standard-dose PET images as reference. Furthermore, we evaluated the impact of post-reconstruction Gaussian filtering on the PET images in order to reduce noise and improve the signal-to-noise ratio at different low-dose levels. Significant degradation of PET image quality and tumor detectability was observed with a decrease in the injected dose by more than 5%, leading to a remarkable increase in RMSE from 0.173 SUV (at 5%) to 1.454 SUV (at 1%). The quantitative investigation of the malignant lesions demonstrated that SUVmax bias greatly increased in low-dose PET images (in particular at 1%, 2%, 3% levels) before applying the post-reconstruction filter, while applying the Gaussian filter on low-dose PET images led to a significant reduction in SUVmax bias. The SUVmean bias within the malignant lesions was negligible (less than 1%) in low-dose PET images; however, this bias increased significantly after applying the post-reconstruction filter. In conclusion, it is strongly recommended that the SUVmax bias and SUVmean bias in low-dose PET images should be considered prior to and following the application of the post-reconstruction Guassain filter, respectively.


title: Cluster dynamics studied with the phase-space Minimum Spanning Tree approach

abstract: The origin of weakly bound objects like clusters and hypernuclei, observed in heavy-ion collisions, is of theoretical and experimental interest. It is in the focus of the experiments at RHIC and LHC since it is not evident how such weakly bound objects can survive in an environment whose hadronic decay products point to a temperature of the order of 150 MeV. It is as well one of the key research topics in the future facilities of FAIR and NICA which are under construction in Darmstadt (Germany) and Dubna (Russia), respectively. We present here first results on the cluster dynamics within the model-independent cluster recognition library "phase-space Minimum Spanning Tree" (psMST) applied to different transport approaches: PHQMD, PHSD, SMASH and UrQMD. The psMST is based on the "Minimum Spanning Tree" (MST) algorithm for the cluster recognition which exploits correlations in coordinate space, and it is extended to correlations of baryons in the clusters in momentum space. We show the sensitivity of the cluster formation on the microscopic realization of the n-body dynamics and on the potential interactions in heavy-ion collisions.


title: BAT AGN Spectroscopic Survey XXVII: Scattered X-Ray Radiation in Obscured Active Galactic Nuclei

abstract: Accreting supermassive black holes (SMBHs), also known as active galactic nuclei (AGN), are generally surrounded by large amounts of gas and dust. This surrounding material reprocesses the primary X-ray emission produced close to the SMBH and gives rise to several components in the broadband X-ray spectra of AGN, including a power-law possibly associated with Thomson-scattered radiation. In this work, we study the properties of this scattered component for a sample of 386 hard-X-ray-selected, nearby ($z \sim 0.03$) obscured AGN from the 70-month Swift/BAT catalog. We investigate how the fraction of Thomson-scattered radiation correlates with different physical properties of AGN, such as line-of-sight column density, X-ray luminosity, black hole mass, and Eddington ratio. We find a significant negative correlation between the scattering fraction and the column density. Based on a large number of spectral simulations, we exclude the possibility that this anti-correlation is due to degeneracies between the parameters. The negative correlation also persists when considering different ranges of luminosity, black hole mass, and Eddington ratio. We discuss how this correlation might be either due to the angle dependence of the Thomson cross-section or to more obscured sources having a higher covering factor of the torus. We also find a positive correlation between the scattering fraction and the ratio of [OIII] $\lambda$5007 to X-ray luminosity. This result is consistent with previous studies and suggests that the Thomson-scattered component is associated with the narrow-line region.


title: Nonlinear circular dichroism in Mie-resonant nanoparticle dimers

abstract: We study nonlinear response of a dimer composed of two identical Mie-resonant dielectric nanoparticles illuminated normally by a circularly polarized light. We develop a general theory describing hybridization of multipolar modes of the coupled nanoparticles, and reveal nonvanishing nonlinear circular dichroism (CD) in the second-harmonic generation (SHG) signal enhanced by the multipolar resonances in the dimer provided its axis is oriented under an angle to the crystalline lattice of the dielectric material. We present experimental results for this SHG-CD effect obtained for the AlGaAs dimers placed on an engineered substrate which confirm the basic prediction of our general multipolar hybridization theory.


title: Model Order Reduction based on Direct Normal Form: Application to Large Finite Element MEMS Structures Featuring Internal Resonance

abstract: Dimensionality reduction in mechanical vibratory systems poses challenges for distributed structures including geometric nonlinearities, mainly because of the lack of invariance of the linear subspaces. A reduction method based on direct normal form computation for large finite element (FE) models is here detailed. The main advantage resides in operating directly from the physical space, hence avoiding the computation of the complete eigenfunctions spectrum. Explicit solutions are given, thus enabling a fully non-intrusive version of the reduction method. The reduced dynamics is obtained from the normal form of the geometrically nonlinear mechanical problem, free of non-resonant monomials, and truncated to the selected master coordinates, thus making a direct link with the parametrisation of invariant manifolds. The method is fully expressed with a complex-valued formalism by detailing the homological equations in a systematic manner, and the link with real-valued expressions is established. A special emphasis is put on the treatment of second-order internal resonances and the specific case of a 1:2 resonance is made explicit. Finally, applications to large-scale models of Micro-Electro-Mechanical structures featuring 1:2 and 1:3 resonances are reported, along with considerations on computational efficiency.


title: Discovering an Algorithm Actually Learning Restricted Single Occurrence Regular Expression with Interleaving

abstract: A recent paper proposed an algorithm iSOIRE, which combines single-occurrence automaton (SOA) and maximum independent set (MIS) to learn a subclass single-occurrence regular expressions with interleaving (SOIREs) and claims the learnt expression is SOIRE, which has unrestricted usage for interleaving. However, in reality, the learnt expression still has many restrictions for using interleaving, even does for Kleene-star or interation, i.e, the learnt expression is not an SOIRE, we prove that by examples. In this paper, for the algorithm iSOIRE, we first give the basic notions, then provide analyses about incorrectness, finally present the correct result learnt by iSOIRE. Our theoretical analyses demonstrate that the result derived by iSOIRE belongs to a subclass of SOIREs.


title: Data driven semi-supervised learning

abstract: We consider a novel data driven approach for designing learning algorithms that can effectively learn with only a small number of labeled examples. This is crucial for modern machine learning applications where labels are scarce or expensive to obtain. We focus on graph-based techniques, where the unlabeled examples are connected in a graph under the implicit assumption that similar nodes likely have similar labels. Over the past decades, several elegant graph-based semi-supervised learning algorithms for how to infer the labels of the unlabeled examples given the graph and a few labeled examples have been proposed. However, the problem of how to create the graph (which impacts the practical usefulness of these methods significantly) has been relegated to domain-specific art and heuristics and no general principles have been proposed. In this work we present a novel data driven approach for learning the graph and provide strong formal guarantees in both the distributional and online learning formalizations. We show how to leverage problem instances coming from an underlying problem domain to learn the graph hyperparameters from commonly used parametric families of graphs that perform well on new instances coming from the same domain. We obtain low regret and efficient algorithms in the online setting, and generalization guarantees in the distributional setting. We also show how to combine several very different similarity metrics and learn multiple hyperparameters, providing general techniques to apply to large classes of problems. We expect some of the tools and techniques we develop along the way to be of interest beyond semi-supervised learning, for data driven algorithms for combinatorial problems more generally.


title: Towards Productizing AI/ML Models: An Industry Perspective from Data Scientists

abstract: The transition from AI/ML models to production-ready AI-based systems is a challenge for both data scientists and software engineers. In this paper, we report the results of a workshop conducted in a consulting company to understand how this transition is perceived by practitioners. Starting from the need for making AI experiments reproducible, the main themes that emerged are related to the use of the Jupyter Notebook as the primary prototyping tool, and the lack of support for software engineering best practices as well as data science specific functionalities.


title: Inductive Inference in Supervised Classification

abstract: Inductive inference in supervised classification context constitutes to methods and approaches to assign some objects or items into different predefined classes using a formal rule that is derived from training data and possibly some additional auxiliary information. The optimality of such an assignment varies under different conditions due to intrinsic attributes of the objects being considered for such a task. One of these cases is when all the objects' features are discrete variables with a priori known categories. As another example, one can consider a modification of this case with a priori unknown categories. These two cases are the main focus of this thesis and based on Bayesian inductive theories, de Finetti type exchangeability is a suitable assumption that facilitates the derivation of classifiers in the former scenario. On the contrary, this type of exchangeability is not applicable in the latter case, instead, it is possible to utilise the partition exchangeability due to John Kingman. These two types of exchangeabilities are discussed and furthermore here I investigate inductive supervised classifiers based on both types of exchangeabilities. I further demonstrate that the classifiers based on de Finetti type exchangeability can optimally handle test items independently of each other in the presence of infinite amounts of training data while on the other hand, classifiers based on partition exchangeability still continue to benefit from joint labelling of all the test items. Additionally, it is shown that the inductive learning process for the simultaneous classifier saturates when the amount of test data tends to infinity.


title: Gender and Racial Fairness in Depression Research using Social Media

abstract: Multiple studies have demonstrated that behavior on internet-based social media platforms can be indicative of an individual's mental health status. The widespread availability of such data has spurred interest in mental health research from a computational lens. While previous research has raised concerns about possible biases in models produced from this data, no study has quantified how these biases actually manifest themselves with respect to different demographic groups, such as gender and racial/ethnic groups. Here, we analyze the fairness of depression classifiers trained on Twitter data with respect to gender and racial demographic groups. We find that model performance systematically differs for underrepresented groups and that these discrepancies cannot be fully explained by trivial data representation issues. Our study concludes with recommendations on how to avoid these biases in future research.


title: Argentina Atomic Power. 70 years after the most spectacular announcement: a dream, a disappointment and the origins of national nuclear development

abstract: "On February 16, 1951, at the atomic energy pilot plant on Huemul Island, San Carlos de Bariloche, thermonuclear reactions were carried out under control conditions on a technical scale." This is how Gral. Peron announced, on March 24, 1951, the amazing result of what became known as the Huemul Project. In this article we review that story of misadventures that, despite its extravagant development and announced end, came to mean the beginning of Argentine nuclear development.


title: Non-convex optimization in digital pre-distortion of the signal

abstract: In this paper, we give some observation of applying modern optimization methods for functionals describing digital predistortion (DPD) of signals with orthogonal frequency division multiplexing (OFDM) modulation. The considered family of model functionals is determined by the class of cascade Wiener--Hammerstein models, which can be represented as a computational graph consisting of various nonlinear blocks. To assess optimization methods with the best convergence depth and rate as a properties of this models family we multilaterally consider modern techniques used in optimizing neural networks and numerous numerical methods used to optimize non-convex multimodal functions. The research emphasizes the most effective of the considered techniques and describes several useful observations about the model properties and optimization methods behavior.


title: The Cayley transform of the generator of a polynomially stable $C_0$-semigroup

abstract: In this paper, we study the decay rate of the Cayley transform of the generator of a polynomially stable $C_0$-semigroup. To estimate the decay rate of the Cayley transform, for polynomial stability. Using this integral condition, we relate polynomial stability to Lyapunov equations. We also study robustness of polynomial stability for a certain class of structured perturbations.


title: Neural Field Models: A mathematical overview and unifying framework

abstract: Mathematical modelling of the macroscopic electrical activity of the brain is highly non-trivial and requires a detailed understanding of not only the associated mathematical techniques, but also the underlying physiology and anatomy. Neural field theory is a population-level approach to modelling the non-linear dynamics of large populations of neurons, while maintaining a degree of mathematical tractability. This class of models provides a solid theoretical perspective on fundamental processes of neural tissue such as state transitions between different brain activities as observed during epilepsy or sleep. Various anatomical, physiological, and mathematical assumptions are essential for deriving a minimal set of equations that strike a balance between biophysical realism and mathematical tractability. However, these assumptions are not always made explicit throughout the literature. Even though neural field models (NFMs) first appeared in the literature in the early 1970's, the relationships between them have not been systematically addressed. This may partially be explained by the fact that the inter-dependencies between these models are often implicit and non-trivial. Herein we provide a review of key stages of the history and development of neural field theory and contemporary uses of this branch of mathematical neuroscience. First, the principles of the theory are summarised throughout a discussion of the pioneering models by Wilson and Cowan, Amari and Nunez. Upon thorough review of these models, we then present a unified mathematical framework in which all neural field models can be derived by applying different assumptions. We then use this framework to i) derive contemporary models by Robinson, Jansen and Rit, Wendling, Liley, and Steyn-Ross, and ii) make explicit the many significant inherited assumptions that exist in the current literature.


title: Non-locality and gravitoelectromagnetic duality

abstract: The weak-field Schwarzschild and NUT solutions of general relativity are gravitoelectromagnetically dual to each other, except on the positive $z$-axis. The presence of non-locality weakens this duality and violates it within a smeared region around the positive $z$-axis, whose typical transverse size is given by the scale of non-locality. We restore an exact non-local gravitoelectromagnetic duality everywhere via a manifestly dual modification of the linearized non-local field equations. In the limit of vanishing non-locality we recover the well-known results from weak-field general relativity.


title: Finite-Horizon, Energy-Optimal Trajectories in Unsteady Flows

abstract: Intelligent mobile sensors, such as uninhabited aerial or underwater vehicles, are becoming prevalent in environmental sensing and monitoring applications. These active sensing platforms operate in unsteady fluid flows, including windy urban environments, hurricanes, and ocean currents. Often constrained in their actuation capabilities, the dynamics of these mobile sensors depend strongly on the background flow, making their deployment and control particularly challenging. Therefore, efficient trajectory planning with partial knowledge about the background flow is essential for teams of mobile sensors to adaptively sense and monitor their environments. In this work, we investigate the use of finite-horizon model predictive control (MPC) for the energy-efficient trajectory planning of an active mobile sensor in an unsteady fluid flow field. We uncover connections between the finite-time optimal trajectories and finite-time Lyapunov exponents (FTLE) of the background flow, confirming that energy-efficient trajectories exploit invariant coherent structures in the flow. We demonstrate our findings on the unsteady double gyre vector field, which is a canonical model for chaotic mixing in the ocean. We present an exhaustive search through critical MPC parameters including the prediction horizon, maximum sensor actuation, and relative penalty on the accumulated state error and actuation effort. We find that even relatively short prediction horizons can often yield nearly energy-optimal trajectories. These results are promising for the adaptive planning of energy-efficient trajectories for swarms of mobile sensors in distributed sensing and monitoring.


title: Radio frequency spectrum analyzer with a 5 THz bandwidth based on nonlinear optics in a CMOS compatible high-index doped silica waveguide

abstract: We report an all-optical radio-frequency (RF) spectrum analyzer with a bandwidth greater than 5 terahertz (THz), based on a 50-cm long spiral waveguide in a CMOS-compatible high-index doped silica platform. By carefully mapping out the dispersion profile of the waveguides for different thicknesses, we identify the optimal design to achieve near zero dispersion in the C-band. To demonstrate the capability of the RF spectrum analyzer, we measure the optical output of a femtosecond fiber laser with an ultrafast optical RF spectrum in the terahertz regime.


title: KGTorrent: A Dataset of Python Jupyter Notebooks from Kaggle

abstract: Computational notebooks have become the tool of choice for many data scientists and practitioners for performing analyses and disseminating results. Despite their increasing popularity, the research community cannot yet count on a large, curated dataset of computational notebooks. In this paper, we fill this gap by introducing KGTorrent, a dataset of Python Jupyter notebooks with rich metadata retrieved from Kaggle, a platform hosting data science competitions for learners and practitioners with any levels of expertise. We describe how we built KGTorrent, and provide instructions on how to use it and refresh the collection to keep it up to date. Our vision is that the research community will use KGTorrent to study how data scientists, especially practitioners, use Jupyter Notebook in the wild and identify potential shortcomings to inform the design of its future extensions.


title: CDFI: Compression-Driven Network Design for Frame Interpolation

abstract: DNN-based frame interpolation--that generates the intermediate frames given two consecutive frames--typically relies on heavy model architectures with a huge number of features, preventing them from being deployed on systems with limited resources, e.g., mobile devices. We propose a compression-driven network design for frame interpolation (CDFI), that leverages model pruning through sparsity-inducing optimization to significantly reduce the model size while achieving superior performance. Concretely, we first compress the recently proposed AdaCoF model and show that a 10X compressed AdaCoF performs similarly as its original counterpart; then we further improve this compressed model by introducing a multi-resolution warping module, which boosts visual consistencies with multi-level details. As a consequence, we achieve a significant performance gain with only a quarter in size compared with the original AdaCoF. Moreover, our model performs favorably against other state-of-the-arts in a broad range of datasets. Finally, the proposed compression-driven framework is generic and can be easily transferred to other DNN-based frame interpolation algorithm. Our source code is available at https://github.com/tding1/CDFI.


title: Interaction-resistant metals in multicomponent Fermi systems

abstract: We analyze two different fermionic systems that defy Mott localization showing a metallic ground state at integer filling and very large Coulomb repulsion. The first is a multiorbital Hubbard model with a Hund's coupling, where this physics has been widely studied and the new metallic state is called a Hund's metal, and the second is a SU(3) Hubbard model with a patterned single-particle potential designed to display a similar interaction-resistant metal in a set-up which can be implemented with SU($N$) ultracold atoms. With simple analytical arguments and exact numerical diagonalization of the Hamiltonians for a minimal three-site system, we demonstrate that the interaction-resistant metal emerges in both cases as a compromise between two different insulating solutions which are stabilized by different terms of the models. This provides a strong evidence that the Hund's metal is a specific realization of a more general phenomenon which can be realized in various strongly correlated systems.


title: Physics-Inspired Heuristics for Soft MIMO Detection in 5G New Radio and Beyond

abstract: Overcoming the conventional trade-off between throughput and bit error rate (BER) performance, versus computational complexity is a long-term challenge for uplink Multiple-Input Multiple-Output (MIMO) detection in base station design for the cellular 5G New Radio roadmap, as well as in next generation wireless local area networks. In this work, we present ParaMax, a MIMO detector architecture that for the first time brings to bear physics-inspired parallel tempering algorithmic techniques [28, 50, 67] on this class of problems. ParaMax can achieve near optimal maximum-likelihood (ML) throughput performance in the Large MIMO regime, Massive MIMO systems where the base station has additional RF chains, to approach the number of base station antennas, in order to support even more parallel spatial streams. ParaMax is able to achieve a near ML-BER performance up to 160x160 and 80x80 Large MIMO for low-order modulations such as BPSK and QPSK, respectively, only requiring less than tens of processing elements. With respect to Massive MIMO systems, in 12x24 MIMO with 16-QAM at SNR 16 dB, ParaMax achieves 330 Mbits/s near-optimal system throughput with 4--8 processing elements per subcarrier, which is approximately 1.4x throughput than linear detector-based Massive MIMO systems.


title: Dynamic Grasping with Reachability and Motion Awareness

abstract: Grasping in dynamic environments presents a unique set of challenges. A stable and reachable grasp can become unreachable and unstable as the target object moves, motion planning needs to be adaptive and in real time, the delay in computation makes prediction necessary. In this paper, we present a dynamic grasping framework that is reachability-aware and motion-aware. Specifically, we model the reachability space of the robot using a signed distance field which enables us to quickly screen unreachable grasps. Also, we train a neural network to predict the grasp quality conditioned on the current motion of the target. Using these as ranking functions, we quickly filter a large grasp database to a few grasps in real time. In addition, we present a seeding approach for arm motion generation that utilizes solution from previous time step. This quickly generates a new arm trajectory that is close to the previous plan and prevents fluctuation. We implement a recurrent neural network (RNN) for modelling and predicting the object motion. Our extensive experiments demonstrate the importance of each of these components and we validate our pipeline on a real robot.


title: Estimation and false discovery control for the analysis of environmental mixtures

abstract: The analysis of environmental mixtures is of growing importance in environmental epidemiology, and one of the key goals in such analyses is to identify exposures and their interactions that are associated with adverse health outcomes. Typical approaches utilize flexible regression models combined with variable selection to identify important exposures and estimate a potentially nonlinear relationship with the outcome of interest. Despite this surge in interest, no approaches to date can identify exposures and interactions while controlling any form of error rates with respect to exposure selection. We propose two novel approaches to estimating the health effects of environmental mixtures that simultaneously 1) Estimate and provide valid inference for the overall mixture effect, and 2) identify important exposures and interactions while controlling the false discovery rate. We show that this can lead to substantial power gains to detect weak effects of environmental exposures. We apply our approaches to a study of persistent organic pollutants and find that our approach is able to identify more interactions than existing approaches.


title: Analysis of intensity correlation enhanced plasmonic structured illumination microscopy

abstract: We propose to enhance the performance of localized plasmon structured illumination microscopy (LP-SIM) via intensity correlations. LP-SIM uses sub-wavelength illumination patterns to encode high spatial frequency information. It can enhance the resolution up to three-fold before gaps in the OTF support arise. For blinking fluorophores or for quantum antibunching an intensity correlation analysis induces higher harmonics of the illumination pattern and enlarges the effective OTF. This enables ultrahigh resolutions without gaps in the OTF support, and thus a fully deterministic imaging scheme. We present simulations that include shot and external noise and demonstrate the resolution power under realistic photon budgets. The technique has potential in light microscopy where low-intensity illumination is paramount while aiming for high spatial but moderate temporal resolutions.


title: A baseline for multiple-choice testing in the university classroom

abstract: There is a broad literature in multiple-choice test development, both in terms of item-writing guidelines and psychometric functionality as a measurement tool. However, most of the published literature concerns multiple-choice testing in the context of expert-designed high-stakes standardized assessments, with little attention being paid to the use of the technique within non-expert instructor-created classroom examinations. In this work we present a quantitative analysis of a large corpus of multiple-choice tests deployed in the classrooms of a primarily undergraduate university in Canada. Our report aims to establish three related things: First, reporting on the functional and psychometric operation of 182 multiple-choice tests deployed in a variety of courses at all undergraduate levels of education establishes a much-needed baseline for actual as-deployed classroom tests. Second, we motivate and present modified statistical measures--such as item-excluded correlation measures of discrimination and length-normalized measures of reliability--that should serve as useful parameters for future comparisons of classroom test psychometrics. Finally, we use the broad empirical data from our survey of tests to update widely used item quality guidelines.


title: On the validity of the stochastic quasi-steady-state approximation in open enzyme catalyzed reactions: Timescale separation or singular perturbation?

abstract: The quasi-steady-state approximation is widely used to develop simplified deterministic or stochastic models of enzyme catalyzed reactions. In deterministic models, the quasi-steady-state approximation can be mathematically justified from singular perturbation theory. For several closed enzymatic reactions, the homologous extension of the quasi-steady-state approximation to the stochastic regime, known as the stochastic quasi-steady-state approximation, has been shown to be accurate under the analogous conditions that permit the quasi-steady-state reduction of the deterministic counterpart. However, it was recently demonstrated that the extension of the stochastic quasi-steady-state approximation to an open Michaelis--Menten reaction mechanism is only valid under a condition that is far more restrictive than the qualifier that ensures the validity of its corresponding deterministic quasi-steady-state approximation. In this paper, we suggest a possible explanation for this discrepancy from the lens of geometric singular perturbation theory. In so doing, we illustrate a misconception in the application of the quasi-steady-state approximation: timescale separation does not imply singular perturbation.

categories: math.DS cond-mat.stat-mech physics.chem-ph q-bio.QM


title: CLTA: Contents and Length-based Temporal Attention for Few-shot Action Recognition

abstract: Few-shot action recognition has attracted increasing attention due to the difficulty in acquiring the properly labelled training samples. Current works have shown that preserving spatial information and comparing video descriptors are crucial for few-shot action recognition. However, the importance of preserving temporal information is not well discussed. In this paper, we propose a Contents and Length-based Temporal Attention (CLTA) model, which learns customized temporal attention for the individual video to tackle the few-shot action recognition problem. CLTA utilizes the Gaussian likelihood function as the template to generate temporal attention and trains the learning matrices to study the mean and standard deviation based on both frame contents and length. We show that even a not fine-tuned backbone with an ordinary softmax classifier can still achieve similar or better results compared to the state-of-the-art few-shot action recognition with precisely captured temporal attention.


title: Nonparametric and high-dimensional functional graphical models

abstract: We consider the problem of constructing nonparametric undirected graphical models for high-dimensional functional data. Most existing statistical methods in this context assume either a Gaussian distribution on the vertices or linear conditional means. In this article we provide a more flexible model which relaxes the linearity assumption by replacing it by an arbitrary additive form. The use of functional principal components offers an estimation strategy that uses a group lasso penalty to estimate the relevant edges of the graph. We establish statistical guarantees for the resulting estimators, which can be used to prove consistency if the dimension and the number of functional principal components diverge to infinity with the sample size. We also investigate the empirical performance of our method through simulation studies and a real data application.


title: Quasilinear gyrokinetic theory: A derivation of QuaLiKiz

abstract: In order to predict and analyze turbulent transport in tokamaks, it is important to model transport that arises from microinstabilities. For this task, quasilinear codes have been developed that seek to calculate particle, angular momentum, and heat fluxes both quickly and accurately. In this tutorial, we present a derivation of one such code known as QuaLiKiz, a quasilinear gyrokinetic transport code. The goal of this derivation is to provide a self-contained and complete description of the underlying physics and mathematics of QuaLiKiz from first principles. This work serves both as a comprehensive overview of QuaLiKiz specifically as well as an illustration for deriving quasilinear models in general.


title: Towards an Understanding of Why and How ICT Projects Are Initiated: Analysis via Repertory Grid

abstract: Contemporary business innovation relies increasingly on information and communications technology (ICT) solutions. As ICT initiatives are generally implemented via projects the management of ICT projects has come under increasing scrutiny. ICT projects continue to fail; as a result, while research in ICT project management has indeed increased, many challenges for research and practice remain. Many studies have addressed the execution and management of ICT projects and the many factors that might relate to project outcomes. Very few, however, have considered ICT project initiation and the crucial decisions made at that very early, pre-life cycle stage. The primary intent of this research is therefore to investigate ICT projects with a particular focus on their initiation. In doing so we wished to understand why ICT projects are started, and how they are moved from idea or proposal to supported reality. A combination of semi-structured interviews and the repertory grid data collection and analysis method was employed to investigate and validate the motivating factors that influence individual IT Managers' project initiation decisions and the methods they use to transition from idea to enacted project. Our results showed that there are indeed multiple underlying reasons for the decisions made at this early stage and that there are some especially common decision drivers. Some were expected, in the sense that they mapped to recommended best practice. For instance, most projects are motivated by a desire to achieve efficiencies or cost savings, and their potential tends to be assessed using cost benefit analysis. Other results were more surprising - competitor pressure was not a common driver for ICT project initiation in our analysis. Unsurprisingly, formal evaluation methods are more frequently used to assess project proposals when those projects are larger and higher profile. (Abridged)


title: Generic Perceptual Loss for Modeling Structured Output Dependencies

abstract: The perceptual loss has been widely used as an effective loss term in image synthesis tasks including image super-resolution, and style transfer. It was believed that the success lies in the high-level perceptual feature representations extracted from CNNs pretrained with a large set of images. Here we reveal that, what matters is the network structure instead of the trained weights. Without any learning, the structure of a deep network is sufficient to capture the dependencies between multiple levels of variable statistics using multiple layers of CNNs. This insight removes the requirements of pre-training and a particular network structure (commonly, VGG) that are previously assumed for the perceptual loss, thus enabling a significantly wider range of applications. To this end, we demonstrate that a randomly-weighted deep CNN can be used to model the structured dependencies of outputs. On a few dense per-pixel prediction tasks such as semantic segmentation, depth estimation and instance segmentation, we show improved results of using the extended randomized perceptual loss, compared to the baselines using pixel-wise loss alone. We hope that this simple, extended perceptual loss may serve as a generic structured-output loss that is applicable to most structured output learning tasks.


title: Quantum-inspired Multimodal Fusion for Video Sentiment Analysis

abstract: We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand manner. We address this limitation with inspirations from quantum theory, which contains principled methods for modeling complicated interactions and correlations. In our quantum-inspired framework, the word interaction within a single modality and the interaction across modalities are formulated with superposition and entanglement respectively at different stages. The complex-valued neural network implementation of the framework achieves comparable results to state-of-the-art systems on two benchmarking video sentiment analysis datasets. In the meantime, we produce the unimodal and bimodal sentiment directly from the model to interpret the entangled decision.


title: Enabling OpenMP Task Parallelism on Multi-FPGAs

abstract: FPGA-based hardware accelerators have received increasing attention mainly due to their ability to accelerate deep pipelined applications, thus resulting in higher computational performance and energy efficiency. Nevertheless, the amount of resources available on even the most powerful FPGA is still not enough to speed up very large modern workloads. To achieve that, FPGAs need to be interconnected in a Multi-FPGA architecture capable of accelerating a single application. However, programming such architecture is a challenging endeavor that still requires additional research. This paper extends the OpenMP task-based computation offloading model to enable a number of FPGAs to work together as a single Multi-FPGA architecture. Experimental results for a set of OpenMP stencil applications running on a Multi-FPGA platform consisting of 6 Xilinx VC709 boards interconnected through fiber-optic links have shown close to linear speedups as the number of FPGAs and IP-cores per FPGA increase.


title: Hopper: Multi-hop Transformer for Spatiotemporal Reasoning

abstract: This paper considers the problem of spatiotemporal object-centric reasoning in videos. Central to our approach is the notion of object permanence, i.e., the ability to reason about the location of objects as they move through the video while being occluded, contained or carried by other objects. Existing deep learning based approaches often suffer from spatiotemporal biases when applied to video reasoning problems. We propose Hopper, which uses a Multi-hop Transformer for reasoning object permanence in videos. Given a video and a localization query, Hopper reasons over image and object tracks to automatically hop over critical frames in an iterative fashion to predict the final position of the object of interest. We demonstrate the effectiveness of using a contrastive loss to reduce spatiotemporal biases. We evaluate over CATER dataset and find that Hopper achieves 73.2% Top-1 accuracy using just 1 FPS by hopping through just a few critical frames. We also demonstrate Hopper can perform long-term reasoning by building a CATER-h dataset that requires multi-step reasoning to localize objects of interest correctly.


title: The localization of quantum random walks on sierpinski gaskets

abstract: We consider the discrete time quantum random walks on a Sierpinski gasket. We study the hitting probability as the level of fractal goes to infinity in terms of their localization exponents $\beta_w$ , total variation exponents $\delta_w$ and relative entropy exponents $\eta_w$ . We define and solve the amplitude Green functions recursively when the level of the fractal graph goes to infinity. We obtain exact recursive formulas for the amplitude Green functions, based on which the hitting probabilities and expectation of the first-passage time are calculated. Using the recursive formula with the aid of Monte Carlo integration, we evaluate their numerical values. We also show that when the level of the fractal graph goes to infinity, with probability 1, the quantum random walks will return to origin, i.e., the quantum walks on Sierpinski gasket are recurrent.


title: Two-phase Interactions between Propagating Shock Waves and Evaporating Water Droplets

abstract: One-dimensional numerical simulations based on hybrid Eulerian-Lagrangian method are performed to study the interactions between propagating shocks and dispersed evaporating water droplets. Two-way coupling for exchanges of mass, momentum, energy and vapour species is adopted for the dilute two-phase gas-droplet flows. Interphase interactions and droplet breakup dynamics are investigated with initial droplet diameters of 30, 50, 70 and 90 {\mu}m under an incident shock wave Mach number of 1.3. Novel two-phase flow phenomena are observed when droplet breakup occurs. First, droplets near the two-phase contact surface show obvious dispersed distribution because of the reflected pressure wave that propagates in the reverse direction of the leading shock. The reflected pressure wave grows stronger for larger droplets. Second, spatial oscillations of the gas phase pressure, droplet quantities (e.g., diameter and net force) and two-phase interactions (e.g., mass, momentum, and energy exchange), are observed in the post-shock region when droplet breakup occurs, which are caused by shock / droplet interactions. Third, the spatial distribution of droplets (i.e., number density, volume fraction) also shows strong oscillation in the post-shock region when droplet breakup occurs, which is caused by the oscillating force exerted on the droplets.


title: Systematics and Consequences of Comet Nucleus Outgassing Torques

abstract: Anisotropic outgassing from comets exerts a torque sufficient to rapidly change the angular momentum of the nucleus, potentially leading to rotational instability. Here, we use empirical measures of spin changes in a sample of comets to characterize the torques and to compare them with expectations from a simple model. Both the data and the model show that the characteristic spin-up timescale, $\tau_s$, is a strong function of nucleus radius, $r_n$. Empirically, we find that the timescale for comets (most with perihelion 1 to 2 AU and eccentricity $\sim$0.5) varies as $\tau_s \sim 100 r_n^{2}$, where $r_n$ is expressed in kilometers and $\tau_s$ is in years. The fraction of the nucleus surface that is active varies as $f_A \sim 0.1 r_n^{-2}$. We find that the median value of the dimensionless moment arm of the torque is $k_T$ = 0.007 (i.e. $\sim$0.7\% of the escaping momentum torques the nucleus), with weak ($<$3$\sigma$) evidence for a size dependence $k_T \sim 10^{-3} r_n^2$. Sub-kilometer nuclei have spin-up timescales comparable to their orbital periods, confirming that outgassing torques are quickly capable of driving small nuclei towards rotational disruption. Torque-induced rotational instability likely accounts for the paucity of sub-kilometer short-period cometary nuclei, and for the pre-perihelion destruction of sungrazing comets. Torques from sustained outgassing on small active asteroids can rival YORP torques, even for very small ($\lesssim$1 g s$^{-1}$) mass loss rates. Finally, we highlight the important role played by observational biases in the measured distributions of $\tau_s$, $f_A$ and $k_T$.


title: Transfer Learning of Memory Kernels in Coarse-grained Modeling

abstract: The present work concerns the transferability of coarse-grained (CG) modeling in reproducing the dynamic properties of the reference atomistic systems across a range of parameters. In particular, we focus on implicit-solvent CG modeling of polymer solutions. The CG model is based on the generalized Langevin equation, where the memory kernel plays the critical role in determining the dynamics in all time scales. Thus, we propose methods for transfer learning of memory kernels. The key ingredient of our methods is Gaussian process regression. By integration with the model order reduction via proper orthogonal decomposition and the active learning technique, the transfer learning can be practically efficient and requires minimum training data. Through two example polymer solution systems, we demonstrate the accuracy and efficiency of the proposed transfer learning methods in the construction of transferable memory kernels. The transferability allows for out-of-sample predictions, even in the extrapolated domain of parameters. Built on the transferable memory kernels, the CG models can reproduce the dynamic properties of polymers in all time scales at different thermodynamic conditions (such as temperature and solvent viscosity) and for different systems with varying concentrations and lengths of polymers.


title: An Experiment Study on Federated LearningTestbed

abstract: While the Internet of Things (IoT) can benefit from machine learning by outsourcing model training on the cloud, user data exposure to an untrusted cloud service provider can pose threat to user privacy. Recently, federated learning is proposed as an approach for privacy-preserving machine learning (PPML) for the IoT, while its practicability remains unclear. This work presents the evaluation on the efficiency and privacy performance of a readily available federated learning framework based on PySyft, a Python library for distributed deep learning. It is observed that the training speed of the framework is significantly slower than of the centralized approach due to communication overhead. Meanwhile, the framework bears some vulnerability to potential man-in-the-middle attacks at the network level. The report serves as a starting point for PPML performance analysis and suggests the future direction for PPML framework development.


title: On the location of zeros of the Laplacian matching polynomials of graphs

abstract: The Laplacian matching polynomial of a graph $G$, denoted by $\mathscr{L\hspace{-0.7mm}M}(G,x)$, is a new graph polynomial whose all roots are nonnegative real numbers. In this paper, we investigate the location of zeros of the Laplacian matching polynomials. Let $G$ be a connected graph. We show that $0$ is a root of $\mathscr{L\hspace{-0.7mm}M}(G, x)$ if and only if $G$ is a tree. We prove that the number of distinct positive zeros of $\mathscr{L\hspace{-0.7mm}M}(G,x)$ is at least equal to the length of the longest path in $G$. It is also established that the zeros of $\mathscr{L\hspace{-0.7mm}M}(G,x)$ and $\mathscr{L\hspace{-0.7mm}M}(G-e,x)$ interlace for each edge $e$ of $G$. Using the path-tree of $G$, we present a linear algebraic approach to investigate the largest zero of $\mathscr{L\hspace{-0.7mm}M}(G,x)$ and particularly to give tight upper and lower bounds on it.


title: A stochastic model for the hydrodynamic force in Euler--Lagrange simulations of particle-laden flows

abstract: Standard Eulerian--Lagrangian (EL) methods generally employ drag force models that only represent the mean hydrodynamic force acting upon a particle-laden suspension. Consequently, higher-order drag force statistics, arising from neighbor-induced flow perturbations, are not accounted for; with implications on predictions for particle velocity variance and dispersion. We develop a force Langevin (FL) model that treats neighbor-induced drag fluctuations as a stochastic force within an EL framework. The stochastic drag force follows an Ornstein-Uhlenbeck process and requires closure of the integral time scale for the fluctuating hydrodynamic force and the standard deviation in drag. The former is closed using the mean-free time between successive collisions, derived from the kinetic theory of non-uniform gases. For the latter, particle-resolved direct numerical simulation (PR--DNS) of fixed particle assemblies is utilized to develop a correlation. The stochastic EL framework specifies unresolved drag force statistics, leading to the correct evolution and sustainment of particle velocity variance over a wide range of Reynolds numbers and solids volume fractions when compared to PR--DNS of freely-evolving homogeneous suspensions. By contrast, standard EL infers drag statistics from variations in the resolved flow and thus under-predicts the growth and steady particle velocity variance in homogeneous suspensions. Velocity statistics from standard EL approaches are found to depend on the bandwidth of the projection function used for two-way momentum coupling, while results obtained from the stochastic EL approach are insensitive to the projection bandwidth.


title: Empirical Optimization on Post-Disaster Communication Restoration for Social Equality

abstract: Disasters are constant threats to humankind, and beyond losses in lives, they cause many implicit yet profound societal issues such as wealth disparity and digital divide. Among those recovery measures in the aftermath of disasters, restoring and improving communication services is of vital importance. Although existing works have proposed many architectural and protocol designs, none of them have taken human factors and social equality into consideration. Recent sociological studies have shown that people from marginalized groups (e.g., minority, low income, and poor education) are more vulnerable to communication outages. In this work, we take pioneering efforts in integrating human factors into an empirical optimization model to determine strategies for post-disaster communication restoration. We cast the design into a mix-integer non-linear programming problem, which is proven too complex to be solved. Through a suite of convex relaxations, we then develop heuristic algorithms to efficiently solve the transformed optimization problem. Based on a collected dataset, we further evaluate and demonstrate how our design will prioritize communication services for vulnerable people and promote social equality compared with an existing modeling benchmark.


title: Dynamic Transfer for Multi-Source Domain Adaptation

abstract: Recent works of multi-source domain adaptation focus on learning a domain-agnostic model, of which the parameters are static. However, such a static model is difficult to handle conflicts across multiple domains, and suffers from a performance degradation in both source domains and target domain. In this paper, we present dynamic transfer to address domain conflicts, where the model parameters are adapted to samples. The key insight is that adapting model across domains is achieved via adapting model across samples. Thus, it breaks down source domain barriers and turns multi-source domains into a single-source domain. This also simplifies the alignment between source and target domains, as it only requires the target domain to be aligned with any part of the union of source domains. Furthermore, we find dynamic transfer can be simply modeled by aggregating residual matrices and a static convolution matrix. Experimental results show that, without using domain labels, our dynamic transfer outperforms the state-of-the-art method by more than 3% on the large multi-source domain adaptation datasets -- DomainNet. Source code is at https://github.com/liyunsheng13/DRT.


title: HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmark

abstract: HardWare-aware Neural Architecture Search (HW-NAS) has recently gained tremendous attention by automating the design of DNNs deployed in more resource-constrained daily life devices. Despite its promising performance, developing optimal HW-NAS solutions can be prohibitively challenging as it requires cross-disciplinary knowledge in the algorithm, micro-architecture, and device-specific compilation. First, to determine the hardware-cost to be incorporated into the NAS process, existing works mostly adopt either pre-collected hardware-cost look-up tables or device-specific hardware-cost models. Both of them limit the development of HW-NAS innovations and impose a barrier-to-entry to non-hardware experts. Second, similar to generic NAS, it can be notoriously difficult to benchmark HW-NAS algorithms due to their significant required computational resources and the differences in adopted search spaces, hyperparameters, and hardware devices. To this end, we develop HW-NAS-Bench, the first public dataset for HW-NAS research which aims to democratize HW-NAS research to non-hardware experts and make HW-NAS research more reproducible and accessible. To design HW-NAS-Bench, we carefully collected the measured/estimated hardware performance of all the networks in the search spaces of both NAS-Bench-201 and FBNet, on six hardware devices that fall into three categories (i.e., commercial edge devices, FPGA, and ASIC). Furthermore, we provide a comprehensive analysis of the collected measurements in HW-NAS-Bench to provide insights for HW-NAS research. Finally, we demonstrate exemplary user cases to (1) show that HW-NAS-Bench allows non-hardware experts to perform HW-NAS by simply querying it and (2) verify that dedicated device-specific HW-NAS can indeed lead to optimal accuracy-cost trade-offs. The codes and all collected data are available at https://github.com/RICE-EIC/HW-NAS-Bench.


title: The evolving ecosystem of COVID-19 contact tracing applications

abstract: Since the outbreak of the novel coronavirus, COVID-19, there has been increased interest in the use of digital contact tracing as a means of stopping chains of viral transmission, provoking alarm from privacy advocates. Concerning the ethics of this technology, recent studies have predominantly focused on (1) the formation of guidelines for ethical contact tracing, (2) the analysis of specific implementations, or (3) the review of a select number of contact tracing applications and their relevant privacy or ethical implications. In this study, we provide a comprehensive survey of the evolving ecosystem of COVID-19 tracing applications, examining 152 contact tracing applications and assessing the extent to which they comply with existing guidelines for ethical contact tracing. The assessed criteria cover areas including data collection and storage, transparency and consent, and whether the implementation is open source. We find that although many apps released early in the pandemic fell short of best practices, apps released more recently, following the publication of the Apple/Google exposure notification protocol, have tended to be more closely aligned with ethical contact tracing principles. This dataset will be publicly available and may be updated as the pandemic continues.


title: Isometric Actions and Finite Approximations

abstract: We show that every isometric action on a Cantor set is conjugate to an inverse limit of actions on finite sets; and that every isometric action by a finitely generated amenable group is residually finite.


title: Progress on the localization number of a graph

abstract: We highlight new results on the localization number of a graph, a parameter derived from the localization graph searching game. After introducing the game and providing an overview of existing results, we describe recent results on the localization number. We describe bounds or exact values of the localization number of incidence graphs of designs, polarity graphs, and Kneser graphs.


title: On the index of minimal surfaces with free boundary in a half-space

abstract: We study the Morse index of minimal surfaces with free boundary in a half-space. We improve previous estimates relating the Neumann index to the Dirichlet index and use this to answer a question of Ambrozio, Buzano, Carlotto, and Sharp concerning the non-existence of index two embedded minimal surfaces with free boundary in a half-space. We also give a simplified proof of a result of Chodosh and Maximo concerning lower bounds for the index of the Costa deformation family.


title: Sharp Sobolev inequalities involving boundary terms revisited

abstract: We revisit the sharp Sobolev inequalities involving boundary terms on Riemannian manifolds with boundaries proved by \emph{[Y.Y. Li and M. Zhu, Geom. Funct. Anal. \textbf{8} (1998), 59--87.]} and explore the role of the mean curvature.


title: Cognitive simulation models for inertial confinement fusion: Combining simulation and experimental data

abstract: The design space for inertial confinement fusion (ICF) experiments is vast and experiments are extremely expensive. Researchers rely heavily on computer simulations to explore the design space in search of high-performing implosions. However, ICF multiphysics codes must make simplifying assumptions, and thus deviate from experimental measurements for complex implosions. For more effective design and investigation, simulations require input from past experimental data to better predict future performance. In this work, we describe a cognitive simulation method for combining simulation and experimental data into a common, predictive model. This method leverages a machine learning technique called transfer learning, the process of taking a model trained to solve one task, and partially retraining it on a sparse dataset to solve a different, but related task. In the context of ICF design, neural network models trained on large simulation databases and partially retrained on experimental data, producing models that are far more accurate than simulations alone. We demonstrate improved model performance for a range of ICF experiments at the National Ignition Facility, and predict the outcome of recent experiments with less than ten percent error for several key observables. We discuss how the methods might be used to carry out a data-driven experimental campaign to optimize performance, illustrating the key product -- models that become increasingly accurate as data is acquired.


title: Molecular contrails -- triggered contraction by passages of massive objects through molecular clouds

abstract: We study the effects of passages of compact objects such as stars, star clusters, and black holes through molecular clouds, and propose that the gravitational interaction between the compact object and the ambient gas can lead to the formation of thin and collimated features made of dense gas, which we call "molecular contrails". Supercritical contrails can collapse further leading to triggered star formation. The width of a molecular contrail is determined by the mass and velocity of the compact object and the velocity dispersion of the ambient molecular medium. Under typical conditions in the Milky Way, passages of stellar-mass objects lead to the formation of width $d\gtrsim 0.01\;\rm {parsec}$ contrails, and passages of star clusters lead to the formation of $d\gtrsim 1\;\rm {parsec}$ contrails. We present a few molecular contrail candidates from both categories identified from ALMA 1.3mm continuum observations of star-forming regions and the $^{13}$CO(1-0) map from the Galactic Ring Survey respectively. The contrails represent an overlooked channel where stars and gas in the Galactic disk interact to for structures. They also present a potential way of detecting dark compact objects in the Milky Way.


title: Fusion-FlowNet: Energy-Efficient Optical Flow Estimation using Sensor Fusion and Deep Fused Spiking-Analog Network Architectures

abstract: Standard frame-based cameras that sample light intensity frames are heavily impacted by motion blur for high-speed motion and fail to perceive scene accurately when the dynamic range is high. Event-based cameras, on the other hand, overcome these limitations by asynchronously detecting the variation in individual pixel intensities. However, event cameras only provide information about pixels in motion, leading to sparse data. Hence, estimating the overall dense behavior of pixels is difficult. To address such issues associated with the sensors, we present Fusion-FlowNet, a sensor fusion framework for energy-efficient optical flow estimation using both frame- and event-based sensors, leveraging their complementary characteristics. Our proposed network architecture is also a fusion of Spiking Neural Networks (SNNs) and Analog Neural Networks (ANNs) where each network is designed to simultaneously process asynchronous event streams and regular frame-based images, respectively. Our network is end-to-end trained using unsupervised learning to avoid expensive video annotations. The method generalizes well across distinct environments (rapid motion and challenging lighting conditions) and demonstrates state-of-the-art optical flow prediction on the Multi-Vehicle Stereo Event Camera (MVSEC) dataset. Furthermore, our network offers substantial savings in terms of the number of network parameters and computational energy cost.


title: Mass-velocity dispersion relation by using the \textit{Gaia} data and its effect on interpreting short-duration and degenerate microlensing events

abstract: Gravitational microlensing, the lensing of stars in the Milky Way galaxy with other stars, has been used for exploring compact dark matter objects, exoplanets, and black holes. The duration of microlensing events, the so-called Einstein crossing time, is a function of distance, mass, and velocities of lens objects. Lenses with different ages and masses might have various characteristic velocities inside the galaxy and this might lead to our misinterpretation of microlensing events. In this work, we use the \gaia~archived data to find a relation between the velocity dispersion and mass, and the age of stars. This mass-velocity dispersion relation confirms the known age-velocity relation for early-type and massive stars, and additionally reveals a dependence of stellar velocity dispersion on the mass for low-mass and late-type stars at $2$-$3$ sigma level. By considering this correlation, we simulate short-duration microlensing events due to brown dwarfs. From this simulation, we conclude that lens masses are underestimated by $\sim 2.5$-$5.5\%$ while modeling short-duration and degenerate microlensing events with the Bayesian analysis.


title: Comprehensive Survey and Taxonomies of False Injection Attacks in Smart Grid: Attack Models, Targets, and Impacts

abstract: Smart Grid has rapidly transformed the centrally controlled power system into a massively interconnected cyber-physical system that benefits from the revolutions happening in the communications (e.g. 5G) and the growing proliferation of the Internet of Things devices (such as smart metres and intelligent electronic devices). While the convergence of a significant number of cyber-physical elements has enabled the Smart Grid to be far more efficient and competitive in addressing the growing global energy challenges, it has also introduced a large number of vulnerabilities culminating in violations of data availability, integrity, and confidentiality. Recently, false data injection (FDI) has become one of the most critical cyberattacks, and appears to be a focal point of interest for both research and industry. To this end, this paper presents a comprehensive review in the recent advances of the FDI attacks, with particular emphasis on 1) adversarial models, 2) attack targets, and 3) impacts in the Smart Grid infrastructure. This review paper aims to provide a thorough understanding of the incumbent threats affecting the entire spectrum of the Smart Grid. Related literature are analysed and compared in terms of their theoretical and practical implications to the Smart Grid cybersecurity. In conclusion, a range of technical limitations of existing false data attack research is identified, and a number of future research directions is recommended.


title: Remote magnon entanglement between two massive ferrimagnetic spheres via cavity optomagnonics

abstract: Recent studies show that hybrid quantum systems based on magnonics provide a new and promising platform for generating macroscopic quantum states involving a large number of spins. Here we show how to entangle two magnon modes in two massive yttrium-iron-garnet (YIG) spheres using cavity optomagnonics, where magnons couple to high-quality optical whispering gallery modes supported by the YIG sphere. The spheres can be as large as 1 mm in diameter and each sphere contains more than $10^{18}$ spins. The proposal is based on the asymmetry of the Stokes and anti-Stokes sidebands generated by the magnon-induced Brillouin light scattering in cavity optomagnonics. This allows one to utilize the Stokes and anti-Stokes scattering process, respectively, for generating and verifying the entanglement. Our work indicates that cavity optomagnonics could be a promising system for preparing macroscopic quantum states.


title: PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization

abstract: To defend against manipulation of image content, such as splicing, copy-move, and removal, we develop a Progressive Spatio-Channel Correlation Network (PSCC-Net) to detect and localize image manipulations. PSCC-Net processes the image in a two-path procedure: a top-down path that extracts local and global features and a bottom-up path that detects whether the input image is manipulated, and estimates its manipulation masks at multiple scales, where each mask is conditioned on the previous one. Different from the conventional encoder-decoder and no-pooling structures, PSCC-Net leverages features at different scales with dense cross-connections to produce manipulation masks in a coarse-to-fine fashion. Moreover, a Spatio-Channel Correlation Module (SCCM) captures both spatial and channel-wise correlations in the bottom-up path, which endows features with holistic cues, enabling the network to cope with a wide range of manipulation attacks. Thanks to the light-weight backbone and progressive mechanism, PSCC-Net can process 1,080P images at 50+ FPS. Extensive experiments demonstrate the superiority of PSCC-Net over the state-of-the-art methods on both detection and localization.


title: Interior Product, Lie Derivative and Wilson Line in the $KBc$ Subsector of Open String Field Theory

abstract: The open string field theory of Witten (SFT) has a close formal similarity with Chern-Simons theory in three dimensions. This similarity is due to the fact that the former theory has concepts corresponding to forms, exterior derivative, wedge product and integration over the manifold. In this paper, we introduce the interior product and the Lie derivative in the $KBc$ subsector of SFT. The interior product in SFT is specified by a two-component "tangent vector" and lowers the ghost number by one (like the ordinary interior product maps a $p$-form to $(p-1)$-form). The Lie derivative in SFT is defined as the anti-commutator of the interior product and the BRST operator. The important property of these two operations is that they respect the $KBc$ algebra. Deforming the original $(K,B,c)$ by using the Lie derivative, we can consider an infinite copies of the $KBc$ algebra, which we call the $KBc$ manifold. As an application, we construct the Wilson line on the manifold, which could play a role in reproducing degenerate fluctuation modes around a multi-brane solution.


title: Finite groups which have maximal covers

abstract: Let $\lambda(G)$ be the maximum number of subgroups in an irredundant covering of a finite group $G$. We prove that the finite groups with $\lambda(G)=|G|-t$, where $t\leq 5$, are solvable, and classify such groups.


title: Extractive Summarization of Call Transcripts

abstract: Text summarization is the process of extracting the most important information from the text and presenting it concisely in fewer sentences. Call transcript is a text that involves textual description of a phone conversation between a customer (caller) and agent(s) (customer representatives). This paper presents an indigenously developed method that combines topic modeling and sentence selection with punctuation restoration in condensing ill-punctuated or un-punctuated call transcripts to produce summaries that are more readable. Extensive testing, evaluation and comparisons have demonstrated the efficacy of this summarizer for call transcript summarization.


title: GCN-ALP: Addressing Matching Collisions in Anchor Link Prediction

abstract: Nowadays online users prefer to join multiple social media for the purpose of socialized online service. The problem \textit{anchor link prediction} is formalized to link user data with the common ground on user profile, content and network structure across social networks. Most of the traditional works concentrated on learning matching function with explicit or implicit features on observed user data. However, the low quality of observed user data confuses the judgment on anchor links, resulting in the matching collision problem in practice. In this paper, we explore local structure consistency and then construct a matching graph in order to circumvent matching collisions. Furthermore, we propose graph convolution networks with mini-batch strategy, efficiently solving anchor link prediction on matching graph. The experimental results on three real application scenarios show the great potentials of our proposed method in both prediction accuracy and efficiency. In addition, the visualization of learned embeddings provides us a qualitative way to understand the inference of anchor links on the matching graph.


title: The Anomalous Resonant Frequency Variation of Microwave Superconducting Niobium Cavities Near $T_c$

abstract: Superconducting radio-frequency (SRF) niobium cavities are the modern means of particle acceleration and an enabling technology for record coherence superconducting quantum systems and ultra-sensitive searches for new physics. Here, we report a systematic effect in Nb cavities indicative of improved superconducting properties - an anomalous decrease (dip) in the resonant frequency at temperatures just below the critical temperature $T_\mathrm{c}$. The frequency dip magnitude correlates with cavity quality factor, near-surface impurity distribution, and $T_\mathrm{c}$. It is also a precursor of the peculiar decrease in the BCS surface impedance with increasing RF current. A first demonstration of the coherence peak in the AC conductivity in Nb SRF cavities is also presented and found to correlate with a large frequency dip.


title: HeterSkinNet: A Heterogeneous Network for Skin Weights Prediction

abstract: Character rigging is universally needed in computer graphics but notoriously laborious. We present a new method, HeterSkinNet, aiming to fully automate such processes and significantly boost productivity. Given a character mesh and skeleton as input, our method builds a heterogeneous graph that treats the mesh vertices and the skeletal bones as nodes of different types and uses graph convolutions to learn their relationships. To tackle the graph heterogeneity, we propose a new graph network convolution operator that transfers information between heterogeneous nodes. The convolution is based on a new distance HollowDist that quantifies the relations between mesh vertices and bones. We show that HeterSkinNet is robust for production characters by providing the ability to incorporate meshes and skeletons with arbitrary topologies and morphologies (e.g., out-of-body bones, disconnected mesh components, etc.). Through exhaustive comparisons, we show that HeterSkinNet outperforms state-of-the-art methods by large margins in terms of rigging accuracy and naturalness. HeterSkinNet provides a solution for effective and robust character rigging.


title: Noise Modulation: Let Your Model Interpret Itself

abstract: Given the great success of Deep Neural Networks(DNNs) and the black-box nature of it,the interpretability of these models becomes an important issue.The majority of previous research works on the post-hoc interpretation of a trained model.But recently, adversarial training shows that it is possible for a model to have an interpretable input-gradient through training.However,adversarial training lacks efficiency for interpretability.To resolve this problem, we construct an approximation of the adversarial perturbations and discover a connection between adversarial training and amplitude modulation. Based on a digital analogy,we propose noise modulation as an efficient and model-agnostic alternative to train a model that interprets itself with input-gradients.Experiment results show that noise modulation can effectively increase the interpretability of input-gradients model-agnosticly.


title: Magnetization textures in twisted bilayer 2D CrX$_3$ (X=Br, I)

abstract: Motivated by the recent experiment demonstration of stacking dependent interlayer magnetic interaction [T. Song et al., Nat. Mater. 18, 1298 (2019); T. Li et al., Nat. Mater. 18, 1303 (2019); W. Chen et al., Science 366, 983 (2019)], we investigate the magnetization textures and the control possibilities in the moir\'{e} pattern formed of twisted bilayer two-dimensional (2D) magnets CrX$_3$ (X=Br, I). We find that the stacking dependent interlayer magnetic interaction results in the formation of periodic magnetization domains in a long-period moir\'{e} pattern. Magnetization textures with various topological numbers can be constructed, depending on the winding of the textures around the domain walls. A uniform external magnetic field competes with the lateral modulated interlayer magnetic interaction and can be utilized to tune the magnetization textures.


title: On Spurious Causality, CO2, and Global Temperature

abstract: Stips, Macias, Coughlan, Garcia-Gorriz, and Liang (2016, Nature Scientific Reports) use information flows (Liang, 2008, 2014) to establish causality from various forcings to global temperature. We show that the formulas being used hinges on a simplifying assumption that is nearly always rejected by the data. We propose an adequate measure of information flow based on Vector Autoregressions, and find that most results in Stips et al. (2016) cannot be corroborated. Then, it is discussed which modeling choices (e.g., the choice of CO2 series and assumptions about simultaneous relationships) may help in extracting credible estimates of causal flows and the transient climate response simply by looking at the joint dynamics of two climatic time series.


title: Semiparametric Bayesian Inference for Local Extrema of Functions in the Presence of Noise

abstract: There is a wide range of applications where the local extrema of a function are the key quantity of interest. However, there is surprisingly little work on methods to infer local extrema with uncertainty quantification in the presence of noise. By viewing the function as an infinite-dimensional nuisance parameter, a semiparametric formulation of this problem poses daunting challenges, both methodologically and theoretically, as (i) the number of local extrema may be unknown, and (ii) the induced shape constraints associated with local extrema are highly irregular. In this article, we build upon a derivative-constrained Gaussian process prior recently proposed by Yu et al. (2023) to derive what we call an encompassing approach that indexes possibly multiple local extrema by a single parameter. We provide closed-form characterization of the posterior distribution and study its large sample behavior under this unconventional encompassing regime. We show that the posterior measure converges to a mixture of Gaussians with the number of components matching the underlying truth, leading to posterior exploration that accounts for multi-modality. Point and interval estimates of local extrema with frequentist properties are also provided. The encompassing approach leads to a remarkably simple, fast semiparametric approach for inference on local extrema. We illustrate the method through simulations and a real data application to event-related potential analysis.


title: DCF-ASN: Coarse-to-fine Real-time Visual Tracking via Discriminative Correlation Filter and Attentional Siamese Network

abstract: Discriminative correlation filters (DCF) and siamese networks have achieved promising performance on visual tracking tasks thanks to their superior computational efficiency and reliable similarity metric learning, respectively. However, how to effectively take advantages of powerful deep networks, while maintaining the real-time response of DCF, remains a challenging problem. Embedding the cross-correlation operator as a separate layer into siamese networks is a popular choice to enhance the tracking accuracy. Being a key component of such a network, the correlation layer is updated online together with other parts of the network. Yet, when facing serious disturbance, fused trackers may still drift away from the target completely due to accumulated errors. To address these issues, we propose a coarse-to-fine tracking framework, which roughly infers the target state via an online-updating DCF module first and subsequently, finely locates the target through an offline-training asymmetric siamese network (ASN). Benefitting from the guidance of DCF and the learned channel weights obtained through exploiting the given ground-truth template, ASN refines feature representation and implements precise target localization. Systematic experiments on five popular tracking datasets demonstrate that the proposed DCF-ASN achieves the state-of-the-art performance while exhibiting good tracking efficiency.


title: Training image classifiers using Semi-Weak Label Data

abstract: In Multiple Instance learning (MIL), weak labels are provided at the bag level with only presence/absence information known. However, there is a considerable gap in performance in comparison to a fully supervised model, limiting the practical applicability of MIL approaches. Thus, this paper introduces a novel semi-weak label learning paradigm as a middle ground to mitigate the problem. We define semi-weak label data as data where we know the presence or absence of a given class and the exact count of each class as opposed to knowing the label proportions. We then propose a two-stage framework to address the problem of learning from semi-weak labels. It leverages the fact that counting information is non-negative and discrete. Experiments are conducted on generated samples from CIFAR-10. We compare our model with a fully-supervised setting baseline, a weakly-supervised setting baseline and learning from pro-portion (LLP) baseline. Our framework not only outperforms both baseline models for MIL-based weakly super-vised setting and learning from proportion setting, but also gives comparable results compared to the fully supervised model. Further, we conduct thorough ablation studies to analyze across datasets and variation with batch size, losses architectural changes, bag size and regularization


title: Boosting Adversarial Transferability through Enhanced Momentum

abstract: Deep learning models are known to be vulnerable to adversarial examples crafted by adding human-imperceptible perturbations on benign images. Many existing adversarial attack methods have achieved great white-box attack performance, but exhibit low transferability when attacking other models. Various momentum iterative gradient-based methods are shown to be effective to improve the adversarial transferability. In what follows, we propose an enhanced momentum iterative gradient-based method to further enhance the adversarial transferability. Specifically, instead of only accumulating the gradient during the iterative process, we additionally accumulate the average gradient of the data points sampled in the gradient direction of the previous iteration so as to stabilize the update direction and escape from poor local maxima. Extensive experiments on the standard ImageNet dataset demonstrate that our method could improve the adversarial transferability of momentum-based methods by a large margin of 11.1% on average. Moreover, by incorporating with various input transformation methods, the adversarial transferability could be further improved significantly. We also attack several extra advanced defense models under the ensemble-model setting, and the enhancements are remarkable with at least 7.8% on average.


title: Speed of excited random walks with long backward steps

abstract: We study a model of multi-excited random walk with non-nearest neighbour steps on $\mathbb Z$, in which the walk can jump from a vertex $x$ to either $x+1$ or $x-i$ with $i\in \{1,2,\dots,L\}$, $L\ge 1$. We first point out the multi-type branching structure of this random walk and then prove a limit theorem for a related multi-type Galton-Watson process with emigration, which is of independent interest. Combining this result and the method introduced by Basdevant and Singh [Probab. Theory Related Fields (2008), 141 (3-4)], we extend their result (w.r.t the case $L=1$) to our model. More specifically, we show that in the regime of transience to the right, the walk has positive speed if and only if the expected total drift $\delta>2$. This confirms a special case of a conjecture proposed by Davis and Peterson.


title: Knowledge-Guided Object Discovery with Acquired Deep Impressions

abstract: We present a framework called Acquired Deep Impressions (ADI) which continuously learns knowledge of objects as "impressions" for compositional scene understanding. In this framework, the model first acquires knowledge from scene images containing a single object in a supervised manner, and then continues to learn from novel multi-object scene images which may contain objects that have not been seen before without any further supervision, under the guidance of the learned knowledge as humans do. By memorizing impressions of objects into parameters of neural networks and applying the generative replay strategy, the learned knowledge can be reused to generate images with pseudo-annotations and in turn assist the learning of novel scenes. The proposed ADI framework focuses on the acquisition and utilization of knowledge, and is complementary to existing deep generative models proposed for compositional scene representation. We adapt a base model to make it fall within the ADI framework and conduct experiments on two types of datasets. Empirical results suggest that the proposed framework is able to effectively utilize the acquired impressions and improve the scene decomposition performance.


title: Linear Relations Among Galois Conjugates Over $\mathbb{F}_q(t)$

abstract: We classify the coefficients $(a_1,...,a_n) \in \mathbb{F}_q[t]^n$ that can appear in a linear relation $\sum_{i=1}^n a_i \gamma_i =0$ among Galois conjugates $\gamma_i \in \overline{\mathbb{F}_q(t)}$. We call such an $n$-tuple a Smyth tuple. Our main theorem gives an affirmative answer to a function field analogue of a 1986 conjecture of Smyth over $\mathbb{Q}$. Smyth showed that certain local conditions on the $a_i$ are necessary and conjectured that they are sufficient. Our main result is that the analogous conditions are necessary and sufficient over $\mathbb{F}_q(t)$, which we show using a combinatorial characterization of Smyth tuples due to Smyth. We also formulate a generalization of Smyth's Conjecture in an arbitrary number field that is not a straightforward generalization of the conjecture over $\mathbb{Q}$ due to a subtlety occurring at the archimedean places.


title: Robust penalized empirical likelihood in high dimensional longitudinal data analysis

abstract: As an effective nonparametric method, empirical likelihood (EL) is appealing in combining estimating equations flexibly and adaptively for incorporating data information. To select important variables and estimating equations in the sparse high-dimensional model, we consider a penalized EL method based on robust estimating functions by applying two penalty functions for regularizing the regression parameters and the associated Lagrange multipliers simultaneously, which allows the dimensionalities of both regression parameters and estimating equations to grow exponentially with the sample size. A first inspection on the robustness of estimating equations contributing to the estimating equations selection and variable selection is discussed from both theoretical perspective and intuitive simulation results in this paper. The proposed method can improve the robustness and effectiveness when the data have underlying outliers or heavy tails in the response variables and/or covariates. The robustness of the estimator is measured via the bounded influence function, and the oracle properties are also established under some regularity conditions. Extensive simulation studies and a yeast cell data are used to evaluate the performance of the proposed method. The numerical results reveal that the robustness of sparse estimating equations selection fundamentally enhances variable selection accuracy when the data have heavy tails and/or include underlying outliers.


title: Hyperspectral Image Super-Resolution in Arbitrary Input-Output Band Settings

abstract: Hyperspectral image (HSI) with narrow spectral bands can capture rich spectral information, but it sacrifices its spatial resolution in the process. Many machine-learning-based HSI super-resolution (SR) algorithms have been proposed recently. However, one of the fundamental limitations of these approaches is that they are highly dependent on image and camera settings and can only learn to map an input HSI with one specific setting to an output HSI with another. However, different cameras capture images with different spectral response functions and bands numbers due to the diversity of HSI cameras. Consequently, the existing machine-learning-based approaches fail to learn to super-resolve HSIs for a wide variety of input-output band settings. We propose a single Meta-Learning-Based Super-Resolution (MLSR) model, which can take in HSI images at an arbitrary number of input bands' peak wavelengths and generate SR HSIs with an arbitrary number of output bands' peak wavelengths. We leverage NTIRE2020 and ICVL datasets to train and validate the performance of the MLSR model. The results show that the single proposed model can successfully generate super-resolved HSI bands at arbitrary input-output band settings. The results are better or at least comparable to baselines that are separately trained on a specific input-output band setting.


title: The Impacts of Sentiments and Tones in Community-Generated Issue Discussions

abstract: The diverse community members who contribute to the discussions on issue tracking systems of open-source software projects often exhibit complex affective states such as sentiments and tones. These affective states can significantly influence the effectiveness of the issue discussions in elaborating the initial ideas into actionable tasks that the development teams need to address. In this paper, we present an extended empirical study to investigate the impacts of sentiments and tones in community-generated issue discussions. We created and validated a large dataset of sentiments and tones in the issues posts and comments created by diverse community members in three popular open source projects. Our analysis results drew a complex picture of the relationships between, on the one hand, the sentiments and tones in the issue discussions, and on the other hand, various discussion and development-related measures such as the discussion length and the issue resolution time. We also found that when factors such as the issue poster roles and the issue types were controlled, sentiments and tones had varied associations with the measures. Insights gained from these findings can support open source community members in making and moderating effective issue discussions and guide the design of tools to better support community engagement.


title: Spin-Injection-Generated Shock Waves and Solitons in a Ferromagnetic Thin Film

abstract: Unsteady nonlinear magnetization dynamics are studied in an easy-plane ferromagnetic channel subject to spin injection at one edge. The model Landau-Lifshitz equation is known to support steady-state solutions, termed dissipative exchange flows (DEFs) or spin superfluids. In this work, by means of numerical simulations and theoretical analysis, we provide a full description of the injection-induced, large-amplitude, nonlinear magnetization dynamics up to the steady state. The dynamics prior to reaching steady state are driven by spin injection, the perpendicular applied magnetic field, the exchange interaction, and local demagnetizing fields. We show that the dynamics take well-defined profiles in the form of rarefaction waves (RW), dispersive shock waves (DSW), and solitons. The combination of these building blocks depends on the interplay between the spin injection strength and the applied magnetic field. A solitonic feature at the injection boundary, signaling the onset of the magnetic "supersonic" condition at the injection edge, rapidly develops and persists in the steady-state configuration of a contact soliton DEF. We also demonstrate the existence of sustained soliton-train dynamics in long time that can only arise in a nonzero applied magnetic field scenario. The dynamical evolution of spin-injection-induced magnetization dynamics presented here may help guide observations in long-distance spin transport experiments.


title: A Pedagogical Review of the Vacuum Retarded Dipole Model of Pulsar Spin Down

abstract: Pulsars are rapidly spinning highly magnetised neutron stars. Their spin period is observed to decrease with time. An early analytical model for this process was the vacuum retarded dipole (VRD) by Deutsch (1955). This model assumes an idealised star and it finds that the rotational energy is radiated away by the electromagnetic fields. This model has been superseded by more realistic numerical simulations that account for the non-vacuum like surroundings of the neutron star. However, the VRD still provides a reasonable approximation and is a useful limiting case that can provide some qualitative understanding. We provide detailed derivations of the spin down and related electromagnetic field equations of the VRD solution. We also correct typographical errors in the general field equations and boundary conditions used by Deutsch (1955).


title: Distinguishing Time Clustering of Astrophysical Bursts

abstract: Many astrophysical bursts can recur, and their time series structure or pattern could be closely tied to the emission and system physics. While analysis of periodic events is well established, some sources, e.g. some fast radio bursts and soft gamma-ray emitters, are suspected of more subtle and less explored periodic windowed behavior: the bursts themselves are not periodic, but the activity only occurs during periodic windows. We focus here on distinguishing periodic windowed behavior from merely clustered events through time clustering analysis, using techniques analogous to spatial clustering, demonstrating methods for identifying and characterizing the behavior. An important aspect is accounting for the ``curious incident of the dog in the night time'' - lack of bursts carries information. As a worked example, we analyze six years of data from the soft gamma repeater SGR1935+2154, deriving a window period of 231 days and 55% duty cycle; this has now successfully predicted both active and inactive periods.


title: Scalable Vision Transformers with Hierarchical Pooling

abstract: The recently proposed Visual image Transformers (ViT) with pure attention have achieved promising performance on image recognition tasks, such as image classification. However, the routine of the current ViT model is to maintain a full-length patch sequence during inference, which is redundant and lacks hierarchical representation. To this end, we propose a Hierarchical Visual Transformer (HVT) which progressively pools visual tokens to shrink the sequence length and hence reduces the computational cost, analogous to the feature maps downsampling in Convolutional Neural Networks (CNNs). It brings a great benefit that we can increase the model capacity by scaling dimensions of depth/width/resolution/patch size without introducing extra computational complexity due to the reduced sequence length. Moreover, we empirically find that the average pooled visual tokens contain more discriminative information than the single class token. To demonstrate the improved scalability of our HVT, we conduct extensive experiments on the image classification task. With comparable FLOPs, our HVT outperforms the competitive baselines on ImageNet and CIFAR-100 datasets. Code is available at https://github.com/MonashAI/HVT


title: Towards a Dimension-Free Understanding of Adaptive Linear Control

abstract: We study the problem of adaptive control of the linear quadratic regulator for systems in very high, or even infinite dimension. We demonstrate that while sublinear regret requires finite dimensional inputs, the ambient state dimension of the system need not be bounded in order to perform online control. We provide the first regret bounds for LQR which hold for infinite dimensional systems, replacing dependence on ambient dimension with more natural notions of problem complexity. Our guarantees arise from a novel perturbation bound for certainty equivalence which scales with the prediction error in estimating the system parameters, without requiring consistent parameter recovery in more stringent measures like the operator norm. When specialized to finite dimensional settings, our bounds recover near optimal dimension and time horizon dependence.