title: Solution and Fitness Evolution (SAFE): Coevolving Solutions and Their Objective Functions

abstract: We recently highlighted a fundamental problem recognized to confound algorithmic optimization, namely, \textit{conflating} the objective with the objective function. Even when the former is well defined, the latter may not be obvious, e.g., in learning a strategy to navigate a maze to find a goal (objective), an effective objective function to \textit{evaluate} strategies may not be a simple function of the distance to the objective. We proposed to automate the means by which a good objective function may be discovered -- a proposal reified herein. We present \textbf{S}olution \textbf{A}nd \textbf{F}itness \textbf{E}volution (\textbf{SAFE}), a \textit{commensalistic} coevolutionary algorithm that maintains two coevolving populations: a population of candidate solutions and a population of candidate objective functions. As proof of principle of this concept, we show that SAFE successfully evolves not only solutions within a robotic maze domain, but also the objective functions needed to measure solution quality during evolution.


title: Bayesian Optimization Over Iterative Learners with Structured Responses: A Budget-aware Planning Approach

abstract: The rising growth of deep neural networks (DNNs) and datasets in size motivates the need for efficient solutions for simultaneous model selection and training. Many methods for hyperparameter optimization (HPO) of iterative learners, including DNNs, attempt to solve this problem by querying and learning a response surface while searching for the optimum of that surface. However, many of these methods make myopic queries, do not consider prior knowledge about the response structure, and/or perform a biased cost-aware search, all of which exacerbate identifying the best-performing model when a total cost budget is specified. This paper proposes a novel approach referred to as {\bf B}udget-{\bf A}ware {\bf P}lanning for {\bf I}terative Learners (BAPI) to solve HPO problems under a constrained cost budget. BAPI is an efficient non-myopic Bayesian optimization solution that accounts for the budget and leverages the prior knowledge about the objective function and cost function to select better configurations and to take more informed decisions during the evaluation (training). Experiments on diverse HPO benchmarks for iterative learners show that BAPI performs better than state-of-the-art baselines in most cases.


title: A Random Adaptation Perspective on Distributed Averaging

abstract: We propose a random adaptation variant of time-varying distributed averaging dynamics in discrete time. We show that this leads to novel interpretations of fundamental concepts in distributed averaging, opinion dynamics, and distributed learning. Namely, we show that the ergodicity of a stochastic chain is equivalent to the almost sure (a.s.) finite-time agreement attainment in the proposed random adaptation dynamics. Using this result, we provide a new interpretation for the absolute probability sequence of an ergodic chain. We then modify the base-case dynamics into a time-reversed inhomogeneous Markov chain, and we show that in this case ergodicity is equivalent to the uniqueness of the limiting distributions of the Markov chain. Finally, we introduce and study a time-varying random adaptation version of the Friedkin-Johnsen model and a rank-one perturbation of the base-case dynamics.


title: Protoformer: Embedding Prototypes for Transformers

abstract: Transformers have been widely applied in text classification. Unfortunately, real-world data contain anomalies and noisy labels that cause challenges for state-of-art Transformers. This paper proposes Protoformer, a novel self-learning framework for Transformers that can leverage problematic samples for text classification. Protoformer features a selection mechanism for embedding samples that allows us to efficiently extract and utilize anomalies prototypes and difficult class prototypes. We demonstrated such capabilities on datasets with diverse textual structures (e.g., Twitter, IMDB, ArXiv). We also applied the framework to several models. The results indicate that Protoformer can improve current Transformers in various empirical settings.


title: The Promise of Cross-Species Coexpression Analysis in Studying the Coevolution and Ecology of Host-Symbiont Interactions

abstract: Measuring gene expression simultaneously in both hosts and symbionts offers a powerful approach to explore the biology underlying species interactions. Such dual or simultaneous RNAseq approaches have primarily been used to gain insight into gene function in model systems, but there is opportunity to expand and apply these tools in new ways to understand ecological and evolutionary questions. By incorporating genetic diversity in both hosts and symbionts and studying how gene expression is correlated between partner species, we can gain new insight into host-symbiont coevolution and the ecology of species interactions. In this perspective, we explore how these relatively new tools could be applied to study such questions. We review the mechanisms that could be generating patterns of cross-species gene coexpression, including indirect genetic effects and selective filters, how these tools could be applied across different biological and temporal scales, and outline other methodological considerations and experiment possibilities.


title: Persistent hot carrier diffusion in boron arsenide single crystals imaged by ultrafast electron microscopy

abstract: Cubic boron arsenide (BAs) is promising for microelectronics thermal management due to its high thermal conductivity. Recently, its potential as an optoelectronic material is also being explored. However, it remains challenging to measure its photocarrier transport properties due to small sizes of available high-quality crystals. Here, we use scanning ultrafast electron microscopy (SUEM) to directly visualize the diffusion of photoexcited charge carriers in BAs single crystals. Surprisingly, we observed ambipolar diffusion at low optical fluence with persistent hot carrier dynamics for above 200 picoseconds, which can be attributed to the large frequency gap between acoustic and optical phonons, the same feature that is responsible for the high thermal conductivity. At higher optical fluence, we observed spontaneous electron-hole separation. Our results show BAs is an attractive optoelectronic material combining high thermal conductivity and excellent photocarrier transport properties. Our study also demonstrates the capability of SUEM to probe photocarrier transport in emerging materials.


title: The Tidal Disruption Event AT2021ehb: Evidence of Relativistic Disk Reflection, and Rapid Evolution of the Disk-Corona System

abstract: We present X-ray, UV, optical, and radio observations of the nearby ($\approx78$ Mpc) tidal disruption event (TDE) AT2021ehb/ZTF21aanxhjv during its first 430 days of evolution. AT2021ehb occurs in the nucleus of a galaxy hosting a $\approx 10^{7}\,M_\odot$ black hole ($M_{\rm BH}$ inferred from host galaxy scaling relations). High-cadence Swift and NICER monitoring reveals a delayed X-ray brightening. The spectrum first undergoes a gradual ${\rm soft }\rightarrow{\rm hard}$ transition and then suddenly turns soft again within 3 days at $\delta t\approx 272$ days during which the X-ray flux drops by a factor of ten. In the joint NICER+NuSTAR observation ($\delta t =264$ days, harder state), we observe a prominent non-thermal component up to 30 keV and an extremely broad emission line in the iron K band. The bolometric luminosity of AT2021ehb reaches a maximum of $6.0^{+10.4}_{-3.8}\% L_{\rm Edd}$ when the X-ray spectrum is the hardest. During the dramatic X-ray evolution, no radio emission is detected, the UV/optical luminosity stays relatively constant, and the optical spectra are featureless. We propose the following interpretations: (i) the ${\rm soft }\rightarrow{\rm hard}$ transition may be caused by the gradual formation of a magnetically dominated corona; (ii) hard X-ray photons escape from the system along solid angles with low scattering optical depth ($\sim\,$a few) whereas the UV/optical emission is likely generated by reprocessing materials with much larger column density -- the system is highly aspherical; (iii) the abrupt X-ray flux drop may be triggered by the thermal-viscous instability in the inner accretion flow leading to a much thinner disk.


title: Defending Multimodal Fusion Models against Single-Source Adversaries

abstract: Beyond achieving high performance across many vision tasks, multimodal models are expected to be robust to single-source faults due to the availability of redundant information between modalities. In this paper, we investigate the robustness of multimodal neural networks against worst-case (i.e., adversarial) perturbations on a single modality. We first show that standard multimodal fusion models are vulnerable to single-source adversaries: an attack on any single modality can overcome the correct information from multiple unperturbed modalities and cause the model to fail. This surprising vulnerability holds across diverse multimodal tasks and necessitates a solution. Motivated by this finding, we propose an adversarially robust fusion strategy that trains the model to compare information coming from all the input sources, detect inconsistencies in the perturbed modality compared to the other modalities, and only allow information from the unperturbed modalities to pass through. Our approach significantly improves on state-of-the-art methods in single-source robustness, achieving gains of 7.8-25.2% on action recognition, 19.7-48.2% on object detection, and 1.6-6.7% on sentiment analysis, without degrading performance on unperturbed (i.e., clean) data.


title: Numerical analysis of turbulent forced convection and fluid flow past a triangular cylinder with control plate using standard $\kappa$-$\epsilon$ model

abstract: Turbulent flow past an equilateral triangular cylinder with splitter plate inserted downstream is numerically tested for different gap ratios (0, 0.5, 1, 1.5, 2) and plate dimensions (0, 1, 1.5) on the flow field and heat transfer characteristics. Unsteady flow simulations are carried out at Re=22,000 in a finite volume based collocated framework, on a two-dimensional unstructured mesh. Reynolds averaged momentum and energy equations are solved in conjunction with the standard $\kappa$-$\epsilon$ model. In this study, cylinder and control plate are subjected to constant wall temperature. It is observed that the drag force on the triangular cylinder-splitter plate system reduced with an increase in gap ratio. Vortex shedding is suppressed as Strouhal number (St) reduced to its least value for the maximum gap-ratio configuration studied. Heat transfer performance is also significantly improved with the inclusion of a finite gap. In addition to that, the effect of variation in length of the splitter plate has also been studied on the force coefficients, Strouhal number, local and surface averaged Nusselt number. Results show that increasing the length of the splitter plate significantly suppressed the shedding with a minimum frequency obtained for the maximum plate length of Ls/h = 1.5. However, overall heat transfer reduced with the increase in plate length.


title: Missing data patterns in runners' careers: do they matter?

abstract: Predicting the future performance of young runners is an important research issue in experimental sports science and performance analysis. We analyse a data set with annual seasonal best performances of male middle distance runners for a period of 14 years and provide a modelling framework that accounts for both the fact that each runner has typically run in three distance events (800, 1500 and 5000 meters) and the presence of periods of no running activities. We propose a latent class matrix-variate state space model and we empirically demonstrate that accounting for missing data patterns in runners' careers improves the out of sample prediction of their performances over time. In particular, we demonstrate that for this analysis, the missing data patterns provide valuable information for the prediction of runner's performance.


title: Higher-order superintegrable momentum-dependent Hamiltonians on curved spaces from the classical Zernike system

abstract: We consider the classical momentum- or velocity-dependent two-dimensional Hamiltonian given by $$\mathcal H_N = p_1^2 + p_2^2 +\sum_{n=1}^N \gamma_n(q_1 p_1 + q_2 p_2)^n ,$$ where $q_i$ and $p_i$ are generic canonical variables, $\gamma_n$ are arbitrary coefficients, and $N\in \mathbb N$. For $N=2$, being both $\gamma_1,\gamma_2$ different from zero, this reduces to the classical Zernike system. We prove that $\mathcal H_N$ always provides a superintegrable system (for any value of $\gamma_n$ and $N$) by obtaining the corresponding constants of the motion explicitly, which turn out to be of higher-order in the momenta. Such generic results are not only applied to the Euclidean plane, but also to the sphere and the hyperbolic plane. In the latter curved spaces, $\mathcal H_N $ is expressed in geodesic polar coordinates showing that such a new superintegrable Hamiltonian can be regarded as a superposition of the isotropic 1:1 curved (Higgs) oscillator with even-order anharmonic curved oscillators plus another superposition of higher-order momentum-dependent potentials. Furthermore, the symmetry algebra determined by the constants of the motion is also studied, giving rise to a $(2N-1)$th-order polynomial algebra. As a byproduct, the Hamiltonian $\mathcal H_N $ is interpreted as a family of superintegrable perturbations of the classical Zernike system. Finally, it is shown that $\mathcal H_N$ (and so the Zernike system as well) is endowed with a Poisson $\mathfrak{sl}(2,\mathbb R)$-coalgebra symmetry which would allow for further possible generalizations that are also discussed.


title: Hierarchical Reinforcement Learning with Opponent Modeling for Distributed Multi-agent Cooperation

abstract: Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for multi-agent cooperation through the interaction of the agents and environments. However, traditional DRL solutions suffer from the high dimensions of multiple agents with continuous action space during policy search. Besides, the dynamicity of agents' policies makes the training non-stationary. To tackle the issues, we propose a hierarchical reinforcement learning approach with high-level decision-making and low-level individual control for efficient policy search. In particular, the cooperation of multiple agents can be learned in high-level discrete action space efficiently. At the same time, the low-level individual control can be reduced to single-agent reinforcement learning. In addition to hierarchical reinforcement learning, we propose an opponent modeling network to model other agents' policies during the learning process. In contrast to end-to-end DRL approaches, our approach reduces the learning complexity by decomposing the overall task into sub-tasks in a hierarchical way. To evaluate the efficiency of our approach, we conduct a real-world case study in the cooperative lane change scenario. Both simulation and real-world experiments show the superiority of our approach in the collision rate and convergence speed.


title: Deploying Robots in Everyday Environments: Towards Dependable and Practical Robotic Systems

abstract: Robot deployment in realistic dynamic environments is a challenging problem despite the fact that robots can be quite skilled at a large number of isolated tasks. One reason for this is that robots are rarely equipped with powerful introspection capabilities, which means that they cannot always deal with failures in a reasonable manner; in addition, manual diagnosis is often a tedious task that requires technicians to have a considerable set of robotics skills. In this paper, we discuss our ongoing efforts - in the context of the ROPOD project - to address some of these problems. In particular, we (i) present our early efforts at developing a robotic black box and consider some factors that complicate its design, (ii) explain our component and system monitoring concept, and (iii) describe the necessity for remote monitoring and experimentation as well as our initial attempts at performing those. Our preliminary work opens a range of promising directions for making robots more usable and reliable in practice - not only in the context of ROPOD, but in a more general sense as well.


title: New Detections of Phosphorus Molecules towards Solar-type Protostars

abstract: Phosphorus is a necessary element for life on Earth, but at present we have limited constraints on its chemistry in star- and planet-forming regions: to date, phosphorus carriers have only been detected towards a few low-mass protostars. Motivated by an apparent association between phosphorus molecule emission and outflow shocking, we used the IRAM 30m telescope to target PN and PO lines towards seven Solar-type protostars with well-characterized outflows, and firmly detected phosphorus molecules in three new sources. This sample, combined with archival observations of three additional sources, enables the first exploration of the demographics of phosphorus chemistry in low-mass protostars. The sources with PN detections show evidence for strong outflow shocks based on their H$_2$O 1$_{10}$-1$_{01}$ fluxes. On the other hand, no protostellar properties or bulk outflow mechanical properties are found to correlate with the detection of PN. This implies that gas-phase phosphorus is specifically linked to shocked gas within the outflows. Still, the PN and PO line kinematics suggest an emission origin in post-shocked gas rather than directly shocked material. Despite sampling a wide range of protostellar properties and outflow characteristics, we find a fairly narrow range of source-averaged PO/PN ratios (0.6-2.2) and volatile P abundances as traced by (PN+PO)/CH$_3$OH ($\sim$1-3%). Spatially resolved observations are needed to further constrain the emission origins and environmental drivers of the phosphorus chemistry in these sources.


title: On the computational properties of the uncountability of the real numbers

abstract: The uncountability of the real numbers is one of their most basic properties, known (far) outside of mathematics. Cantor's 1874 proof of the uncountability of the real numbers even appears in the very first paper on set theory, i.e. a historical milestone. Despite this famous status and history, the computational properties of the uncountability of the real numbers have not been studied much. In this paper, we study the following computational operation that witnesses that the real numbers not countable: on input a countable set of reals, output a real not in that set. In particular, we formulate a considerable number of operations that are computationally equivalent to the centred operation, working in Kleene's higher-order computability theory based on his S1-S9 computation schemes. Perhaps surprisingly, our equivalent operations involve most basic properties of the Riemann integral and Volterra's early work circa 1881.


title: Random Processes With Power Law Spectral Density

abstract: A statistical model of discrete finite length random processes with negative power law spectral densities is presented. The definition of terms is followed by a description of the spectral density trend. An algorithmic construction of random process, and a short block of computer code is given to implement the construction of the random process. The relationship between the second order properties of the random processes and the parameters of the construction is developed and demonstrated. The paper ends with a demonstration of the connection between the frequency of the random process sign changes and the power law exponent.


title: Manipulation of Nuclear Isomers with Lasers: Mechanisms and Prospects

abstract: Over one hundred years have passed since the nuclear isomer was first introduced, in analogy with chemical isomers to describe long-lived excited nuclear states. In 1921, Otto Hahn discovered the first nuclear isomer $^{234m}$Pa. After that, step by step, it was realized that different types of nuclear isomers exist, including spin isomer, K isomer, seniority isomers, and ``shape and fission'' isomer. The spin isomer occurs when the spin change $\Delta I$ of a transition is very large. The larger $\Delta I$, the lower the electromagnetic transition rates, the longer the half-lives. The K-isomer exists due to the significant change in K, where K is the projection of the total angular momentum on the symmetry axis. The seniority isomers arise due to a very small transition probability in seniority conserving transitions around semi-magic nuclei, where the seniority, which corresponds to the number of unpaired nucleons, is a reasonably pure quantum number. For a so-called shape isomer, the inhibition of the decay transition comes from the associated shape changes. It is caused by that a nucleus is trapped in a deformed shape which is its secondary minimum and is hard to decay back to its ground state.


title: T-structures on unbounded twisted complexes

abstract: This paper is a sequel to "T-structures and twisted complexes on derived injectives" by the same author with W. Lowen and M. Van den Bergh. We define a dg-category of unbounded twisted complexes on a dg-category, which is particularly interesting in the case of dg-categories of derived injectives or derived projectives associated to a t-structure. On such unbounded twisted complexes we define a natural "injective" and dually a "projective" t-structure. This is intended as a direct generalization of the homotopy categories of injective or projective objects of an abelian category.


title: Empirical Evaluation of Physical Adversarial Patch Attacks Against Overhead Object Detection Models

abstract: Adversarial patches are images designed to fool otherwise well-performing neural network-based computer vision models. Although these attacks were initially conceived of and studied digitally, in that the raw pixel values of the image were perturbed, recent work has demonstrated that these attacks can successfully transfer to the physical world. This can be accomplished by printing out the patch and adding it into scenes of newly captured images or video footage. In this work we further test the efficacy of adversarial patch attacks in the physical world under more challenging conditions. We consider object detection models trained on overhead imagery acquired through aerial or satellite cameras, and we test physical adversarial patches inserted into scenes of a desert environment. Our main finding is that it is far more difficult to successfully implement the adversarial patch attacks under these conditions than in the previously considered conditions. This has important implications for AI safety as the real-world threat posed by adversarial examples may be overstated.


title: Factorial-Type Recurrence Relations and $p$-adic Incomplete Gamma Functions

abstract: We introduce an automorphism $\mathcal{S}$ of the space $C(\mathbb{Z}_p,\mathbb{C}_p)$ of continuous functions $\mathbb{Z}_p \rightarrow \mathbb{C}_p$ and show that it can be used to give an alternative construction of the $p$-adic incomplete $\Gamma$-functions recently introduced by O'Desky and Richman (arXiv:2012.04615). We then describe various properties of the automorphism $\mathcal{S}$, showing that it is self-adjoint with respect to a certain non-degenerate symmetric bilinear form defined in terms of $p$-adic integration, and showing that its inverse plays a role in a $p$-adic integral-transform space akin to the role of differentiation in the classical space of Laplace-transformed functions. We also derive an integral-transform formula for the $p$-adic incomplete $\Gamma$-functions.


title: A coupled phase field formulation for modelling fatigue cracking in lithium-ion battery electrode particles

abstract: Electrode particle cracking is one of the main phenomena driving battery capacity degradation. Recent phase field fracture studies have investigated particle cracking behaviour. However, only the beginning of life has been considered and effects such as damage accumulation have been neglected. Here, a multi-physics phase field fatigue model has been developed to study crack propagation in battery electrode particles undergoing hundreds of cycles. In addition, we couple our electrochemo-mechanical formulation with X-ray CT imaging to simulate fatigue cracking of realistic particle microstructures. Using this modelling framework, non-linear crack propagation behaviour is predicted, leading to the observation of an exponential increase in cracked area with cycle number. Three stages of crack growth (slow, accelerating and unstable) are observed, with phenomena such as crack initialisation at concave regions and crack coalescence having a significant contribution to the resulting fatigue crack growth rates. The critical values of C-rate, particle size and initial crack length are determined, and found to be lower than those reported in the literature using static fracture models. Therefore, this work demonstrates the importance of considering fatigue damage in battery degradation models and provides insights on the control of fatigue crack propagation to alleviate battery capacity degradation.

categories: physics.chem-ph cond-mat.mtrl-sci cs.CE physics.app-ph


title: Learning Preconditions of Hybrid Force-Velocity Controllers for Contact-Rich Manipulation

abstract: Robots need to manipulate objects in constrained environments like shelves and cabinets when assisting humans in everyday settings like homes and offices. These constraints make manipulation difficult by reducing grasp accessibility, so robots need to use non-prehensile strategies that leverage object-environment contacts to perform manipulation tasks. To tackle the challenge of planning and controlling contact-rich behaviors in such settings, this work uses Hybrid Force-Velocity Controllers (HFVCs) as the skill representation and plans skill sequences with learned preconditions. While HFVCs naturally enable robust and compliant contact-rich behaviors, solvers that synthesize them have traditionally relied on precise object models and closed-loop feedback on object pose, which are difficult to obtain in constrained environments due to occlusions. We first relax HFVCs' need for precise models and feedback with our HFVC synthesis framework, then learn a point-cloud-based precondition function to classify where HFVC executions will still be successful despite modeling inaccuracies. Finally, we use the learned precondition in a search-based task planner to complete contact-rich manipulation tasks in a shelf domain. Our method achieves a task success rate of $73.2\%$, outperforming the $51.5\%$ achieved by a baseline without the learned precondition. While the precondition function is trained in simulation, it can also transfer to a real-world setup without further fine-tuning. See supplementary materials and videos at https://sites.google.com/view/constrained-manipulation/


title: Variable-Depth Simulation of Most Permissive Boolean Networks

abstract: In systems biology, Boolean networks (BNs) aim at modeling the qualitative dynamics of quantitative biological systems. Contrary to their (a)synchronous interpretations, the Most Permissive (MP) interpretation guarantees capturing all the trajectories of any quantitative system compatible with the BN, without additional parameters. Notably, the MP mode has the ability to capture transitions related to the heterogeneity of time scales and concentration scales in the abstracted quantitative system and which are not captured by asynchronous modes. So far, the analysis of MPBNs has focused on Boolean dynamical properties, such as the existence of particular trajectories or attractors. This paper addresses the sampling of trajectories from MPBNs in order to quantify the propensities of attractors reachable from a given initial BN configuration. The computation of MP transitions from a configuration is performed by iteratively discovering possible state changes. The number of iterations is referred to as the permissive depth, where the first depth corresponds to the asynchronous transitions. This permissive depth reflects the potential concentration and time scales heterogeneity along the abstracted quantitative process. The simulation of MPBNs is illustrated on several models from the literature, on which the depth parametrization can help to assess the robustness of predictions on attractor propensities changes triggered by model perturbations.


title: Bicategories of Diffeological Groupoids

abstract: We study three variants of bicategories of diffeological groupoids, and show that they are all equivalent: the bicategory with generalised morphisms, the bicategory with anafunctors, and the bicategory with bibundles. Moreover, we show that the corresponding sub-bicategories of locally subductive diffeological groupoids, as well as Lie groupoids, are (essentially) full sub-bicategories. As applications, we obtain equivalences with the corresponding 2-categories of geometric stacks, and present some Morita invariants.


title: Gravitational lensing, memory and the Penrose limit

abstract: In this paper, we discuss the gravitational field of ultrarelativistic extended spinning objects. For this purpose, we use a solution of the linearized gravitational equations obtained in the frame where such an object is translationally at rest, and boost this solution close to the speed of light. In order to obtain a regular limiting metric for non-spinning matter, it is sufficient to keep the energy of the boosted body fixed. This process is known as the Penrose limit. We demonstrate that in the presence of rotation, an additional rescaling is required for the angular momentum density components in the directions orthogonal to the boost. As a result of the Lorentz contraction, the thickness of the body in the direction of the boost shrinks. The body takes the form of a pancake, and its gravitational field is localized in the null plane. We discuss light and particle scattering in this gravitational field, and calculate the scattering parameters associated with the gravitational memory effect. We also show that by taking the inverse of the Penrose transform, one can use the obtained scattering map to study the gravitational lensing effect in the rest frame of a massive spinning object.


title: Non-algebraic geometrically trivial cohomology classes over finite fields

abstract: We give the first examples of smooth projective varieties $X$ over a finite field $\mathbb{F}$ admitting a non-algebraic torsion $\ell$-adic cohomology class of degree $4$ which vanishes over $\overline{\mathbb{F}}$. We use them to show that two versions of the integral Tate conjecture over $\mathbb{F}$ are not equivalent to one another and that a fundamental exact sequence of Colliot-Th\'el\`ene and Kahn does not necessarily split. Some of our examples have dimension $4$, and are the first known examples of fourfolds with non-vanishing $H^{3}_{\text{nr}}(X,\mathbb{Q}_{2}/\mathbb{Z}_{2}(2))$.


title: SiMa: Effective and Efficient Matching Across Data Silos Using Graph Neural Networks

abstract: How can we leverage existing column relationships within silos, to predict similar ones across silos? Can we do this efficiently and effectively? Existing matching approaches do not exploit prior knowledge, relying on prohibitively expensive similarity computations. In this paper we present the first technique for matching columns across data silos, called SiMa, which leverages Graph Neural Networks (GNNs) to learn from existing column relationships within data silos, and dataset-specific profiles. The main novelty of SiMa is its ability to be trained incrementally on column relationships within each silo individually, without requiring the consolidation of all datasets in a single place. Our experiments show that SiMa is more effective than the - otherwise inapplicable to the setting of silos - state-of-the-art matching methods, while requiring orders of magnitude less computational resources. Moreover, we demonstrate that SiMa considerably outperforms other state-of-the-art column representation learning methods.


title: Bifurcation and chaos in one dimensional chains of small particles

abstract: This work deals with bifurcation and the chaotic behavior in one dimensional chains of small particles. We consider two distinct possibilities, one where the particles are modeled by a fourth-order potential which was already studied. We revisit this system and bring novelties concerning the presence of the three-armed star behavior and the study of the corresponding Lyapunov exponent. The other system is new, and there the particles are more involved and modeled by an eighth-order potential. We investigate this new system within the same approach, emphasizing the behavior of the orbits, the bifurcation profile and the corresponding Lyapunov exponent.


title: Cascading Failures in Smart Grids under Random, Targeted and Adaptive Attacks

abstract: We study cascading failures in smart grids, where an attacker selectively compromises the nodes with probabilities proportional to their degrees, betweenness, or clustering coefficient. This implies that nodes with high degrees, betweenness, or clustering coefficients are attacked with higher probability. We mathematically and experimentally analyze the sizes of the giant components of the networks under different types of targeted attacks, and compare the results with the corresponding sizes under random attacks. We show that networks disintegrate faster for targeted attacks compared to random attacks. A targeted attack on a small fraction of high degree nodes disintegrates one or both of the networks, whereas both the networks contain giant components for random attack on the same fraction of nodes. An important observation is that an attacker has an advantage if it compromises nodes based on their betweenness, rather than based on degree or clustering coefficient. We next study adaptive attacks, where an attacker compromises nodes in rounds. Here, some nodes are compromised in each round based on their degree, betweenness or clustering coefficients, instead of compromising all nodes together. In this case, the degree, betweenness, or clustering coefficient is calculated before the start of each round, instead of at the beginning. We show experimentally that an adversary has an advantage in this adaptive approach, compared to compromising the same number of nodes all at once.


title: On the second law of thermodynamics: An ideal-gas flow spontaneously induced by a locally nonchaotic energy barrier

abstract: People are well aware that, inherently, certain small-scale nonchaotic particle movements are not governed by thermodynamics. Usually, such phenomena are studied by kinetic theory and their energy properties are considered "trivial". In current research, we show that, beyond the boundary of the second law of thermodynamics where Boltzmann's H-theorem does not apply, there are also large-sized systems of nontrivial energy properties: when the system is isolated, entropy can decrease; from a single thermal reservoir, the system can absorb heat and produce useful work without any other effect. The key concept is local nonchaoticity, demonstrated by using a narrow energy barrier. The barrier width is much less than the nominal particle mean free path, so that inside the barrier, the particle-particle collisions are sparse and the particle trajectories tend to be locally nonchaotic. Across the barrier, the steady-state particle flux ratio is intrinsically in a non-Boltzmann form. With a step-ramp structure, the nonequilibrium effect spreads to the entire system, and a global flow is generated spontaneously from the random thermal motion. The deviation from thermodynamic equilibrium is steady and significant, and compatible with the basic principle of maximum entropy. These theoretical and numerical analyses may shed light on the fundamentals of thermodynamics and statistical mechanics.


title: On the structure Lie operator of a real hypersurface in the complex quadric

abstract: The almost contact metric structure that we have on a real hypersurface $M$ in the complex quadric $Q^{m}=SO_{m+2}/SO_mSO_2$ allows us to define, for any nonnull real number $k$, the $k$-th generalized Tanaka-Webster connection on $M$, $\hat{\nabla}^{(k)}$. Associated to this connection we have Cho and torsion operators, $F_X^{(k)}$ and $T_X^{(k)}$, respectively, for any vector field $X$ tangent to $M$. From them and for any symmetric operator $B$ on $M$ we can consider two tensor fields of type (1,2) on $M$ that we will denote by $B_F^{(k)}$ and $B_T^{(k)}$, respectively. We will classify real hypersurfaces $M$ in $Q^m$ for which any of those tensors identically vanishes, in the particular case of $B$ being the structure Lie operator $L_{\xi}$ on $M$.


title: Self-Supervised 3D Monocular Object Detection by Recycling Bounding Boxes

abstract: Modern object detection architectures are moving towards employing self-supervised learning (SSL) to improve performance detection with related pretext tasks. Pretext tasks for monocular 3D object detection have not yet been explored yet in literature. The paper studies the application of established self-supervised bounding box recycling by labeling random windows as the pretext task. The classifier head of the 3D detector is trained to classify random windows containing different proportions of the ground truth objects, thus handling the foreground-background imbalance. We evaluate the pretext task using the RTM3D detection model as baseline, with and without the application of data augmentation. We demonstrate improvements of between 2-3 % in mAP 3D and 0.9-1.5 % BEV scores using SSL over the baseline scores. We propose the inverse class frequency re-weighted (ICFW) mAP score that highlights improvements in detection for low frequency classes in a class imbalanced dataset with long tails. We demonstrate improvements in ICFW both mAP 3D and BEV scores to take into account the class imbalance in the KITTI validation dataset. We see 4-5 % increase in ICFW metric with the pretext task.


title: On how to avoid exacerbating spurious correlations when models are overparameterized

abstract: Overparameterized models fail to generalize well in the presence of data imbalance even when combined with traditional techniques for mitigating imbalances. This paper focuses on imbalanced classification datasets, in which a small subset of the population -- a minority -- may contain features that correlate spuriously with the class label. For a parametric family of cross-entropy loss modifications and a representative Gaussian mixture model, we derive non-asymptotic generalization bounds on the worst-group error that shed light on the role of different hyper-parameters. Specifically, we prove that, when appropriately tuned, the recently proposed VS-loss learns a model that is fair towards minorities even when spurious features are strong. On the other hand, alternative heuristics, such as the weighted CE and the LA-loss, can fail dramatically. Compared to previous works, our bounds hold for more general models, they are non-asymptotic, and, they apply even at scenarios of extreme imbalance.


title: Multi Visual Modality Fall Detection Dataset

abstract: Falls are one of the leading cause of injury-related deaths among the elderly worldwide. Effective detection of falls can reduce the risk of complications and injuries. Fall detection can be performed using wearable devices or ambient sensors; these methods may struggle with user compliance issues or false alarms. Video cameras provide a passive alternative; however, regular RGB cameras are impacted by changing lighting conditions and privacy concerns. From a machine learning perspective, developing an effective fall detection system is challenging because of the rarity and variability of falls. Many existing fall detection datasets lack important real-world considerations, such as varied lighting, continuous activities of daily living (ADLs), and camera placement. The lack of these considerations makes it difficult to develop predictive models that can operate effectively in the real world. To address these limitations, we introduce a novel multi-modality dataset (MUVIM) that contains four visual modalities: infra-red, depth, RGB and thermal cameras. These modalities offer benefits such as obfuscated facial features and improved performance in low-light conditions. We formulated fall detection as an anomaly detection problem, in which a customized spatio-temporal convolutional autoencoder was trained only on ADLs so that a fall would increase the reconstruction error. Our results showed that infra-red cameras provided the highest level of performance (AUC ROC=0.94), followed by thermal (AUC ROC=0.87), depth (AUC ROC=0.86) and RGB (AUC ROC=0.83). This research provides a unique opportunity to analyze the utility of camera modalities in detecting falls in a home setting while balancing performance, passiveness, and privacy.


title: Identifying Possible Winners in Ranked Choice Voting Elections with Outstanding Ballots

abstract: Several election districts in the US have recently moved to ranked-choice voting (RCV) to decide the results of local elections. RCV allows voters to rank their choices, and the results are computed in rounds, eliminating one candidate at a time. RCV ensures fairer elections and has been shown to increase elected representation of women and people of color. A main drawback of RCV is that the round-by-round process requires all the ballots to be tallied before the results of an election can be calculated. With increasingly large portions of ballots coming from absentee voters, RCV election outcomes are not always apparent on election night, and can take several weeks to be published, leading to a loss of trust in the electoral process from the public. In this paper, we present an algorithm for efficiently computing possible winners of RCV elections from partially known ballots and evaluate it on data from the recent New York City Primary elections. We show that our techniques allow to significantly narrow down the field of possible election winners, and in some case identify the winner as soon as election night despite a number of yet-unaccounted absentee ballots, providing more transparency in the electoral process.


title: A Planning-free Longitudinal Controller Design for Vehicles in Dynamic Traffic Environments

abstract: This paper investigates the longitudinal control problem in a dynamic traffic environment where driving scenarios change between free-driving scenarios and car-following scenarios. A comprehensive longitudinal controller is proposed to ensure reasonable transient response and steady-state response in scenarios changes, which is independent of planning algorithms. This design takes into account passenger comfort, safety concerns and disturbance rejections, and attempts to meet the requirement of lower cost, faster response, increased comfort, enhanced safety and elevated extendability from the automated vehicle industry. Design insights and intuitions are provided in detail. Comprehensive simulations are conducted to demonstrate the efficacy of the proposed controller in different driving scenarios.


title: On the distribution of polynomials having a given number of irreducible factors over finite fields

abstract: Let $q\geqslant 2$ be a fixed prime power. We prove an asymptotic formula for counting the number of monic polynomials that are of degree $n$ and have exactly $k$ irreducible factors over the finite field $\mathbb{F}_q$. We also compare our results with the analogous existing ones in the integer case, where one studies all the natural numbers up to $x$ with exactly $k$ prime factors. In particular, we show that the number of monic polynomials grows at a surprisingly higher rate when $k$ is a little larger than $\log n$ than what one would speculate from looking at the integer case.


title: Riemann-Cartan gravity with dynamical signature

abstract: Model of Riemann-Cartan gravity with varying signature of metric is considered. The basic dynamical variables of the formalism are vierbein, spin connection, and an internal metric in the tangent space. The corresponding action contains new terms, which depend on these fields. In general case the signature of the metric is determined dynamically. The Minkowski signature is preferred dynamically because the configurations with the other signatures are dynamically suppressed. We also discuss briefly the motion of particles in the background of the modified black hole configuration, in which inside the horizon the signature is that of Euclidean space - time.


title: Sequential image recovery using joint hierarchical Bayesian learning

abstract: Recovering temporal image sequences (videos) based on indirect, noisy, or incomplete data is an essential yet challenging task. We specifically consider the case where each data set is missing vital information, which prevents the accurate recovery of the individual images. Although some recent (variational) methods have demonstrated high-resolution image recovery based on jointly recovering sequential images, there remain robustness issues due to parameter tuning and restrictions on the type of the sequential images. Here, we present a method based on hierarchical Bayesian learning for the joint recovery of sequential images that incorporates prior intra- and inter-image information. Our method restores the missing information in each image by "borrowing" it from the other images. As a result, \emph{all} of the individual reconstructions yield improved accuracy. Our method can be used for various data acquisitions and allows for uncertainty quantification. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.


title: Modeling Oceanic Variables with Dynamic Graph Neural Networks

abstract: Researchers typically resort to numerical methods to understand and predict ocean dynamics, a key task in mastering environmental phenomena. Such methods may not be suitable in scenarios where the topographic map is complex, knowledge about the underlying processes is incomplete, or the application is time critical. On the other hand, if ocean dynamics are observed, they can be exploited by recent machine learning methods. In this paper we describe a data-driven method to predict environmental variables such as current velocity and sea surface height in the region of Santos-Sao Vicente-Bertioga Estuarine System in the southeastern coast of Brazil. Our model exploits both temporal and spatial inductive biases by joining state-of-the-art sequence models (LSTM and Transformers) and relational models (Graph Neural Networks) in an end-to-end framework that learns both the temporal features and the spatial relationship shared among observation sites. We compare our results with the Santos Operational Forecasting System (SOFS). Experiments show that better results are attained by our model, while maintaining flexibility and little domain knowledge dependency.


title: HyGNN: Drug-Drug Interaction Prediction via Hypergraph Neural Network

abstract: Drug-Drug Interactions (DDIs) may hamper the functionalities of drugs, and in the worst scenario, they may lead to adverse drug reactions (ADRs). Predicting all DDIs is a challenging and critical problem. Most existing computational models integrate drug-centric information from different sources and leverage them as features in machine learning classifiers to predict DDIs. However, these models have a high chance of failure, especially for the new drugs when all the information is not available. This paper proposes a novel Hypergraph Neural Network (HyGNN) model based on only the SMILES string of drugs, available for any drug, for the DDI prediction problem. To capture the drug similarities, we create a hypergraph from drugs' chemical substructures extracted from the SMILES strings. Then, we develop HyGNN consisting of a novel attention-based hypergraph edge encoder to get the representation of drugs as hyperedges and a decoder to predict the interactions between drug pairs. Furthermore, we conduct extensive experiments to evaluate our model and compare it with several state-of-the-art methods. Experimental results demonstrate that our proposed HyGNN model effectively predicts DDIs and impressively outperforms the baselines with a maximum ROC-AUC and PR-AUC of 97.9% and 98.1%, respectively.


title: A novel set of algorithms to recognize galleries of ambrosia beetle in computerized axial tomography of trees trunks

abstract: Megaplatypus mutatus is an ambrosia beetle that attacks several species of trees by making galleries in the trunks where its larvae and associated fungi develop. This damage spoils the wood for commercial use and cause stem breakage in front of strong winds. Due to the insect's cryptic lifestyle, gallery analyses have usually been studied by destructive methods. However, they alter the homeostasis of the insect-fungi interaction, modifies the topology of the gallery and, more importantly, does not reveal the 100% complex structure made by the insect. Therefore, a novel way to study this structure is by imaging the galleries by means of computerized axial tomography (CT). This method allows obtaining a three-dimensional representation of the gallery and the pupal chambers to be studied, while the wood and insect sample is not disturbed and generates a high amount of data. The isolation of the galleries and pupal chambers from the CT background images is not simple, because there is not enough contrast between the grey levels of the galleries and the marks generated by internal components of the trunk itself. In this paper, we present a robust algorithm that allows automating the isolation of the galleries and pupal chambers from CT trunk images which can be used in a broad spectrum of image analysis.


title: Design and Analysis of Robust Resilient Diffusion over Multi-Task Networks Against Byzantine Attacks

abstract: This paper studies distributed diffusion adaptation over clustered multi-task networks in the presence of impulsive interferences and Byzantine attacks. We develop a robust resilient diffusion least mean Geman-McClure-estimation (RDLMG) algorithm based on the cost function used by the Geman-McClure estimator, which can reduce the sensitivity to large outliers and make the algorithm robust under impulsive interferences. Moreover, the mean sub-sequence reduced method, in which each node discards the extreme value information of cost contributions received from its neighbors, can make the network resilient against Byzantine attacks. In this regard, the proposed RDLMG algorithm ensures that all normal nodes converge to their ideal states with cooperation among nodes. A statistical analysis of the RDLMG algorithm is also carried out in terms of mean and mean-square performances. Numerical results evaluate the proposed RDLMG algorithm in applications to multi-target localization and multi-task spectrum sensing.


title: A two-stage method for reconstruction of parameters in diffusion equations

abstract: Parameter reconstruction for diffusion equations has a wide range of applications. In this paper, we proposed a two-stage scheme to efficiently solve conductivity reconstruction problems for steady-state diffusion equations with solution data measured inside the domain. The first stage is based on total variation regularization of the log diffusivity and the split Bregman iteration method. In the second stage, we apply the K-means clustering for the reconstruction of ``blocky'' conductivity functions. The convergence of the scheme is theoretically proved and extensive numerical examples are shown to demonstrate the performance of the scheme.


title: Implementation of SquashFS Support in U-Boot

abstract: U-Boot is a notorious bootloader and Open Source project. This work had as objective adding support for the SquashFS filesystem to U-Boot and the support developed was submitted as a contribution to the project. The bootloader is responsible, in this context, for loading the kernel and the device tree blob into RAM. It needs to be capable of reading a storage device's partition formatted with a specific filesystem type. Adding this support allows U-Boot to read from SquashFS partitions. The source code was submitted to U-Boot's mailing list through a series of patches to be reviewed by one of the project's maintainer. Once it gets merged, the support will be used and modified by U-Boot's international community.


title: On supercritical elliptic problems: existence, multiplicity of positive and symmetry breaking solutions

abstract: The main thrust of our current work is to exploit very specific characteristics of a given problem in order to acquire improved compactness for supercritical problems and to prove existence of new types of solutions. To this end, we shall develop a variational machinery in order to construct a new type of classical solutions for a large class of supercritical elliptic partial differential equations.\\ The issue of symmetry and symmetry breaking is challenging and fundamental in mathematics and physics. Symmetry breaking is the source of many interesting phenomena namely phase transitions, instabilities, segregation, etc. As a consequence of our results we shall establish the existence of several symmetry breaking solutions when the underlying problem is fully symmetric. Our methodology is variational, and we are not seeking non symmetric solutions which bifurcate from the symmetric one. Instead, we construct many new positive solutions by developing a minimax principle for general semilinear elliptic problems restricted to a given convex subset instead of the whole space. As a byproduct of our investigation, several new Sobolev embeddings are established for functions having a mild monotonicity on symmetric monotonic domains.


title: Spatiotemporal Data Mining: A Survey

abstract: Spatiotemporal data mining aims to discover interesting, useful but non-trivial patterns in big spatial and spatiotemporal data. They are used in various application domains such as public safety, ecology, epidemiology, earth science, etc. This problem is challenging because of the high societal cost of spurious patterns and exorbitant computational cost. Recent surveys of spatiotemporal data mining need update due to rapid growth. In addition, they did not adequately survey parallel techniques for spatiotemporal data mining. This paper provides a more up-to-date survey of spatiotemporal data mining methods. Furthermore, it has a detailed survey of parallel formulations of spatiotemporal data mining.


title: Atomically imprinted graphene plasmonic cavities

abstract: Plasmon polaritons in van der Waals (vdW) materials hold promise for next-generation photonics. The ability to deterministically imprint spatial patterns of high carrier density in cavities and circuitry with nanoscale features underlies future progress in nonlinear nanophotonics and strong light-matter interactions. Here, we demonstrate a general strategy to atomically imprint low-loss graphene plasmonic structures using oxidation-activated charge transfer (OCT). We cover graphene with a monolayer of WSe$_2$, which is subsequently oxidized into high work-function WOx to activate charge transfer. Nano-infrared imaging reveals low-loss plasmon polaritons at the WOx/graphene interface. We insert WSe$_2$ spacers to precisely control the OCT-induced carrier density and achieve a near-intrinsic quality factor of plasmons. Finally, we imprint canonical plasmonic cavities exhibiting laterally abrupt doping profiles with single-digit nanoscale precision via programmable OCT. Specifically, we demonstrate technologically appealing but elusive plasmonic whispering-gallery resonators based on free-standing graphene encapsulated in WOx. Our results open avenues for novel quantum photonic architectures incorporating two-dimensional materials.


title: Training Your Sparse Neural Network Better with Any Mask

abstract: Pruning large neural networks to create high-quality, independently trainable sparse masks, which can maintain similar performance to their dense counterparts, is very desirable due to the reduced space and time complexity. As research effort is focused on increasingly sophisticated pruning methods that leads to sparse subnetworks trainable from the scratch, we argue for an orthogonal, under-explored theme: improving training techniques for pruned sub-networks, i.e. sparse training. Apart from the popular belief that only the quality of sparse masks matters for sparse training, in this paper we demonstrate an alternative opportunity: one can carefully customize the sparse training techniques to deviate from the default dense network training protocols, consisting of introducing ``ghost" neurons and skip connections at the early stage of training, and strategically modifying the initialization as well as labels. Our new sparse training recipe is generally applicable to improving training from scratch with various sparse masks. By adopting our newly curated techniques, we demonstrate significant performance gains across various popular datasets (CIFAR-10, CIFAR-100, TinyImageNet), architectures (ResNet-18/32/104, Vgg16, MobileNet), and sparse mask options (lottery ticket, SNIP/GRASP, SynFlow, or even randomly pruning), compared to the default training protocols, especially at high sparsity levels. Code is at https://github.com/VITA-Group/ToST


title: Towards a Tighter Bound on Possible-Rendezvous Areas: Preliminary Results

abstract: Given trajectories with gaps, we investigate methods to tighten spatial bounds on areas (e.g., nodes in a spatial network) where possible rendezvous activity could have occurred. The problem is important for reducing the onerous amount of manual effort to post-process possible rendezvous areas using satellite imagery and has many societal applications to improve public safety, security, and health. The problem of rendezvous detection is challenging due to the difficulty of interpreting missing data within a trajectory gap and the very high cost of detecting gaps in such a large volume of location data. Most recent literature presents formal models, namely space-time prism, to track an object's rendezvous patterns within trajectory gaps on a spatial network. However, the bounds derived from the space-time prism are rather loose, resulting in unnecessarily extensive post-processing manual effort. To address these limitations, we propose a Time Slicing-based Gap-Aware Rendezvous Detection (TGARD) algorithm to tighten the spatial bounds in spatial networks. We propose a Dual Convergence TGARD (DC-TGARD) algorithm to improve computational efficiency using a bi-directional pruning approach. Theoretical results show the proposed spatial bounds on the area of possible rendezvous are tighter than that from related work (space-time prism). Experimental results on synthetic and real-world spatial networks (e.g., road networks) show that the proposed DC-TGARD is more scalable than the TGARD algorithm.


title: Harmonic Finsler manifolds of $({\alpha}, \beta)$-type

abstract: In this paper we construct a new class of harmonic and asymptotically harmonic Finsler manifolds of $({\alpha},\beta)$-type. This class is defined by a Riemannian metric ${\alpha}$ and a special 1-form $\beta$.


title: Central Products and the Chermak-Delgado Lattice

abstract: The Chermak-Delgado lattice of a finite group is a modular, self-dual sublattice of the lattice of subgroups. We prove that the Chermak-Delgado lattice of a central product contains the product of the Chermak-Delgado lattices of the relevant central factors. Furthermore, we obtain information about heights of elements in the Chermak-Delgado lattice relative to their heights in the Chermak-Delgado lattices of central factors. We also explore how the central product can be used as a tool in investigating Chermak-Delgado lattices.


title: Low-resource Accent Classification in Geographically-proximate Settings: A Forensic and Sociophonetics Perspective

abstract: Accented speech recognition and accent classification are relatively under-explored research areas in speech technology. Recently, deep learning-based methods and Transformer-based pretrained models have achieved superb performances in both areas. However, most accent classification tasks focused on classifying different kinds of English accents and little attention was paid to geographically-proximate accent classification, especially under a low-resource setting where forensic speech science tasks usually encounter. In this paper, we explored three main accent modelling methods combined with two different classifiers based on 105 speaker recordings retrieved from five urban varieties in Northern England. Although speech representations generated from pretrained models generally have better performances in downstream classification, traditional methods like Mel Frequency Cepstral Coefficients (MFCCs) and formant measurements are equipped with specific strengths. These results suggest that in forensic phonetics scenario where data are relatively scarce, a simple modelling method and classifier could be competitive with state-of-the-art pretrained speech models as feature extractors, which could enhance a sooner estimation for the accent information in practices. Besides, our findings also cross-validated a new methodology in quantifying sociophonetic changes.


title: The Hadron-Quark Crossover in Neutron Star within Gaussian Process Regression Method

abstract: The equations of state of the neutron star at the hadron-quark crossover region are interpolated with the Gaussian process regression (GPR) method, which can reduce the randomness of present interpolation schemes. The relativistic mean-field (RMF) model and Nambu-Jona-Lasinio (NJL) model are employed to describe the hadronic phase and quark phase, respectively. In the RMF model, the coupling term between $\omega$ and $\rho$ mesons is considered to control the density-dependent behaviors of symmetry energy, i.e. the slope of symmetry energy, $L$. Furthermore, the vector interaction between quarks is included in the NJL model to obtain the additional repulsive contributions. Their coupling strengths and the crossover windows are discussed in the present framework under the constraints on the neutron star from gravitational wave detections, massive neutron star measurements, mass-radius simultaneous observation of NICER collaboration, and the neutron skin thickness of $^{208}$Pb from PREX-II. It is found that the slope of symmetry energy, $L$ should be around $50-90$ MeV and the crossover window is $(0.3,~0.6)~\rm fm^{-3}$ with these observables. Furthermore, the uncertainties of neutron star masses and radii in the hadron-quark crossover regions are also predicted by the GPR method.


title: Singularity-Avoidance Prescribed Performance Attitude Tracking of Spacecraft

abstract: The attitude tracking problem with preassigned performance requirements has earned tremendous interest in recent years, and the Prescribed Performance Control (PPC) scheme is often adopted to tackle this problem. Nevertheless, traditional PPC schemes have inherent problems, which the solution still lacks, such as the singularity problem when the state constraint is violated and the potential over-control problem when the state trajectory approaches the constraint boundary. This paper proposes a Singularity-Avoidance Prescribed Performance Control scheme (SAPPC) to deal with these problems. A novel shear mapping-based error transformation is proposed to provide a globally non-singular error transformation procedure, while a time-varying constraint boundary is employed to exert appropriate constraint strength at different control stages, alleviating the potential instability caused by the over-control problem. Besides, a novel piece-wise reference performance function (RPF) is constructed to provide a relevant reference trajectory for the state responding signals, allowing precise control of the system's responding behavior. Based on the proposed SAPPC scheme, a backstepping controller is developed, with the predefined-time stability technique and the dynamic surface control technique employed to enhance the controller's robustness and performance. Finally, theoretical analysis and numerical simulation results are presented to validate the proposed control scheme's effectiveness and robustness.


title: SnoW: Serverless n-Party calls over WebRTC

abstract: We present a novel WebRTC communication system capable of hosting multi-party audio and video conferencing sessions without a media server. We implement various communication models based on the needs and capabilities of the communicating parties, and show that we can construct the equivalent of Mesh, SFU, and MCU WebRTC networks in our peer-to-peer architecture. In our evaluation we conclude that using a limited number of merged streams can improve the user experience significantly, in particular if low-resource devices are involved.


title: In-situ study of mineral liberation at the onset of fragmentation of a copper ore using X-ray micro-computed tomography

abstract: A better understanding of the relation between ore fragmentation and ore texture is a key to the energy efficient extraction of targeted minerals from low grade ore deposits. In this study, X-ray micro-computed tomography is employed to study mineral liberation during the tensile failure and onset of fragmentation of a copper ore. We present the results of experiments based on a high-pressure instrument enabling micro-mechanical studies to be carried out in-situ (inside a micro-CT scanner). This experimental platform enables mapping in 3D of the evolution of a sample of copper ore during an in-situ fragmentation test. The fragmentation occurs quasi-statically via tensile-activated nucleation and growth of multiple cracks producing a complex fracture network. Coupling breakage with microstructural information, we determine quantitatively the impact of ore textural features on fracture patterns and mineral liberation. This information can be compared to the ore mechanical behaviour, in particular to measurements of the deformation energy, the strain deformation field or the stress relaxation response. The copper liberation, fragment size distribution and breakage patterns are statistically characterised and related to two dominant comminution mechanisms which are clearly identified in the sequence of tomographic images. Our results show that in-situ micro-CT experiments could inform new studies of ore fragmentation at the laboratory scale and may offer new avenues to address current challenges in the design of efficient comminution processes.


title: Augmenting Density Matrix Renormalization Group with Disentanglers

abstract: Density Matrix Renormalization Group (DMRG) and its extensions in the form of Matrix Product States (MPS) are arguably the choice for the study of one dimensional quantum systems in the last three decades. However, due to the limited entanglement encoded in the wave-function ansatz, to maintain the accuracy of DMRG with the increase of the system size in the study of two dimensional systems, exponentially increased resources are required, which limits the applicability of DMRG to only narrow systems. In this work, we introduce a new ansatz in which DMRG is augmented with disentanglers to encode area-law-like entanglement entropy (entanglement entropy supported in the new ansatz scales as $l$ for a $l \times l$ system). In the new method, the $O(D^3)$ low computational cost of DMRG is kept (with an overhead of $O(d^4)$ and $d$ the dimension of the physical degree of freedom). We perform benchmark calculations with this approach on the two dimensional transverse Ising and Heisenberg models. This new ansatz extends the power of DMRG in the study of two-dimensional quantum systems.


title: Generalized Beliefs for Cooperative AI

abstract: Self-play is a common paradigm for constructing solutions in Markov games that can yield optimal policies in collaborative settings. However, these policies often adopt highly-specialized conventions that make playing with a novel partner difficult. To address this, recent approaches rely on encoding symmetry and convention-awareness into policy training, but these require strong environmental assumptions and can complicate policy training. We therefore propose moving the learning of conventions to the belief space. Specifically, we propose a belief learning model that can maintain beliefs over rollouts of policies not seen at training time, and can thus decode and adapt to novel conventions at test time. We show how to leverage this model for both search and training of a best response over various pools of policies to greatly improve ad-hoc teamplay. We also show how our setup promotes explainability and interpretability of nuanced agent conventions.


title: Towards Blockchain-Based Secure Data Management for Remote Patient Monitoring

abstract: Traditional data collection, storage and processing of Electronic Health Records (EHR) utilize centralized techniques that pose several risks of single point of failure and lean the systems to a number of internal and external data breaches that compromise their reliability and availability. Blockchain is an emerging distributed technology that can solve these issues due to its immutability and architectural nature that prevent records manipulation or alterations. In this paper, we discuss the progress and opportunities of remote patient monitoring using futuristic blockchain technologies and its two primary frameworks: Ethereum and Hyperledger Fabric. We also discuss the possible blockchain use cases in software engineering for systematic, disciplined, and quantifiable application development. The study extends by introducing a system architecture for EHR data management using Ethereum as a model. We discuss the challenges and limitations along with the initial evaluation results of the proposed system and draw future research directions in this promising area.


title: A Piecewise Convexification Method for Non-Convex Multi-Objective Optimization Programs with Box Constraints

abstract: This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global optimization and the interval subdivision, a series of convex relaxation sub-multiobjective problems for this non-convex multi-objective optimization problem are firstly obtained, and these sub-problems constitute a piecewise convexification problem of the original problem on the whole box. We then construct the (approximate, weakly) efficient solution set of this piecewise convexification problem, and use these sets to approximate the globally (weakly) efficient solution set of the original problem. Furthermore, we propose a piecewise convexification algorithm and show that this algorithm can also obtain approximate globally efficient solutions by calculating a finite subset of the efficient solution set of the multi-objective convex sub-problems only. Finally, its performance is demonstrated with various test instances.


title: Estimation and inference for the Wasserstein distance between mixing measures in topic models

abstract: The Wasserstein distance between mixing measures has come to occupy a central place in the statistical analysis of mixture models. This work proposes a new canonical interpretation of this distance and provides tools to perform inference on the Wasserstein distance between mixing measures in topic models. We consider the general setting of an identifiable mixture model consisting of mixtures of distributions from a set $\mathcal{A}$ equipped with an arbitrary metric $d$, and show that the Wasserstein distance between mixing measures is uniquely characterized as the most discriminative convex extension of the metric $d$ to the set of mixtures of elements of $\mathcal{A}$. The Wasserstein distance between mixing measures has been widely used in the study of such models, but without axiomatic justification. Our results establish this metric to be a canonical choice. Specializing our results to topic models, we consider estimation and inference of this distance. Though upper bounds for its estimation have been recently established elsewhere, we prove the first minimax lower bounds for the estimation of the Wasserstein distance in topic models. We also establish fully data-driven inferential tools for the Wasserstein distance in the topic model context. Our results apply to potentially sparse mixtures of high-dimensional discrete probability distributions. These results allow us to obtain the first asymptotically valid confidence intervals for the Wasserstein distance in topic models.


title: Tripartite high-dimensional magnon-photon entanglement in PT -symmetry broken phases of a non-Hermitian hybrid system

abstract: Hybrid systems that combine spin ensembles and superconducting circuits provide a promising platform for implementing quantum information processing. We propose a non-Hermitian magnoncircuit-QED hybrid model consisting of two cavities and an yttrium iron garnet (YIG) sphere placed in one of the cavities. Abundant exceptional points (EPs), parity-time (PT )-symmetry phases and PT -symmetry broken phases are investigated in the parameter space. Tripartite highdimensional entangled states can be generated steadily among modes of the magnon and photons in PT -symmetry broken phases, corresponding to which the stable quantum coherence exists. Results show that the tripartite high-dimensional entangled state is robust against the dissipation of hybrid system, independent of a certain initial state, and insensitive to the fluctuation of magnonphoton coupling. Further, we propose to simulate the hybrid model with an equivalent LCR circuit. This work may provide prospects for realizing multipartite high-dimensional entangled states in the magnon-circuit-QED hybrid system.


title: Malware Detection and Prevention using Artificial Intelligence Techniques

abstract: With the rapid technological advancement, security has become a major issue due to the increase in malware activity that poses a serious threat to the security and safety of both computer systems and stakeholders. To maintain stakeholders, particularly, end users security, protecting the data from fraudulent efforts is one of the most pressing concerns. A set of malicious programming code, scripts, active content, or intrusive software that is designed to destroy intended computer systems and programs or mobile and web applications is referred to as malware. According to a study, naive users are unable to distinguish between malicious and benign applications. Thus, computer systems and mobile applications should be designed to detect malicious activities towards protecting the stakeholders. A number of algorithms are available to detect malware activities by utilizing novel concepts including Artificial Intelligence, Machine Learning, and Deep Learning. In this study, we emphasize Artificial Intelligence (AI) based techniques for detecting and preventing malware activity. We present a detailed review of current malware detection technologies, their shortcomings, and ways to improve efficiency. Our study shows that adopting futuristic approaches for the development of malware detection applications shall provide significant advantages. The comprehension of this synthesis shall help researchers for further research on malware detection and prevention using AI.


title: Generation of higher-dimensional isospectral-nonisospectral integrable hierarchies associated with a new class of higher-dimensional column-vector loop algebras

abstract: We construct a new class of higher-dimensional column-vector loop algebras. Based on it, a method for generating higher-dimensional isospectral-nonisospectral integrable hierarchies is proposed. As an application, we derive a generalized nonisospectral integrable Schr\"odinger hierarchy which can be reduced to the famous derivative nonlinear Schr\"odinger equation. By using the higher-dimensional column-vector loop algebras, we obtain an expanded isospectral-nonisospectral integrable Schr\"odinger hierarchy which can be reduced to many classical and new equations, such as the expanded nonisospectral derivative nonlinear Schr\"odinger system, the heat equation, the Fokker-Plank equation which has a wide range of applications in stochastic dynamic systems. Furthermore, we deduce a ZN nonisospectral integrable Schr\"odinger hierarchy, which means that the coupling results are extended to an arbitrary number of components. Additionally, the Hamiltonian structures of these hierarchies are discussed by using the quadratic form trace identity.


title: Exploiting Transformation Invariance and Equivariance for Self-supervised Sound Localisation

abstract: We present a simple yet effective self-supervised framework for audio-visual representation learning, to localize the sound source in videos. To understand what enables to learn useful representations, we systematically investigate the effects of data augmentations, and reveal that (1) composition of data augmentations plays a critical role, i.e. explicitly encouraging the audio-visual representations to be invariant to various transformations~({\em transformation invariance}); (2) enforcing geometric consistency substantially improves the quality of learned representations, i.e. the detected sound source should follow the same transformation applied on input video frames~({\em transformation equivariance}). Extensive experiments demonstrate that our model significantly outperforms previous methods on two sound localization benchmarks, namely, Flickr-SoundNet and VGG-Sound. Additionally, we also evaluate audio retrieval and cross-modal retrieval tasks. In both cases, our self-supervised models demonstrate superior retrieval performances, even competitive with the supervised approach in audio retrieval. This reveals the proposed framework learns strong multi-modal representations that are beneficial to sound localisation and generalization to further applications. \textit{All codes will be available}.


title: Scalable and optimal Bayesian inference for sparse covariance matrices via screened beta-mixture prior

abstract: In this paper, we propose a scalable Bayesian method for sparse covariance matrix estimation by incorporating a continuous shrinkage prior with a screening procedure. In the first step of the procedure, the off-diagonal elements with small correlations are screened based on their sample correlations. In the second step, the posterior of the covariance with the screened elements fixed at $0$ is computed with the beta-mixture prior. The screened elements of the covariance significantly increase the efficiency of the posterior computation. The simulation studies and real data applications show that the proposed method can be used for the high-dimensional problem with the `large p, small n'. In some examples in this paper, the proposed method can be computed in a reasonable amount of time, while no other existing Bayesian methods can be. The proposed method has also sound theoretical properties. The screening procedure has the sure screening property and the selection consistency, and the posterior has the optimal minimax or nearly minimax convergence rate under the Frobeninus norm.


title: Meta Auxiliary Learning for Low-resource Spoken Language Understanding

abstract: Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta auxiliary learning to improve the performance of low-resource SLU task by only taking advantage of abundant manual transcriptions of speech data. One obvious advantage of such method is that it provides a flexible framework to implement a low-resource SLU training task without requiring access to any further semantic annotations. In particular, a NLU model is taken as label generation network to predict intent and slot tags from texts; a multi-task network trains ASR task and SLU task synchronously from speech; and the predictions of label generation network are delivered to the multi-task network as semantic targets. The efficiency of the proposed algorithm is demonstrated with experiments on the public CATSLU dataset, which produces more suitable ASR hypotheses for the downstream NLU task.


title: On the second cohomology of the norm one group of a p-adic division algebra

abstract: Let $F$ be a $p$-adic field, that is, a finite extension of $\mathbb Q_p$. Let $D$ be a finite-dimensional central division algebra over $F$ and let $SL_1(D)$ be the group of elements of reduced norm $1$ in $D$. Prasad and Raghunathan proved that $H^2(SL_1(D),\mathbb R/\mathbb Z)$ is a cyclic $p$-group whose order is bounded from below by the number of $p$-power roots of unity in $F$, unless $D$ is a quaternion algebra over $\mathbb Q_2$. In this paper we give an explicit upper bound for the order of $H^2(SL_1(D),\mathbb R/\mathbb Z)$ for $p\geq 5$ and determine $H^2(SL_1(D),\mathbb R/\mathbb Z)$ precisely when $F$ is cyclotomic, $p\geq 19$ and the degree of $D$ is not a power of $p$.


title: Smooth fans that are endpoint rigid

abstract: Let $X$ be a smooth fan and denote its set of endpoints by $E(X)$. Let $E$ be one of the following spaces: the natural numbers, the irrational numbers, or the product of the Cantor set with the natural numbers. We prove that there is a smooth fan $X$ such that $E(X)$ is homeomorphic to $E$ and for every homeomorphism $h \colon X \to X$, the restriction of $h$ to $E(X)$ is the identity. On the other hand, we also prove that if $X$ is any smooth fan such that $E(X)$ is homeomorphic to complete Erd\H{o}s space, then $X$ is necessarily homeomorphic to the Lelek fan; this adds to a 1989 result by W{\l}odzimierz Charatonik.


title: Hermitian adjacency matrices of mixed multigraphs

abstract: A mixed multigraph is obtained from an undirected multigraph by orienting a subset of its edges. In this paper, we study a new Hermitian matrix representation of mixed multigraphs, give an introduction to cospectral operations on mixed multigraphs, and characterize switching equivalent mixed multigraphs in terms of fundamental cycle basis. As an application, an upper bound of cospectral classes of mixed multigraphs with the same underlying graph is obtained.


title: Hydrodynamic attractor of noisy plasmas

abstract: We provide a generalized formulation of fluctuating hydrodynamics for the far-from-equilibrium noisy medium. As an example, we consider a noisy plasma experiencing Bjorken expansion, for which the leading order evolution is captured by hydrodynamic attractor of classical hydrodynamics, while the quadratic couplings of fluctuations are solved effectively via a generalized version of the hydrodynamic kinetic equation. In the far-from-equilibrium plasma, backreaction of hydrodynamic fluctuations results in renormalization of transport properties, as well as long time tails, of high orders. In particular, corresponding to a renormalized hydrodynamic attractor, evolution in a noisy plasma towards equilibrium becomes non-monotonic.


title: Evolutionary Preference Learning via Graph Nested GRU ODE for Session-based Recommendation

abstract: Session-based recommendation (SBR) aims to predict the user next action based on the ongoing sessions. Recently, there has been an increasing interest in modeling the user preference evolution to capture the fine-grained user interests. While latent user preferences behind the sessions drift continuously over time, most existing approaches still model the temporal session data in discrete state spaces, which are incapable of capturing the fine-grained preference evolution and result in sub-optimal solutions. To this end, we propose Graph Nested GRU ordinary differential equation (ODE), namely GNG-ODE, a novel continuum model that extends the idea of neural ODEs to continuous-time temporal session graphs. The proposed model preserves the continuous nature of dynamic user preferences, encoding both temporal and structural patterns of item transitions into continuous-time dynamic embeddings. As the existing ODE solvers do not consider graph structure change and thus cannot be directly applied to the dynamic graph, we propose a time alignment technique, called t-Alignment, to align the updating time steps of the temporal session graphs within a batch. Empirical results on three benchmark datasets show that GNG-ODE significantly outperforms other baselines.


title: A Pair Measurement Surface Code on Pentagons

abstract: In this paper, I present a way to compile the surface code into two-body parity measurements ("pair measurements"), where the pair measurements run along the edges of a Cairo pentagonal tiling. The resulting circuit improves on prior work by Chao et al. by using fewer pair measurements per four-body stabilizer measurement (5 instead of 6) and fewer time steps per round of stabilizer measurement (6 instead of 10). Using Monte Carlo sampling, I show that these improvements increase the threshold of the surface code when compiling into pair measurements from $\approx 0.2\%$ to $\approx 0.4\%$, and also that they improve the teraquop footprint at a $0.1\%$ physical gate error rate from $\approx6000$ qubits to $\approx3000$ qubits. However, I also show that the teraquop footprint of Chao et al's construction improves more quickly than mine as physical error rate decreases, and is likely better below a physical gate error rate of $\approx 0.03\%$ (due to bidirectional hook errors in my construction). I also compare to the planar honeycomb code, showing that although this work does noticeably reduce the gap between the surface code and the honeycomb code (when compiling into pair measurements), the honeycomb code is still more efficient (threshold $\approx 0.8\%$, teraquop footprint at $0.1\%$ of $\approx 1000$).


title: Efficiently Leveraging Multi-level User Intent for Session-based Recommendation via Atten-Mixer Network

abstract: Session-based recommendation (SBR) aims to predict the user's next action based on short and dynamic sessions. Recently, there has been an increasing interest in utilizing various elaborately designed graph neural networks (GNNs) to capture the pair-wise relationships among items, seemingly suggesting the design of more complicated models is the panacea for improving the empirical performance. However, these models achieve relatively marginal improvements with exponential growth in model complexity. In this paper, we dissect the classical GNN-based SBR models and empirically find that some sophisticated GNN propagations are redundant, given the readout module plays a significant role in GNN-based models. Based on this observation, we intuitively propose to remove the GNN propagation part, while the readout module will take on more responsibility in the model reasoning process. To this end, we propose the Multi-Level Attention Mixture Network (Atten-Mixer), which leverages both concept-view and instance-view readouts to achieve multi-level reasoning over item transitions. As simply enumerating all possible high-level concepts is infeasible for large real-world recommender systems, we further incorporate SBR-related inductive biases, i.e., local invariance and inherent priority to prune the search space. Experiments on three benchmarks demonstrate the effectiveness and efficiency of our proposal. We also have already launched the proposed techniques to a large-scale e-commercial online service since April 2021, with significant improvements of top-tier business metrics demonstrated in the online experiments on live traffic.


title: Energy transfer in simple and active binary fluid turbulence {\bf {-}} a false friend of incompressible MHD turbulence

abstract: Inertial range energy transfer in three dimensional fully developed binary fluid turbulence is studied under the assumption of statistical homogeneity. Using two point statistics, exact relations corresponding to the energy cascade are derived (i) in terms of two-point increments and (ii) two-point correlators. Despite having some apparent resemblances, the exact relation in binary fluid turbulence is found to be different from that of the incompressible MHD turbulence (Politano and Pouquet, GRL, 1998). Besides the usual direct cascade of energy, under certain situations, an inverse cascade of energy is also speculated depending upon the strength of the activity parameter and the interplay between the two-point increments of the fluid velocity and the composition gradient fields. An alternative form of the exact relation is also derived in terms of the `upsilon' variables and a subsequent phenomenology is also proposed predicting a $k^{-{3}/{2}}$ law for the turbulent energy spectrum.


title: Athermal resistance to phase interface motion due to precipitates: A phase field study

abstract: Athermal resistance to the motion of a phase interface due to a precipitate is investigated. The coupled phase field and elasticity equations are solved for the phase transformation (PT). The volumetric misfit strain due to the precipitate is included using the error and rectangular functions. Due to the presence of precipitates, the critical thermal driving forces remarkably differ between the direct and reverse PTs, resulting in a hysteresis behavior. For the precipitate radius small compared to the interface width, the misfit strain does not practically show any effect on the critical thermal driving force. Also, the critical thermal driving force value nonlinearly increases vs. the precipitate concentration for both the direct and reverse PTs. Change in the precipitate surface energy significantly changes the PT morphology and the critical thermal driving forces. The critical thermal driving force shows dependence on the misfit strain for large precipitate sizes compared to the interface width. For both the constant surface energy (CSE) and variable surface energy (VSE) boundary conditions (BCs) at the precipitate surface, the critical thermal driving force linearly increases vs. the misfit strain coefficient for the direct PT while it is almost independent of it for the reverse PT. For larger precipitates, the critical thermal driving force nonlinearly increases vs. the precipitate concentration for the direct PT. For the reverse PT, its value for the CSE BCs linearly increases vs. the precipitate concentration while it is independent of the precipitate concentration for the VSE BCs. Also, for any concentration, the VSE BCs result in higher thermal critical driving forces, a smaller hysteresis range, and a larger transformation rate. The critical microstructure and thermal driving forces are validated using the thermodynamic phase equilibrium condition for stationary interfaces.


title: Learning to Rearrange with Physics-Inspired Risk Awareness

abstract: Real-world applications require a robot operating in the physical world with awareness of potential risks besides accomplishing the task. A large part of risky behaviors arises from interacting with objects in ignorance of affordance. To prevent the agent from making unsafe decisions, we propose to train a robotic agent by reinforcement learning to execute tasks with an awareness of physical properties such as mass and friction in an indoor environment. We achieve this through a novel physics-inspired reward function that encourages the agent to learn a policy discerning different masses and friction coefficients. We introduce two novel and challenging indoor rearrangement tasks -- the variable friction pushing task and the variable mass pushing task -- that allow evaluation of the learned policies in trading off performance and physics-inspired risk. Our results demonstrate that by equipping with the proposed reward, the agent is able to learn policies choosing the pushing targets or goal-reaching trajectories with minimum physical cost, which can be further utilized as a precaution to constrain the agent's behavior in a safety-critic environment.


title: Can Hong-Ou-Mandel type quantum correlation be a test tool for quantum entanglement?

abstract: Quantum technologies based on the particle nature of a photon has been progressed over the last several decades, where the fundamental quantum feature of entanglement has been tested by Hong-Ou-Mandel (HOM) type anticorrelation as well as Bell-type nonlocal correlation. Mutually exclusive quantum natures of the wave-particle duality of a single photon have been intensively investigated to understand the fundamental physics of mysterious quantum nature. Here, we revisit the HOM-type quantum correlation to answer the question whether the HOM-type anticorrelation can be a test tool for quantum entanglement. For this, a pair of spontaneous parametric down converted photons is tested for the anticorrelation of HOM effects, where the SPDC-generated photon pair is not in an entangled state.


title: Calibrated Nonparametric Scan Statistics for Anomalous Pattern Detection in Graphs

abstract: We propose a new approach, the calibrated nonparametric scan statistic (CNSS), for more accurate detection of anomalous patterns in large-scale, real-world graphs. Scan statistics identify connected subgraphs that are interesting or unexpected through maximization of a likelihood ratio statistic; in particular, nonparametric scan statistics (NPSSs) identify subgraphs with a higher than expected proportion of individually significant nodes. However, we show that recently proposed NPSS methods are miscalibrated, failing to account for the maximization of the statistic over the multiplicity of subgraphs. This results in both reduced detection power for subtle signals, and low precision of the detected subgraph even for stronger signals. Thus we develop a new statistical approach to recalibrate NPSSs, correctly adjusting for multiple hypothesis testing and taking the underlying graph structure into account. While the recalibration, based on randomization testing, is computationally expensive, we propose both an efficient (approximate) algorithm and new, closed-form lower bounds (on the expected maximum proportion of significant nodes for subgraphs of a given size, under the null hypothesis of no anomalous patterns). These advances, along with the integration of recent core-tree decomposition methods, enable CNSS to scale to large real-world graphs, with substantial improvement in the accuracy of detected subgraphs. Extensive experiments on both semi-synthetic and real-world datasets are demonstrated to validate the effectiveness of our proposed methods, in comparison with state-of-the-art counterparts.


title: Mobility overestimation in MoS$_2$ transistors due to invasive voltage probes

abstract: Improving carrier mobilities of two-dimensional (2D) semiconductors is highly sought after. Recently, Ng. et al. [1] reported rippled molybdenum disulfide (MoS$_2$) transistors on bulged silicon nitride (SiN$_x$) substrates that exhibit high electron mobilities up to ~900 cm$^2$V$^{-1}$s$^{-1}$. The high mobility values were attributed to the suppression of electron-phonon scattering by the lattice distortion in the rippled MoS$_2$ channel. While the results are compelling, this Matters Arising shows that the mobility values in ref. [1] are likely to be overestimated due to invasive voltage probes in the four-probe measurement setup, which causes a positive threshold voltage shift near the voltage probes and an artificial overestimation of apparent field-effect mobility.


title: Representative Teacher Keys for Knowledge Distillation Model Compression Based on Attention Mechanism for Image Classification

abstract: With the improvement of AI chips (e.g., GPU, TPU, and NPU) and the fast development of the Internet of Things (IoT), some robust deep neural networks (DNNs) are usually composed of millions or even hundreds of millions of parameters. Such a large model may not be suitable for directly deploying on low computation and low capacity units (e.g., edge devices). Knowledge distillation (KD) has recently been recognized as a powerful model compression method to decrease the model parameters effectively. The central concept of KD is to extract useful information from the feature maps of a large model (i.e., teacher model) as a reference to successfully train a small model (i.e., student model) in which the model size is much smaller than the teacher one. Although many KD methods have been proposed to utilize the information from the feature maps of intermediate layers in the teacher model, most did not consider the similarity of feature maps between the teacher model and the student model. As a result, it may make the student model learn useless information. Inspired by the attention mechanism, we propose a novel KD method called representative teacher key (RTK) that not only considers the similarity of feature maps but also filters out the useless information to improve the performance of the target student model. In the experiments, we validate our proposed method with several backbone networks (e.g., ResNet and WideResNet) and datasets (e.g., CIFAR10, CIFAR100, SVHN, and CINIC10). The results show that our proposed RTK can effectively improve the classification accuracy of the state-of-the-art attention-based KD method.