title: A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

abstract: Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL model accuracy, in this paper, we focus on the improving the training efficiency, which is often a hurdle for adopting FL in real-world applications. Specifically, we design an efficient FL framework which jointly optimizes model accuracy, processing latency and communication efficiency, all of which are primary design considerations for real implementation of FL. Inspired by the recent success of Multi-Agent Reinforcement Learning (MARL) in solving complex control problems, we present \textit{FedMarl}, an MARL-based FL framework which performs efficient run-time client selection. Experiments show that FedMarl can significantly improve model accuracy with much lower processing latency and communication cost.


title: Causal Discovery from Sparse Time-Series Data Using Echo State Network

abstract: Causal discovery between collections of time-series data can help diagnose causes of symptoms and hopefully prevent faults before they occur. However, reliable causal discovery can be very challenging, especially when the data acquisition rate varies (i.e., non-uniform data sampling), or in the presence of missing data points (e.g., sparse data sampling). To address these issues, we proposed a new system comprised of two parts, the first part fills missing data with a Gaussian Process Regression, and the second part leverages an Echo State Network, which is a type of reservoir computer (i.e., used for chaotic system modelling) for Causal discovery. We evaluate the performance of our proposed system against three other off-the-shelf causal discovery algorithms, namely, structural expectation-maximization, sub-sampled linear auto-regression absolute coefficients, and multivariate Granger Causality with vector auto-regressive using the Tennessee Eastman chemical dataset; we report on their corresponding Matthews Correlation Coefficient(MCC) and Receiver Operating Characteristic curves (ROC) and show that the proposed system outperforms existing algorithms, demonstrating the viability of our approach to discover causal relationships in a complex system with missing entries.


title: Adiabaticity in nonreciprocal Landau-Zener tunneling

abstract: We investigate the Landau-Zener tunneling (LZT) of a self-interacting two-level system in which the coupling between the levels is nonreciprocal. In such a non-Hermitian system, when the energy bias between two levels is adjusted very slowly, i.e., in the adiabatic limit, we find that a quantum state can still closely follow the eigenstate solution until it encounters the exceptional points (EPs) at which two eigenvalues and their corresponding eigenvectors coalesce. In the absence of the nonlinear self-interaction, we can obtain explicit expressions for the eigenvectors and eigenvalues and analytically derive the adiabatic LZT probability from invariants at EPs. In the presence of the nonlinear interaction, the dynamics of the adiabatic evolutions are explicitly demonstrated with the help of classical trajectories in the plane of the two canonical variables of the corresponding classical Josephson Hamiltonian. We show that the adiabatic tunneling probabilities can be precisely predicted by the classical action at EPs in the weak nonreciprocal regime. In a certain region of strong nonreciprocity, we find that interestingly, the nonlinear interaction effects can be completely suppressed so that the adiabatic tunneling probabilities are identical to their linear counterparts. We also obtain a phase diagram for large ranges of nonreciprocity and nonlinear interaction parameters to explicitly demonstrate where the adiabaticity can break down, i.e., the emergence of the nonzero tunneling probabilities even in adiabatic limit.


title: Resonant tunneling in disordered borophene nanoribbons with line defects

abstract: Very recently, borophene has been attracting extensive and ongoing interest as the new wonder material with structural polymorphism and superior attributes, showing that the structural imperfection of line defects (LDs) occurs widely at the interface between $\nu_{1/5}$ ($\chi_3$) and $\nu_{1/6}$ ($\beta_{12}$) boron sheets. Motivated by these experiments, here we present a theoretical study of electron transport through two-terminal disordered borophene nanoribbons (BNRs) with random distribution of LDs. Our results indicate that LDs could strongly affect the electron transport properties of BNRs. In the absence of LDs, both $\nu_{1/5}$ and $\nu_{1/6}$ BNRs exhibit metallic behavior, in agreement with experiments. While in the presence of LDs, the overall electron transport ability is dramatically decreased, but some resonant peaks of conductance quantum can be found in the transmission spectrum of any disordered BNR with arbitrary arrangement of LDs. These disordered BNRs exhibit metal-insulator transition by varying nanoribbon width with tunable transmission gap in the insulating regime. Furthermore, the bond currents present fringe patterns and two evolution phenomena of resonant peaks are revealed for disordered BNRs with different widths. These results may help for understanding structure-property relationships and designing LD-based nanodevices.


title: Weak Supervision for Affordable Modeling of Electrocardiogram Data

abstract: Analysing electrocardiograms (ECGs) is an inexpensive and non-invasive, yet powerful way to diagnose heart disease. ECG studies using Machine Learning to automatically detect abnormal heartbeats so far depend on large, manually annotated datasets. While collecting vast amounts of unlabeled data can be straightforward, the point-by-point annotation of abnormal heartbeats is tedious and expensive. We explore the use of multiple weak supervision sources to learn diagnostic models of abnormal heartbeats via human designed heuristics, without using ground truth labels on individual data points. Our work is among the first to define weak supervision sources directly on time series data. Results show that with as few as six intuitive time series heuristics, we are able to infer high quality probabilistic label estimates for over 100,000 heartbeats with little human effort, and use the estimated labels to train competitive classifiers evaluated on held out test data.


title: Progress toward a microwave frequency standard based on laser-cooled large scale 171Yb+ ion crystal

abstract: We report on progress towards a microwave frequency standard based on a laser-cooled 171Yb+ ion trap system. The electronics, lasers, and magnetic shields are integrated into a single physical package. With over 1E5 ions are stably trapped, the system offers a high signal-to-noise ratio Ramsey line-shape. In comparison with previous work, the frequency instability of a 171Yb+ microwave clock was further improved to $8.5 \times {10^{ - 13}}/\sqrt \tau$ for averaging times between 10 and 1000 s.


title: Origin of ferroelectricity in magnesium doped zinc oxide

abstract: Recent experiments demonstrated robust ferroelectricity in Mg-doped ZnO (ZMO) of the wurtzite structure, hinting at a promising strategy to substantially expand the list of ferroelectrics by doping conventional piezoelectrics. We investigate the origin of ferroelectricity in ZMO with first-principles density functional theory (DFT). The general argument that the Mg alloying could soften the ionic potential energy surface of ZMO for polarization reversal is overly simplified. Our DFT calculations reveal that even at a high Mg concentration, the energy difference ($\Delta U$) between the polar and nonpolar phases remains prohibitively large for ZMO systems when the strain is fixed to the polar phase. Interestingly, the magnitude of $\Delta U$ becomes substantially smaller when the strain relaxation is allowed, approaching the value of typical perovskite ferroelectrics such as PbTiO$_3$ with increasing Mg doping concentrations. The enabled switchability of ZMO systems is attributed to a hexagonal phase of MgO that is much lower in energy than its wurtzite counterpart. Detailed orbital and bonding analysis supports that the intra-atomic $3d_{z^2}$-$4p_z$ orbital self-mixing of Zn plays an important role in stabilizing the polar wurtzite phase, the lack of which is responsible for the low-energy nonpolar hexagonal phase of MgO.


title: Prescribed-time Control for Linear Systems in Canonical Form Via Nonlinear Feedback

abstract: For systems in canonical form with nonvanishing uncertainties/disturbances, this work presents an approach to full state regulation within prescribed time irrespective of initial conditions. By introducing the smooth hyperbolic-tangent-like function, a nonlinear and time-varying state feedback control scheme is constructed, which is further extended to address output feedback based prescribed-time regulation by invoking the prescribed-time observer, all are applicable over the entire operational time zone. As an alternative to full state regulation within user-assignable time interval, the proposed method analytically bridges the divide between linear and nonlinear feedback based prescribed-time control, and is able to achieve asymptotic stability, exponential stability and prescribed-time stability with a unified control structure.


title: Backstepping Design Embedded With Time-Varying Command Filters

abstract: If embedded with command filter properly, the implementation of backstepping design could be dramatically simplified. In this paper, we introduce a command filter with time-varying gain and integrate it with backstepping design, resulting in a new set of backstepping control algorithms with low complexity even for high-order strict-feedback systems. Furthermore, with the aid of "softening" sign function based compensator, zero-error output tracking is ensured while at the same time maintaining prescribed transient performance. Numerical simulation is carried out to verify the effectiveness and benefits of the proposed method.


title: TPAD: Identifying Effective Trajectory Predictions Under the Guidance of Trajectory Anomaly Detection Model

abstract: Trajectory Prediction (TP) is an important research topic in computer vision and robotics fields. Recently, many stochastic TP models have been proposed to deal with this problem and have achieved better performance than the traditional models with deterministic trajectory outputs. However, these stochastic models can generate a number of future trajectories with different qualities. They are lack of self-evaluation ability, that is, to examine the rationality of their prediction results, thus failing to guide users to identify high-quality ones from their candidate results. This hinders them from playing their best in real applications. In this paper, we make up for this defect and propose TPAD, a novel TP evaluation method based on the trajectory Anomaly Detection (AD) technique. In TPAD, we firstly combine the Automated Machine Learning (AutoML) technique and the experience in the AD and TP field to automatically design an effective trajectory AD model. Then, we utilize the learned trajectory AD model to examine the rationality of the predicted trajectories, and screen out good TP results for users. Extensive experimental results demonstrate that TPAD can effectively identify near-optimal prediction results, improving stochastic TP models' practical application effect.


title: Fast solver for J2-perturbed Lambert problem using deep neural network

abstract: This paper presents a novel and fast solver for the J2-perturbed Lambert problem. The solver consists of an intelligent initial guess generator combined with a differential correction procedure. The intelligent initial guess generator is a deep neural network that is trained to correct the initial velocity vector coming from the solution of the unperturbed Lambert problem. The differential correction module takes the initial guess and uses a forward shooting procedure to further update the initial velocity and exactly meet the terminal conditions. Eight sample forms are analyzed and compared to find the optimum form to train the neural network on the J2-perturbed Lambert problem. The accuracy and performance of this novel approach will be demonstrated on a representative test case: the solution of a multi-revolution J2-perturbed Lambert problem in the Jupiter system. We will compare the performance of the proposed approach against a classical standard shooting method and a homotopy-based perturbed Lambert algorithm. It will be shown that, for a comparable level of accuracy, the proposed method is significantly faster than the other two.


title: A multivariate spectral hybridization of HS and PRP method for nonlinear systems of equations

abstract: We present a multivariate spectral hybridization of Hestenes-Stiefel (HS) and Polak-Ribiere-Polyak (PRP) method for solving large-scale nonlinear systems of equations. The search direction of the method is obtained by incorporating a multivariate spectral approach with the positive hybridization of Hestenes-Stiefel and Polak-Ribiere-Polyak parameters (HS & PRP hybrid+). By employing a derivative-free nonmonotone line search technique, the global convergence of the sequence generated by the method is proven. Numerical experiments are given to demonstrate the good performance of the method compared with similar methods in the literature designed for solving large-scale nonlinear systems of equations.


title: Adaptive Performance Anomaly Detection for Online Service Systems via Pattern Sketching

abstract: To ensure the performance of online service systems, their status is closely monitored with various software and system metrics. Performance anomalies represent the performance degradation issues (e.g., slow response) of the service systems. When performing anomaly detection over the metrics, existing methods often lack the merit of interpretability, which is vital for engineers and analysts to take remediation actions. Moreover, they are unable to effectively accommodate the ever-changing services in an online fashion. To address these limitations, in this paper, we propose ADSketch, an interpretable and adaptive performance anomaly detection approach based on pattern sketching. ADSketch achieves interpretability by identifying groups of anomalous metric patterns, which represent particular types of performance issues. The underlying issues can then be immediately recognized if similar patterns emerge again. In addition, an adaptive learning algorithm is designed to embrace unprecedented patterns induced by service updates or user behavior changes. The proposed approach is evaluated with public data as well as industrial data collected from a representative online service system in Huawei Cloud. The experimental results show that ADSketch outperforms state-of-the-art approaches by a significant margin, and demonstrate the effectiveness of the online algorithm in new pattern discovery. Furthermore, our approach has been successfully deployed in industrial practice.


title: Evolution of short-period cataclysmic variables: implications from eclipse modeling and stage A superhump method (with New Year's gift)

abstract: In 2013, the method of determining mass ratios of dwarf novae using stage A superhumps (growing superhumps) was established. This method is a dynamical one in that it relies only on celestial mechanics. It is not dependent on an experimental calibration. Since then, more than 100 objects have been measured by this method. In this paper, I provide an updated description of the method. Comparisons with the results of the modern eclipse modeling method, which is considered to be the golden standard, have shown that these two methods agree very well and the stage A superhump method has been confirmed to be as accurate and as reliable as the modern eclipse modeling method. The number of the object by the former methods is now a few time those by the latter method, and the former is indispensable to study the terminal evolution of cataclysmic variables. I also showed that past studies by the other groups assumed incorrect fractional superhump excess relations, causing biases in discussing the evolution. I also derived a new experimental relation for stage B superhumps. The updated evolutionary track around the period minimum suggests that the angular momentum loss is 1.9 times larger than expected by gravitational wave radiation. The measurements of stage A superhumps greatly owe to international collaborations with amateurs and professionals. There is similarity with the world of ornithology in that both play a role in uniting the world via international exchanges of observations. I describe a summary of these collaborations and describe my thoughts about the relation between astronomy and ornithology, and give prospects how multidisciplinary works can be made possible between these seemingly distant fields of science (abridged).


title: Resolving Camera Position for a Practical Application of Gaze Estimation on Edge Devices

abstract: Most Gaze estimation research only works on a setup condition that a camera perfectly captures eyes gaze. They have not literarily specified how to set up a camera correctly for a given position of a person. In this paper, we carry out a study on gaze estimation with a logical camera setup position. We further bring our research in a practical application by using inexpensive edge devices with a realistic scenario. That is, we first set up a shopping environment where we want to grasp customers gazing behaviors. This setup needs an optimal camera position in order to maintain estimation accuracy from existing gaze estimation research. We then apply the state-of-the-art of few-shot learning gaze estimation to reduce training sampling in the inference phase. In the experiment, we perform our implemented research on NVIDIA Jetson TX2 and achieve a reasonable speed, 12 FPS which is faster compared with our reference work, without much degradation of gaze estimation accuracy. The source code is released at https://github.com/linh-gist/GazeEstimationTX2.


title: Deep learning unflooding for robust subsalt waveform inversion

abstract: Full-waveform inversion (FWI), a popular technique that promises high-resolution models, has helped in improving the salt definition in inverted velocity models. The success of the inversion relies heavily on having prior knowledge of the salt, and using advanced acquisition technology with long offsets and low frequencies. Salt bodies are often constructed by recursively picking the top and bottom of the salt from seismic images corresponding to tomography models, combined with flooding techniques. The process is time-consuming and highly prone to error, especially in picking the bottom of the salt (BoS). Many studies suggest performing FWI with long offsets and low frequencies after constructing the salt bodies to correct the miss-interpreted boundaries. Here, we focus on detecting the BoS automatically by utilizing deep learning tools. We specifically generate many random 1D models, containing or free of salt bodies, and calculate the corresponding shot gathers. We then apply FWI starting with salt flooded versions of those models, and the results of the FWI become inputs to the neural network, whereas the corresponding true 1D models are the output. The network is trained in a regression manner to detect the BoS and estimate the subsalt velocity. We analyze three scenarios in creating the training datasets and test their performance on the 2D BP 2004 salt model. We show that when the network succeeds in estimating the subsalt velocity, the requirement of low frequencies and long offsets are somewhat mitigated. In general, this work allows us to merge the top-to-bottom approach with FWI, save the BoS picking time, and empower FWI to converge in the absence of low frequencies and long offsets in the data.


title: Tree-based Regression for Interval-valued Data

abstract: Regression methods for interval-valued data have been increasingly studied in recent years. As most of the existing works focus on linear models, it is important to note that many problems in practice are nonlinear in nature and therefore development of nonlinear regression tools for interval-valued data is crucial. In this paper, we propose a tree-based regression method for interval-valued data, which is well applicable to both linear and nonlinear problems. Unlike linear regression models that usually require additional constraints to ensure positivity of the predicted interval length, the proposed method estimates the regression function in a nonparametric way, so the predicted length is naturally positive without any constraints. A simulation study is conducted that compares our method to popular existing regression models for interval-valued data under both linear and nonlinear settings. Furthermore, a real data example is presented where we apply our method to analyze price range data of the Dow Jones Industrial Average index and its component stocks.


title: Video Source Characterization Using Encoding and Encapsulation Characteristics

abstract: We introduce a new method for camera-model identification. Our approach combines two independent aspects of video file generation corresponding to video coding and media data encapsulation. To this end, a joint representation of the overall file metadata is developed and used in conjunction with a two-level hierarchical classification method. At the first level, our method groups videos into metaclasses considering several abstractions that represent high-level structural properties of file metadata. This is followed by a more nuanced classification of classes that comprise each metaclass. The method is evaluated on more than 20K videos obtained by combining four public video datasets. Tests show that a balanced accuracy of 91% is achieved in correctly identifying the class of a video among 119 video classes. This corresponds to an improvement of 6.5% over the conventional approach based on video file encapsulation characteristics. Furthermore, we investigate a setting relevant to forensic file recovery operations where file metadata cannot be located or are missing but video data is partially available. By estimating a partial list of encoding parameters from coded video data, we demonstrate that an identification accuracy of 57% can be achieved in camera-model identification in the absence of any other file metadata.


title: Arguments about Highly Reliable Agent Designs as a Useful Path to Artificial Intelligence Safety

abstract: Several different approaches exist for ensuring the safety of future Transformative Artificial Intelligence (TAI) or Artificial Superintelligence (ASI) systems, and proponents of different approaches have made different and debated claims about the importance or usefulness of their work in the near term, and for future systems. Highly Reliable Agent Designs (HRAD) is one of the most controversial and ambitious approaches, championed by the Machine Intelligence Research Institute, among others, and various arguments have been made about whether and how it reduces risks from future AI systems. In order to reduce confusion in the debate about AI safety, here we build on a previous discussion by Rice which collects and presents four central arguments which are used to justify HRAD as a path towards safety of AI systems. We have titled the arguments (1) incidental utility,(2) deconfusion, (3) precise specification, and (4) prediction. Each of these makes different, partly conflicting claims about how future AI systems can be risky. We have explained the assumptions and claims based on a review of published and informal literature, along with consultation with experts who have stated positions on the topic. Finally, we have briefly outlined arguments against each approach and against the agenda overall.


title: ${{W}^{2,\delta}}$ Estimates for Solution Sets of Fully Nonlinear Elliptic inequalities on ${C^{1,\alpha}}$ Domains

abstract: In this paper, we establish boundary $W^{2,\delta}$ estimates for $u\in S(\lambda,\Lambda,f)$ on $C^{1,\alpha}$ domains with $f\in L^p$ as $n<p<\infty$ and $C^{1,\alpha}$ boundary values. Instead of straightening out the boundary, our main idea is to obtain boundary $W^{2,\delta}$ estimates from interior $W^{2,\delta_0}$ estimates and Whitney decomposition for some $\delta\leq \delta_0$.


title: Existence of $L^q$-dimension and entropy dimension of self-conformal measures on Riemannian manifolds

abstract: Peres and Solomyak proved that on $\mathbb R^n$, the limits defining the $L^q$-dimension for any $q\in(0,\infty)\setminus\{1\}$, and the entropy dimension of a self-conformal measure exist, without assuming any separation condition. By introducing the notions of heavy maximal packings and partitions, we prove that on a doubling metric space the $L^q$-dimension, $q\in(0,\infty)\setminus\{1\}$, is equivalent to the generalized dimension. We also generalize the result on the existence of the $L^q$-dimension to self-conformal measures on complete Riemannian manifolds with the doubling property. In particular, these results hold for complete Riemannian manifolds with nonnegative Ricci curvature. Moreover, by assuming that the measure is doubling, we extend the result on the existence of the entropy dimension to self-conformal measures on complete Riemannian manifolds.


title: Stacked-Ring Ion Guide for Cooling and Bunching Rare Isotopes

abstract: In modern rare isotope facilities, ion cooling and bunching lies at the heart of the ion transfer along a low-energy beam line that consists of several differential pumping stages. We present a conceptual design of an ion guide as an alternative to the conventional linear Radio-Frequency Quadrupole (RFQ) for cooling and bunching rare isotopes. The ion guide is composed of stacked ring electrodes of varying apertures, to which a confining RF potential following a rectangular waveform is applied. The thicknesses of the rings and the gaps in between are varied accordingly to maximize the confining volume and to reduce ion losses. Ion transport within the ion guide is facilitated by a lower-frequency wave traveling on top of the higher-frequency confining field. The former is induced by locally adjusting the duty cycle of the rectangular waveform of the confining potential. Design parameters are first calculated by analytical studies and then optimized by ion trajectory simulations with SIMION. The results show that the ion guide enables high ion transmission and produces well focused ion bunches. It will be used in the NEXT project, an experimental study of atomic masses of Neutron-rich EXotic nuclei produced in multi-nucleon Transfer reactions.


title: Underwater Robot Manipulation: Advances, Challenges and Prospective Ventures

abstract: Underwater manipulation is one of the most remarkable ongoing research subjects in robotics. \acp{I-AUV} not only have to cope with the technical challenges associated with traditional manipulation tasks but do so while currents and waves perturb the stability of the vehicle, and low-light, turbid water conditions impede perceiving the surroundings. Certainly, the dynamic nature and our limited understanding of the marine environment hinder the autonomous performance of underwater robot manipulation. This manuscript provides a discussion on previous research and the limiting factors that impose on the long-envisioned prospects of autonomous underwater manipulation to finally highlight research directions that have the potential to improve the autonomy capabilities of I-AUV.


title: Fully-heavy hexaquark states via the QCD sum rules

abstract: We construct the diquark-diquark-diquark type vector six-quark currents to investigate the vector and scalar hexaquark states in the framework of the QCD sum rules in a consistent way, and make predictions for the hexaquark masses. We can search for the fully-heavy hexaquark states in the di-$ \Omega_{ccc}$ and di-$ \Omega_{bbb}$ invariant mass spectra in the future. Combined with our previous works on the fully-heavy tetraquark states and pentaquark states, the present predictions can shed light on the nature of the fully-heavy multiquark states.


title: How Grain Boundaries and Interfacial Electrostatic Interactions Modulate Water Desalination Via Nanoporous Hexagonal Boron Nitride

abstract: Researchers are currently exploring nanoporous two-dimensional materials, such as hexagonal boron nitride (hBN), as potential desalination membranes. Here, we study the effect of grain boundaries (GBs) and interfacial electrostatic interactions on the desalination performance of bicrystalline nanoporous hBN, using classical molecular dynamics simulations supported by quantum-mechanical density functional theory (DFT) calculations. We investigate three different nanoporous bicrystalline hBN configurations, with symmetric tilt GBs having misorientation angles of 13.2{\deg}, 21.8{\deg}, and 32.2{\deg}. We find that grain boundaries alter the areas and shapes of nanopores in bicrystalline hBN, as compared to the nanopores in monocrystalline hBN. We observe that, although bicrystalline nanoporous hBN with a misorientation angle of 13.2{\deg} shows improved water flow rate by ~30%, it demonstrates reduced Na$^\mathrm{+}$ ion rejection by ~6%, as compared to monocrystalline hBN. We also uncover the role of the nanopore shape in water desalination, finding that more elongated pores with smaller sizes (in 21.8{\deg}- and 32.2{\deg}-misoriented bicrystalline hBN) can match the water permeation through less elongated pores of slightly larger sizes, with a concomitant ~3-4% drop in Na$^\mathrm{+}$ rejection. Simulations also predict that the water flow rate is significantly affected by interfacial electrostatic interactions. Indeed, the water flow rate is the highest when altered partial charges on B and N atoms were determined using DFT calculations, as compared to when no partial charges or bulk partial charges (i.e., charged hBN) were considered. Overall, our work on water/ion transport through nanopores in bicrystalline hBN indicates that the presence of GBs and surface charge can lead, respectively, to a drop in the ion rejection and water permeation performance of hBN membranes.


title: Gorenstein on the punctured spectrum and nearly Gorenstein property of the Ehrhart ring of the stable set polytope of an h-perfect graph

abstract: In this paper, we give a criterion of the nearly Gorenstein property of the Ehrhart ring of the stable set polytope of an h-perfect graph: the Ehrhart ring of the stable set polytope of an h-perfect graph $G$ with connected components $G^{(1)}, \ldots, G^{(\ell)}$ is nearly Gorenstein if and only if (1) for each $i$, the Ehrhart ring of the stable set polytope of $G^{(i)}$ is Gorenstein and (2) $|\omega(G^{(i)})-\omega(G^{(j)})|\leq 1$ for any $i$ and $j$, where $\omega(G^{(i)})$ is the clique number of $G^{(i)}$. We also show that the Segre product of Cohen-Macaulay graded rings with linear non-zerodivisor which are Gorenstein on the punctured spectrum is also Gorenstein on the punctured spectrum if all but one rings are standard graded.


title: Smooth Nested Simulation: Bridging Cubic and Square Root Convergence Rates in High Dimensions

abstract: Nested simulation concerns estimating functionals of a conditional expectation via simulation. In this paper, we propose a new method based on kernel ridge regression to exploit the smoothness of the conditional expectation as a function of the multidimensional conditioning variable. Asymptotic analysis shows that the proposed method can effectively alleviate the curse of dimensionality on the convergence rate as the simulation budget increases, provided that the conditional expectation is sufficiently smooth. The smoothness bridges the gap between the cubic root convergence rate (that is, the optimal rate for the standard nested simulation) and the square root convergence rate (that is, the canonical rate for the standard Monte Carlo simulation). We demonstrate the performance of the proposed method via numerical examples from portfolio risk management and input uncertainty quantification.


title: Low-Complexity Codebook Design for SCMA based Visible Light Communication

abstract: Sparse code multiple access (SCMA), as a code-domain non-orthogonal multiple access (NOMA) scheme, has received considerable research attention for enabling massive connectivity in future wireless communication systems. In this paper, we present a novel codebook (CB) design for SCMA based visible light communication (VLC) system, which suffers from shot noise. In particular, we introduce an iterative algorithm for designing and optimizing CB by considering the impact of shot noise at the VLC receiver. Based on the proposed CB, we derive and analyze the theoretical bit error rate (BER) expression for the resultant SCMA-VLC system. The simulation results show that our proposed CBs outperform CBs in the existing literature for different loading factors with much less complexity. Further, the derived analytical BER expression well aligns with simulated results, especially in high signal power regions.


title: Sobolev-type regularity and Pohozaev-type identities for some degenerate and singular problems

abstract: Sobolev-type regularity results are proved for solutions to a class of second order elliptic equations with a singular or degenerate weight, under non-homogeneous Neumann conditions. As an application a Pohozaev-type identity for weak solutions is derived.


title: Identification of the anomalous fast bulk events in a p-type point contact germanium detector

abstract: The ultralow detection threshold, ultralow intrinsic background, and excellent energy resolution of p-type point-contact germanium detector are important for rare-event searches, in particular for the detection of direct dark matter interactions, coherent elastic neutrino-nucleus scattering, and neutrinoless double beta decay. Anomalous bulk events with an extremely fast rise time are observed in the CDEX-1B detector. We report a method of extracting fast bulk events from bulk events using a pulse shape simulation and reconstructed source experiment signature. Calibration data and the distribution of X-rays generated by intrinsic radioactivity verified that the fast bulk experienced a single hit near the passivation layer. The performance of this germanium detector indicates that it is capable of single-hit bulk spatial resolution and thus provides a background removal technique.


title: Global monotone convergence of Newton-like iteration for a nonlinear eigen-problem

abstract: The nonlinear eigen-problem $ Ax+F(x)=\lambda x$ is studied where $A$ is an $n\times n$ irreducible Stieltjes matrix. Under certain conditions, this problem has a unique positive solution. We show that, starting from a multiple of the positive eigenvector of $A$, the Newton-like iteration for this problem converges monotonically. Numerical results illustrate the effectiveness of this Newton-like method.


title: Box2Seg: Learning Semantics of 3D Point Clouds with Box-Level Supervision

abstract: Learning dense point-wise semantics from unstructured 3D point clouds with fewer labels, although a realistic problem, has been under-explored in literature. While existing weakly supervised methods can effectively learn semantics with only a small fraction of point-level annotations, we find that the vanilla bounding box-level annotation is also informative for semantic segmentation of large-scale 3D point clouds. In this paper, we introduce a neural architecture, termed Box2Seg, to learn point-level semantics of 3D point clouds with bounding box-level supervision. The key to our approach is to generate accurate pseudo labels by exploring the geometric and topological structure inside and outside each bounding box. Specifically, an attention-based self-training (AST) technique and Point Class Activation Mapping (PCAM) are utilized to estimate pseudo-labels. The network is further trained and refined with pseudo labels. Experiments on two large-scale benchmarks including S3DIS and ScanNet demonstrate the competitive performance of the proposed method. In particular, the proposed network can be trained with cheap, or even off-the-shelf bounding box-level annotations and subcloud-level tags.


title: Nonlinear quantum gates for a Bose-Einstein condensate

abstract: Quantum interferometry and quantum information processing have been proposed for Bose-Einstein condensates (BECs), but BECs are described in complicated ways such as using quantum field theory or using a nonlinear differential equation. Nonlinear quantum mechanics does not mesh well with the superposition principle at the heart of interferometry and quantum information processing but could be compatible. Thus, we develop a rigorous foundation for quantum gates, obtained by solving the equation for evolution, and then we employ this foundation, combined with quantum-control techniques and appropriate state-sampling techniques, to devise feasible nonlinear Hadamard gates and thereby feasible, i.e., high-contrast, nonlinear Ramsey interferometry. Our approach to BEC interferometry and quantum logic shifts the paradigm by enlarging to the case of nonlinear quantum mechanics, which we apply to the cases of BEC interferometry and quantum information processing.


title: Properties of Gamow-Teller and charge-exchange giant spin-monopole resonances in medium-heavy closed-shell parent nuclei: a semi-microscopic description

abstract: The basic version of the semi-microscopic particle-hole dispersive optical model is implemented to describe main properties of the Gamow-Teller and charge-exchange giant spin-monopole resonances in medium-heavy closed-shell parent nuclei. Calculation results obtained for $^{48}Ca$, $^{90}Zr$, $^{132}Sn$, and $^{208}Pb$ are compared with available experimental data.


title: Phase-space consideration on barrier transmission in a time-dependent variational approach with superposed wave packets

abstract: A known limitation of time-dependent mean-field approaches is a lack of quantum tunneling for collective motions such as in sub-barrier fusion reactions. As a first step toward a solution, a time-dependent model is considered using a superposition of Gaussian wave packets, to describe the relative motion between two colliding nuclei, which may be simplified to a problem for one particle in one dimension. In this article, how the model describes the potential-barrier transmission is investigated by paying attention to the time evolution of the phase space distribution, which in particular reveals that the behavior of the free propagation of the incoming state is not trivial, depending on the number of superposed wave packets. Passage over the barrier can occur due to the high-momentum components in the incoming state corresponding to energies above the barrier height, which is, however, of classical nature and needs to be distinguished from the true quantum tunneling. Although a transmitted wave packet in some case may end up with an energy lower than the barrier, a difficulty is noticed in guaranteeing the energy conservation when the energies of different exit channels, e.g. of transmission and reflection, are individually measured. To overcome these issues for a description of quantum tunneling is still a challenging problem. This article mainly treats the same system with the same model as in the paper Phys. Lett. B 808 (2020) 135693, arXiv:2006.06944v1 by N. Hasegawa, K. Hagino and Y. Tanimura. However, the conclusion of the present work disagrees with their quick conclusion that quantum tunneling was simulated by the model. Comments are made on this.


title: Robust classification with flexible discriminant analysis in heterogeneous data

abstract: Linear and Quadratic Discriminant Analysis are well-known classical methods but can heavily suffer from non-Gaussian distributions and/or contaminated datasets, mainly because of the underlying Gaussian assumption that is not robust. To fill this gap, this paper presents a new robust discriminant analysis where each data point is drawn by its own arbitrary Elliptically Symmetrical (ES) distribution and its own arbitrary scale parameter. Such a model allows for possibly very heterogeneous, independent but non-identically distributed samples. After deriving a new decision rule, it is shown that maximum-likelihood parameter estimation and classification are very simple, fast and robust compared to state-of-the-art methods.


title: An Adaptive Device-Edge Co-Inference Framework Based on Soft Actor-Critic

abstract: Recently, the applications of deep neural network (DNN) have been very prominent in many fields such as computer vision (CV) and natural language processing (NLP) due to its superior feature extraction performance. However, the high-dimension parameter model and large-scale mathematical calculation restrict the execution efficiency, especially for Internet of Things (IoT) devices. Different from the previous cloud/edge-only pattern that brings huge pressure for uplink communication and device-only fashion that undertakes unaffordable calculation strength, we highlight the collaborative computation between the device and edge for DNN models, which can achieve a good balance between the communication load and execution accuracy. Specifically, a systematic on-demand co-inference framework is proposed to exploit the multi-branch structure, in which the pre-trained Alexnet is right-sized through \emph{early-exit} and partitioned at an intermediate DNN layer. The integer quantization is enforced to further compress transmission bits. As a result, we establish a new Deep Reinforcement Learning (DRL) optimizer-Soft Actor Critic for discrete (SAC-d), which generates the \emph{exit point}, \emph{partition point}, and \emph{compressing bits} by soft policy iterations. Based on the latency and accuracy aware reward design, such an optimizer can well adapt to the complex environment like dynamic wireless channel and arbitrary CPU processing, and is capable of supporting the 5G URLLC. Real-world experiment on Raspberry Pi 4 and PC shows the outperformance of the proposed solution.


title: Control of electron beam polarization in the bubble regime of laser-wakefield acceleration

abstract: Electron beam polarization in the bubble regime of the interaction between a high-intensity laser and a longitudinally pre-polarized plasma is investigated by means of the Thomas-Bargmann-Michel-Telegdi equation. Using a test-particle model, the dependence of the accelerated electron polarization on the bubble geometry is analyzed in detail. Tracking the polarization dynamics of individual electrons reveals that although the spin direction changes during both the self-injection process and acceleration phase, the former has the biggest impact. For nearly spherical bubbles, the polarization of electron beam persists after capture and acceleration in the bubble. By contrast, for aspherical bubble shapes, the electron beam becomes rapidly depolarized, and the net polarization direction can even reverse in the case of a oblate spheroidal bubble. These findings are confirmed via particle-in-cell simulations.


title: The upper tail problem for induced 4-cycles in sparse random graphs

abstract: Building on the techniques from the breakthrough paper of Harel, Mousset and Samotij, which solved the upper tail problem for cliques, we compute the asymptotics of the upper tail for the number of induced copies of the 4-cycle in the binomial random graph $G_{n,p}$. We observe a new phenomenon in the theory of large deviations of subgraph counts. This phenomenon is that, in a certain (large) range of $p$, the upper tail of the induced 4-cycle does not admit a naive mean-field approximation.


title: Bounce corrections to gravitational lensing, quasinormal spectral stability and gray-body factors of Reissner-Nordstr\"om black holes

abstract: Gravitational lensing in the weak field limit, quasinormal spectra, and gray-body factors are investigated in the Reissner-Nordstr\"om spacetime corrected by bounce parameters. Using the Gauss-Bonnet theorem, we analyze the effects of bounce corrections to the weak gravitational deflection angle and find that the divergence of the deflection angle can be suppressed by a bounce correction in the Reissner-Nordstr\"om spacetime. We also notice that the bounce correction plays the same role as the Morse potential in the deflection angle. Moreover, we derive the perturbation equations with the spin-dependent Regge-Wheeler potential and discuss the quasinormal spectral stability. We observe that the quasinormal spectra decrease for both the massless scalar and electromagnetic field perturbations. We further study the transmission probability of particles scattered by the Regge-Wheeler potential and reveal that the bounce correction introduced into the Reissner-Nordstr\"om spacetime increases the gray-body factors of perturbation fields.


title: Performance Analysis and Power Allocation of Joint Communication and Sensing Towards Future Communication Networks

abstract: To mitigate the radar and communication frequency overlapping caused by massive devices access, we propose a novel joint communication and sensing (JCS) system in this paper, where a micro base station (MiBS) can realize target sensing and cooperative communication simultaneously. Concretely, the MiBS, as the sensing equipment, can also serve as a full-duplex (FD) decode-and-forward (DF) relay to assist the end-to-end communication. To further improve the spectrum utilization, non-orthogonal multiple access (NOMA) is adopted such that the communication between the macro base station (MaBS) and the Internet-of-Things (IoT) devices. To facilitate the performance evaluation, the exact and asymptotic outage probabilities, ergodic rates, sensing probability of the system are characterized. Subsequently, two optimal power allocation (OPA) problems of maximizing the received signal-to-interference-plus-noise ratio of sensing signal and maximizing the sum rate for communication are designed that are solved by means of the Lagrangian method and function monotonicity. The simulation results demonstrate that: 1) the proposed JCS NOMA system can accomplish both communication enhancement and sensing function under the premise of the same power consumption as non-cooperative NOMA; 2) the proposed OPA schemes manifest superiorities over a random power allocation scheme.


title: MAXIM: Multi-Axis MLP for Image Processing

abstract: Recent progress on Transformers and multi-layer perceptron (MLP) models provide new network architectural designs for computer vision tasks. Although these models proved to be effective in many vision tasks such as image recognition, there remain challenges in adapting them for low-level vision. The inflexibility to support high-resolution images and limitations of local attention are perhaps the main bottlenecks. In this work, we present a multi-axis MLP based architecture called MAXIM, that can serve as an efficient and flexible general-purpose vision backbone for image processing tasks. MAXIM uses a UNet-shaped hierarchical structure and supports long-range interactions enabled by spatially-gated MLPs. Specifically, MAXIM contains two MLP-based building blocks: a multi-axis gated MLP that allows for efficient and scalable spatial mixing of local and global visual cues, and a cross-gating block, an alternative to cross-attention, which accounts for cross-feature conditioning. Both these modules are exclusively based on MLPs, but also benefit from being both global and `fully-convolutional', two properties that are desirable for image processing. Our extensive experimental results show that the proposed MAXIM model achieves state-of-the-art performance on more than ten benchmarks across a range of image processing tasks, including denoising, deblurring, deraining, dehazing, and enhancement while requiring fewer or comparable numbers of parameters and FLOPs than competitive models. The source code and trained models will be available at \url{https://github.com/google-research/maxim}.


title: Resistivity testing of palladium dilution limits in CoPd alloys for hydrogen storage

abstract: Palladium satisfies most of the requirements for an effective hydrogen storage material with two major drawbacks: it has a relatively low gravimetric hydrogen density and is prohibitively expensive for large-scale applications. Pd-based alloys should be considered as possible alternatives to a pure Pd. The question is how much one can dilute the Pd concentration in a variety of candidate materials while preserving hydrogen absorption capability. We demonstrate that the resistivity measurements of thin-film alloy samples can be used for a qualitative high-throughput screening and study of the hydrogen-absorbing properties over the entire range of palladium concentrations. Contrary to palladium-rich alloys where additional hydrogen scattering indicates a degree of hydrogen content, the diluted alloy films respond by a decrease of resistance due to their thickness expansion. Evidence of significant hydrogen absorption was found in thin CoPd films diluted to just 20% of Pd.


title: Asymptotics for Exponential Functionals of Random Walks

abstract: This paper provides a detailed description for the asymptotics of exponential functionals of random walks with light/heavy tails. We give the convergence rate based on the key observation that the asymptotics depends on the simple paths with either slowly decreasing local minimum or final value below a low level. Also, our careful analysis of the interrelationship between the local minimum and the final value provides the exact expression of the limiting coefficient in terms of some transformations of the random walk.


title: On the structure and long-term evolution of ice-rich bodies

abstract: The interest in the structure of ice-rich planetary bodies, in particular the differentiation between ice and rock, has grown due to the discovery of Kuiper belt objects and exoplanets. We thus carry out a parameter study for a range of planetary masses $M$, yielding radii $50 \aplt R \aplt 3000$~km, and for rock/ice mass ratios between 0.25 and 4, evolving them for 4.5~Gyr in a cold environment, to obtain the present structure. We use a thermal evolution model that allows for liquid and vapor flow in a porous medium, solving mass and energy conservation equations under hydrostatic equilibrium for a spherical body in orbit around a central star. The model includes the effect of pressure on porosity and on the melting temperature, heating by long-lived radioactive isotopes, and temperature-dependent serpentinization and dehydration. We obtain the boundary in parameter space [size, rock-content] between bodies that differentiate, forming a rocky core, and those which remain undifferentiated: small bodies, bodies with a low rock content, and the largest bodies considered, which develop high internal pressures and barely attain the melting temperature. The final differentiated structure comprises a rocky core, an ice-rich mantle, and a thin dense crust below the surface. We obtain and discuss the bulk density-radius relationship. The effect of a very cold environment is investigated and we find that at an ambient temperature of $\sim$20~K, small bodies preserve the ice in amorphous form to the present.


title: Indian Language Wordnets and their Linkages with Princeton WordNet

abstract: Wordnets are rich lexico-semantic resources. Linked wordnets are extensions of wordnets, which link similar concepts in wordnets of different languages. Such resources are extremely useful in many Natural Language Processing (NLP) applications, primarily those based on knowledge-based approaches. In such approaches, these resources are considered as gold standard/oracle. Thus, it is crucial that these resources hold correct information. Thereby, they are created by human experts. However, human experts in multiple languages are hard to come by. Thus, the community would benefit from sharing of such manually created resources. In this paper, we release mappings of 18 Indian language wordnets linked with Princeton WordNet. We believe that availability of such resources will have a direct impact on the progress in NLP for these languages.


title: Auto-Encoder based Co-Training Multi-View Representation Learning

abstract: Multi-view learning is a learning problem that utilizes the various representations of an object to mine valuable knowledge and improve the performance of learning algorithm, and one of the significant directions of multi-view learning is sub-space learning. As we known, auto-encoder is a method of deep learning, which can learn the latent feature of raw data by reconstructing the input, and based on this, we propose a novel algorithm called Auto-encoder based Co-training Multi-View Learning (ACMVL), which utilizes both complementarity and consistency and finds a joint latent feature representation of multiple views. The algorithm has two stages, the first is to train auto-encoder of each view, and the second stage is to train a supervised network. Interestingly, the two stages share the weights partly and assist each other by co-training process. According to the experimental result, we can learn a well performed latent feature representation, and auto-encoder of each view has more powerful reconstruction ability than traditional auto-encoder.


title: Enhanced total variation minimization for stable image reconstruction

abstract: The total variation (TV) regularization has phenomenally boosted various variational models for image processing tasks. We propose to combine the backward diffusion process in the earlier literature of image enhancement with the TV regularization, and show that the resulting enhanced TV minimization model is particularly effective for reducing the loss of contrast. The main purpose of this paper is to establish stable reconstruction guarantees for the enhanced TV model from noisy subsampled measurements with two sampling strategies, non-adaptive sampling for general linear measurements and variable-density sampling for Fourier measurements. In particular, under some weaker restricted isometry property conditions, the enhanced TV minimization model is shown to have tighter reconstruction error bounds than various TV-based models for the scenario where the level of noise is significant and the amount of measurements is limited. Advantages of the enhanced TV model are also numerically validated by preliminary experiments on the reconstruction of some synthetic, natural, and medical images.

categories: eess.IV cs.CV cs.IT cs.NA math.IT math.NA


title: Invariance encoding in sliced-Wasserstein space for image classification with limited training data

abstract: Deep convolutional neural networks (CNNs) are broadly considered to be state-of-the-art generic end-to-end image classification systems. However, they are known to underperform when training data are limited and thus require data augmentation strategies that render the method computationally expensive and not always effective. Rather than using a data augmentation strategy to encode invariances as typically done in machine learning, here we propose to mathematically augment a nearest subspace classification model in sliced-Wasserstein space by exploiting certain mathematical properties of the Radon Cumulative Distribution Transform (R-CDT), a recently introduced image transform. We demonstrate that for a particular type of learning problem, our mathematical solution has advantages over data augmentation with deep CNNs in terms of classification accuracy and computational complexity, and is particularly effective under a limited training data setting. The method is simple, effective, computationally efficient, non-iterative, and requires no parameters to be tuned. Python code implementing our method is available at https://github.com/rohdelab/mathematical_augmentation. Our method is integrated as a part of the software package PyTransKit, which is available at https://github.com/rohdelab/PyTransKit.


title: A New Constructions of Minimal Binary Linear Codes

abstract: Recently, minimal linear codes have been extensively studied due to their applications in secret sharing schemes, secure two-party computations, and so on. Constructing minimal linear codes violating the Ashikhmin-Barg condition and then determining their weight distributions have been interesting in coding theory and cryptography. In this paper, a generic construction for binary linear codes with dimension $m+2$ is presented, then a necessary and sufficient condition for this binary linear code to be minimal is derived. Based on this condition and exponential sums, a new class of minimal binary linear codes violating the Ashikhmin-Barg condition is obtained, and then their weight enumerators are determined.


title: A martingale approach to time-dependent and time-periodic linear response in Markov jump processes

abstract: We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the perturbation we show that the perturbed process does not explode almost surely and we study the linear response (LR) of observables and additive functionals. When the unperturbed process is stationary, the above LR formulas become computable in terms of the steady state two-time correlation function and of the stationary distribution. Applications are discussed for birth and death processes, random walks in a confining potential, random walks in a random conductance field. We then move to a Markov jump process on a finite state space and investigate the LR of observables and additive functionals in the oscillatory steady state (hence, over an infinite time horizon), when the perturbation is time-periodic. As an application we provide a formula for the complex mobility matrix of a random walk on a discrete $d$-dimensional torus, with possibly heterogeneous jump rates.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Market Impact of Small Orders

abstract: The article is an empirical study of market impact through order book events. It describes a mechanism of extracting an average participation rate and a market impact of small orders which represent individual slices of large metaorders. The study is based on tick data for futures contracts. It is shown that the impact could be either linear or a concave function as a function of trading volume, depending on the instrument. After normalisation, this dependency is shown to be very similar for a wide range of instruments. A simple yet effective model for market impact estimation is proposed. This model is linear in nature and is derived based on straightforward microstructure reasoning. The estimation shows satisfactory results for both concave and linear market impact volume dependencies.


title: On isotropic and numerical equivalence of cycles

abstract: We study the conjecture claiming that, over a flexible field, isotropic Chow groups coincide with numerical Chow groups (with ${\Bbb{F}}_p$-coefficients). This conjecture is essential for understanding the structure of the isotropic motivic category and that of the tensor triangulated spectrum of Voevodsky category of motives. We prove the conjecture for the new range of cases. In particular, we show that, for a given variety $X$, it holds for sufficiently large primes $p$. We also prove the $p$-adic analogue. This permits to interpret integral numerically trivial classes in $CH(X)$ as $p^{\infty}$-anisotropic ones.


title: Routing in an Uncertain World: Adaptivity, Efficiency, and Equilibrium

abstract: We consider the traffic assignment problem in nonatomic routing games where the players' cost functions may be subject to random fluctuations (e.g., weather disturbances, perturbations in the underlying network, etc.). We tackle this problem from the viewpoint of a control interface that makes routing recommendations based solely on observed costs and without any further knowledge of the system's governing dynamics -- such as the network's cost functions, the distribution of any random events affecting the network, etc. In this online setting, learning methods based on the popular exponential weights algorithm converge to equilibrium at an $\mathcal{O}({1/\sqrt{T}})$ rate: this rate is known to be order-optimal in stochastic networks, but it is otherwise suboptimal in static networks. In the latter case, it is possible to achieve an $\mathcal{O}({1/T^{2}})$ equilibrium convergence rate via the use of finely tuned accelerated algorithms; on the other hand, these accelerated algorithms fail to converge altogether in the presence of persistent randomness, so it is not clear how to achieve the "best of both worlds" in terms of convergence speed. Our paper seeks to fill this gap by proposing an adaptive routing algortihm with the following desirable properties: $(i)$ it seamlessly interpolates between the $\mathcal{O}({1/T^{2}})$ and $\mathcal{O}({1/\sqrt{T}})$ rates for static and stochastic environments respectively; $(ii)$ its convergence speed is polylogarithmic in the number of paths in the network; ${(iii)}$ the method's per-iteration complexity and memory requirements are both linear in the number of nodes and edges in the network; and ${(iv)}$ it does not require any prior knowledge of the problem's parameters.


title: SoK: Rowhammer on Commodity Operating Systems

abstract: Rowhammer has drawn much attention from both academia and industry in the past years as rowhammer exploitation poses severe consequences to system security. Since the first comprehensive study of rowhammer in 2014, a number of rowhammer attacks have been demonstrated against dynamic random access memory (DRAM)-based commodity systems to break software confidentiality, integrity and availability. Accordingly, numerous software defenses have been proposed to mitigate rowhammer attacks on commodity systems of either legacy (e.g., DDR3) or recent DRAM (e.g., DDR4). Besides, multiple hardware defenses (e.g., Target Row Refresh) from the industry have been deployed into recent DRAM to eliminate rowhammer, which we categorize as production defenses. In this paper, we systematize rowhammer attacks and defenses with a focus on DRAM-based commodity systems. Particularly, we have established a unified framework demonstrating how a rowhammer attack affects a commodity system. With the framework, we characterize existing attacks, shedding light on new attack vectors that have not yet been explored. We further leverage the framework to categorize software and production defenses, generalize their key defense strategies and summarize their key limitations, from which potential defense strategies are identified.


title: Portfolio selection models based on interval-valued conditional value at risk (ICVaR) and empirical analysis

abstract: Risk management is very important for individual investors or companies. There are many ways to measure the risk of investment. Prices of risky assets vary rapidly and randomly due to the complexity of finance market. Random interval is a good tool to describe uncertainty with both randomness and imprecision. Considering the uncertainty of financial market, we employ random intervals to describe the returns of a risk asset and consider the tail risk, which is called the interval-valued Conditional Value at Risk (ICVaR, for short). Such an ICVaR is a risk measure and satisfies subadditivity. Under the new risk measure ICVaR, as a manner similar to the classical portfolio model of Markowitz, optimal interval-valued portfolio selection models are built. Based on the real data from mainland Chinese stock market, the case study shows that our models are interpretable and consistent with the practical scenarios.


title: Secure Transmission for IRS-Assisted MIMO MmWave Systems

abstract: In this paper, we investigate the secure beamforming design in an intelligent reflection surface (IRS) assisted millimeter wave (mmWave) system, where the hybrid beamforming (HB) and the passive beamforming (PB) are employed by the transmitter and the IRS, respectively. To maximize the secrecy capacity, the joint optimization of HB and PB is formulated as a nonconvex problem with constant-modulus constraints. To efficiently solve such a challenging problem, the original problem is decomposed into a PB subproblem and an HB subproblem, then these two subproblems are sequentially solved by proposed algorithms. Simulation results demonstrate the superior performance of proposed approach in comparison with the state-of-the-art works.


title: CP Phases in 2HDM and Effective Potential: A Geometrical View

abstract: Using a geometric description of 2HDM, we classify CP invariants into three independent sectors such as scalar potential, Yukawa interaction and CKM matrix. Thermal effective potential of 2HDM is calculated in a basis invariant way. It is shown that the CP violation in Yukawa interactions can contribute to effective potential at one loop level but the CP phase in the CKM matrix cannot leak to effective potential at all orders. In the 2HDM with a softly broken Z_2 symmetry, the leading thermal correction tends to restore the CP symmetry at high temperature.


title: Immersed boundary approach to biofilm spread on surfaces

abstract: We propose a computational framework to study the growth and spread of bacterial biofilms on interfaces, as well as the action of antibiotics on them. Bacterial membranes are represented by boundaries immersed in a fluid matrix and subject to interaction forces. Growth, division and death of bacterial cells follow dynamic energy budget rules, in response to variations in environmental concentrations of nutrients, toxicants and substances released by the cells. In this way, we create, destroy and enlarge boundaries, either spherical or rod-like. Appropriate forces represent details of the interaction between cells, and the interaction with the environment. Numerical simulations illustrate the evolution of top views and diametral slices of small biofilm seeds, as well as the action of antibiotics. We show that cocktails of antibiotics targeting active and dormant cells can entirely eradicate a biofilm.

categories: q-bio.CB physics.bio-ph physics.comp-ph physics.med-ph


title: A Survey on Face Recognition Systems

abstract: Face Recognition has proven to be one of the most successful technology and has impacted heterogeneous domains. Deep learning has proven to be the most successful at computer vision tasks because of its convolution-based architecture. Since the advent of deep learning, face recognition technology has had a substantial increase in its accuracy. In this paper, some of the most impactful face recognition systems were surveyed. Firstly, the paper gives an overview of a general face recognition system. Secondly, the survey covers various network architectures and training losses that have had a substantial impact. Finally, the paper talks about various databases that are used to evaluate the capabilities of a face recognition system.


title: Chemical principles of instability and self-organization in reacting and diffusive systems

abstract: How patterns and structures undergo symmetry breaking and self-organize within biological systems from initially homogeneous states is a key issue for biological development. The activator-inhibitor (AI) mechanism, derived from reaction-diffusion (RD) models, has been widely believed to be the elementary mechanism for biological pattern formation. This mechanism generally requires activators to be self-enhanced and diffuse more slowly than inhibitors. Here, we identify the instability sources of biological systems and derive the self-organization conditions through solving eigenvalues (dispersion relation) of the generalized RD model for two chemicals. We show that both the single AI mechanisms with long-range inhibition and activation are enough to self-organize into fully-expressed domains without the involvement of the inhibitor-inhibitor (II) mechanism, through singly enhancing the difference in self-proliferation rates of activators and inhibitors or weakening the coupling degree between them. When cross diffusion involves, both the self-enhancement and the difference in diffusion coefficients of chemicals are no longer necessary for self-organization, and the patterning mechanism can be extended to semi-inhibitor and II mechanisms. However, we show that the single activator-activator (AA) mechanism is generally unable to self-organize, even if biological domain growth is additionally involved. Moreover, adding an II system after an AI one can produce discrete and bi-stable patterns. We also observe that a higher dimensional space can solely alter the patterning principles derived from a lower dimensional space, which may be due to the instability driven by the higher degree of spatial freedom. Such results provide new insights into biological pattern formation.


title: Rethink the Evaluation for Attack Strength of Backdoor Attacks in Natural Language Processing

abstract: It has been shown that natural language processing (NLP) models are vulnerable to a kind of security threat called the Backdoor Attack, which utilizes a `backdoor trigger' paradigm to mislead the models. The most threatening backdoor attack is the stealthy backdoor, which defines the triggers as text style or syntactic. Although they have achieved an incredible high attack success rate (ASR), we find that the principal factor contributing to their ASR is not the `backdoor trigger' paradigm. Thus the capacity of these stealthy backdoor attacks is overestimated when categorized as backdoor attacks. Therefore, to evaluate the real attack power of backdoor attacks, we propose a new metric called attack successful rate difference (ASRD), which measures the ASR difference between clean state and poison state models. Besides, since the defenses against stealthy backdoor attacks are absent, we propose Trigger Breaker, consisting of two too simple tricks that can defend against stealthy backdoor attacks effectively. Experiments show that our method achieves significantly better performance than state-of-the-art defense methods against stealthy backdoor attacks.


title: Emotional Speaker Identification using a Novel Capsule Nets Model

abstract: Speaker recognition systems are widely used in various applications to identify a person by their voice; however, the high degree of variability in speech signals makes this a challenging task. Dealing with emotional variations is very difficult because emotions alter the voice characteristics of a person; thus, the acoustic features differ from those used to train models in a neutral environment. Therefore, speaker recognition models trained on neutral speech fail to correctly identify speakers under emotional stress. Although considerable advancements in speaker identification have been made using convolutional neural networks (CNN), CNNs cannot exploit the spatial association between low-level features. Inspired by the recent introduction of capsule networks (CapsNets), which are based on deep learning to overcome the inadequacy of CNNs in preserving the pose relationship between low-level features with their pooling technique, this study investigates the performance of using CapsNets in identifying speakers from emotional speech recordings. A CapsNet-based speaker identification model is proposed and evaluated using three distinct speech databases, i.e., the Emirati Speech Database, SUSAS Dataset, and RAVDESS (open-access). The proposed model is also compared to baseline systems. Experimental results demonstrate that the novel proposed CapsNet model trains faster and provides better results over current state-of-the-art schemes. The effect of the routing algorithm on speaker identification performance was also studied by varying the number of iterations, both with and without a decoder network.


title: Effectiveness of Area-to-Value Legends and Grid Lines in Contiguous Area Cartograms

abstract: A contiguous area cartogram is a geographic map in which the area of each region is proportional to numerical data (e.g., population size) while keeping neighboring regions connected. In this study, we investigated whether value-to-area legends (square symbols next to the values represented by the squares' areas) and grid lines aid map readers in making better area judgments. We conducted an experiment to determine the accuracy, speed, and confidence with which readers infer numerical data values for the mapped regions. We found that, when only informed about the total numerical value represented by the whole cartogram without any legend, the distribution of estimates for individual regions was centered near the true value with substantial spread. Legends with grid lines significantly reduced the spread but led to a tendency to underestimate the values. Comparing differences between regions or between cartograms revealed that legends and grid lines slowed the estimation without improving accuracy. However, participants were more likely to complete the tasks when legends and grid lines were present, particularly when the area units represented by these features could be interactively selected. We recommend considering the cartogram's use case and purpose before deciding whether to include grid lines or an interactive legend.


title: Internal Gravity Waves in the Earth's Ionosphere

abstract: The theory of low-frequency internal gravity waves (IGWs) is readdressed in the stable stratified weakly ionized Earth's ionosphere. The formation of dipolar vortex structures and their dynamical evolution, as well as, the emergence of chaos in the wave-wave interactions are studied both in presence and absence of the Pedersen conductivity. The latter is shown to inhibit the formation of solitary vortices and the onset of chaos.


title: Performance Analysis of Event-Triggered Consensus Control for Multi-agent Systems under Cyber-Physical Attacks

abstract: This work presents a rigorous analysis of the adverse effects of cyber-physical attacks on the performance of multi-agent consensus with event-triggered control protocols. It is shown how a strategic malicious attack on sensors and actuators can deceive the triggering condition of both state-based event-triggered mechanism and combinational state-based event-triggered mechanism, which are commonplace and widely used in the literature. More precisely, it is first shown that a deception attack in the case of combinational state-based event-triggered mechanism can result in a non-triggering misbehavior, in the sense that the compromised agent does not trigger any event and consequently results in partial feedback disconnectivity by preventing information from reaching the local neighbors of the compromised agent. This indicates that the combinational state-based event-triggered mechanism can be leveraged by the attacker to harm the network connectivity by rendering the recent data unavailable to agents. It is then shown that the deception attack in the case of state-based event-triggered mechanism can result in a continuous-triggering misbehavior in the sense that the event-triggered mechanism continuously generates triggering events resulting in undesirable phenomenon of Zeno behavior. Finally, numerical simulations are presented to illustrate the theoretical findings.


title: Correlations and Critical Behavior in Lattice Gluodynamics

abstract: In the Landau-gauge lattice gluodynamics we find that, both in the SU(2) and SU(3) theory, a correlation of the Polyakov loop with the asymmetry of the $A^2$ gluon condensate as well as with the longitudinal propagator makes it possible to determine the critical behavior of these quantities. We discuss finite-volume corrections and reveal that they can be reduced by the use of regression analysis. We also analyze the temperature dependence of low-momenta propagators in different Polyakov-loop sectors.


title: Protostellar Outflows: a window to the past

abstract: During the early phases of low-mass star formation, episodic accretion causes the ejection of high-velocity outflow bullets, which carry a fossil record of the driving protostar's accretion history. We present 44 SPH simulations of $1\,\mathrm{M}_{\odot}$ cores, covering a wide range of initial conditions, and follow the cores for five free-fall times. Individual protostars are represented by sink particles, and the sink particles launch episodic outflows using a subgrid model. The Optics algorithm is used to identify individual episodic bullets within the outflows. The parameters of the overall outflow and the individual bullets are then used to estimate the age and energetics of the outflow, and the accretion events that triggered it; and to evaluate how reliable these estimates are, if observational uncertainties and selection effects (like inclination) are neglected. Of the commonly used methods for estimating outflow ages, it appears that those based on the length and speed of advance of the lobe are the most reliable in the early phases of evolution, and those based on the width of the outflow cavity and the speed of advance are most reliable during the later phases. We describe a new method that is almost as accurate as these methods, and reliable throughout the evolution. In addition we show how the accretion history of the protostar can be accurately reconstructed from the dynamics of the bullets if each lobe contains at least two bullets. The outflows entrain about ten times more mass than originally ejected by the protostar.


title: Quantum Distributed Algorithms for Detection of Cliques

abstract: The possibilities offered by quantum computing have drawn attention in the distributed computing community recently, with several breakthrough results showing quantum distributed algorithms that run faster than the fastest known classical counterparts, and even separations between the two models. A prime example is the result by Izumi, Le Gall, and Magniez [STACS 2020], who showed that triangle detection by quantum distributed algorithms is easier than triangle listing, while an analogous result is not known in the classical case. In this paper we present a framework for fast quantum distributed clique detection. This improves upon the state-of-the-art for the triangle case, and is also more general, applying to larger clique sizes. Our main technical contribution is a new approach for detecting cliques by encapsulating this as a search task for nodes that can be added to smaller cliques. To extract the best complexities out of our approach, we develop a framework for nested distributed quantum searches, which employ checking procedures that are quantum themselves. Moreover, we show a circuit-complexity barrier on proving a lower bound of the form $\Omega(n^{3/5+\epsilon})$ for $K_p$-detection for any $p \geq 4$, even in the classical (non-quantum) distributed CONGEST setting.


title: A reduced variational approach for searching cycles in high-dimensional systems

abstract: Searching recurrent patterns in complex systems with high-dimensional phase spaces is an important task in diverse fields. In the current work, an improved scheme is proposed to accelerate the recently designed variational approach for finding periodic orbits in systems with chaotic dynamics based on the existence of inertial manifold widely observed in various spatially extended systems, especially those with high dimensions. On the premise of keeping exponential convergence of the variational method, an effective loop evolution equation is derived to greatly reduce the storage and computing time. With repeated modification of local coordinates and evolution of the guess loop being carried out alternately, the rapid convergence and the stability of the reduction scheme are effectively achieved. The dimension of local coordinate subspaces is generally larger than the number of nonnegative Lyapunov exponents to ensure the exponential convergence. The proposed scheme is successfully demonstrated on several well-known examples and expected to supply a powerful tool in the exploration of high-dimensional nonlinear systems.


title: MaskMTL: Attribute prediction in masked facial images with deep multitask learning

abstract: Predicting attributes in the landmark free facial images is itself a challenging task which gets further complicated when the face gets occluded due to the usage of masks. Smart access control gates which utilize identity verification or the secure login to personal electronic gadgets may utilize face as a biometric trait. Particularly, the Covid-19 pandemic increasingly validates the essentiality of hygienic and contactless identity verification. In such cases, the usage of masks become more inevitable and performing attribute prediction helps in segregating the target vulnerable groups from community spread or ensuring social distancing for them in a collaborative environment. We create a masked face dataset by efficiently overlaying masks of different shape, size and textures to effectively model variability generated by wearing mask. This paper presents a deep Multi-Task Learning (MTL) approach to jointly estimate various heterogeneous attributes from a single masked facial image. Experimental results on benchmark face attribute UTKFace dataset demonstrate that the proposed approach supersedes in performance to other competing techniques. The source code is available at https://github.com/ritikajha/Attribute-prediction-in-masked-facial-images-with-deep-multitask-learning


title: A simple model describing evolution of genomic GC content with random perturbations in asexually reproducing organisms

abstract: A model is presented relating the evolution of genomic GC content over time to AT$\rightarrow$GC and GC$\rightarrow$AT mutation rates. By employing It\^o calculus it is shown that if mutation rates in asexually reproducing organisms are subject to random perturbations that can vary over time several implications follow. For instance, an extra Brownian motion term appears influencing nucleotide variability; the greater the variability of the random perturbations on the mutation rates the stronger the impact of the Brownian motion term. Reducing the influence of the random perturbations, to limit fitness decreasing and deleterious mutations, will likely imply divesting resources to genomic repair systems. The stable mutation rates seen in many organisms could thus be an evolved strategy to reduce the influence of the Brownian motion term. Furthermore, if change to genomic GC content, i.e. the GC content of variable sites or single nucleotide polymorphisms (SNPs), is just as likely to increase as to decrease, something that resembles knockout of repair enzymes and removal of selective pressures seen in evolutionary laboratory experiments, the species genome will likely decay unless infinite resources are available. These implications are solely a consequence of allowing random perturbations affect AT- and GC mutation rates and not obtainable using standard non-stochastic methodology. Finally, a connection between the model for genomic GC content evolution and the classical Luria-Delbr\"uck mutation model is presented in a stochastic setting.


title: Privacy-aware Early Detection of COVID-19 through Adversarial Training

abstract: Early detection of COVID-19 is an ongoing area of research that can help with triage, monitoring and general health assessment of potential patients and may reduce operational strain on hospitals that cope with the coronavirus pandemic. Different machine learning techniques have been used in the literature to detect coronavirus using routine clinical data (blood tests, and vital signs). Data breaches and information leakage when using these models can bring reputational damage and cause legal issues for hospitals. In spite of this, protecting healthcare models against leakage of potentially sensitive information is an understudied research area. In this work, we examine two machine learning approaches, intended to predict a patient's COVID-19 status using routinely collected and readily available clinical data. We employ adversarial training to explore robust deep learning architectures that protect attributes related to demographic information about the patients. The two models we examine in this work are intended to preserve sensitive information against adversarial attacks and information leakage. In a series of experiments using datasets from the Oxford University Hospitals, Bedfordshire Hospitals NHS Foundation Trust, University Hospitals Birmingham NHS Foundation Trust, and Portsmouth Hospitals University NHS Trust we train and test two neural networks that predict PCR test results using information from basic laboratory blood tests, and vital signs performed on a patients' arrival to hospital. We assess the level of privacy each one of the models can provide and show the efficacy and robustness of our proposed architectures against a comparable baseline. One of our main contributions is that we specifically target the development of effective COVID-19 detection models with built-in mechanisms in order to selectively protect sensitive attributes against adversarial attacks.


title: Using Wi-Fi Signal as Sensing Medium: Passive Radar, Channel State Information and Followups

abstract: The idea of exploiting the Wi-Fi bursts as the medium for sensing purposes, particularly for the human targets in the indoor environment, was cultivated in both radar and computer science communities and it has became a noticeable research genre with cross-disciplinary impact in security, healthcare, human-machine interaction etc.This article comparatively introduces passive radar based and channel state information (CSI) based approaches. For each means, the primary design principles, signal processing and representative applications scenarios are shown. At last, some opportunities and challenges of Wi-Fi sensing are pointed out for the sake of stepping closer to the practitioners and end-users.


title: Bandlimited signal reconstruction from leaky integrate-and-fire encoding using POCS

abstract: Leaky integrate-and-fire (LIF) encoding is a model of neuron transfer function in biology that has recently attracted the attention of the signal processing and neuromorphic computing communities as a technique of event-based sampling for data acquisition. While LIF enables the implementation of analog-circuit signal samplers of lower complexity and higher accuracy simultaneously, the core difficulty of this technique is the retrieval of an input from its LIF-encoded output. In this article, we study this problem in the context of bandlimited inputs, by extracting the most abstract features of an LIF encoder as a generalized nonuniform sampler. In this view, the LIF output is seen as the transformation of the input by a known linear operator. We show that the signal reconstruction method of projection onto convex sets (POCS) converges to a weighted pseudo-inverse of this operator. This allows perfect recovery under uniqueness of reconstruction, minimum-norm reconstruction under incomplete sampling, as well as a noise shaping of time quantization that outperforms standard pseudo-inversion. On the practical side, a single iteration of the POCS method can be used to improve any estimate whose LIF samples are not consistent with those of the input, and a rigorous discrete-time implementation of this iteration is proposed that does not require a Nyquist-rate representation of the signals.


title: The Generalized Sylvester's And Orchard Problems Via Discriminantal arrangement

abstract: In 1989 Manin and Schechtman defined the discriminantal arrangement $\mathcal{B}(n, k,\mathcal{A})$ associated to a generic arrangement $\mathcal{A}$ of $n$ hyperplanes in a $k$-dimensional space. An equivalent notion was already introduced by Crapo in 1985 with the name of geometry of circuits. While both those papers were mainly focused on the case in which $\mathcal{B}(n, k,\mathcal{A})$ has a constant combinatorics when $\mathcal{A}$ changes, it turns out that the case in which the combinatorics of $\mathcal{B}(n, k,\mathcal{A})$ changes is quite interesting as it classifies special configurations of points in the $k$-dimensional space. In this paper we provide an example of this fact elucidating the connection between the well known generalized Sylvester's and orchard problems and the combinatorics of $\mathcal{B}(n, k,\mathcal{A})$. In particular we point out how this connection could be helpful to address those old but still open problems.


title: Negative and Positive Feedback from a Supernova Remnant with SHREC: A detailed Study of the Shocked Gas in IC443

abstract: Supernova remnants (SNRs) contribute to regulate the star formation efficiency and evolution of galaxies. As they expand into the interstellar medium (ISM), they transfer vast amounts of energy and momentum that displace, compress and heat the surrounding material. Despite the extensive work in galaxy evolution models, it remains to be observationally validated to what extent the molecular ISM is affected by the interaction with SNRs. We use the first results of the ESO-ARO Public Spectroscopic Survey SHREC, to investigate the shock interaction between the SNR IC443 and the nearby molecular clump G. We use high sensitivity SiO(2-1) and H$^{13}$CO$^+$(1-0) maps obtained by SHREC together with SiO(1-0) observations obtained with the 40m telescope at the Yebes Observatory. We find that the bulk of the SiO emission is arising from the ongoing shock interaction between IC443 and clump G. The shocked gas shows a well ordered kinematic structure, with velocities blue-shifted with respect to the central velocity of the SNR, similar to what observed toward other SNR-cloud interaction sites. The shock compression enhances the molecular gas density, n(H$_2$), up to $>$10$^5$ cm$^{-3}$, a factor of >10 higher than the ambient gas density and similar to values required to ignite star formation. Finally, we estimate that up to 50\% of the momentum injected by IC443 is transferred to the interacting molecular material. Therefore the molecular ISM may represent an important momentum carrier in sites of SNR-cloud interactions.


title: Harmonic Schwarzian derivative and methods of approximation of zeros

abstract: We review the relation between the classical formulas of the pre-Schwarzian and Schwarzian derivatives of locally univalent analytic functions and the derivatives of the generating functions of the methods due to Newton and Halley, respectively, for approximating zeros. We extend these relations to the cases when the functions considered are harmonic.


title: Differentially Private Release of Event Logs for Process Mining

abstract: The applicability of process mining techniques hinges on the availability of event logs capturing the execution of a business process. In some use cases, particularly those involving customer-facing processes, these event logs may contain private information. Data protection regulations restrict the use of such event logs for analysis purposes. One way of circumventing these restrictions is to anonymize the event log to the extent that no individual can be singled out using the anonymized log. This article addresses the problem of anonymizing an event log in order to guarantee that, upon release of the anonymized log, the probability that an attacker may single out any individual represented in the original log does not increase by more than a threshold. The article proposes a differentially private release mechanism, which samples the cases in the log and adds noise to the timestamps to the extent required to achieve the above privacy guarantee. The article reports on an empirical comparison of the proposed approach against the state-of-the-art approaches using 14 real-life event logs in terms of data utility loss and computational efficiency.


title: Quantum statistical fluctuation of energy and its novel pseudo-gauge dependence

abstract: We discuss the quantum statistical fluctuations of energy in subsystems of hot relativistic gas for both spin-zero and spin half particles. We explicitly show the system size dependence of the quantum statistical fluctuation of energy. Our results show that with decreasing system size quantum statistical fluctuations increase substantially. As the consistency of the framework, we also argue that the quantum statistical fluctuations give rise to the known result for statistical fluctuation of energy in the canonical ensemble if we consider the size of the subsystem to be sufficiently large. For a spin-half particle quantum fluctuations show some interesting novel features. We show that within a small sub-system quantum statistical fluctuation of energy for spin half particles depends on the various pseudo-gauge choices of the energy-momentum tensor. Interestingly, for sufficiently large subsystems quantum fluctuations obtained for different pseudo-gauge choices converge and we recover the canonical-ensemble formula known for statistical fluctuations of energy. Our calculation is very general and can be applied to any branch of physics whenever one deals with a thermal system. As a practical application, we argue that our results can be used to determine a coarse-graining scale to introduce the concept of classical energy density or fluid element relevant for the strongly interacting matter, in particular for small systems produced in heavy-ion collisions.


title: Localization properties of the sparse Barrat-M\'ezard trap model

abstract: Inspired by works on the Anderson model on sparse graphs, we devise a method to analyze the localization properties of sparse systems that may be solved using cavity theory. We apply this method to study the properties of the eigenvectors of the master operator of the sparse Barrat-M\'ezard trap model, with an emphasis on the extended phase. As probes for localization, we consider the inverse participation ratio and the correlation volume, both dependent on the distribution of the diagonal elements of the resolvent. Our results reveal a rich and non-trivial behavior of the estimators across the spectrum of relaxation rates and an interplay between entropic and activation mechanisms of relaxation that give rise to localized modes embedded in the bulk of extended states. We characterize this route to localization and find it to be distinct from the paradigmatic Anderson model or standard random matrix systems.


title: ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connections

abstract: With the continuous development of neural networks for computer vision tasks, more and more network architectures have achieved outstanding success. As one of the most advanced neural network architectures, DenseNet shortcuts all feature maps to solve the model depth problem. Although this network architecture has excellent accuracy with low parameters, it requires an excessive inference time. To solve this problem, HarDNet reduces the connections between the feature maps, making the remaining connections resemble harmonic waves. However, this compression method may result in a decrease in the model accuracy and an increase in the parameters and model size. This network architecture may reduce the memory access time, but its overall performance can still be improved. Therefore, we propose a new network architecture, ThreshNet, using a threshold mechanism to further optimize the connection method. Different numbers of connections for different convolution layers are discarded to accelerate the inference of the network. The proposed network has been evaluated with image classification using CIFAR 10 and SVHN datasets under platforms of NVIDIA RTX 3050 and Raspberry Pi 4. The experimental results show that, compared with HarDNet68, GhostNet, MobileNetV2, ShuffleNet, and EfficientNet, the inference time of the proposed ThreshNet79 is 5%, 9%, 10%, 18%, and 20% faster, respectively. The number of parameters of ThreshNet95 is 55% less than that of HarDNet85. The new model compression and model acceleration methods can speed up the inference time, enabling network models to operate on mobile devices.


title: Glance and Focus Networks for Dynamic Visual Recognition

abstract: Spatial redundancy widely exists in visual recognition tasks, i.e., discriminative features in an image or video frame usually correspond to only a subset of pixels, while the remaining regions are irrelevant to the task at hand. Therefore, static models which process all the pixels with an equal amount of computation result in considerable redundancy in terms of time and space consumption. In this paper, we formulate the image recognition problem as a sequential coarse-to-fine feature learning process, mimicking the human visual system. Specifically, the proposed Glance and Focus Network (GFNet) first extracts a quick global representation of the input image at a low resolution scale, and then strategically attends to a series of salient (small) regions to learn finer features. The sequential process naturally facilitates adaptive inference at test time, as it can be terminated once the model is sufficiently confident about its prediction, avoiding further redundant computation. It is worth noting that the problem of locating discriminant regions in our model is formulated as a reinforcement learning task, thus requiring no additional manual annotations other than classification labels. GFNet is general and flexible as it is compatible with any off-the-shelf backbone models (such as MobileNets, EfficientNets and TSM), which can be conveniently deployed as the feature extractor. Extensive experiments on a variety of image classification and video recognition tasks and with various backbone models demonstrate the remarkable efficiency of our method. For example, it reduces the average latency of the highly efficient MobileNet-V3 on an iPhone XS Max by 1.3x without sacrificing accuracy. Code and pre-trained models are available at https://github.com/blackfeather-wang/GFNet-Pytorch.