title: CRT-Net: A Generalized and Scalable Framework for the Computer-Aided Diagnosis of Electrocardiogram Signals

abstract: Electrocardiogram (ECG) signals play critical roles in the clinical screening and diagnosis of many types of cardiovascular diseases. Despite deep neural networks that have been greatly facilitated computer-aided diagnosis (CAD) in many clinical tasks, the variability and complexity of ECG in the clinic still pose significant challenges in both diagnostic performance and clinical applications. In this paper, we develop a robust and scalable framework for the clinical recognition of ECG. Considering the fact that hospitals generally record ECG signals in the form of graphic waves of 2-D images, we first extract the graphic waves of 12-lead images into numerical 1-D ECG signals by a proposed bi-directional connectivity method. Subsequently, a novel deep neural network, namely CRT-Net, is designed for the fine-grained and comprehensive representation and recognition of 1-D ECG signals. The CRT-Net can well explore waveform features, morphological characteristics and time domain features of ECG by embedding convolution neural network(CNN), recurrent neural network(RNN), and transformer module in a scalable deep model, which is especially suitable in clinical scenarios with different lengths of ECG signals captured from different devices. The proposed framework is first evaluated on two widely investigated public repositories, demonstrating the superior performance of ECG recognition in comparison with state-of-the-art. Moreover, we validate the effectiveness of our proposed bi-directional connectivity and CRT-Net on clinical ECG images collected from the local hospital, including 258 patients with chronic kidney disease (CKD), 351 patients with Type-2 Diabetes (T2DM), and around 300 patients in the control group. In the experiments, our methods can achieve excellent performance in the recognition of these two types of disease.


title: Tilting behavior of lamellar ice tip during unidirectional freezing of aqueous solutions

abstract: Freezing of ice has been largely reported from many aspects, especially its complex pattern formation. Ice grown from liquid phase is usually characteristic of lamellar morphology which plays a significant role in various domains. However, tilted growth of ice via transition from coplanar to non-coplanar growth in directional solidification has been paid little attention in previous studies and there is misleading explanation of the formation of tilted lamellar ice. Here, we in-situ investigated the variations of tilting behavior of lamellar ice tip under different conditions within a single ice crystal with manipulated orientation via unidirectional freezing of aqueous solutions. It is found that tilted growth of ice tips is sensitive to pulling velocity and solute type. These experimental results reveal intrinsic tilted growth behavior of lamellar ice and enrich our understanding in pattern formation of ice.


title: Efficient sorting of orbital-angular-momentum states with large topological charges and their unknown superpositions via machine learning

abstract: Light beams carrying orbital-angular-momentum (OAM) play an important role in optical manipulation and communication owing to their unbounded state space. However, it is still challenging to efficiently discriminate OAM modes with large topological charges and thus only a small part of the OAM states have been usually used. Here we demonstrate that neural networks can be trained to sort OAM modes with large topological charges and unknown superpositions. Using intensity images of OAM modes generalized in simulations and experiments as the input data, we illustrate that our neural network has great generalization power to recognize OAM modes of large topological charges beyond training areas with high accuracy. Moreover, the trained neural network can correctly classify and predict arbitrary superpositions of two OAM modes with random topological charges. Our machine learning approach only requires a small portion of experimental samples and significantly reduces the cost in experiments, which paves the way to study the OAM physics and increase the state space of OAM beams in practical applications.


title: Monte Carlo simulation of molecular dynamics for amino acid production from carboxylic acid via C-14 beta-decay

abstract: To study the chemical origin of life, we investigated the amino acid production probability from radiocarbon (C-14)-containing carboxylic acid via beta-decay using a newly developed Monte Carlo simulator for molecular dynamics calculation. Using the simulation, we calculated the dynamical trajectory of N-14 recoiled via C-14 beta-decay in [3-C-14]propionic acid and evaluated the staying probability of N-14 in the compound, which is the glycinium (a protonated glycine) production probability from [3-C-14]propionic acid. The glycinium production probability was calculated to be 78.7% assuming static compound structures of [3-C-14]propionic acid and a glycinium C-N binding potential energy of 3.93 eV. From calculations with various binding potential parameters, a glycinium production probability of approximately 30% was expected by simulation in case of a loose C-N binding potential energy of 2-eV.


title: Enhanced Doubly Robust Learning for Debiasing Post-click Conversion Rate Estimation

abstract: Post-click conversion, as a strong signal indicating the user preference, is salutary for building recommender systems. However, accurately estimating the post-click conversion rate (CVR) is challenging due to the selection bias, i.e., the observed clicked events usually happen on users' preferred items. Currently, most existing methods utilize counterfactual learning to debias recommender systems. Among them, the doubly robust (DR) estimator has achieved competitive performance by combining the error imputation based (EIB) estimator and the inverse propensity score (IPS) estimator in a doubly robust way. However, inaccurate error imputation may result in its higher variance than the IPS estimator. Worse still, existing methods typically use simple model-agnostic methods to estimate the imputation error, which are not sufficient to approximate the dynamically changing model-correlated target (i.e., the gradient direction of the prediction model). To solve these problems, we first derive the bias and variance of the DR estimator. Based on it, a more robust doubly robust (MRDR) estimator has been proposed to further reduce its variance while retaining its double robustness. Moreover, we propose a novel double learning approach for the MRDR estimator, which can convert the error imputation into the general CVR estimation. Besides, we empirically verify that the proposed learning scheme can further eliminate the high variance problem of the imputation learning. To evaluate its effectiveness, extensive experiments are conducted on a semi-synthetic dataset and two real-world datasets. The results demonstrate the superiority of the proposed approach over the state-of-the-art methods. The code is available at https://github.com/guosyjlu/MRDR-DL.


title: Variability of magnetically-dominated jets from accreting black holes

abstract: Structured jets are recently invoked to explain the complex emission of gamma ray bursts, such as GW 170817. Based on the accretion simulations, the jets are expected to have a structure that is more complex than a simple top-hat. Also, the structure of launching regions of blazar jets should influence their large scale evolution. This is recently revealed by the interactions of jet components in TXS 0506+056, where the jet is observed at a viewing angle close to zero. Observational studies have also shown an anti-correlation between the jet variability, measured e.g. by its minimum variability time scale, and the Lorentz factor, that spans several orders of magnitude and covers both blazars and GRBs samples. Motivated by those observational properties of black hole sources, we investigate the accretion inflow and outflow properties, by means of numerical GR MHD simulations. We perform axisymmetric calculations of the structure and evolution of central engine, composed of magnetized torus around Kerr black hole that is launching a non-uniform jet. We probe the jet energetics at different points along the line of sight, and we measure the jet time variability as localized in these specific regions. We quantify our results by computing the minimum variability timescales and power density spectra. We reproduce the MTS-$\Gamma$ correlation and we attribute it to the black hole spin as the main driving parameter of the engine. We also find that the PDS slope is not strongly affected by the black hole spin, while it differs for various viewing angles.


title: Directly profiling the dark-state transition density via scanning tunneling microscope

abstract: The molecular dark state participates in many important photon-induced processes, yet is typically beyond the optical-spectroscopic measurement due to the forbidden transition dictated by the selection rule. In this work, we propose to use the scanning tunneling microscope (STM) as an incisive tool to directly profile the dark-state transition density of a single molecule, taking advantage of the localized static electronic field near the metal tip. The detection of dark state is achieved by measuring the fluorescence from a higher bright state to the ground state with assistant optical pumping. The current proposal shall bring new methodology to study the single-molecule properties in the electro-optical devices and the light-assisted biological processes.


title: ByT5: Towards a token-free future with pre-trained byte-to-byte models

abstract: Most widely-used pre-trained language models operate on sequences of tokens corresponding to word or subword units. By comparison, token-free models that operate directly on raw text (bytes or characters) have many benefits: they can process text in any language out of the box, they are more robust to noise, and they minimize technical debt by removing complex and error-prone text preprocessing pipelines. Since byte or character sequences are longer than token sequences, past work on token-free models has often introduced new model architectures designed to amortize the cost of operating directly on raw text. In this paper, we show that a standard Transformer architecture can be used with minimal modifications to process byte sequences. We characterize the trade-offs in terms of parameter count, training FLOPs, and inference speed, and show that byte-level models are competitive with their token-level counterparts. We also demonstrate that byte-level models are significantly more robust to noise and perform better on tasks that are sensitive to spelling and pronunciation. As part of our contribution, we release a new set of pre-trained byte-level Transformer models based on the T5 architecture, as well as all code and data used in our experiments.


title: Simultaneous predictive bands for functional time series using minimum entropy sets

abstract: Functional Time Series are sequences of dependent random elements taking values on some functional space. Most of the research on this domain is focused on producing a predictor able to forecast the value of the next function having observed a part of the sequence. For this, the Autoregresive Hilbertian process is a suitable framework. We address here the problem of constructing simultaneous predictive confidence bands for a stationary functional time series. The method is based on an entropy measure for stochastic processes, in particular functional time series. To construct predictive bands we use a functional bootstrap procedure that allow us to estimate the prediction law through the use of pseudo-predictions. Each pseudo-realisation is then projected into a space of finite dimension, associated to a functional basis. We use Reproducing Kernel Hilbert Spaces (RKHS) to represent the functions, considering then the basis associated to the reproducing kernel. Using a simple decision rule, we classify the points on the projected space among those belonging to the minimum entropy set and those that do not. We push back the minimum entropy set to the functional space and construct a band using the regularity property of the RKHS. The proposed methodology is illustrated through artificial and real-world data sets.


title: Double-lens technique for efficient capture of short-lived particles by a crystal

abstract: For the experiments to measure the dipole moments of short-lived particles via crystal channeling, we propose a beam-optics system of two crystal lenses that increases the number of channeled short-lived particles per one incident primary proton by a factor of about 1000 at LHC.


title: Multiplicity and concentration results for a $(p, q)$-Laplacian problem in $\mathbb{R}^{N}$

abstract: In this paper we study the multiplicity and concentration of positive solutions for the following $(p, q)$-Laplacian problem: \begin{equation*} \left\{ \begin{array}{ll} -\Delta_{p} u -\Delta_{q} u +V(\varepsilon x) \left(|u|^{p-2}u + |u|^{q-2}u\right) = f(u) &\mbox{ in } \mathbb{R}^{N}, \\ u\in W^{1, p}(\mathbb{R}^{N})\cap W^{1, q}(\mathbb{R}^{N}), \quad u>0 \mbox{ in } \mathbb{R}^{N}, \end{array} \right. \end{equation*} where $\varepsilon>0$ is a small parameter, $1< p<q<N$, $\Delta_{r}u=\mbox{div}(|\nabla u|^{r-2}\nabla u)$, with $r\in \{p, q\}$, is the $r$-Laplacian operator, $V:\mathbb{R}^{N}\rightarrow \mathbb{R}$ is a continuous function satisfying the global Rabinowitz condition, and $f:\mathbb{R}\rightarrow \mathbb{R}$ is a continuous function with subcritical growth. Using suitable variational arguments and Ljusternik-Schnirelmann category theory, we investigate the relation between the number of positive solutions and the topology of the set where $V$ attains its minimum for small $\varepsilon$.


title: THINK: A Novel Conversation Model for Generating Grammatically Correct and Coherent Responses

abstract: Many existing conversation models that are based on the encoder-decoder framework have focused on ways to make the encoder more complicated to enrich the context vectors so as to increase the diversity and informativeness of generated responses. However, these approaches face two problems. First, the decoder is too simple to effectively utilize the previously generated information and tends to generate duplicated and self-contradicting responses. Second, the complex encoder tends to generate diverse but incoherent responses because the complex context vectors may deviate from the original semantics of context. In this work, we proposed a conversation model named "THINK" (Teamwork generation Hover around Impressive Noticeable Keywords) to make the decoder more complicated and avoid generating duplicated and self-contradicting responses. The model simplifies the context vectors and increases the coherence of generated responses in a reasonable way. For this model, we propose Teamwork generation framework and Semantics Extractor. Compared with other baselines, both automatic and human evaluation showed the advantages of our model.


title: Harmonic elctron-cyclotron maser emissions driven by energetic electrons of the horseshoe distribution with application to solar radio spikes

abstract: Content. Electron-cyclotron maser emission (ECME) is the favored mechanism for solar radio spikes and has been investigated extensively since the 1980s. Most studies relevant to solar spikes employ a loss-cone-type distribution of energetic electrons, generating waves mainly in the fundamental X/O mode (X1/O1), with a ratio of plasma oscillation frequency to electron gyrofrequency (${\omega}_ {pe}/{\Omega}_{ce}$) lower than 1. Despite the great progress made in this theory, one major problem is how the fundamental emissions pass through the second-harmonic absorption layer in the corona and escape. This is generally known as the escaping difficulty of the theory. Aims. We study the harmonic emissions generated by ECME driven by energetic electrons with the horseshoe distribution to solve the escaping difficulty of ECME for solar spikes. Methods. We performed a fully kinetic electromagnetic PIC simulation with ${\omega}_ {pe}/{\Omega}_{ce}$ = 0.1, corresponding to the strongly magnetized plasma conditions in the flare region, with energetic electrons characterized by the horseshoe distribution. We also varied the density ratio of energetic electrons to total electrons ($n_e/n_0$) in the simulation. Results. We obtain efficient amplification of waves in Z and X2 modes, with a relatively weak growth of O1 and X3. With a higher-density ratio, the X2 emission becomes more intense, and the rate of energy conversion from energetic electrons into X2 modes can reach $\sim$0.06% and 0.17%, with $n_e/n_0$= 5% and 10%, respectively. Conclusions. We find that the horseshoe-driven ECME can lead to an efficient excitation of X2 and X3 with a low value of ${\omega}_ {pe}/{\Omega}_{ce}$, providing novel means for resolving the escaping difficulty of ECME when applied to solar radio spikes. The simultaneous growth of X2 and X3 can be used to explain some harmonic structures observed in solar spikes.


title: Concentration phenomena for a fractional relativistic Schr\"odinger equation with critical growth

abstract: In this paper, we are concerned with the following fractional relativistic Schr\"odinger equation with critical growth: \begin{equation*} \left\{ \begin{array}{ll} (-\Delta+m^{2})^{s}u + V(\varepsilon x) u= f(u)+u^{2^{*}_{s}-1} \mbox{ in } \mathbb{R}^{N}, \\ u\in H^{s}(\mathbb{R}^{N}), \quad u>0 \, \mbox{ in } \mathbb{R}^{N}, \end{array} \right. \end{equation*} where $\varepsilon>0$ is a small parameter, $s\in (0, 1)$, $m>0$, $N> 2s$, $2^{*}_{s}=\frac{2N}{N-2s}$ is the fractional critical exponent, $(-\Delta+m^{2})^{s}$ is the fractional relativistic Schr\"odinger operator, $V:\mathbb{R}^{N}\rightarrow \mathbb{R}$ is a continuous potential, and $f:\mathbb{R}\rightarrow \mathbb{R}$ is a superlinear continuous nonlinearity with subcritical growth at infinity. Under suitable assumptions on the potential $V$, we construct a family of positive solutions $u_{\varepsilon}\in H^{s}(\mathbb{R}^{N})$, with exponential decay, which concentrates around a local minimum of $V$ as $\varepsilon\rightarrow 0$.


title: Technical comment on The impact of population-wide rapid antigen testing on SARS-CoV-2 prevalence in Slovakia

abstract: Pavelka et al. (Science, Reports, 7 May 2021) claim that a single round of population-wide antigen testing in Slovakia reduced the observed COVID-19 prevalence by 58%, and that it played a substantial role in curbing the pandemic. We argue that this estimate, which is based on incorrect assumptions, is exaggerated, and that the relief was short-lived with little effect on mitigating the pandemic.


title: Saudi Parents' Privacy Concerns about Their Children's Smart Device Applications

abstract: In this paper, we investigate Saudi parents' privacy concerns regarding their children's smart device applications (apps). To this end, we conducted a survey and analysed 119 responses. Our results show that Saudi parents expressed a high level of concern regarding their children's privacy when using smart device apps. However, they expressed higher concerns about apps' content than privacy issues such as apps' requests to access sensitive data. Furthermore, parents' concerns are not in line with most of the children's installed apps, which contain apps inappropriate for their age, require parental guidance, and request access to sensitive data such as location. We also discuss several aspects of Saudi parents' practices and concerns compared to those reported by Western (mainly from the UK) and Chinese parents in previous reports. We found interesting patterns and established new relationships. For example, Saudi and Western parents show higher levels of privacy concerns than Chinese parents. Finally, we tested 14 privacy practices and concerns against high versus low socioeconomic classes (parents' education, technical background, and income) to find whether there are significant differences between high and low classes (we denote these differences by "digital divide"). Out of 42 tests (14 properties x 3 classes) we found significant differences between high and low classes in 7 tests only. While this is a positive trend overall, it is important to work on bridging these gaps. The results of this paper provide key findings to identify areas of improvement and recommendations, especially for Saudis, which can be used by parents, developers, researchers, regulators, and policy makers.


title: Noised Consistency Training for Text Summarization

abstract: Neural abstractive summarization methods often require large quantities of labeled training data. However, labeling large amounts of summarization data is often prohibitive due to time, financial, and expertise constraints, which has limited the usefulness of summarization systems to practical applications. In this paper, we argue that this limitation can be overcome by a semi-supervised approach: consistency training which is to leverage large amounts of unlabeled data to improve the performance of supervised learning over a small corpus. The consistency regularization semi-supervised learning can regularize model predictions to be invariant to small noise applied to input articles. By adding noised unlabeled corpus to help regularize consistency training, this framework obtains comparative performance without using the full dataset. In particular, we have verified that leveraging large amounts of unlabeled data decently improves the performance of supervised learning over an insufficient labeled dataset.


title: The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization

abstract: We propose a model for multiclass classification of time series to make a prediction as early and as accurate as possible. The matrix sequential probability ratio test (MSPRT) is known to be asymptotically optimal for this setting, but contains a critical assumption that hinders broad real-world applications; the MSPRT requires the underlying probability density. To address this problem, we propose to solve density ratio matrix estimation (DRME), a novel type of density ratio estimation that consists of estimating matrices of multiple density ratios with constraints and thus is more challenging than the conventional density ratio estimation. We propose a log-sum-exp-type loss function (LSEL) for solving DRME and prove the following: (i) the LSEL provides the true density ratio matrix as the sample size of the training set increases (consistency); (ii) it assigns larger gradients to harder classes (hard class weighting effect); and (iii) it provides discriminative scores even on class-imbalanced datasets (guess-aversion). Our overall architecture for early classification, MSPRT-TANDEM, statistically significantly outperforms baseline models on four datasets including action recognition, especially in the early stage of sequential observations. Our code and datasets are publicly available at: https://github.com/TaikiMiyagawa/MSPRT-TANDEM.


title: The Power of Sampling: Dimension-free Risk Bounds in Private ERM

abstract: Differentially private empirical risk minimization (DP-ERM) is a fundamental problem in private optimization. While the theory of DP-ERM is well-studied, as large-scale models become prevalent, traditional DP-ERM methods face new challenges, including (1) the prohibitive dependence on the ambient dimension, (2) the highly non-smooth objective functions, (3) costly first-order gradient oracles. Such challenges demand rethinking existing DP-ERM methodologies. In this work, we show that the regularized exponential mechanism combined with existing samplers can address these challenges altogether: under the standard unconstrained domain and low-rank gradients assumptions, our algorithm can achieve rank-dependent risk bounds for non-smooth convex objectives using only zeroth order oracles, which was not accomplished by prior methods. This highlights the power of sampling in differential privacy. We further construct lower bounds, demonstrating that when gradients are full-rank, there is no separation between the constrained and unconstrained settings. Our lower bound is derived from a general black-box reduction from unconstrained to the constrained domain and an improved lower bound in the constrained setting, which might be of independent interest.


title: Weak-value technique for detecting weak magnetic field based on Faraday magneto-optic effect

abstract: We study the amplification of weak magnetic field with Weak-value technique based on Faraday magneto-optic effect. By using a different scheme to perform the Sagnac interferometer with the probe in momentum space, we have demonstrated the new weak measure protocol to detect the small weak magnetic field by amplifying the phase shift of Faraday magneto-optic effect. At the given the maximum incident intensity of the initial spectrum, the detection limit of the intensity of the spectrometer and the accuracy of detecting weak magnetic field, we can theoretically give the appropriate pre-selection, post-selection and others optical structure before experiment. Our numerical results show our scheme with Weak-value technique is effective and feasible to detect weak magnetic field with magnetic field intensity lower than $10^{-10}$ T.


title: On-site Online Feature Selection for Classification of Switchgear Actuations

abstract: As connected sensors continue to evolve, interest in low-voltage monitoring solutions is increasing. This also applies in the area of switchgear monitoring, where the detection of switch actions, their differentiation and aging are of fundamental interest. In particular, the universal applicability for various types of construction plays a major role. Methods in which design-specific features are learned in an offline training are therefore less suitable for assessing the condition of switchgears. A new computational efficient method for intelligent online feature selection is presented, which can be used to train a model for the addressed use cases on-site. Process- and design-specific features can be learned locally (e.g. on a sensor system) without the need of prior offline training. The proposed method is evaluated on four datasets of switchgear measurements, which were recorded using microelectromechanical system (MEMS) based sensors (acoustic and vibration). Furthermore, we show that the features selected by our method can be used to track changes in switching processes due to aging effects.


title: Dielectric metasurface for independent complex-amplitude control of arbitrary two orthogonal states of polarization

abstract: Metasurfaces are planar structures that can manipulate the amplitude, phase and polarization (APP) of light at subwavelength scale. Although various functionalities have been proposed based on metasurface, a most general optical control, i.e., independent complex-amplitude (amplitude and phase) control of arbitrary two orthogonal states of polarizations, has not yet been realized. Such level of optical control can not only cover the various functionalities realized previously, but also enable new functionalities that are not feasible before. Here, we propose a single-layer dielectric metasurface to realize this goal and experimentally demonstrate several advanced functionalities, such as two independent full-color printing images under arbitrary elliptically orthogonal polarizations and dual sets of printing-hologram integrations. Our work opens the way for a wide range of applications in advanced image display, information encoding, and polarization optics.


title: Evaluation of machine learning algorithms for predictive Reynolds stress transport modeling

abstract: The application machine learning (ML) algorithms to turbulence modeling has shown promise over the last few years, but their application has been restricted to eddy viscosity based closure approaches. In this article we discuss rationale for the application of machine learning with high-fidelity turbulence data to develop models at the level of Reynolds stress transport modeling. Based on these rationale we compare different machine learning algorithms to determine their efficacy and robustness at modeling the different transport processes in the Reynolds Stress Transport Equations. Those data driven algorithms include Random forests, gradient boosted trees and neural networks. The direct numerical simulation (DNS) data for flow in channels is used both as training and testing of the ML models. The optimal hyper-parameters of the ML algorithms are determined using Bayesian optimization. The efficacy of above mentioned algorithms is assessed in the modeling and prediction of the terms in the Reynolds stress transport equations. It was observed that all the three algorithms predict the turbulence parameters with acceptable level of accuracy. These ML models are then applied for prediction of the pressure strain correlation of flow cases that are different from the flows used for training, to assess their robustness and generalizability. This explores the assertion that ML based data driven turbulence models can overcome the modeling limitations associated with the traditional turbulence models and ML models trained with large amounts data with different classes of flows can predict flow field with reasonable accuracy for unknown flows with similar flow physics. In addition to this verification we carry out validation for the final ML models by assessing the importance of different input features for prediction.


title: Category Algebras and States on Categories

abstract: The purpose of this paper is to build a new bridge between category theory and a generalized probability theory known as noncommutative probability or quantum probability, which was originated as a mathematical framework for quantum theory, in terms of states as linear functionals defined on category algebras. We clarify that category algebras can be considered as generalized matrix algebras and that states on categories as linear functionals defined on category algebras turn out to be generalized of probability measures on sets as discrete categories. Moreover, by establishing a generalization of famous GNS (Gelfand-Naimark-Segal) construction, we obtain representations of category algebras of $^{\dagger}$-categories on certain generalized Hilbert spaces which we call semi-Hilbert modules over rigs.


title: Charge-state distributions of highly charged lead ions at relativistic collision energies

abstract: Presented is a study of the charge-state evolution of relativistic lead ions passing through a thin aluminum stripper foil. It was motivated by the Gamma Factory project at CERN, where optical laser pulses will be converted into intense gamma-ray beams with energies up to a few hundred MeV via excitation of atomic transitions in few-electron heavy-ions at highly relativistic velocities. In this study all charge-states starting from Pb$^{54+}$ up to bare ions are considered at kinetic projectile energies of 4.2 and 5.9 GeV/u. To this purpose the BREIT code is employed together with theoretical cross-sections for single-electron loss and capture of the projectile ions. To verify the predicted charge-state evolution, the results are compared to the very few experimental data being available for highly-relativistic lead beams. Reasonable agreement is found, in particular for the yields of Pb$^{80+}$ and Pb$^{81+}$ ions that were recently measured using an aluminum stripper foil located in the transfer beam line between the PS and SPS synchrotron accelerators at CERN. The present study lays the groundwork to optimize the yields of charge states of interest for experiments within the scientific program of the future Gamma Factory project.


title: Constraining scalar-tensor theories by neutron star-balck hole gravitational wave events

abstract: With the continuous upgrade of detectors, more and more gravitational wave (GW) events were captured by the LIGO Scientific Collaboration and Virgo Collaboration (LVC), which offers a new avenue to test General Relativity and explore the nature of gravity. Although, various model-independent tests have been performed by LVC in previous works, it is still interesting to ask what constraints on specific models can be placed by current GW observations. In this work, we focus on three models of scalar-tensor theories, the Brans-Dicke theory (BD), the theory with scalarization phenomena proposed by Damour and Esposito-Far\`{e}se (DEF), and Screened Modified Gravity (SMG). From all 4 possible NSBH events so far, we use two of them to place the constraints. The other two are excluded in this work due to the possible unphysical deviations. We consider the inspiral range with the cutoff frequency at the innermost stable circular orbit and add a modification of dipole radiation into the waveform template. The scalar charges of neutron stars in the dipole term are derived by solving the Tolman-Oppenheimer-Volkoff equations for different equations-of-states. The constraints are obtained by performing the full Bayesian inference with the help of the open source software \texttt{Bilby}. The results show that the constraints given by GWs are comparable with those given by pulsar timing experiments for DEF theory, but are not competitive with the current solar system constraints for BD and SMG theories.


title: Learning to Select Cuts for Efficient Mixed-Integer Programming

abstract: Cutting plane methods play a significant role in modern solvers for tackling mixed-integer programming (MIP) problems. Proper selection of cuts would remove infeasible solutions in the early stage, thus largely reducing the computational burden without hurting the solution accuracy. However, the major cut selection approaches heavily rely on heuristics, which strongly depend on the specific problem at hand and thus limit their generalization capability. In this paper, we propose a data-driven and generalizable cut selection approach, named Cut Ranking, in the settings of multiple instance learning. To measure the quality of the candidate cuts, a scoring function, which takes the instance-specific cut features as inputs, is trained and applied in cut ranking and selection. In order to evaluate our method, we conduct extensive experiments on both synthetic datasets and real-world datasets. Compared with commonly used heuristics for cut selection, the learning-based policy has shown to be more effective, and is capable of generalizing over multiple problems with different properties. Cut Ranking has been deployed in an industrial solver for large-scale MIPs. In the online A/B testing of the product planning problems with more than $10^7$ variables and constraints daily, Cut Ranking has achieved the average speedup ratio of 12.42% over the production solver without any accuracy loss of solution.


title: Conic-Optimization Based Algorithms for Nonnegative Matrix Factorization

abstract: Nonnegative matrix factorization is the following problem: given a nonnegative input matrix $V$ and a factorization rank $K$, compute two nonnegative matrices, $W$ with $K$ columns and $H$ with $K$ rows, such that $WH$ approximates $V$ as well as possible. In this paper, we propose two new approaches for computing high-quality NMF solutions using conic optimization. These approaches rely on the same two steps. First, we reformulate NMF as minimizing a concave function over a product of convex cones--one approach is based on the exponential cone, and the other on the second-order cone. Then, we solve these reformulations iteratively: at each step, we minimize exactly, over the feasible set, a majorization of the objective functions obtained via linearization at the current iterate. Hence these subproblems are convex conic programs and can be solved efficiently using dedicated algorithms. We prove that our approaches reach a stationary point with an accuracy decreasing as $\mathcal{O}(\frac{1}{i})$, where $i$ denotes the iteration number. To the best of our knowledge, our analysis is the first to provide a convergence rate to stationary points for NMF. Furthermore, in the particular cases of rank-one factorizations (that is, $K=1$), we show that one of our formulations can be expressed as a convex optimization problem implying that optimal rank-one approximations can be computed efficiently. Finally, we show on several numerical examples that our approaches are able to frequently compute exact NMFs (that is, with $V = WH$), and compete favorably with the state of the art.


title: Hybrid Beamforming for Intelligent Reflecting Surface Aided Millimeter Wave MIMO Systems

abstract: As communication systems that employ millimeter wave (mmWave) frequency bands must use large antenna arrays to overcome the severe propagation loss of mmWave signals, hybrid beamforming has been considered as an integral component of mmWave communications. Recently, intelligent reflecting surface (IRS) has been proposed as an innovative technology that can significantly improve the performance of mmWave communication systems through the use of low-cost passive reflecting elements. In this paper, we study IRS-aided mmWave multiple-input multiple-output (MIMO) systems with hybrid beamforming architectures. We first exploit the sparse-scattering structure and large dimension of mmWave channels to develop the joint design of IRS reflection matrix and hybrid beamformer for narrowband MIMO systems. Then, we generalize the proposed joint design to broadband MIMO systems with orthogonal frequency division multiplexing (OFDM) modulation by leveraging the angular sparsity of frequency-selective mmWave channels. Simulation results demonstrate that the proposed joint designs can significantly enhance the spectral efficiency of the systems of interest and achieve superior performance over the existing designs.


title: Cross-Lingual Abstractive Summarization with Limited Parallel Resources

abstract: Parallel cross-lingual summarization data is scarce, requiring models to better use the limited available cross-lingual resources. Existing methods to do so often adopt sequence-to-sequence networks with multi-task frameworks. Such approaches apply multiple decoders, each of which is utilized for a specific task. However, these independent decoders share no parameters, hence fail to capture the relationships between the discrete phrases of summaries in different languages, breaking the connections in order to transfer the knowledge of the high-resource languages to low-resource languages. To bridge these connections, we propose a novel Multi-Task framework for Cross-Lingual Abstractive Summarization (MCLAS) in a low-resource setting. Employing one unified decoder to generate the sequential concatenation of monolingual and cross-lingual summaries, MCLAS makes the monolingual summarization task a prerequisite of the cross-lingual summarization (CLS) task. In this way, the shared decoder learns interactions involving alignments and summary patterns across languages, which encourages attaining knowledge transfer. Experiments on two CLS datasets demonstrate that our model significantly outperforms three baseline models in both low-resource and full-dataset scenarios. Moreover, in-depth analysis on the generated summaries and attention heads verifies that interactions are learned well using MCLAS, which benefits the CLS task under limited parallel resources.


title: Pruning and Slicing Neural Networks using Formal Verification

abstract: Deep neural networks (DNNs) play an increasingly important role in various computer systems. In order to create these networks, engineers typically specify a desired topology, and then use an automated training algorithm to select the network's weights. While training algorithms have been studied extensively and are well understood, the selection of topology remains a form of art, and can often result in networks that are unnecessarily large - and consequently are incompatible with end devices that have limited memory, battery or computational power. Here, we propose to address this challenge by harnessing recent advances in DNN verification. We present a framework and a methodology for discovering redundancies in DNNs - i.e., for finding neurons that are not needed, and can be removed in order to reduce the size of the DNN. By using sound verification techniques, we can formally guarantee that our simplified network is equivalent to the original, either completely, or up to a prescribed tolerance. Further, we show how to combine our technique with slicing, which results in a family of very small DNNs, which are together equivalent to the original. Our approach can produce DNNs that are significantly smaller than the original, rendering them suitable for deployment on additional kinds of systems, and even more amenable to subsequent formal verification. We provide a proof-of-concept implementation of our approach, and use it to evaluate our techniques on several real-world DNNs.


title: Data Augmentation for Text Generation Without Any Augmented Data

abstract: Data augmentation is an effective way to improve the performance of many neural text generation models. However, current data augmentation methods need to define or choose proper data mapping functions that map the original samples into the augmented samples. In this work, we derive an objective to formulate the problem of data augmentation on text generation tasks without any use of augmented data constructed by specific mapping functions. Our proposed objective can be efficiently optimized and applied to popular loss functions on text generation tasks with a convergence rate guarantee. Experiments on five datasets of two text generation tasks show that our approach can approximate or even surpass popular data augmentation methods.


title: Finite irreducible conformal modules of rank two Lie conformal algebras

abstract: In the present paper, we prove that any finite non-trivial irreducible module over a rank two Lie conformal algebra $\mathcal{H}$ is of rank one. We also describe the actions of $\mathcal{H}$ on its finite irreducible modules explicitly. Moreover, we show that all finite non-trivial irreducible modules of finite Lie conformal algebras whose semisimple quotient is the Virasoro Lie conformal algebra are of rank one.


title: Cybersecurity and Sustainable Development

abstract: Growing interdependencies between organizations lead them towards the creation of inter-organizational networks where cybersecurity and sustainable development have become one of the most important issues. The Environmental Goods and Services Sector (EGSS) is one of the fastest developing sectors of the economy fueled by the growing relationships between network entities based on ICT usage. In this sector, Green Cybersecurity is an emerging issue because it secures processes related directly and indirectly to environmental management and protection. In the future, the multidimensional development of the EGSS can help European Union to overcome the upcoming crises. At the same time, computer technologies and cybersecurity can contribute to the implementation of the concept of sustainable development. The development of environmental technologies along with their cybersecurity is one of the aims of the realization of sustainable production and domestic security concepts among the EU countries. Hence, the aim of this article is a theoretical discussion and research on the relationships between cybersecurity and sustainable development in inter-organizational networks. Therefore, the article is an attempt to give an answer to the question about the current state of the implementation of cybersecurity in relation to the EGSS part of the economy in different EU countries.


title: Exceptional sign changes of the non-local spin Seebeck effect in antiferromagnetic hematite

abstract: Low power spintronic devices based on the propagation of pure magnonic spin currents in antiferromagnetic insulator materials offer several distinct advantages over ferromagnetic components including higher frequency magnons and a stability against disturbing external magnetic fields. In this work, we make use of the insulating antiferromagnetic phase of iron oxide, the mineral hematite $\alpha$-Fe$_2$O$_3$ to investigate the long distance transport of thermally generated magnonic spin currents. We report on the excitation of magnons generated by the spin Seebeck effect, transported both parallel and perpendicular to the antiferromagnetic easy-axis under an applied magnetic field. Making use of an atomistic hematite toy model, we calculate the transport characteristics from the deviation of the antiferromagnetic ordering from equilibrium under an applied field. We resolve the role of the magnetic order parameters in the transport, and experimentally we find significant thermal spin transport without the need for a net magnetization.


title: Scalar curvature and the moment map in generalized Kahler geometry

abstract: We introduce a notion of scalar curvature of a twisted generalized Kahler manifold in terms of pure spinors formalism. A moment map framework with a modified action of generalized Hamiltonians on an arbitrary compact generalized Kahler manifold is developed. Then it turns out that a moment map is given by the scalar curvature, which is a generalization of the result of the scalar curvature as a moment map in the ordinary Kahler geometry, due to Fujiki and Donaldson. A noncommutative compact Lie group $G$ does not have any Kahler structure. However, we show that every compact Lie group admits generalized Kahler structures with constant scalar curvature. In particular, generalized Kahler structures with constant scalar curvature on the standard Hopf surface are explicitly given.


title: Scheduling Jobs with Stochastic Holding Costs

abstract: We study a single-server scheduling problem for the objective of minimizing the expected cumulative holding cost incurred by jobs, where parameters defining stochastic job holding costs are unknown to the scheduler. We consider a general setting allowing for different job classes, where jobs of the same class have statistically identical holding costs and service times, with an arbitrary number of jobs across classes. In each time step, the server can process a job and observes random holding costs of the jobs that are yet to be completed. We consider a learning-based $c\mu$ rule scheduling which starts with a preemption period of fixed duration, serving as a learning phase, and having gathered data about jobs, it switches to nonpreemptive scheduling. Our algorithms are designed to handle instances with large and small gaps in mean job holding costs and achieve near-optimal performance guarantees. The performance of algorithms is evaluated by regret, where the benchmark is the minimum possible total holding cost attained by the $c\mu$ rule scheduling policy when the parameters of jobs are known. We show regret lower bounds and algorithms that achieve nearly matching regret upper bounds. Our numerical results demonstrate the efficacy of our algorithms and show that our regret analysis is nearly tight.


title: Estimation to structured distances to singularity for matrix pencils with symmetry structures: A linear algebra-based approach

abstract: We study the structured distance to singularity for a given regular matrix pencil $A+sE$, where $(A,E)\in \mathbb S \subseteq (\mathbb C^{n,n})^2$. This includes Hermitian, skew-Hermitian, $*$-even, $*$-odd, $*$-palindromic, T-palindromic, and dissipative Hamiltonian pencils. We present a purely linear algebra-based approach to derive explicit computable formulas for the distance to the nearest structured pencil $(A-\Delta_A)+s(E-\Delta_E)$ such that $A-\Delta_A$ and $E-\Delta_E$ have a common null vector. We then obtain a family of computable lower bounds for the unstructured and structured distances to singularity. Numerical experiments suggest that in many cases, there is a significant difference between structured and unstructured distances. This approach extends to structured matrix polynomials with higher degrees.


title: Finite irreducible modules of a class of $\mathbb{Z}^+$-graded Lie conformal algebras

abstract: In this paper, we introduce the notion of completely non-trivial module of a Lie conformal algebra. By this notion, we classify all finite irreducible modules of a class of $\mathbb{Z}^+$-graded Lie conformal algebras $\mathcal{L}=\bigoplus_{i=0}^{\infty} \mathbb{C}[\partial]L_i$ satisfying $ [{L_0}_\lambda L_0]=(\partial+2\lambda)L_0,$ and $[{L_1}_\lambda L_i]\neq 0$ for any $i\in \mathbb{Z}^+$. These Lie conformal algebras include Block type Lie conformal algebra $\mathcal{B}(p)$ and map Virasoro Lie conformal algebra $\mathcal{V}(\mathbb{C}[T])=Vir\otimes \mathbb{C}[T]$. As a result, we show that all non-trivial finite irreducible modules of these algebras are free of rank one as a $\mathbb{C}[\partial]$-module.


title: Time-covariant Schr\"{o}dinger equation and invariant decay probability: The $\Lambda$-Kantowski-Sachs universe

abstract: The system under study is the $\Lambda$-Kantowski-Sachs universe. Its canonical quantization is provided based on a recently developed method: the singular minisuperspace Lagrangian describing the system, is reduced to a regular (by inserting into the dynamical equations the lapse dictated by the quadratic constraint) possessing an explicit (though arbitrary) time dependence; thus a time-covariant Schr\"{o}dinger equation arises. Additionally, an invariant (under transformations $t=f(\tilde{t})$) decay probability is defined and thus ``observers'' which correspond to different gauge choices obtain, by default, the same results. The time of decay for a Gaussian wave packet localized around the point $a=0$ (where $a$ the radial scale factor) is calculated to be of the order $\sim 10^{-42}-10^{-41}\mathrm{s}$. The acquired value is near the end of the Planck era (when comparing to a FLRW universe), during which the quantum effects are most prominent. Some of the results are compared to those obtained by following the well known canonical quantization of cosmological systems, i.e. the solutions of the Wheeler-DeWitt equation.


title: Deception Detection in Videos using the Facial Action Coding System

abstract: Facts are important in decision making in every situation, which is why it is important to catch deceptive information before they are accepted as facts. Deception detection in videos has gained traction in recent times for its various real-life application. In our approach, we extract facial action units using the facial action coding system which we use as parameters for training a deep learning model. We specifically use long short-term memory (LSTM) which we trained using the real-life trial dataset and it provided one of the best facial only approaches to deception detection. We also tested cross-dataset validation using the Real-life trial dataset, the Silesian Deception Dataset, and the Bag-of-lies Deception Dataset which has not yet been attempted by anyone else for a deception detection system. We tested and compared all datasets amongst each other individually and collectively using the same deep learning training model. The results show that adding different datasets for training worsen the accuracy of the model. One of the primary reasons is that the nature of these datasets vastly differs from one another.


title: Rational homotopy and simply-connected 8-manifolds

abstract: We introduce a rational homotopy invariant P of a topological space, which is a quintic tensor on the cohomology. For n > 1, formality of a closed (n-1)-connected manifold of dimension up to 5n-2 is equivalent to vanishing of P and the Bianchi-Massey tensor introduced by Crowley and the second author arXiv:1505.04184. We show also that elements of the group of closed simply-connected spin 8-manifolds with the cohomology of an r-fold connected sum of S^2 x S^6 are determined up to torsion by the value of P.


title: Stochastic thermodynamics of a piezoelectric energy harvester model

abstract: We experimentally study a piezoelectric energy harvester driven by broadband random vibrations. We show that a linear model, consisting of an underdamped Langevin equation for the dynamics of the tip mass, electromechanically coupled with a capacitor and a load resistor, can accurately describe the experimental data. In particular, the theoretical model allows us to define fluctuating currents and to study the stochastic thermodynamics of the system, with focus on the distribution of the extracted work over different time intervals. Our analytical and numerical analysis of the linear model is successfully compared to the experiments


title: Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answering

abstract: ASCENT is a fully automated methodology for extracting and consolidating commonsense assertions from web contents (Nguyen et al., WWW 2021). It advances traditional triple-based commonsense knowledge representation by capturing semantic facets like locations and purposes, and composite concepts, i.e., subgroups and related aspects of subjects. In this demo, we present a web portal that allows users to understand its construction process, explore its content, and observe its impact in the use case of question answering. The demo website and an introductory video are both available online.


title: Did Uranus' regular moons form via a rocky giant impactor?

abstract: The formation of Uranus' regular moons has been suggested to be linked to the origin of its enormous spin axial tilt (~98^o). A giant impact between proto-Uranus and a 2-3 M_Earth impactor could lead to a large tilt and to the formation of an impact generated disc, where prograde and circular satellites are accreted. The most intriguing features of the current regular Uranian satellite system is that it possesses a positive trend in the mass-distance distribution and likely also in the bulk density, implying that viscous spreading of the disc after the giant impact plays a crucial role in shaping the architecture of the final system. In this paper, we investigate the formation of Uranus' satellites by combining results of SPH simulations for the giant impact, a 1D semi-analytic disc model for viscous spreading of the post-impact disc, and N-body simulations for the assembly of satellites from a disc of moonlets. Assuming the condensed rock (i.e., silicate) remains small and available to stick onto the relatively rapid growing condensed water-ice, we find that the best case in reproducing the observed mass and bulk composition of Uranus' satellite system is a pure-rocky impactor with 3 M_Earth colliding with the young Uranus with an impact parameter b = 0.75. Such an oblique collision could also naturally explain Uranus' large tilt and possibly, its low internal heat flux. The giant impact scenario can naturally explain the key features of Uranus and its regular moons. We therefore suggest that the Uranian satellite system formed as a result of an impact rather than from a circumplanetary disc.


title: Detecting the early inspiral of a gravitational-wave signal with convolutional neural networks

abstract: We introduce a novel methodology for the operation of an early %warning alert system for gravitational waves. It is based on short convolutional neural networks. We focus on compact binary coalescences, for light, intermediate and heavy binary-neutron-star systems. The signals are 1-dimensional time series $-$ the whitened time-strain $-$ injected in Gaussian noise built from the power-spectral density of the LIGO detectors at design sensitivity. We build short 1-dimensional convolutional neural networks to detect these types of events by training them on part of the early inspiral. We show that such networks are able to retrieve these signals from a small portion of the waveform.


title: Domain-Adaptive Pretraining Methods for Dialogue Understanding

abstract: Language models like BERT and SpanBERT pretrained on open-domain data have obtained impressive gains on various NLP tasks. In this paper, we probe the effectiveness of domain-adaptive pretraining objectives on downstream tasks. In particular, three objectives, including a novel objective focusing on modeling predicate-argument relations, are evaluated on two challenging dialogue understanding tasks. Experimental results demonstrate that domain-adaptive pretraining with proper objectives can significantly improve the performance of a strong baseline on these tasks, achieving the new state-of-the-art performances.


title: Gradings on associative algebras with involution and real forms of classical simple Lie algebras

abstract: We study gradings by abelian groups on associative algebras with involution over an arbitrary field. Of particular importance are the fine gradings (that is, those that do not admit a proper refinement), because any grading on a finite-dimensional algebra can be obtained from them via a group homomorphism (although not in a unique way). We classify up to equivalence the fine gradings on simple associative algebras with involution over the field of real numbers (or any real closed field) and, as a consequence, on the real forms of classical simple Lie algebras.


title: Grouped Variable Selection for Generalized Eigenvalue Problems

abstract: Many problems require the selection of a subset of variables from a full set of optimization variables. The computational complexity of an exhaustive search over all possible subsets of variables is, however, prohibitively expensive, necessitating more efficient but potentially suboptimal search strategies. We focus on sparse variable selection for generalized Rayleigh quotient optimization and generalized eigenvalue problems. Such problems often arise in the signal processing field, e.g., in the design of optimal data-driven filters. We extend and generalize existing work on convex optimization-based variable selection using semidefinite relaxations toward group-sparse variable selection using the $\ell_{1,\infty}$-norm. This group-sparsity allows, for instance, to perform sensor selection for spatio-temporal (instead of purely spatial) filters, and to select variables based on multiple generalized eigenvectors instead of only the dominant one. Furthermore, we extensively compare our method to state-of-the-art methods for sensor selection for spatio-temporal filter design in a simulated sensor network setting. The results show both the proposed algorithm and backward greedy selection method best approximate the exhaustive solution. However, the backward greedy selection has more specific failure cases, in particular for ill-conditioned covariance matrices. As such, the proposed algorithm is the most robust currently available method for group-sparse variable selection in generalized eigenvalue problems.


title: Non-adiabatic quantum control of valley states in silicon

abstract: Non-adiabatic quantum effects, often experimentally observed in semiconductors nano-devices such as single-electron pumps operating at high frequencies, can result in undesirable and uncontrollable behaviour. However, when combined with the valley degree of freedom inherent to silicon, these unfavourable effects may be leveraged for quantum information processing schemes. By using an explicit time evolution of the Schrodinger equation, we study numerically non-adiabatic transitions between the two lowest valley states of an electron in a quantum dot formed in a SiGe/Si heterostructure. The presence of a single atomic layer step at the top SiGe/Si interface opens an anti-crossing in the electronic spectrum as the centre of the quantum dot is varied. We show that an electric field applied perpendicularly to the interface allows tuning of the anti-crossing energy gap. As a result, by moving the electron through this anti-crossing, and by electrically varying the energy gap, it is possible to electrically control the probabilities of the two lowest valley states.


title: Measuring global properties of neural generative model outputs via generating mathematical objects

abstract: We train deep generative models on datasets of reflexive polytopes. This enables us to compare how well the models have picked up on various global properties of generated samples. Our datasets are complete in the sense that every single example, up to changes of coordinate, is included in the dataset. Using this property we also perform tests checking to what extent the models are merely memorizing the data. We also train models on the same dataset represented in two different ways, enabling us to measure which form is easiest to learn from. We use these experiments to show that deep generative models can learn to generate geometric objects with non-trivial global properties, and that the models learn some underlying properties of the objects rather than simply memorizing the data.


title: Transferable Deep Reinforcement Learning Framework for Autonomous Vehicles with Joint Radar-Data Communications

abstract: Autonomous Vehicles (AVs) are required to operate safely and efficiently in dynamic environments. For this, the AVs equipped with Joint Radar-Communications (JRC) functions can enhance the driving safety by utilizing both radar detection and data communication functions. However, optimizing the performance of the AV system with two different functions under uncertainty and dynamic of surrounding environments is very challenging. In this work, we first propose an intelligent optimization framework based on the Markov Decision Process (MDP) to help the AV make optimal decisions in selecting JRC operation functions under the dynamic and uncertainty of the surrounding environment. We then develop an effective learning algorithm leveraging recent advances of deep reinforcement learning techniques to find the optimal policy for the AV without requiring any prior information about surrounding environment. Furthermore, to make our proposed framework more scalable, we develop a Transfer Learning (TL) mechanism that enables the AV to leverage valuable experiences for accelerating the training process when it moves to a new environment. Extensive simulations show that the proposed transferable deep reinforcement learning framework reduces the obstacle miss detection probability by the AV up to 67% compared to other conventional deep reinforcement learning approaches.


title: Control and numerical approximation of fractional diffusion equations

abstract: The aim of this work is to give a broad panorama of the control properties of fractional diffusive models from a numerical analysis and simulation perspective. We do this by surveying several research results we obtained in the last years, focusing in particular on the numerical computation of controls. Our reference model will be a non-local diffusive dynamics driven by the fractional Laplacian on a bounded domain $\Omega$. The starting point of our analysis will be a Finite Element approximation for the associated elliptic model in one and two space-dimensions, for which we also present error estimates and convergence rates in the $L^2$ and energy norm. Secondly, we will address two specific control scenarios: firstly, we consider the standard interior control problem, in which the control is acting from a small subset $\omega\subset\Omega$. Secondly, we move our attention to the exterior control problem, in which the control region $\mathcal O\subset\Omega^c$ is located outside $\Omega$. This exterior control notion extends boundary control to the fractional framework, in which the non-local nature of the models does not allow for controls supported on $\partial\Omega$. We will conclude by discussing the interesting problem of simultaneous control, in which we consider families of parameter-dependent fractional heat equations and we aim at designing a unique control function capable of steering all the different realizations of the model to the same target configuration. In this framework, we will see how the employment of stochastic optimization techniques may help in alleviating the computational burden for the approximation of simultaneous controls. Our discussion is complemented by several open problems related with fractional models which are currently unsolved and may be of interest for future investigation.


title: Mrk 1239: a Type-2 Counterpart of Narrow-line Seyfert-1?

abstract: We present new spectrophotometric and spectropolarimetric observations of Mrk 1239, one of the 8 prototypes that defines type-1 narrow-line Seyfert galaxies (NLS1s). Unlike the other typical NLS1s though, a high degree of polarization ($P\sim$5.6%) and red optical-IR ($g-W_4$ = 12.35) colors suggest that Mrk 1239 is more similar to type-2 active galactic nuclei like NGC 1068. Detailed analysis of spectral energy distribution in the UV-optical-IR yields two components from the nucleus: a direct and transmitted component that is heavily obscured ($E_{B-V} \approx 1.6$), and another indirect and scattered one with mild extinction ($E_{B-V} \sim$ 0.5). Such a two-light-paths scenario is also found in previous reports based on the X-ray data. Comparison of emission lines and the detection of He\,{\footnotesize I}*$\lambda$10830 BAL at [-3000,-1000] km s$^{-1}$ indicates that the obscuring clouds are at physical scale between the sublimation radius and that of the narrow emission line regions. The potential existence of powerful outflows is found as both the obscurer and scatterer are outflowing. Similar to many other type-2s, jet-like structure in the radio band is found in Mrk 1239, perpendicular to the polarization angle, suggesting polar scattering. We argue that Mrk 1239 is very probably a type-2 counterpart of NLS1s. The identification of 1 out of 8 prototype NLS1s as a type-2 counterpart implies that there can be a substantial amount of analogs of Mrk 1239 misidentified as type-1s in the optical band. Properties of these misidentified objects are going to be explored in our future works.


title: Mass scaling of the near-critical 2D Ising model using random currents

abstract: We examine the Ising model at its critical temperature with an external magnetic field $h a^{\frac{15}{8}}$ on $a\mathbb{Z}^2$ for $a,h >0$. A new proof of exponential decay of the truncated two-point correlation functions is presented. It is proven that the mass (inverse correlation length) is of the order of $h^\frac{8}{15}$ in the limit $h \to 0$. This was previously proven with CLE-methods in $\lbrack 1 \rbrack$. Our new proof uses instead the random current representation of the Ising model and its backbone exploration. The method further relies on recent couplings to the random cluster model $\lbrack 2 \rbrack$ as well as a near-critical RSW-result for the random cluster model $\lbrack 3 \rbrack$.

categories: math-ph cond-mat.stat-mech math.MP math.PR


title: Stimulated resonant spin amplification reveals millisecond electron spin coherence time of rare-earth ions in solids

abstract: The inhomogeneity of an electron spin ensemble as well as fluctuating environment acting upon individual spins drastically shorten the spin coherence time $T_2$ and hinder coherent spin manipulation. We show that this problem can be solved by the simultaneous application of a radiofrequency (rf) field, which stimulates coherent spin precession decoupled from an inhomogeneous environment, and periodic optical pulses, which amplify this precession. The resulting resonance, taking place when the rf field frequency approaches the laser pulse repetition frequency, has a width determined by the spin coherence time $T_2$ that is free from the inhomogeneity effects. We measure a 50-Hz-narrow electron spin resonance and milliseconds-long $T_2$ for electrons in the ground state of Ce$^{3+}$ ions in the YAG lattice at low temperatures, while the inhomogeneous spin dephasing time $T_2^*$ is only 25 ns. This study paves the way to coherent optical manipulation in spin systems decoupled from their inhomogeneous environment.


title: Audio-visual scene classification: analysis of DCASE 2021 Challenge submissions

abstract: This paper presents the details of the Audio-Visual Scene Classification task in the DCASE 2021 Challenge (Task 1 Subtask B). The task is concerned with classification using audio and video modalities, using a dataset of synchronized recordings. This task has attracted 43 submissions from 13 different teams around the world. Among all submissions, more than half of the submitted systems have better performance than the baseline. The common techniques among the top systems are the usage of large pretrained models such as ResNet or EfficientNet which are trained for the task-specific problem. Fine-tuning, transfer learning, and data augmentation techniques are also employed to boost the performance. More importantly, multi-modal methods using both audio and video are employed by all the top 5 teams. The best system among all achieved a logloss of 0.195 and accuracy of 93.8%, compared to the baseline system with logloss of 0.662 and accuracy of 77.1%.


title: Effect of Cd diffusion on the electrical properties of the Cu(In,Ga)Se2 thin-film solar cell

abstract: Cu(In,Ga)Se2 (CIGSe)-based solar cells are promising candidates for efficient sunlight harvesting. However, their complex composition and microstructure can change under operation conditions, for instance heating from sun light illumination can lead to a degradation in performance. Here, we investigate the thermally-induced degradation processes in a set of CIGSe-based solar cells that were annealed at temperatures between 150C and 300C. Using correlative atom probe tomography (APT)/transmission electron microscope (TEM), we found that the buffer-absorber interface is not sharp but consists of an interfacial zone (2 - 6.5 nm wide) where a gradient of constituent elements belonging to the CdS buffer and CIGSe absorber appears. An enhanced short-range Cd in-diffusion inside the CIGSe was observed whenever a low Ga/(Ga+In) ratio occurred at the interface. This might indicate the presence of Ga vacancies as a channeling defect for Cd in-diffusion inside the CIGSe layer leading to a buried pn-homojunction. We evidence that a considerable amount of Cd is found inside the CIGSe layer at annealing temperatures higher than 150C. Further investigations of the elemental redistribution inside the CIGSe layer combined with C-V measurements support the formation of CdCu donor like defects deep inside the p-type CIGSe which lead to a strong compensation of the CIGSe layer and hence to strong deterioration of cell efficiency at annealing temperatures higher than 200C. Hence, understanding the degradation processes in Cu(In,Ga)Se2 (CIGSe)-based solar cells opens new opportunities for further improvement of the long-term device performance.


title: ResT: An Efficient Transformer for Visual Recognition

abstract: This paper presents an efficient multi-scale vision Transformer, called ResT, that capably served as a general-purpose backbone for image recognition. Unlike existing Transformer methods, which employ standard Transformer blocks to tackle raw images with a fixed resolution, our ResT have several advantages: (1) A memory-efficient multi-head self-attention is built, which compresses the memory by a simple depth-wise convolution, and projects the interaction across the attention-heads dimension while keeping the diversity ability of multi-heads; (2) Position encoding is constructed as spatial attention, which is more flexible and can tackle with input images of arbitrary size without interpolation or fine-tune; (3) Instead of the straightforward tokenization at the beginning of each stage, we design the patch embedding as a stack of overlapping convolution operation with stride on the 2D-reshaped token map. We comprehensively validate ResT on image classification and downstream tasks. Experimental results show that the proposed ResT can outperform the recently state-of-the-art backbones by a large margin, demonstrating the potential of ResT as strong backbones. The code and models will be made publicly available at https://github.com/wofmanaf/ResT.


title: An efficient hybrid hash based privacy amplification algorithm for quantum key distribution

abstract: Privacy amplification (PA) is an essential part in a quantum key distribution (QKD) system, distilling a highly secure key from a partially secure string by public negotiation between two parties. The optimization objectives of privacy amplification for QKD are large block size, high throughput and low cost. For the global optimization of these objectives, a novel privacy amplification algorithm is proposed in this paper by combining multilinear-modular-hashing and modular arithmetic hashing. This paper proves the security of this hybrid hashing PA algorithm within the framework of both information theory and composition security theory. A scheme based on this algorithm is implemented and evaluated on a CPU platform. The results on a typical CV-QKD system indicate that the throughput of this scheme (261Mbps@2.6*10^8 input block size) is twice higher than the best existing scheme (140Mbps@1*10^8 input block size). Moreover, This scheme is implemented on a mobile CPU platform instead of a desktop CPU or a server CPU, which means that this algorithm has a better performance with a much lower cost and power consumption.


title: Twelve-year update of the MST catalogue of gamma-ray source candidates above 10 GeV and at Galactic latitudes higher than 20 degrees

abstract: We present an updated version catalogue of gamma-ray source candidates, 12Y-MST, selected using the minimum spanning tree (MST) algorithm on the 12-year Fermi-LAT sky (Pass 8) at energies higher than 10 GeV. The high-energy sky at absolute Galactic latitudes above 20 degrees has been investigated using rather restrictive selection criteria, resulting in a total sample of 1664 photon clusters, or candidate sources. Of these, 230 are new detections, that is, candidate sources without any association in other gamma-ray catalogues. A large fraction of them have interesting counterparts, most likely blazars. We describe the main results on the catalogue selection and search of counterparts. We also present an additional sample of 224 candidate sources (12Y-MSTw), which are clusters that we extracted by applying weaker selection criteria: about 57% of them have not been reported in other catalogues.


title: Focus on Local: Detecting Lane Marker from Bottom Up via Key Point

abstract: Mainstream lane marker detection methods are implemented by predicting the overall structure and deriving parametric curves through post-processing. Complex lane line shapes require high-dimensional output of CNNs to model global structures, which further increases the demand for model capacity and training data. In contrast, the locality of a lane marker has finite geometric variations and spatial coverage. We propose a novel lane marker detection solution, FOLOLane, that focuses on modeling local patterns and achieving prediction of global structures in a bottom-up manner. Specifically, the CNN models lowcomplexity local patterns with two separate heads, the first one predicts the existence of key points, and the second refines the location of key points in the local range and correlates key points of the same lane line. The locality of the task is consistent with the limited FOV of the feature in CNN, which in turn leads to more stable training and better generalization. In addition, an efficiency-oriented decoding algorithm was proposed as well as a greedy one, which achieving 36% runtime gains at the cost of negligible performance degradation. Both of the two decoders integrated local information into the global geometry of lane markers. In the absence of a complex network architecture design, the proposed method greatly outperforms all existing methods on public datasets while achieving the best state-of-the-art results and real-time processing simultaneously.


title: \v{C}erenkov radiation in vacuum from a superluminal grating

abstract: Nothing can physically travel faster than light in vacuum. This is why it has been considered that there is no \v{C}erenkov radiation (\v{C}R) without an effective refractive index due to some background field. In this Letter, we theoretically predict \v{C}R in vacuum from a spatiotemporally modulated boundary. We consider the modulation of traveling wave type and apply a uniform electrostatic field on the boundary to generate electric dipoles. Since the induced dipoles stick to the interface, they travel at the modulation speed. When the grating travels faster than light, it emits \v{C}R. In order to quantitatively examine this argument, we need to calculate the field scattered at the boundary. We utilise a dynamical differential method, which we developed in the previous paper, to quantitatively evaluate the field distribution in such a situation. We can confirm that all scattered fields are evanescent if the modulation speed is slower than light while some become propagating if the modulation is faster than light.


title: Superfluidity breakdown of Rabi-coupled two-component Bose-Einstein condensates in optical lattices

abstract: We demarcate the unstable regimes of superfluids in a Rabi-coupled two-component Bose-Einstein condensate in the presence of optical lattices. We find that the Rabi coupling can stabilize superfluids. A significant separation between Landau and dynamical instabilities is presented in a Rabi-coupled Zeeman lattice.


title: Fast zone-based algorithms for reachability in pushdown timed automata

abstract: Given the versatility of timed automata a huge body of work has evolved that considers extensions of timed automata. One extension that has received a lot of interest is timed automata with a, possibly unbounded, stack, also called the pushdown timed automata (PDTA) model. While different algorithms have been given for reachability in different variants of this model, most of these results are purely theoretical and do not give rise to efficient implementations. One main reason for this is that none of these algorithms (and the implementations that exist) use the so-called zone-based abstraction, but rely either on the region-abstraction or other approaches, which are significantly harder to implement. In this paper, we show that a naive extension of the zone based reachability algorithm for the control state reachability problem of timed automata is not sound in the presence of a stack. To understand this better we give an inductive rule based view of the zone reachability algorithm for timed automata. This alternate view allows us to analyze and adapt the rules to also work for pushdown timed automata. We obtain the first zone-based algorithm for PDTA which is terminating, sound and complete. We implement our algorithm in the tool TChecker and perform experiments to show its efficacy, thus leading the way for more practical approaches to the verification of pushdown timed systems.


title: Dark Matter Fraction in z~1 Star-Forming Galaxies

abstract: We present a observational study of the dark matter fraction in 225 rotation supported star-forming galaxies at $z\approx 0.9$ having stellar mass range: $ 9.0 \leq log(M_* \ \mathrm{M_\odot}) \leq 11.0$ and star formation rate: $0.49 \leq log \left(SFR \ \mathrm{[M_{\odot}\ yr^{-1}]} \right) \leq 1.77$. This is a sub sample of KMOS redshift one spectroscopic survey (KROSS) previously studied by \citet{GS20}. The stellar masses ($M_*$) of these objects were previously estimated using mass-to-light ratios derived from fitting the spectral energy distribution of the galaxies. Star formation rates were derived from the H$_\alpha$ luminosities. The total gas masses ($M_{gas}$) are determined by scaling relations of molecular and atomic gas \citep[][respectively] {Tacconi2018, Lagos2011}. The dynamical masses ($M_{dyn}$) are directly derived from the rotation curves (RCs) at different scale lengths (effective radius: $R_e$, $\sim 2 \ R_e$ and $\sim 3 \ R_e$) and then the dark matter fractions ($f_{ DM }=1-M_{bar}/M_{dyn}$) at these radii are calculated. We report that at $z\sim 1$ only a small fraction ($\sim 5\%$) of our sample has a low ($< 20\%$) DM fraction within $\sim$ 2-3 $R_e$. The majority ($> 72\%$) of SFGs in our sample have dark matter dominated outer disks ($\sim 5-10$ kpc) in agreement with local SFGs. Moreover, we find a large scatter in the fraction of dark matter at a given stellar mass (or circular velocity) with respect to local SFGs, suggesting that galaxies at $z \sim 1$, a) span a wide range of stages in the formation of stellar disks, b) have diverse DM halo properties coupled with baryons.


title: Dynamics of freely rising spheres: the effect of moment of inertia

abstract: The goal of this study is to elucidate the effect the particle moment of inertia (MOI) has on the dynamics of spherical particles rising in a quiescent and turbulent fluid. To this end, we performed experiments with varying density ratios $\Gamma$, the ratio of the particle density and fluid density, ranging from $0.37$ up to $0.97$. At each $\Gamma$ the MOI was varied by shifting mass between the shell and the center of the particle to vary $I^*$ (the particle MOI normalised by the MOI of particle with the same weight and a uniform mass distribution). Helical paths are observed for low, and `3D chaotic' trajectories at higher values of $\Gamma$. The present data suggests no influence of $I^*$ on the critical value for this transition $0.42<\Gamma_{\textrm{crit}}<0.52$. For the `3D chaotic' rise mode we identify trends of decreasing particle drag coefficient ($C_d$) and amplitude of oscillation with increasing $I^*$. Due to limited data it remains unclear if a similar dependence exists in the helical regime as well. Path oscillations remain finite for all cases studied and no `rectilinear' mode is encountered, which may be the consequence of allowing for a longer transient distance in the present compared to earlier work. Rotational dynamics did not vary significantly between quiescent and turbulent surroundings, indicating that these are predominantly wake driven.


title: Solving peak overlaps for proximity histogram analysis of complex interfaces for atom probe tomography data

abstract: Atom probe tomography is a powerful tools in investigating nanostructures such as interfaces and nanoparticles in material science. Advanced analysis tools are particularly useful for analyzing these nanostructures characterized very often by curved shapes. However, these tools are very limited for complex materials with non-negligible peak overlaps in their respective mass-to-charge ratio spectra. Usually, an analyst solves peak overlaps in the bulk regions but the behavior at interfaces is rarely considered. Therefore, in this work we demonstrate how the proximity histogram generated for a specific interface can be corrected by using the natural abundances of isotopes. This leads to overlap-solved proximity histograms with a resolution of up to 0.1 nm. This work expands on previous work that showed the advantage of a maximum likelihood peak overlap solving. The corrected proximity histograms together with the maximum likelihood peak overlap algorithm were implemented in an user-friendly software suite called EPOSA.


title: Spatiotemporal dynamics of biocrust and vegetation on sand dunes

abstract: We propose a model to study the spatiotemporal dynamics of biocrust and vegetation cover on sand dunes. The model consists of two coupled partial nonlinear differential equations and includes diffusion and advection terms for modeling the dispersal of vegetation and biocrust and the effect of wind on them. In the absence of spatial variability, the model exhibits self-sustained relaxation oscillations and regimes of bistability--the first state is dominated by biocrust and the second by vegetation. We concentrate on the one-dimensional dynamics of the model and show that the front that connects these two states propagates mainly due to the wind advection. In the oscillatory regime, the front propagation is complex. For low wind DP (drift potential) values, a series of spatially oscillatory domains develops as the front advances downwind. These domains form due to the oscillations of the spatially homogeneous states away from the front. However, for higher DP values, the dynamics is much more complex, becoming very sensitive to the initial conditions and exhibiting an irregular spatial pattern as small domains are created and annihilated during the front advance. Such irregular dynamics can be associated with the temporal variations of dune cover. In addition, similar behavior can be generated by other models that exhibit temporal oscillations and bistability.


title: Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Driving

abstract: In this paper, we show how uncertainty estimation can be leveraged to enable safety critical image segmentation in autonomous driving, by triggering a fallback behavior if a target accuracy cannot be guaranteed. We introduce a new uncertainty measure based on disagreeing predictions as measured by a dissimilarity function. We propose to estimate this dissimilarity by training a deep neural architecture in parallel to the task-specific network. It allows this observer to be dedicated to the uncertainty estimation, and let the task-specific network make predictions. We propose to use self-supervision to train the observer, which implies that our method does not require additional training data. We show experimentally that our proposed approach is much less computationally intensive at inference time than competing methods (e.g. MCDropout), while delivering better results on safety-oriented evaluation metrics on the CamVid dataset, especially in the case of glare artifacts.


title: A kinetic model of a polyelectrolyte gel undergoing phase separation

abstract: In this study we use non-equilibrium thermodynamics to systematically derive a phase-field model of a polyelectrolyte gel coupled to a hydrodynamic model for a salt solution surrounding the gel. The governing equations for the gel account for the free energy of the internal interfaces which form upon phase separation, the nonlinear elasticity of the polyelectrolyte network, and multi-component diffusive transport following a Stefan--Maxwell approach. The time-dependent model describes the evolution of the gel across multiple time and spatial scales and so is able to capture the large-scale solvent flux and the emergence of long-time pattern formation in the system. We explore the model for the case of a constrained gel undergoing uni-axial deformations. Numerical simulations show that rapid changes in the gel volume occur once the volume phase transition sets in, as well as the triggering of spinodal decomposition that leads to strong inhomogeneities in the lateral stresses, potentially leading to experimentally visible patterns.


title: Optimal three-state field-free molecular orientation with terahertz pulses

abstract: We present a combined analytical and numerical investigation to show how an optimal control field can be designed to generate maximum field-free orientation of molecules for three populated rotational states. Based on a model involving pure rotational ladder-climbing excitation between rotational states, a set of optimal amplitude and phase conditions are analytically derived for the applied control fields. The maximum degree of orientation can be achieved when the field satisfies amplitude and phase conditions at the two transition frequencies. Multiple optimal solutions exist and to examine these conditions, we devise a quantum coherent control scheme using two terahertz pulses and successfully apply it to the linear polar molecule HCN at ultracold temperature. The sensitivity of both populations and phases of rotational states to control field parameters, i.e., the detuning, bandwidth, and time delay, is analyzed for understanding the optimal orientation mechanism. This work thus examines the frequency domain landscape belonging to optimal pulses.


title: Symmetry for positive critical points of Caffarelli-Kohn-Nirenberg inequalities

abstract: We consider positive critical points of Caffarelli-Kohn-Nirenberg inequalities and prove a Liouville type result which allows us to give a complete classification of the solutions in a certain range of parameters, providing a symmetry result for positive solutions. The governing operator is a weighted $p$-Laplace operator, which we consider for a general $p \in (1,d)$. For $p=2$, the symmetry breaking region for extremals of Caffarelli-Kohn-Nirenberg inequalities was completely characterized in [J. Dolbeault, M. Esteban, M. Loss, Invent. Math. 44 (2016)]. Our results extend this result to a general $p$ and are optimal in some cases.


title: Non-archimedean pinchings

abstract: We develop the theory of pinchings for non-archimedean analytic spaces. In particular, we show that although pinchings of affinoid spaces do not have to be affinoid, pinchings of Hausdorff analytic spaces always exist in the category of analytic spaces.


title: Projected mushroom-type phase-change memory

abstract: Phase-change memory devices have found applications in in-memory computing where the physical attributes of these devices are exploited to compute in place without the need to shuttle data between memory and processing units. However, non-idealities such as temporal variations in the electrical resistance have a detrimental impact on the achievable computational precision. To address this, a promising approach is projecting the phase configuration of phase change material onto some stable element within the device. Here we investigate the projection mechanism in a prominent phase-change memory device architecture, namely mushroom-type phase-change memory. Using nanoscale projected Ge2Sb2Te5 devices we study the key attributes of state-dependent resistance, drift coefficients, and phase configurations, and using them reveal how these devices fundamentally work.


title: Number fluctuations induce persistent congestion

abstract: The capacity of a street segment quantifies the maximal density of vehicles before congestion arises. Here we show in a simple mathematical model that fluctuations in the instantaneous number of vehicles entering a street segment are sufficient to induce persistent congestion. Congestion emerges even if the average flow is below the segment's capacity where congestion is absent without fluctuations. We explain how this fluctuation-induced congestion emerges due to a self-amplifying reduction of the average vehicle velocities.


title: AutoSampling: Search for Effective Data Sampling Schedules

abstract: Data sampling acts as a pivotal role in training deep learning models. However, an effective sampling schedule is difficult to learn due to the inherently high dimension of parameters in learning the sampling schedule. In this paper, we propose an AutoSampling method to automatically learn sampling schedules for model training, which consists of the multi-exploitation step aiming for optimal local sampling schedules and the exploration step for the ideal sampling distribution. More specifically, we achieve sampling schedule search with shortened exploitation cycle to provide enough supervision. In addition, we periodically estimate the sampling distribution from the learned sampling schedules and perturb it to search in the distribution space. The combination of two searches allows us to learn a robust sampling schedule. We apply our AutoSampling method to a variety of image classification tasks illustrating the effectiveness of the proposed method.


title: Fast magnetoacoustic wave trains: from tadpoles to boomerangs

abstract: Rapidly propagating fast magnetoacoustic wave trains guided by field-aligned plasma non-uniformities are confidently observed in the Sun's corona. Observations at large heights suggest that fast wave trains can travel long distances from the excitation locations. We study characteristic time signatures of fully developed, dispersive fast magnetoacoustic wave trains in field-aligned zero-$\beta$ plasma slabs in the linear regime. Fast wave trains are excited by a spatially localised impulsive driver and propagate along the waveguide as prescribed by the waveguide-caused dispersion. In slabs with steeper transverse density profiles, developed wave trains are shown to consist of three distinct phases: a long-period quasi-periodic phase with the oscillation period shortening with time, a multi-periodic (peloton) phase in which distinctly different periods co-exist, and a short-lived periodic Airy phase. The appearance of these phases is attributed to a non-monotonic dependence of the fast wave group speed on the parallel wavenumber due to the waveguide dispersion, and is shown to be different for axisymmetric (sausage) and non-axisymmetric (kink) modes. In wavelet analysis, this corresponds to the transition from the previously known tadpole shape to a new boomerang shape of the wave train spectrum, with two well-pronounced arms at shorter and longer periods. We describe a specific previously published radio observation of a coronal fast wave train, highly suggestive of a change of the wavelet spectrum from a tadpole to a boomerang, broadly consistent with our modelling. The applicability of these boomerang-shaped fast wave trains for probing the transverse structuring of the waveguiding coronal plasma is discussed.


title: AdvParams: An Active DNN Intellectual Property Protection Technique via Adversarial Perturbation Based Parameter Encryption

abstract: A well-trained DNN model can be regarded as an intellectual property (IP) of the model owner. To date, many DNN IP protection methods have been proposed, but most of them are watermarking based verification methods where model owners can only verify their ownership passively after the copyright of DNN models has been infringed. In this paper, we propose an effective framework to actively protect the DNN IP from infringement. Specifically, we encrypt the DNN model's parameters by perturbing them with well-crafted adversarial perturbations. With the encrypted parameters, the accuracy of the DNN model drops significantly, which can prevent malicious infringers from using the model. After the encryption, the positions of encrypted parameters and the values of the added adversarial perturbations form a secret key. Authorized user can use the secret key to decrypt the model. Compared with the watermarking methods which only passively verify the ownership after the infringement occurs, the proposed method can prevent infringement in advance. Moreover, compared with most of the existing active DNN IP protection methods, the proposed method does not require additional training process of the model, which introduces low computational overhead. Experimental results show that, after the encryption, the test accuracy of the model drops by 80.65%, 81.16%, and 87.91% on Fashion-MNIST, CIFAR-10, and GTSRB, respectively. Moreover, the proposed method only needs to encrypt an extremely low number of parameters, and the proportion of the encrypted parameters of all the model's parameters is as low as 0.000205%. The experimental results also indicate that, the proposed method is robust against model fine-tuning attack and model pruning attack. Moreover, for the adaptive attack where attackers know the detailed steps of the proposed method, the proposed method is also demonstrated to be robust.


title: Network Activities Recognition and Analysis Based on Supervised Machine Learning Classification Methods Using J48 and Na\"ive Bayes Algorithm

abstract: Network activities recognition has always been a significant component of intrusion detection. However, with the increasing network traffic flow and complexity of network behavior, it is becoming more and more difficult to identify the specific behavior quickly and accurately by user network monitoring software. It also requires the system security staff to pay close attention to the latest intrusion monitoring technology and methods. All of these greatly increase the difficulty and complexity of intrusion detection tasks. The application of machine learning methods based on supervised classification technology would help to liberate the network security staff from the heavy and boring tasks. A finetuned model would accurately recognize user behavior, which could provide persistent monitoring with a relative high accuracy and good adaptability. Finally, the results of network activities recognition by J48 and Na\"ive Bayes algorithms are introduced and evaluated.


title: Accelerating JavaScript Static Analysis via Dynamic Shortcuts (Extended Version)

abstract: JavaScript has become one of the most widely used programming languages for web development, server-side programming, and even micro-controllers for IoT. However, its extremely functional and dynamic features degrade the performance and precision of static analysis. Moreover, the variety of built-in functions and host environments requires excessive manual modeling of their behaviors. To alleviate these problems, researchers have proposed various ways to leverage dynamic analysis during JavaScript static analysis. However, they do not fully utilize the high performance of dynamic analysis and often sacrifice the soundness of static analysis. In this paper, we present dynamic shortcuts, a new technique to flexibly switch between abstract and concrete execution during JavaScript static analysis in a sound way. It can significantly improve the analysis performance and precision by using highly-optimized commercial JavaScript engines and lessen the modeling efforts for opaque code. We actualize the technique via $\text{SAFE}_\textsf{DS}$, an extended combination of $\text{SAFE}$ and Jalangi, a static analyzer and a dynamic analyzer, respectively. We evaluated $\text{SAFE}_\textsf{DS}$ using 269 official tests of Lodash 4 library. Our experiment shows that $\text{SAFE}_\textsf{DS}$ is 7.81x faster than the baseline static analyzer, and it improves the precision to reduce failed assertions by 12.31% on average for 22 opaque functions.